tribuchet: building on eliza Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm worker2 # Disk image does not exist, creating the virtualisation disk image... client # Disk image does not exist, creating the virtualisation disk image... worker1 # Disk image does not exist, creating the virtualisation disk image... client: QEMU running (pid 49) lb # Disk image does not exist, creating the virtualisation disk image... client # Formatting '/build/vm-state-client/tmp.2TAJQAmMXA', fmt=raw size=1073741824 worker2 # Formatting '/build/vm-state-worker2/tmp.LnX4PrHZI6', fmt=raw size=1073741824 worker2: QEMU running (pid 51) lb # Formatting '/build/vm-state-lb/tmp.BUAcV3XL43', fmt=raw size=1073741824 client # mke2fs 1.47.4 (6-Mar-2025) worker2 # mke2fs 1.47.4 (6-Mar-2025) lb: QEMU running (pid 50) worker1 # Formatting '/build/vm-state-worker1/tmp.zpcdo71ni4', fmt=raw size=1073741824 worker1: QEMU running (pid 52) lb # mke2fs 1.47.4 (6-Mar-2025) worker1 # mke2fs 1.47.4 (6-Mar-2025) client # Discarding device blocks: 0/262144 done worker2 # Discarding device blocks: 0/262144 done (finished: start all VMs, in 0.47 seconds) client # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes client: waiting for unit network-addresses-eth1.service client # Filesystem UUID: b33be005-ca40-4a05-a1fe-ff0acc2ff65a worker2 # Filesystem UUID: fb96e099-efc4-4c5b-9589-f5efd9479053 client: waiting for the VM to finish booting client # Superblock backups stored on blocks: worker2 # Superblock backups stored on blocks: worker1 # Discarding device blocks: 0/262144 done lb # Discarding device blocks: 0/262144 done client # 32768, 98304, 163840, 229376 worker2 # 32768, 98304, 163840, 229376 worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes lb # Creating filesystem with 262144 4k blocks and 65536 inodes client # worker2 # worker1 # Filesystem UUID: 8c8dabfc-891b-4801-962e-21c7a7e4239d lb # Filesystem UUID: c2eb829f-f19e-4e6f-ae63-b26aa4c7dcce client # Allocating group tables: 0/8 done worker2 # Allocating group tables: 0/8 done worker1 # Superblock backups stored on blocks: lb # Superblock backups stored on blocks: client # Writing inode tables: 0/8 done worker2 # Writing inode tables: 0/8 done worker1 # 32768, 98304, 163840, 229376 lb # 32768, 98304, 163840, 229376 client # Creating journal (8192 blocks): done worker2 # Creating journal (8192 blocks): done worker1 # lb # client # Writing superblocks and filesystem accounting information: 0/8 done worker2 # Writing superblocks and filesystem accounting information: 0/8 done worker1 # Allocating group tables: 0/8 done lb # Allocating group tables: 0/8 done client # worker2 # worker1 # Writing inode tables: 0/8 done lb # Writing inode tables: 0/8 done client # Virtualisation disk image created. worker2 # Virtualisation disk image created. worker1 # Creating journal (8192 blocks): done lb # Creating journal (8192 blocks): done worker1 # Writing superblocks and filesystem accounting information: 0/8 done lb # Writing superblocks and filesystem accounting information: 0/8 done worker1 # lb # worker1 # Virtualisation disk image created. lb # Virtualisation disk image created. worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker2 # [ 0.000000] KASLR enabled worker2 # [ 0.000000] random: crng init done worker2 # [ 0.000000] Machine model: linux,dummy-virt worker2 # [ 0.000000] efi: UEFI not found. worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker2 # [ 0.000000] Zone ranges: worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] DMA32 empty worker2 # [ 0.000000] Normal empty worker2 # [ 0.000000] Device empty worker2 # [ 0.000000] Movable zone start for each node worker2 # [ 0.000000] Early memory node ranges worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker2 # [ 0.000000] psci: probing for conduit method from DT. worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker2 # [ 0.000000] psci: Trusted OS migration not required worker2 # [ 0.000000] psci: SMC Calling Convention v1.1 worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 worker2 # [ 0.000000] Detected PIPT I-cache on CPU0 worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface worker2 # [ 0.000000] CPU features: detected: Spectre-v4 worker2 # [ 0.000000] CPU features: detected: Spectre-BHB worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker2 # [ 0.000000] alternatives: applying boot alternatives worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/7125nj8p93qa3r29n9673xywybzmdlgw-nixos-system-worker2-test/init regInfo=/nix/store/2xzyszdr99wfxpqj1a8llwgvj56qhxgy-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/2xzyszdr99wfxpqj1a8llwgvj56qhxgy-closure-info/registration", will be passed to user space. worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker2 # [ 0.000000] software IO TLB: area num 1. worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker2 # [ 0.000000] Fallback order for Node 0: 0 worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker2 # [ 0.000000] Policy zone: DMA worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.000000] allocated 3145728 bytes of page_ext worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker2 # [ 0.000000] rcu: Hierarchical RCU implementation. client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker2 # [ 0.000000] rcu: RCU event tracing is enabled. client # [ 0.000000] KASLR enabled client # [ 0.000000] random: crng init done worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.000000] Machine model: linux,dummy-virt worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled. client # [ 0.000000] efi: UEFI not found. worker2 # [ 0.000000] Rude variant of Tasks RCU enabled. client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled. client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.000000] Zone ranges: client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] DMA32 empty lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 client # [ 0.000000] Normal empty lb # [ 0.000000] KASLR enabled client # [ 0.000000] Device empty worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] random: crng init done client # [ 0.000000] Movable zone start for each node lb # [ 0.000000] Machine model: linux,dummy-virt client # [ 0.000000] Early memory node ranges worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] lb # [ 0.000000] efi: UEFI not found. worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker2 # [ 0.000000] GICv3: 256 SPIs implemented client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented worker1 # [ 0.000000] KASLR enabled client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker1 # [ 0.000000] random: crng init done worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] client # [ 0.000000] psci: probing for conduit method from DT. lb # [ 0.000000] Zone ranges: worker1 # [ 0.000000] Machine model: linux,dummy-virt worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker1 # [ 0.000000] efi: UEFI not found. client # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] DMA32 empty client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT lb # [ 0.000000] Normal empty client # [ 0.000000] psci: Trusted OS migration not required worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 lb # [ 0.000000] Device empty worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] client # [ 0.000000] psci: SMC Calling Convention v1.1 lb # [ 0.000000] Movable zone start for each node lb # [ 0.000000] Early memory node ranges worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker1 # [ 0.000000] Zone ranges: client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 worker1 # [ 0.000000] DMA32 empty lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] Normal empty worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) client # [ 0.000000] Detected PIPT I-cache on CPU0 worker1 # [ 0.000000] Device empty lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 worker1 # [ 0.000000] Movable zone start for each node lb # [ 0.000000] psci: probing for conduit method from DT. client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker1 # [ 0.000000] Early memory node ranges worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 lb # [ 0.000000] psci: PSCIv1.3 detected in firmware. client # [ 0.000000] CPU features: detected: GICv3 CPU interface worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs client # [ 0.000000] CPU features: detected: Spectre-v4 worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.000000] CPU features: detected: Spectre-BHB lb # [ 0.000000] psci: Trusted OS migration not required worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] psci: SMC Calling Convention v1.1 worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker1 # [ 0.000000] psci: probing for conduit method from DT. client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware. client # [ 0.000000] alternatives: applying boot alternatives lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs lb # [ 0.000000] Detected PIPT I-cache on CPU0 worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.000000] psci: Trusted OS migration not required worker1 # [ 0.000000] psci: SMC Calling Convention v1.1 worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker2 # [ 0.000037] arm-pv: using stolen time PV lb # [ 0.000000] CPU features: detected: GICv3 CPU interface worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) lb # [ 0.000000] CPU features: detected: Spectre-v4 worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 worker2 # [ 0.000655] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.000000] CPU features: detected: Spectre-BHB client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/kn580alm8i65l8xnw33vjbcfrdhrbapf-nixos-system-client-test/init regInfo=/nix/store/pjzrk30p45r569g66fnvv3qqq9mz2m7v-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker1 # [ 0.000000] Detected PIPT I-cache on CPU0 worker2 # [ 0.000831] Console: colour dummy device 80x25 lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker2 # [ 0.000839] printk: legacy console [tty0] enabled worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/pjzrk30p45r569g66fnvv3qqq9mz2m7v-closure-info/registration", will be passed to user space. lb # [ 0.000000] alternatives: applying boot alternatives worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface worker2 # [ 0.001031] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker1 # [ 0.000000] CPU features: detected: Spectre-v4 client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker2 # [ 0.001038] pid_max: default: 32768 minimum: 301 worker1 # [ 0.000000] CPU features: detected: Spectre-BHB worker2 # [ 0.001108] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker2 # [ 0.001280] landlock: Up and running. worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker2 # [ 0.001283] Yama: becoming mindful. client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.001943] LSM support for eBPF active worker1 # [ 0.000000] alternatives: applying boot alternatives client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/sy3pchz5vg22ylc3whvkp4s8qngi8wmd-nixos-system-lb-test/init regInfo=/nix/store/4q693lxjjy3z9gghvdrv4s7qcr63j8a1-closure-info/registration console=ttyAMA0,115200n8 console=tty0 client # [ 0.000000] software IO TLB: area num 1. worker2 # [ 0.002119] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker2 # [ 0.002152] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/4q693lxjjy3z9gghvdrv4s7qcr63j8a1-closure-info/registration", will be passed to user space. worker2 # [ 0.003280] cacheinfo: Unable to detect cache hierarchy for CPU 0 client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) client # [ 0.000000] Fallback order for Node 0: 0 worker2 # [ 0.004111] rcu: Hierarchical SRCU implementation. worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/vniqsik90d4pd2jhgb9p4y85sl28s16w-nixos-system-worker1-test/init regInfo=/nix/store/sm9ih6p81j3iq8b7cs9xw4s50lcfgml0-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker2 # [ 0.004116] rcu: Max phase no-delay instances is 1000. lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker2 # [ 0.005328] fsl-mc MSI: its@8080000 domain created lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.000000] Policy zone: DMA worker2 # [ 0.005418] EFI services will not be available. worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/sm9ih6p81j3iq8b7cs9xw4s50lcfgml0-closure-info/registration", will be passed to user space. worker2 # [ 0.005531] smp: Bringing up secondary CPUs ... lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.005539] smp: Brought up 1 node, 1 CPU lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.005542] SMP: Total of 1 processors activated. lb # [ 0.000000] software IO TLB: area num 1. worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes client # [ 0.000000] allocated 3145728 bytes of page_ext worker2 # [ 0.005547] CPU: All CPU(s) started at EL1 lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker2 # [ 0.005559] CPU features: detected: Branch Target Identification worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker2 # [ 0.005564] CPU features: detected: ARMv8.4 Translation Table Level lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.000000] rcu: Hierarchical RCU implementation. lb # [ 0.000000] Fallback order for Node 0: 0 client # [ 0.000000] rcu: RCU event tracing is enabled. worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker2 # [ 0.005567] CPU features: detected: Instruction cache invalidation not required for I/D coherence lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker1 # [ 0.000000] software IO TLB: area num 1. lb # [ 0.000000] Policy zone: DMA client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.005570] CPU features: detected: Data cache clean to the PoU not required for I/D coherence client # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.000000] Rude variant of Tasks RCU enabled. worker2 # [ 0.005574] CPU features: detected: Common not Private translations worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.000000] Tracing variant of Tasks RCU enabled. worker2 # [ 0.005577] CPU features: detected: CRC32 instructions worker1 # [ 0.000000] Fallback order for Node 0: 0 lb # [ 0.000000] allocated 3145728 bytes of page_ext client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker2 # [ 0.005580] CPU features: detected: Data cache clean to Point of Deep Persistence lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker1 # [ 0.000000] Policy zone: DMA lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.005584] CPU features: detected: Data cache clean to Point of Persistence lb # [ 0.000000] rcu: Hierarchical RCU implementation. worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.005587] CPU features: detected: Data independent timing control (DIT) lb # [ 0.000000] rcu: RCU event tracing is enabled. client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.005590] CPU features: detected: E0PD lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.000000] allocated 3145728 bytes of page_ext client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.005592] CPU features: detected: Enhanced Counter Virtualization lb # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages lb # [ 0.000000] Rude variant of Tasks RCU enabled. worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker2 # [ 0.005595] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] Tracing variant of Tasks RCU enabled. worker1 # [ 0.000000] rcu: Hierarchical RCU implementation. worker2 # [ 0.005598] CPU features: detected: Enhanced Virtualization Traps client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker1 # [ 0.000000] rcu: RCU event tracing is enabled. lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. client # [ 0.000000] GICv3: 256 SPIs implemented worker2 # [ 0.005601] CPU features: detected: Fine Grained Traps worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.000000] GICv3: 0 Extended SPIs implemented lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.005605] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled. client # [ 0.000000] Root IRQ handler: gic_handle_irq client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker1 # [ 0.000000] Rude variant of Tasks RCU enabled. worker2 # [ 0.005610] CPU features: detected: RCpc load-acquire (LDAPR) lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled. worker2 # [ 0.005612] CPU features: detected: LSE atomic instructions lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker2 # [ 0.005615] CPU features: detected: Privileged Access Never worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker2 # [ 0.005618] CPU features: detected: PMUv3 worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.005620] CPU features: detected: RAS Extension Support lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] GICv3: 256 SPIs implemented lb # [ 0.000000] GICv3: 0 Extended SPIs implemented worker2 # [ 0.005623] CPU features: detected: RASv1p1 Extension Support client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] Root IRQ handler: gic_handle_irq worker2 # [ 0.005626] CPU features: detected: Random Number Generator client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.005628] CPU features: detected: Speculation barrier (SB) lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker2 # [ 0.005631] CPU features: detected: Stage-2 Force Write-Back lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker1 # [ 0.000000] GICv3: 256 SPIs implemented client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker2 # [ 0.005634] CPU features: detected: TLB range maintenance instructions worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq worker2 # [ 0.005639] CPU features: detected: Speculative Store Bypassing Safe (SSBS) client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker2 # [ 0.005688] alternatives: applying system-wide alternatives client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) worker2 # [ 0.008889] CPU features: detected: BBM Level 2 without TLB conflict abort worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker2 # [ 0.009074] Memory: 1406548K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) client # [ 0.000030] arm-pv: using stolen time PV worker2 # [ 0.009534] devtmpfs: initialized lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) worker2 # [ 0.011441] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.000378] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 client # [ 0.000530] Console: colour dummy device 80x25 worker2 # [ 0.011464] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). client # [ 0.000538] printk: legacy console [tty0] enabled worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 worker2 # [ 0.011655] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker2 # [ 0.011660] 0 pages in range for non-PLT usage worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns client # [ 0.000750] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker2 # [ 0.011661] 508288 pages in range for PLT usage client # [ 0.000757] pid_max: default: 32768 minimum: 301 worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker2 # [ 0.011775] pinctrl core: initialized pinctrl subsystem lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns lb # [ 0.000028] arm-pv: using stolen time PV client # [ 0.000825] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.012575] DMI not present or invalid. worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). client # [ 0.000964] landlock: Up and running. worker2 # [ 0.016531] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.000967] Yama: becoming mindful. lb # [ 0.000377] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.001412] LSM support for eBPF active lb # [ 0.000526] Console: colour dummy device 80x25 worker2 # [ 0.018936] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns client # [ 0.001543] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.000533] printk: legacy console [tty0] enabled worker2 # [ 0.019128] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker1 # [ 0.000030] arm-pv: using stolen time PV client # [ 0.001577] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.019338] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.000725] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) client # [ 0.002624] cacheinfo: Unable to detect cache hierarchy for CPU 0 lb # [ 0.000732] pid_max: default: 32768 minimum: 301 worker1 # [ 0.000425] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.019363] audit: initializing netlink subsys (disabled) client # [ 0.003356] rcu: Hierarchical SRCU implementation. worker1 # [ 0.000610] Console: colour dummy device 80x25 lb # [ 0.000799] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.019990] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.000928] landlock: Up and running. worker1 # [ 0.000618] printk: legacy console [tty0] enabled client # [ 0.003360] rcu: Max phase no-delay instances is 1000. lb # [ 0.000931] Yama: becoming mindful. worker2 # [ 0.019992] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.001355] LSM support for eBPF active worker2 # [ 0.019996] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.004529] fsl-mc MSI: its@8080000 domain created worker1 # [ 0.000829] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) lb # [ 0.001509] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.020001] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.000835] pid_max: default: 32768 minimum: 301 client # [ 0.004620] EFI services will not be available. worker1 # [ 0.000907] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.020004] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.001541] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.004700] smp: Bringing up secondary CPUs ... worker1 # [ 0.001042] landlock: Up and running. lb # [ 0.002613] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker1 # [ 0.001044] Yama: becoming mindful. client # [ 0.004708] smp: Brought up 1 node, 1 CPU worker2 # [ 0.020038] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.001500] LSM support for eBPF active lb # [ 0.003352] rcu: Hierarchical SRCU implementation. client # [ 0.004711] SMP: Total of 1 processors activated. worker2 # [ 0.020047] cpuidle: using governor ladder worker2 # [ 0.020052] cpuidle: using governor menu client # [ 0.004716] CPU: All CPU(s) started at EL1 lb # [ 0.003356] rcu: Max phase no-delay instances is 1000. worker1 # [ 0.001650] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.004525] fsl-mc MSI: its@8080000 domain created client # [ 0.004726] CPU features: detected: Branch Target Identification worker2 # [ 0.020251] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. lb # [ 0.004624] EFI services will not be available. worker1 # [ 0.001682] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.004731] CPU features: detected: ARMv8.4 Translation Table Level worker2 # [ 0.020268] ASID allocator initialised with 65536 entries lb # [ 0.004712] smp: Bringing up secondary CPUs ... worker1 # [ 0.002826] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker2 # [ 0.021576] Serial: AMBA PL011 UART driver lb # [ 0.004720] smp: Brought up 1 node, 1 CPU worker1 # [ 0.003588] rcu: Hierarchical SRCU implementation. client # [ 0.004734] CPU features: detected: Instruction cache invalidation not required for I/D coherence lb # [ 0.004724] SMP: Total of 1 processors activated. worker2 # [ 0.027043] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker1 # [ 0.003592] rcu: Max phase no-delay instances is 1000. lb # [ 0.004729] CPU: All CPU(s) started at EL1 worker2 # [ 0.027216] printk: console [ttyAMA0] enabled worker1 # [ 0.004861] fsl-mc MSI: its@8080000 domain created client # [ 0.004738] CPU features: detected: Data cache clean to the PoU not required for I/D coherence lb # [ 0.004740] CPU features: detected: Branch Target Identification worker1 # [ 0.004953] EFI services will not be available. client # [ 0.004741] CPU features: detected: Common not Private translations worker1 # [ 0.005034] smp: Bringing up secondary CPUs ... lb # [ 0.004745] CPU features: detected: ARMv8.4 Translation Table Level client # [ 0.004744] CPU features: detected: CRC32 instructions worker1 # [ 0.005042] smp: Brought up 1 node, 1 CPU lb # [ 0.004748] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker1 # [ 0.005045] SMP: Total of 1 processors activated. client # [ 0.004747] CPU features: detected: Data cache clean to Point of Deep Persistence worker1 # [ 0.005050] CPU: All CPU(s) started at EL1 client # [ 0.004751] CPU features: detected: Data cache clean to Point of Persistence lb # [ 0.004751] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker1 # [ 0.005061] CPU features: detected: Branch Target Identification lb # [ 0.004755] CPU features: detected: Common not Private translations client # [ 0.004754] CPU features: detected: Data independent timing control (DIT) worker1 # [ 0.005066] CPU features: detected: ARMv8.4 Translation Table Level client # [ 0.004757] CPU features: detected: E0PD lb # [ 0.004758] CPU features: detected: CRC32 instructions worker1 # [ 0.005069] CPU features: detected: Instruction cache invalidation not required for I/D coherence client # [ 0.004760] CPU features: detected: Enhanced Counter Virtualization lb # [ 0.004761] CPU features: detected: Data cache clean to Point of Deep Persistence client # [ 0.004763] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker1 # [ 0.005073] CPU features: detected: Data cache clean to the PoU not required for I/D coherence lb # [ 0.004764] CPU features: detected: Data cache clean to Point of Persistence client # [ 0.004766] CPU features: detected: Enhanced Virtualization Traps worker1 # [ 0.005077] CPU features: detected: Common not Private translations lb # [ 0.004768] CPU features: detected: Data independent timing control (DIT) client # [ 0.004769] CPU features: detected: Fine Grained Traps lb # [ 0.004771] CPU features: detected: E0PD worker1 # [ 0.005080] CPU features: detected: CRC32 instructions lb # [ 0.004773] CPU features: detected: Enhanced Counter Virtualization worker1 # [ 0.005083] CPU features: detected: Data cache clean to Point of Deep Persistence client # [ 0.004773] CPU features: detected: Generic authentication (architected QARMA5 algorithm) client # [ 0.004778] CPU features: detected: RCpc load-acquire (LDAPR) worker1 # [ 0.005087] CPU features: detected: Data cache clean to Point of Persistence lb # [ 0.004776] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker2 # [ 0.150462] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.004781] CPU features: detected: LSE atomic instructions worker1 # [ 0.005090] CPU features: detected: Data independent timing control (DIT) lb # [ 0.004780] CPU features: detected: Enhanced Virtualization Traps worker2 # [ 0.150482] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.005093] CPU features: detected: E0PD lb # [ 0.004783] CPU features: detected: Fine Grained Traps client # [ 0.004784] CPU features: detected: Privileged Access Never worker2 # [ 0.150487] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages client # [ 0.004787] CPU features: detected: PMUv3 worker1 # [ 0.005096] CPU features: detected: Enhanced Counter Virtualization lb # [ 0.004786] CPU features: detected: Generic authentication (architected QARMA5 algorithm) client # [ 0.004789] CPU features: detected: RAS Extension Support worker2 # [ 0.150491] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker1 # [ 0.005099] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) lb # [ 0.004791] CPU features: detected: RCpc load-acquire (LDAPR) client # [ 0.004792] CPU features: detected: RASv1p1 Extension Support worker2 # [ 0.150495] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.005102] CPU features: detected: Enhanced Virtualization Traps lb # [ 0.004794] CPU features: detected: LSE atomic instructions client # [ 0.004795] CPU features: detected: Random Number Generator worker1 # [ 0.005105] CPU features: detected: Fine Grained Traps lb # [ 0.004797] CPU features: detected: Privileged Access Never worker2 # [ 0.150499] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.004797] CPU features: detected: Speculation barrier (SB) lb # [ 0.004800] CPU features: detected: PMUv3 worker2 # [ 0.150504] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker1 # [ 0.005109] CPU features: detected: Generic authentication (architected QARMA5 algorithm) client # [ 0.004800] CPU features: detected: Stage-2 Force Write-Back lb # [ 0.004803] CPU features: detected: RAS Extension Support worker2 # [ 0.150508] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker1 # [ 0.005115] CPU features: detected: RCpc load-acquire (LDAPR) lb # [ 0.004805] CPU features: detected: RASv1p1 Extension Support client # [ 0.004803] CPU features: detected: TLB range maintenance instructions worker1 # [ 0.005118] CPU features: detected: LSE atomic instructions lb # [ 0.004808] CPU features: detected: Random Number Generator client # [ 0.004808] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker1 # [ 0.005121] CPU features: detected: Privileged Access Never lb # [ 0.004811] CPU features: detected: Speculation barrier (SB) worker1 # [ 0.005124] CPU features: detected: PMUv3 client # [ 0.004845] alternatives: applying system-wide alternatives lb # [ 0.004813] CPU features: detected: Stage-2 Force Write-Back worker2 # [ 0.157764] fbcon: Taking over console worker1 # [ 0.005127] CPU features: detected: RAS Extension Support client # [ 0.007763] CPU features: detected: BBM Level 2 without TLB conflict abort worker2 # [ 0.157781] ACPI: Interpreter disabled. worker1 # [ 0.005129] CPU features: detected: RASv1p1 Extension Support worker2 # [ 0.159664] iommu: Default domain type: Translated worker1 # [ 0.005132] CPU features: detected: Random Number Generator worker2 # [ 0.159675] iommu: DMA domain TLB invalidation policy: strict mode worker1 # [ 0.005135] CPU features: detected: Speculation barrier (SB) client # [ 0.007945] Memory: 1406532K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved) worker1 # [ 0.005138] CPU features: detected: Stage-2 Force Write-Back worker2 # [ 0.161373] SCSI subsystem initialized worker1 # [ 0.005141] CPU features: detected: TLB range maintenance instructions worker1 # [ 0.005146] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker1 # [ 0.005184] alternatives: applying system-wide alternatives worker1 # [ 0.008260] CPU features: detected: BBM Level 2 without TLB conflict abort worker1 # [ 0.008410] Memory: 1406516K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) worker1 # [ 0.008802] devtmpfs: initialized lb # [ 0.004816] CPU features: detected: TLB range maintenance instructions worker2 # [ 0.166725] usbcore: registered new interface driver usbfs worker1 # [ 0.010594] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.166758] usbcore: registered new interface driver hub lb # [ 0.004821] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker1 # [ 0.010616] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.166776] usbcore: registered new device driver usb lb # [ 0.004859] alternatives: applying system-wide alternatives worker2 # [ 0.167038] pps_core: LinuxPPS API ver. 1 registered worker1 # [ 0.010804] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL client # [ 0.008364] devtmpfs: initialized lb # [ 0.007835] CPU features: detected: BBM Level 2 without TLB conflict abort worker1 # [ 0.010808] 0 pages in range for non-PLT usage client # [ 0.010230] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.010809] 508288 pages in range for PLT usage worker2 # [ 0.167043] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker2 # [ 0.167054] PTP clock support registered worker1 # [ 0.010905] pinctrl core: initialized pinctrl subsystem client # [ 0.010254] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.167102] EDAC MC: Ver: 3.0.0 lb # [ 0.008103] Memory: 1406580K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved) lb # [ 0.008484] devtmpfs: initialized client # [ 0.010443] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker2 # [ 0.171611] scmi_core: SCMI protocol bus registered client # [ 0.010448] 0 pages in range for non-PLT usage lb # [ 0.010495] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.010449] 508288 pages in range for PLT usage worker2 # [ 0.172578] FPGA manager framework lb # [ 0.010517] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.173568] vgaarb: loaded client # [ 0.010567] pinctrl core: initialized pinctrl subsystem client # [ 0.011320] DMI not present or invalid. lb # [ 0.010715] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker2 # [ 0.174196] clocksource: Switched to clocksource arch_sys_counter client # [ 0.014886] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.010719] 0 pages in range for non-PLT usage lb # [ 0.010720] 508288 pages in range for PLT usage client # [ 0.017134] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.010815] pinctrl core: initialized pinctrl subsystem lb # [ 0.011628] DMI not present or invalid. client # [ 0.017338] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.014587] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.017539] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.016811] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.017561] audit: initializing netlink subsys (disabled) worker2 # [ 0.178113] VFS: Disk quotas dquot_6.6.0 lb # [ 0.016993] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.018164] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.178149] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.011736] DMI not present or invalid. client # [ 0.018166] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.017193] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.015025] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.018170] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.017216] audit: initializing netlink subsys (disabled) worker1 # [ 0.017272] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.018175] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.017835] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.017837] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.017451] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.018178] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.181712] netfs: FS-Cache loaded worker2 # [ 0.181849] pnp: PnP ACPI: disabled lb # [ 0.017840] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.018203] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.017654] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.018212] cpuidle: using governor ladder lb # [ 0.017845] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.017676] audit: initializing netlink subsys (disabled) client # [ 0.018218] cpuidle: using governor menu lb # [ 0.017848] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.018296] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.018405] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker1 # [ 0.018298] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.017873] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 client # [ 0.018421] ASID allocator initialised with 65536 entries lb # [ 0.017882] cpuidle: using governor ladder worker1 # [ 0.018301] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.019670] Serial: AMBA PL011 UART driver lb # [ 0.017887] cpuidle: using governor menu worker1 # [ 0.018307] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.018073] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker2 # [ 0.185695] NET: Registered PF_INET protocol family client # [ 0.024898] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker1 # [ 0.018310] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.025021] printk: console [ttyAMA0] enabled lb # [ 0.018088] ASID allocator initialised with 65536 entries worker2 # [ 0.185950] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.019305] Serial: AMBA PL011 UART driver worker1 # [ 0.018342] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.018351] cpuidle: using governor ladder client # [ 0.148282] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.024511] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker1 # [ 0.018356] cpuidle: using governor menu lb # [ 0.024627] printk: console [ttyAMA0] enabled client # [ 0.148305] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.018541] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. client # [ 0.148311] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker1 # [ 0.018557] ASID allocator initialised with 65536 entries lb # [ 0.143943] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker1 # [ 0.019762] Serial: AMBA PL011 UART driver client # [ 0.148315] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page lb # [ 0.143961] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.024867] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 client # [ 0.148319] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.024988] printk: console [ttyAMA0] enabled lb # [ 0.143966] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages client # [ 0.148324] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.143970] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page client # [ 0.148328] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker1 # [ 0.144186] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.143975] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.148332] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker1 # [ 0.144205] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.143979] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.144211] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages lb # [ 0.143983] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker1 # [ 0.144224] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page lb # [ 0.143987] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page client # [ 0.155766] fbcon: Taking over console worker1 # [ 0.144228] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.155784] ACPI: Interpreter disabled. worker1 # [ 0.144232] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.157718] iommu: Default domain type: Translated worker1 # [ 0.144237] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages lb # [ 0.151328] fbcon: Taking over console client # [ 0.157731] iommu: DMA domain TLB invalidation policy: strict mode lb # [ 0.151344] ACPI: Interpreter disabled. worker1 # [ 0.144241] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page client # [ 0.159451] SCSI subsystem initialized lb # [ 0.153181] iommu: Default domain type: Translated lb # [ 0.153190] iommu: DMA domain TLB invalidation policy: strict mode worker1 # [ 0.151484] fbcon: Taking over console lb # [ 0.154907] SCSI subsystem initialized worker1 # [ 0.151499] ACPI: Interpreter disabled. worker1 # [ 0.153339] iommu: Default domain type: Translated worker1 # [ 0.153348] iommu: DMA domain TLB invalidation policy: strict mode worker1 # [ 0.154982] SCSI subsystem initialized lb # [ 0.160206] usbcore: registered new interface driver usbfs lb # [ 0.160237] usbcore: registered new interface driver hub client # [ 0.167181] usbcore: registered new interface driver usbfs lb # [ 0.160255] usbcore: registered new device driver usb client # [ 0.167215] usbcore: registered new interface driver hub lb # [ 0.160529] pps_core: LinuxPPS API ver. 1 registered client # [ 0.167243] usbcore: registered new device driver usb client # [ 0.167543] pps_core: LinuxPPS API ver. 1 registered worker1 # [ 0.160468] usbcore: registered new interface driver usbfs lb # [ 0.160535] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti lb # [ 0.160545] PTP clock support registered worker1 # [ 0.160500] usbcore: registered new interface driver hub client # [ 0.167550] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti lb # [ 0.160593] EDAC MC: Ver: 3.0.0 worker1 # [ 0.160518] usbcore: registered new device driver usb client # [ 0.167560] PTP clock support registered client # [ 0.167615] EDAC MC: Ver: 3.0.0 lb # [ 0.165130] scmi_core: SCMI protocol bus registered worker1 # [ 0.160785] pps_core: LinuxPPS API ver. 1 registered client # [ 0.172300] scmi_core: SCMI protocol bus registered lb # [ 0.166061] FPGA manager framework worker1 # [ 0.160790] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti lb # [ 0.166985] vgaarb: loaded worker1 # [ 0.160800] PTP clock support registered client # [ 0.173354] FPGA manager framework worker1 # [ 0.160847] EDAC MC: Ver: 3.0.0 lb # [ 0.167604] clocksource: Switched to clocksource arch_sys_counter client # [ 0.174367] vgaarb: loaded worker1 # [ 0.165361] scmi_core: SCMI protocol bus registered worker1 # [ 0.166280] FPGA manager framework client # [ 0.175043] clocksource: Switched to clocksource arch_sys_counter worker1 # [ 0.167297] vgaarb: loaded client # [ 0.175654] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.167931] clocksource: Switched to clocksource arch_sys_counter client # [ 0.175683] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.178111] netfs: FS-Cache loaded client # [ 0.178248] pnp: PnP ACPI: disabled lb # [ 0.171170] VFS: Disk quotas dquot_6.6.0 lb # [ 0.171204] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.171462] VFS: Disk quotas dquot_6.6.0 lb # [ 0.174801] netfs: FS-Cache loaded worker1 # [ 0.171491] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.174939] pnp: PnP ACPI: disabled worker2 # [ 0.214681] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.214723] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.175159] netfs: FS-Cache loaded worker1 # [ 0.175284] pnp: PnP ACPI: disabled worker2 # [ 0.214750] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.214823] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.178758] NET: Registered PF_INET protocol family worker2 # [ 0.214967] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.179032] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.184517] NET: Registered PF_INET protocol family worker2 # [ 0.215044] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.184812] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.215078] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.179082] NET: Registered PF_INET protocol family worker2 # [ 0.215113] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.179342] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.215220] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.215242] NET: Registered PF_XDP protocol family worker2 # [ 0.215258] PCI: CLS 0 bytes, default 64 worker2 # [ 0.215498] Trying to unpack rootfs image as initramfs... worker2 # [ 0.232079] kvm [1]: HYP mode not available client # [ 0.215017] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.208273] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.208319] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.216458] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.208346] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.216507] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.208421] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.216593] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.208240] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.208566] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.216740] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.208290] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.208651] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.216856] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.208316] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.208685] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.216902] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.208392] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.208720] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.216942] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.208536] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.208828] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.217086] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.208619] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.208852] NET: Registered PF_XDP protocol family client # [ 0.217116] NET: Registered PF_XDP protocol family lb # [ 0.208871] PCI: CLS 0 bytes, default 64 client # [ 0.217137] PCI: CLS 0 bytes, default 64 worker1 # [ 0.208664] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.209117] Trying to unpack rootfs image as initramfs... client # [ 0.217424] Trying to unpack rootfs image as initramfs... worker1 # [ 0.208701] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.208795] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.208818] NET: Registered PF_XDP protocol family worker1 # [ 0.208837] PCI: CLS 0 bytes, default 64 worker1 # [ 0.209085] Trying to unpack rootfs image as initramfs... lb # [ 0.225209] kvm [1]: HYP mode not available worker1 # [ 0.225422] kvm [1]: HYP mode not available client # [ 0.239107] kvm [1]: HYP mode not available worker2 # [ 0.322763] Initialise system trusted keyrings worker2 # [ 0.323522] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker2 # [ 0.324863] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker2 # [ 0.325655] 9p: Installing v9fs 9p2000 file system support worker2 # [ 0.354335] Key type asymmetric registered worker2 # [ 0.354364] Asymmetric key parser 'x509' registered worker2 # [ 0.354446] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker2 # [ 0.356529] io scheduler mq-deadline registered worker2 # [ 0.356540] io scheduler kyber registered lb # [ 0.316157] Initialise system trusted keyrings lb # [ 0.316890] workingset: timestamp_bits=42 max_order=19 bucket_order=0 lb # [ 0.318196] squashfs: version 4.0 (2009/01/31) Phillip Lougher lb # [ 0.319005] 9p: Installing v9fs 9p2000 file system support worker2 # [ 0.366353] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker1 # [ 0.321131] Initialise system trusted keyrings worker2 # [ 0.367738] ledtrig-cpu: registered to indicate activity on CPUs worker1 # [ 0.321879] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker2 # [ 0.368138] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: client # [ 0.331658] Initialise system trusted keyrings worker1 # [ 0.323183] squashfs: version 4.0 (2009/01/31) Phillip Lougher client # [ 0.332404] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker2 # [ 0.368156] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 client # [ 0.333768] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker2 # [ 0.368168] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker2 # [ 0.368176] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 client # [ 0.334564] 9p: Installing v9fs 9p2000 file system support worker2 # [ 0.368207] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker1 # [ 0.323925] 9p: Installing v9fs 9p2000 file system support worker2 # [ 0.368233] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker2 # [ 0.368306] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.368316] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.368322] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker2 # [ 0.368327] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker2 # [ 0.368332] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker2 # [ 0.368389] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.368837] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.369025] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.369044] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.369076] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.369098] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.369558] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.369748] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.369766] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.369799] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.389528] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.389716] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.389735] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.343832] Key type asymmetric registered worker2 # [ 0.389767] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.343857] Asymmetric key parser 'x509' registered lb # [ 0.347696] Key type asymmetric registered worker1 # [ 0.343926] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) lb # [ 0.347722] Asymmetric key parser 'x509' registered worker2 # [ 0.393412] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.347782] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker2 # [ 0.393603] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.349892] io scheduler mq-deadline registered worker2 # [ 0.393622] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.349903] io scheduler kyber registered worker2 # [ 0.393657] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.394120] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.352087] io scheduler mq-deadline registered worker1 # [ 0.352095] io scheduler kyber registered client # [ 0.363253] Key type asymmetric registered client # [ 0.363286] Asymmetric key parser 'x509' registered client # [ 0.363352] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) client # [ 0.365500] io scheduler mq-deadline registered client # [ 0.365511] io scheduler kyber registered lb # [ 0.359753] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker1 # [ 0.360069] pl061_gpio 9030000.pl061: PL061 GPIO chip registered lb # [ 0.361151] ledtrig-cpu: registered to indicate activity on CPUs lb # [ 0.361556] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: lb # [ 0.361572] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker1 # [ 0.361445] ledtrig-cpu: registered to indicate activity on CPUs lb # [ 0.361584] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker1 # [ 0.361811] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: lb # [ 0.361592] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker2 # [ 0.406340] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.361829] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 lb # [ 0.361612] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker2 # [ 0.406366] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.375163] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker1 # [ 0.361841] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 lb # [ 0.361636] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker2 # [ 0.406396] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.361709] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker1 # [ 0.361849] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker2 # [ 0.406877] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint lb # [ 0.361718] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.407065] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker1 # [ 0.361880] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits lb # [ 0.361732] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker2 # [ 0.407081] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.376505] ledtrig-cpu: registered to indicate activity on CPUs worker1 # [ 0.361905] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] lb # [ 0.361739] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker2 # [ 0.407110] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.361984] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 client # [ 0.376894] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: lb # [ 0.361744] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker1 # [ 0.361993] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.407551] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.376910] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 lb # [ 0.361799] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.407734] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.361999] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker2 # [ 0.407749] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.362228] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.376923] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker1 # [ 0.362004] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] lb # [ 0.362411] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.407779] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.362009] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] client # [ 0.376932] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 lb # [ 0.362427] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.407795] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.362064] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint client # [ 0.376956] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits lb # [ 0.362456] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.408252] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker1 # [ 0.362495] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.362472] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.376979] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker2 # [ 0.408439] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.362678] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.362933] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.377054] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.408469] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.362694] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.363115] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] client # [ 0.377063] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.362724] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.408929] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.363130] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.377069] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker1 # [ 0.362740] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.409120] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.363159] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.377074] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker2 # [ 0.409152] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.363190] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.363605] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.377079] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker1 # [ 0.363372] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.409554] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.363388] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.377173] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.383321] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.409740] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] lb # [ 0.383340] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.363417] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.377631] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.409987] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.383369] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.377820] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.363863] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.410286] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] client # [ 0.377836] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.410306] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.377865] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.410338] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.377881] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.410805] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.378351] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.410992] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] client # [ 0.378535] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.411011] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.378550] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.411044] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.378580] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.411632] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker2 # [ 0.411645] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned client # [ 0.397673] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.411650] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned client # [ 0.397858] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.411695] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned client # [ 0.397874] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.411745] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned client # [ 0.397904] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.391883] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.411796] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned client # [ 0.398369] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.392076] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] client # [ 0.398552] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.411846] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned lb # [ 0.392093] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.398567] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.411896] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned lb # [ 0.392125] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.398599] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.411946] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned lb # [ 0.392589] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.392770] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.411996] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned lb # [ 0.392786] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.412046] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned lb # [ 0.392815] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.412097] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned lb # [ 0.393260] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.392107] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.393442] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker2 # [ 0.412161] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker1 # [ 0.392136] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.393457] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.412209] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker1 # [ 0.392166] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.393486] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.412234] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker1 # [ 0.392676] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.412259] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned lb # [ 0.393965] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.392863] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.394147] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.412284] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker1 # [ 0.392879] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.394162] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.412312] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker1 # [ 0.392910] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.394192] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.412336] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker1 # [ 0.393374] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.394207] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.412362] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker1 # [ 0.393569] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.394657] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker1 # [ 0.393587] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.412386] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned lb # [ 0.394842] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.393618] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.412412] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned lb # [ 0.394878] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.412437] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.394079] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint lb # [ 0.395328] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.394264] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker2 # [ 0.412462] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned lb # [ 0.395514] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.394279] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.412488] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned lb # [ 0.395543] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.394309] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.411106] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.412513] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned client # [ 0.411310] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.394787] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.412537] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned client # [ 0.411327] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.394970] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.412562] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned client # [ 0.411357] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.394986] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.412586] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker1 # [ 0.395015] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.412611] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned client # [ 0.411851] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.395031] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.412036] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker2 # [ 0.412635] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned client # [ 0.412051] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.412660] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker1 # [ 0.395487] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker2 # [ 0.412685] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned client # [ 0.412081] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.395674] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.412710] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned worker1 # [ 0.395704] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.412539] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.414132] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.412739] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] client # [ 0.412723] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.396168] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.414316] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker2 # [ 0.412751] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] client # [ 0.412738] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.396362] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.412765] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] lb # [ 0.414573] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.412767] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.396392] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.413924] pci 0000:00:0a.0: enabling device (0000 -> 0002) lb # [ 0.414826] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] client # [ 0.412783] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.414843] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.396783] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.413298] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker1 # [ 0.396971] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] lb # [ 0.414881] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.413486] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.397220] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.415336] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.413515] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.397490] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.415520] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] client # [ 0.413974] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.397507] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.415535] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.414162] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.397536] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.415564] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.414192] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.416148] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker1 # [ 0.398001] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.398183] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.416160] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned client # [ 0.414586] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.398198] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.414769] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] lb # [ 0.416165] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker1 # [ 0.398227] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.474318] pci 0000:00:0a.0: quirk_usb_early_handoff+0x0/0xa60 took 58982 usecs client # [ 0.415019] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.416209] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned client # [ 0.415319] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.398804] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned lb # [ 0.416255] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned client # [ 0.415337] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.398815] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned lb # [ 0.416301] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned client # [ 0.415366] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.398820] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned lb # [ 0.416346] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned client # [ 0.415835] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.398867] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned client # [ 0.416021] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.416392] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker1 # [ 0.398915] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned client # [ 0.416036] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.416439] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker1 # [ 0.398962] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned client # [ 0.416074] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.416485] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned client # [ 0.416661] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker1 # [ 0.399010] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned lb # [ 0.416530] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned client # [ 0.416673] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker1 # [ 0.399057] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned lb # [ 0.416577] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned client # [ 0.416679] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker1 # [ 0.399104] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned lb # [ 0.416646] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned client # [ 0.416724] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker1 # [ 0.399154] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned lb # [ 0.416692] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned client # [ 0.416771] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker1 # [ 0.399201] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned lb # [ 0.416714] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned client # [ 0.416817] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker1 # [ 0.399250] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned lb # [ 0.416735] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned client # [ 0.416866] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker1 # [ 0.399332] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned lb # [ 0.416756] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned lb # [ 0.416780] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker1 # [ 0.399378] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned client # [ 0.416913] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned lb # [ 0.416804] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker1 # [ 0.399399] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned client # [ 0.416959] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker1 # [ 0.399421] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned lb # [ 0.416825] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned client # [ 0.417006] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker1 # [ 0.399442] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned lb # [ 0.416847] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned client # [ 0.417052] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker1 # [ 0.399466] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned lb # [ 0.416869] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned client # [ 0.417099] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned lb # [ 0.416890] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.399488] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned lb # [ 0.416912] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned client # [ 0.417171] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker1 # [ 0.399510] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned lb # [ 0.416935] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker1 # [ 0.399531] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned client # [ 0.417217] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned lb # [ 0.416955] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker1 # [ 0.399553] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned client # [ 0.417238] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned lb # [ 0.416977] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker1 # [ 0.399575] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned client # [ 0.417270] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned lb # [ 0.416998] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned client # [ 0.417292] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker1 # [ 0.399597] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned lb # [ 0.417019] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned client # [ 0.417317] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker1 # [ 0.399620] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned lb # [ 0.417040] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned worker1 # [ 0.399641] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned client # [ 0.417339] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned lb # [ 0.417062] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned worker2 # [ 0.494489] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker1 # [ 0.399662] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned client # [ 0.417360] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned lb # [ 0.417083] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker1 # [ 0.399683] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker2 # [ 0.496621] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) client # [ 0.417383] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned lb # [ 0.417104] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned worker1 # [ 0.399704] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned lb # [ 0.417125] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned client # [ 0.417407] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker1 # [ 0.399725] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned lb # [ 0.417151] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] client # [ 0.417430] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.399747] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned lb # [ 0.417161] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] client # [ 0.417453] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker1 # [ 0.399768] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned lb # [ 0.417165] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] client # [ 0.417475] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker1 # [ 0.399789] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned lb # [ 0.418319] pci 0000:00:0a.0: enabling device (0000 -> 0002) client # [ 0.417496] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker1 # [ 0.399811] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned worker1 # [ 0.399837] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] client # [ 0.417517] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned client # [ 0.417538] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker1 # [ 0.399847] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] client # [ 0.417559] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker1 # [ 0.399852] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] client # [ 0.417581] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned client # [ 0.417602] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned client # [ 0.417623] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned client # [ 0.417645] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned client # [ 0.417666] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned client # [ 0.417693] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker2 # [ 0.506817] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 0.417703] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker2 # [ 0.508911] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) client # [ 0.417707] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] client # [ 0.418884] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker1 # [ 0.465071] pci 0000:00:0a.0: enabling device (0000 -> 0002) client # [ 0.479206] pci 0000:00:0a.0: quirk_usb_early_handoff+0x0/0xa60 took 58910 usecs worker2 # [ 0.518775] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker2 # [ 0.521552] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker2 # [ 0.523802] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker2 # [ 0.525985] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) lb # [ 0.482249] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker1 # [ 0.485620] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) lb # [ 0.488634] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker1 # [ 0.487785] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker2 # [ 0.536059] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) lb # [ 0.490601] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) worker2 # [ 0.537909] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) client # [ 0.499839] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) client # [ 0.502133] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker1 # [ 0.498785] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) lb # [ 0.500970] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker2 # [ 0.549354] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) lb # [ 0.503007] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) client # [ 0.513099] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) worker1 # [ 0.505025] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker1 # [ 0.506960] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) lb # [ 0.514384] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker2 # [ 0.563454] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.566080] msm_serial: driver initialized lb # [ 0.517382] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) lb # [ 0.519443] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker1 # [ 0.517290] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker1 # [ 0.519603] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) client # [ 0.523325] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) client # [ 0.527329] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) client # [ 0.529383] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker2 # [ 0.570288] SuperH (H)SCI(F) driver initialized worker2 # [ 0.570382] STM32 USART driver initialized lb # [ 0.529412] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) lb # [ 0.531388] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker1 # [ 0.530961] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) client # [ 0.539227] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) client # [ 0.542503] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker1 # [ 0.533945] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker1 # [ 0.535736] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) lb # [ 0.542852] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) client # [ 0.553975] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker1 # [ 0.545476] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker2 # [ 0.597938] loop: module loaded worker2 # [ 0.598110] virtio_blk virtio5: 1/0/0 default/read/poll queues client # [ 0.556624] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) client # [ 0.558820] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) lb # [ 0.555562] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.558056] msm_serial: driver initialized lb # [ 0.558203] SuperH (H)SCI(F) driver initialized lb # [ 0.558259] STM32 USART driver initialized worker2 # [ 0.607041] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 0.561126] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 0.563706] msm_serial: driver initialized worker1 # [ 0.563850] SuperH (H)SCI(F) driver initialized worker1 # [ 0.563903] STM32 USART driver initialized worker2 # [ 0.609948] megasas: 07.734.00.00-rc1 worker2 # [ 0.610632] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] client # [ 0.576375] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.579174] msm_serial: driver initialized client # [ 0.579345] SuperH (H)SCI(F) driver initialized client # [ 0.579400] STM32 USART driver initialized worker2 # [ 0.622235] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.622260] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.623939] Using buffer write method worker2 # [ 0.624015] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker2 # [ 0.626904] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.626929] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.628337] Using buffer write method worker2 # [ 0.628364] Concatenating MTD devices: worker2 # [ 0.628368] (0): "0.flash" worker2 # [ 0.628371] (1): "0.flash" worker2 # [ 0.628375] into device "0.flash" lb # [ 0.590341] loop: module loaded lb # [ 0.590529] virtio_blk virtio5: 1/0/0 default/read/poll queues lb # [ 0.591301] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 0.594129] loop: module loaded worker1 # [ 0.594323] virtio_blk virtio5: 1/0/0 default/read/poll queues worker1 # [ 0.595058] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 0.600801] megasas: 07.734.00.00-rc1 worker1 # [ 0.601521] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] client # [ 0.614057] loop: module loaded worker1 # [ 0.603452] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.614239] virtio_blk virtio5: 1/0/0 default/read/poll queues worker1 # [ 0.603477] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.615023] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 0.604239] megasas: 07.734.00.00-rc1 lb # [ 0.604981] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] lb # [ 0.607099] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.607152] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.608698] Using buffer write method lb # [ 0.608756] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] lb # [ 0.610362] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.610388] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.613378] Using buffer write method worker1 # [ 0.613448] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker1 # [ 0.614884] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.614911] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.619676] megasas: 07.734.00.00-rc1 lb # [ 0.624129] Using buffer write method client # [ 0.620391] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] lb # [ 0.624154] Concatenating MTD devices: lb # [ 0.624158] (0): "0.flash" lb # [ 0.624163] (1): "0.flash" lb # [ 0.624166] into device "0.flash" worker1 # [ 0.624675] Using buffer write method worker1 # [ 0.624701] Concatenating MTD devices: worker1 # [ 0.624705] (0): "0.flash" worker1 # [ 0.624710] (1): "0.flash" worker1 # [ 0.624713] into device "0.flash" client # [ 0.644237] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.644291] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.646134] Using buffer write method client # [ 0.646210] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] client # [ 0.657015] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.657049] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.658643] Using buffer write method client # [ 0.658674] Concatenating MTD devices: client # [ 0.658679] (0): "0.flash" client # [ 0.658683] (1): "0.flash" client # [ 0.658686] into device "0.flash" worker2 # [ 0.878508] Freeing initrd memory: 26148K worker2 # [ 0.884551] tun: Universal TUN/TAP device driver, 1.6 worker2 # [ 0.888267] thunder_xcv, ver 1.0 worker2 # [ 0.888308] thunder_bgx, ver 1.0 worker2 # [ 0.888333] nicpf, ver 1.0 worker2 # [ 0.888862] e1000: Intel(R) PRO/1000 Network Driver worker2 # [ 0.888869] e1000: Copyright (c) 1999-2006 Intel Corporation. worker2 # [ 0.888892] e1000e: Intel(R) PRO/1000 Network Driver worker2 # [ 0.888901] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker2 # [ 0.888933] igb: Intel(R) Gigabit Ethernet Network Driver lb # [ 0.849500] Freeing initrd memory: 26140K worker2 # [ 0.888939] igb: Copyright (c) 2007-2014 Intel Corporation. worker2 # [ 0.888960] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker2 # [ 0.888965] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker2 # [ 0.889094] sky2: driver version 1.30 worker2 # [ 0.890831] ehci-pci 0000:00:0a.0: EHCI Host Controller worker2 # [ 0.890881] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker2 # [ 0.891085] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 lb # [ 0.855487] tun: Universal TUN/TAP device driver, 1.6 worker2 # [ 0.901049] usbcore: registered new interface driver usb-storage worker2 # [ 0.901178] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.901192] usbserial: USB Serial support registered for generic worker2 # [ 0.901764] hv_vmbus: registering driver hyperv_keyboard lb # [ 0.859313] thunder_xcv, ver 1.0 lb # [ 0.859359] thunder_bgx, ver 1.0 worker2 # [ 0.902251] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 lb # [ 0.859381] nicpf, ver 1.0 worker2 # [ 0.902575] hub 1-0:1.0: USB hub found worker2 # [ 0.902597] hub 1-0:1.0: 6 ports detected worker2 # [ 0.908000] rtc-pl031 9010000.pl031: registered as rtc0 worker1 # [ 0.859127] Freeing initrd memory: 26148K worker2 # [ 0.908031] rtc-pl031 9010000.pl031: setting system clock to 2026-09-21T09:34:31 UTC (1789983271) lb # [ 0.861146] e1000: Intel(R) PRO/1000 Network Driver worker2 # [ 0.908344] i2c_dev: i2c /dev entries driver lb # [ 0.861158] e1000: Copyright (c) 1999-2006 Intel Corporation. lb # [ 0.861183] e1000e: Intel(R) PRO/1000 Network Driver lb # [ 0.861192] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. lb # [ 0.861221] igb: Intel(R) Gigabit Ethernet Network Driver worker1 # [ 0.865168] tun: Universal TUN/TAP device driver, 1.6 lb # [ 0.861227] igb: Copyright (c) 2007-2014 Intel Corporation. worker2 # [ 0.913344] sdhci: Secure Digital Host Controller Interface driver lb # [ 0.861250] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker2 # [ 0.913358] sdhci: Copyright(c) Pierre Ossman lb # [ 0.861255] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker2 # [ 0.913612] Synopsys Designware Multimedia Card Interface Driver lb # [ 0.861387] sky2: driver version 1.30 worker2 # [ 0.913971] sdhci-pltfm: SDHCI platform and OF driver helper lb # [ 0.863067] usbcore: registered new interface driver usb-storage lb # [ 0.863121] usbcore: registered new interface driver usbserial_generic lb # [ 0.863136] usbserial: USB Serial support registered for generic lb # [ 0.864363] ehci-pci 0000:00:0a.0: EHCI Host Controller lb # [ 0.864388] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker2 # [ 0.918361] hid: raw HID events driver (C) Jiri Kosina lb # [ 0.864703] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 worker2 # [ 0.918612] usbcore: registered new interface driver usbhid worker2 # [ 0.918619] usbhid: USB HID core driver worker1 # [ 0.868994] thunder_xcv, ver 1.0 worker1 # [ 0.869040] thunder_bgx, ver 1.0 worker1 # [ 0.869061] nicpf, ver 1.0 lb # [ 0.875163] hv_vmbus: registering driver hyperv_keyboard worker2 # [ 0.921536] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker1 # [ 0.869614] e1000: Intel(R) PRO/1000 Network Driver lb # [ 0.875643] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker1 # [ 0.869621] e1000: Copyright (c) 1999-2006 Intel Corporation. lb # [ 0.875973] hub 1-0:1.0: USB hub found lb # [ 0.875994] hub 1-0:1.0: 6 ports detected worker1 # [ 0.869645] e1000e: Intel(R) PRO/1000 Network Driver worker2 # [ 0.924092] drop_monitor: Initializing network drop monitor service worker1 # [ 0.869653] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker2 # [ 0.924253] NET: Registered PF_INET6 protocol family worker1 # [ 0.869681] igb: Intel(R) Gigabit Ethernet Network Driver worker1 # [ 0.869687] igb: Copyright (c) 2007-2014 Intel Corporation. lb # [ 0.878994] rtc-pl031 9010000.pl031: registered as rtc0 worker2 # [ 0.926197] Segment Routing with IPv6 worker1 # [ 0.869710] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker2 # [ 0.926242] In-situ OAM (IOAM) with IPv6 lb # [ 0.879021] rtc-pl031 9010000.pl031: setting system clock to 2026-09-21T09:34:31 UTC (1789983271) worker2 # [ 0.926276] NET: Registered PF_PACKET protocol family worker1 # [ 0.869715] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. lb # [ 0.879356] i2c_dev: i2c /dev entries driver worker1 # [ 0.869846] sky2: driver version 1.30 worker1 # [ 0.871386] usbcore: registered new interface driver usb-storage worker1 # [ 0.871489] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.871503] usbserial: USB Serial support registered for generic worker2 # [ 0.927877] 9pnet: Installing 9P2000 support worker1 # [ 0.872722] ehci-pci 0000:00:0a.0: EHCI Host Controller worker2 # [ 0.930096] Key type dns_resolver registered client # [ 0.891650] Freeing initrd memory: 26160K worker1 # [ 0.872754] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker1 # [ 0.873004] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 lb # [ 0.884165] sdhci: Secure Digital Host Controller Interface driver worker1 # [ 0.884638] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 lb # [ 0.884174] sdhci: Copyright(c) Pierre Ossman worker1 # [ 0.884992] hub 1-0:1.0: USB hub found worker1 # [ 0.885007] hub 1-0:1.0: 6 ports detected lb # [ 0.884445] Synopsys Designware Multimedia Card Interface Driver lb # [ 0.884822] sdhci-pltfm: SDHCI platform and OF driver helper lb # [ 0.886505] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 0.887235] hv_vmbus: registering driver hyperv_keyboard lb # [ 0.886774] usbcore: registered new interface driver usbhid lb # [ 0.886781] usbhid: USB HID core driver client # [ 0.897875] tun: Universal TUN/TAP device driver, 1.6 worker2 # [ 0.937344] registered taskstats version 1 worker1 # [ 0.888864] rtc-pl031 9010000.pl031: registered as rtc0 worker2 # [ 0.937509] Loading compiled-in X.509 certificates worker1 # [ 0.888889] rtc-pl031 9010000.pl031: setting system clock to 2026-09-21T09:34:31 UTC (1789983271) worker1 # [ 0.889194] i2c_dev: i2c /dev entries driver lb # [ 0.892424] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available lb # [ 0.893942] drop_monitor: Initializing network drop monitor service lb # [ 0.894076] NET: Registered PF_INET6 protocol family client # [ 0.901599] thunder_xcv, ver 1.0 client # [ 0.901645] thunder_bgx, ver 1.0 lb # [ 0.897080] Segment Routing with IPv6 client # [ 0.901669] nicpf, ver 1.0 lb # [ 0.897110] In-situ OAM (IOAM) with IPv6 client # [ 0.902215] e1000: Intel(R) PRO/1000 Network Driver lb # [ 0.897140] NET: Registered PF_PACKET protocol family client # [ 0.902222] e1000: Copyright (c) 1999-2006 Intel Corporation. worker1 # [ 0.894004] sdhci: Secure Digital Host Controller Interface driver client # [ 0.902247] e1000e: Intel(R) PRO/1000 Network Driver worker1 # [ 0.894016] sdhci: Copyright(c) Pierre Ossman lb # [ 0.898758] 9pnet: Installing 9P2000 support client # [ 0.902256] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker1 # [ 0.894280] Synopsys Designware Multimedia Card Interface Driver client # [ 0.902285] igb: Intel(R) Gigabit Ethernet Network Driver worker2 # [ 0.946013] Demotion targets for Node 0: null worker1 # [ 0.894653] sdhci-pltfm: SDHCI platform and OF driver helper worker2 # [ 0.946120] Key type .fscrypt registered client # [ 0.902291] igb: Copyright (c) 2007-2014 Intel Corporation. worker2 # [ 0.946127] Key type fscrypt-provisioning registered client # [ 0.902314] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker2 # [ 0.948054] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.899007] hid: raw HID events driver (C) Jiri Kosina client # [ 0.902320] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker2 # [ 0.948080] ima: Allocated hash algorithm: sha1 client # [ 0.902452] sky2: driver version 1.30 worker1 # [ 0.899245] usbcore: registered new interface driver usbhid lb # [ 0.901629] Key type dns_resolver registered worker2 # [ 0.948102] ima: No architecture policies found worker1 # [ 0.899252] usbhid: USB HID core driver worker2 # [ 0.950496] input: gpio-keys as /devices/platform/gpio-keys/input/input0 client # [ 0.911714] ehci-pci 0000:00:0a.0: EHCI Host Controller client # [ 0.911747] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker1 # [ 0.902055] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available client # [ 0.911984] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 worker1 # [ 0.903546] drop_monitor: Initializing network drop monitor service worker1 # [ 0.903689] NET: Registered PF_INET6 protocol family client # [ 0.914394] usbcore: registered new interface driver usb-storage worker1 # [ 0.906828] Segment Routing with IPv6 client # [ 0.914450] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.906845] In-situ OAM (IOAM) with IPv6 client # [ 0.914465] usbserial: USB Serial support registered for generic worker1 # [ 0.906877] NET: Registered PF_PACKET protocol family client # [ 0.917350] hv_vmbus: registering driver hyperv_keyboard lb # [ 0.907918] registered taskstats version 1 lb # [ 0.908062] Loading compiled-in X.509 certificates client # [ 0.918841] rtc-pl031 9010000.pl031: registered as rtc0 client # [ 0.918869] rtc-pl031 9010000.pl031: setting system clock to 2026-09-21T09:34:31 UTC (1789983271) worker1 # [ 0.908725] 9pnet: Installing 9P2000 support worker1 # [ 0.910826] Key type dns_resolver registered client # [ 0.920977] i2c_dev: i2c /dev entries driver lb # [ 0.916618] Demotion targets for Node 0: null lb # [ 0.916724] Key type .fscrypt registered lb # [ 0.916730] Key type fscrypt-provisioning registered lb # [ 0.916826] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.916845] ima: Allocated hash algorithm: sha1 lb # [ 0.916865] ima: No architecture policies found client # [ 0.924185] sdhci: Secure Digital Host Controller Interface driver lb # [ 0.920846] input: gpio-keys as /devices/platform/gpio-keys/input/input0 client # [ 0.924194] sdhci: Copyright(c) Pierre Ossman client # [ 0.924461] Synopsys Designware Multimedia Card Interface Driver worker1 # [ 0.917764] registered taskstats version 1 client # [ 0.924829] sdhci-pltfm: SDHCI platform and OF driver helper worker1 # [ 0.917917] Loading compiled-in X.509 certificates client # [ 0.926569] hid: raw HID events driver (C) Jiri Kosina client # [ 0.926810] usbcore: registered new interface driver usbhid worker2 # [ 0.968201] clk: Disabling unused clocks client # [ 0.926817] usbhid: USB HID core driver worker2 # [ 0.968226] PM: genpd: Disabling unused power domains client # [ 0.931546] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 client # [ 0.932592] hub 1-0:1.0: USB hub found client # [ 0.933062] hub 1-0:1.0: 6 ports detected worker2 # [ 0.972484] Freeing unused kernel memory: 4736K worker2 # [ 0.972677] Run /init as init process client # [ 0.934816] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker1 # [ 0.926623] Demotion targets for Node 0: null worker1 # [ 0.926736] Key type .fscrypt registered worker1 # [ 0.926742] Key type fscrypt-provisioning registered worker1 # [ 0.926832] ima: No TPM chip found, activating TPM-bypass! client # [ 0.937415] drop_monitor: Initializing network drop monitor service worker1 # [ 0.926851] ima: Allocated hash algorithm: sha1 client # [ 0.937565] NET: Registered PF_INET6 protocol family worker1 # [ 0.926872] ima: No architecture policies found client # [ 0.939498] Segment Routing with IPv6 client # [ 0.939519] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.930972] input: gpio-keys as /devices/platform/gpio-keys/input/input0 client # [ 0.939574] NET: Registered PF_PACKET protocol family client # [ 0.941222] 9pnet: Installing 9P2000 support lb # [ 0.938499] clk: Disabling unused clocks lb # [ 0.938529] PM: genpd: Disabling unused power domains client # [ 0.944003] Key type dns_resolver registered worker2 # [ 0.988448] systemd[1]: Successfully made /usr/ read-only. lb # [ 0.942752] Freeing unused kernel memory: 4736K lb # [ 0.942953] Run /init as init process client # [ 0.950462] registered taskstats version 1 client # [ 0.950628] Loading compiled-in X.509 certificates client # [ 0.959324] Demotion targets for Node 0: null client # [ 0.959430] Key type .fscrypt registered worker1 # [ 0.949537] clk: Disabling unused clocks client # [ 0.959437] Key type fscrypt-provisioning registered worker1 # [ 0.949563] PM: genpd: Disabling unused power domains client # [ 0.959533] ima: No TPM chip found, activating TPM-bypass! client # [ 0.959553] ima: Allocated hash algorithm: sha1 client # [ 0.959574] ima: No architecture policies found worker1 # [ 0.953886] Freeing unused kernel memory: 4736K worker1 # [ 0.954109] Run /init as init process client # [ 0.963657] input: gpio-keys as /devices/platform/gpio-keys/input/input0 lb # [ 0.957780] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 0.970194] systemd[1]: Successfully made /usr/ read-only. client # [ 0.982027] clk: Disabling unused clocks client # [ 0.982055] PM: genpd: Disabling unused power domains client # [ 0.986316] Freeing unused kernel memory: 4736K client # [ 0.986513] Run /init as init process client # [ 1.001308] systemd[1]: Successfully made /usr/ read-only. worker2 # [ 1.154260] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 1.123722] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 1.132023] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 1.179120] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 1.306527] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 lb # [ 1.275950] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker2 # [ 1.323267] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.335488] systemd[1]: Detected virtualization qemu. worker1 # [ 1.284289] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker2 # [ 1.337594] systemd[1]: Detected architecture arm64. worker2 # [ 1.339589] systemd[1]: Running in initrd. worker2 # [ 1.342318] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.345169] systemd[1]: Hostname set to . lb # [ 1.292643] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.304649] systemd[1]: Detected virtualization qemu. lb # [ 1.306625] systemd[1]: Detected architecture arm64. lb # [ 1.308610] systemd[1]: Running in initrd. lb # [ 1.311200] systemd[1]: Initializing machine ID from random generator. lb # [ 1.314134] systemd[1]: Hostname set to . worker1 # [ 1.305057] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.316973] systemd[1]: Detected virtualization qemu. worker1 # [ 1.318936] systemd[1]: Detected architecture arm64. worker1 # [ 1.320895] systemd[1]: Running in initrd. worker1 # [ 1.323475] systemd[1]: Initializing machine ID from random generator. client # [ 1.331246] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker1 # [ 1.326491] systemd[1]: Hostname set to . client # [ 1.337257] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.349565] systemd[1]: Detected virtualization qemu. worker2 # [ 1.390414] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 client # [ 1.351678] systemd[1]: Detected architecture arm64. client # [ 1.353612] systemd[1]: Running in initrd. client # [ 1.356237] systemd[1]: Initializing machine ID from random generator. client # [ 1.359137] systemd[1]: Hostname set to . lb # [ 1.359889] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker1 # [ 1.372221] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 client # [ 1.415307] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker2 # [ 1.510286] usb 1-2: new high-speed USB device number 3 using ehci-pci lb # [ 1.479711] usb 1-2: new high-speed USB device number 3 using ehci-pci worker1 # [ 1.491980] usb 1-2: new high-speed USB device number 3 using ehci-pci client # [ 1.535086] usb 1-2: new high-speed USB device number 3 using ehci-pci worker2 # [ 1.622944] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.611804] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.669254] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker2 # [ 1.672943] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 client # [ 1.642223] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.633430] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.638043] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 lb # [ 1.643856] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker1 # [ 1.661575] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker1 # [ 1.666251] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 client # [ 1.684667] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 client # [ 1.686849] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker2 # [ 1.727493] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.736707] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.737985] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.739477] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.740651] systemd[1]: Reached target Path Units. worker2 # [ 1.741508] systemd[1]: Reached target Slice Units. worker2 # [ 1.742401] systemd[1]: Reached target Swaps. worker2 # [ 1.743169] systemd[1]: Reached target Timer Units. worker2 # [ 1.744211] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.745500] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.746751] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.746899] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.747022] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.747047] systemd[1]: Reached target Socket Units. client # [ 1.711552] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.752435] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.759543] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 1.721080] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.760776] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 1.722094] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.723250] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.724139] systemd[1]: Reached target Path Units. client # [ 1.724865] systemd[1]: Reached target Slice Units. client # [ 1.725565] systemd[1]: Reached target Swaps. client # [ 1.726191] systemd[1]: Reached target Timer Units. client # [ 1.727118] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.728160] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.729127] systemd[1]: Listening on Journal Sockets. client # [ 1.729974] systemd[1]: Listening on udev Control Socket. client # [ 1.730869] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.724788] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.731711] systemd[1]: Reached target Socket Units. worker2 # [ 1.770394] systemd[1]: Mounting Kernel Configuration File System... client # [ 1.733874] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.778434] systemd[1]: Starting Journal Service... client # [ 1.740242] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 1.735142] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.741206] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 1.736399] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.737694] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.738736] systemd[1]: Reached target Path Units. lb # [ 1.739552] systemd[1]: Reached target Slice Units. lb # [ 1.740439] systemd[1]: Reached target Swaps. lb # [ 1.741182] systemd[1]: Reached target Timer Units. lb # [ 1.742169] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.743398] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.750646] systemd[1]: Mounting Kernel Configuration File System... lb # [ 1.744656] systemd[1]: Listening on Journal Sockets. lb # [ 1.745664] systemd[1]: Listening on udev Control Socket. lb # [ 1.746696] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.747632] systemd[1]: Reached target Socket Units. lb # [ 1.750106] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.749261] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.756894] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 1.763415] systemd[1]: Starting Journal Service... lb # [ 1.758099] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 1.758279] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.759461] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.760881] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.761931] systemd[1]: Reached target Path Units. worker1 # [ 1.762739] systemd[1]: Reached target Slice Units. worker2 # [ 1.810406] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.763566] systemd[1]: Reached target Swaps. worker2 # [ 1.810525] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.764382] systemd[1]: Reached target Timer Units. worker2 # [ 1.813650] systemd[1]: Starting Coldplug All udev Devices... lb # [ 1.767767] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 1.765382] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.766591] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.767756] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.768821] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.768943] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.768966] systemd[1]: Reached target Socket Units. client # [ 1.781979] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.773197] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.782882] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.777175] systemd[1]: Starting Journal Service... worker1 # [ 1.783619] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 1.832166] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.792354] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.784990] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 1.838322] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.839496] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 1.839781] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 1.840002] systemd[1]: Mounted Kernel Configuration File System. lb # [ 1.802905] systemd[1]: Starting Load Kernel Modules... lb # [ 1.803013] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.797555] systemd[1]: Mounting Kernel Configuration File System... client # [ 1.811327] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.850688] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.812441] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 1.812738] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 1.812976] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 1.858357] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 1.823866] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.816178] systemd[1]: Starting Journal Service... lb # [ 1.821391] systemd-journald[73]: Collecting audit messages is disabled. lb # [ 1.822393] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.872321] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 worker1 # [ 1.825477] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.872566] [drm] features: -virgl +edid -resource_blob -host_visible worker2 # [ 1.872574] [drm] features: -context_init worker2 # [ 1.873303] [drm] number of scanouts: 1 client # [ 1.833413] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.826390] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.829520] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.873321] [drm] number of cap sets: 0 worker2 # [ 1.880823] systemd-journald[73]: Collecting audit messages is disabled. worker2 # [ 1.882009] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic client # [ 1.842942] systemd-journald[73]: Collecting audit messages is disabled. worker2 # [ 1.882028] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 lb # [ 1.840567] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 1.847986] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 1.848389] systemd[1]: Mounted Kernel Configuration File System. lb # [ 1.851255] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.855131] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 1.859855] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 client # [ 1.860093] [drm] features: -virgl +edid -resource_blob -host_visible client # [ 1.860101] [drm] features: -context_init client # [ 1.860797] [drm] number of scanouts: 1 client # [ 1.860814] [drm] number of cap sets: 0 worker1 # [ 1.860431] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.910820] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 1.913363] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.879140] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic client # [ 1.879162] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker2 # [ 1.921280] Console: switching to colour frame buffer device 160x50 client # [ 1.891708] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.881256] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.881568] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.882742] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 1.883067] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 1.888378] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.889555] systemd[1]: Mounted Kernel Configuration File System. lb # [ 1.892247] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.899415] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.898787] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.899647] systemd-journald[73]: Collecting audit messages is disabled. lb # [ 1.904109] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.954794] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device lb # [ 1.911689] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.904002] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.908575] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 worker1 # [ 1.908814] [drm] features: -virgl +edid -resource_blob -host_visible worker2 # [ 1.958148] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 1.908823] [drm] features: -context_init worker1 # [ 1.909534] [drm] number of scanouts: 1 worker2 # [ 1.958391] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 1.909552] [drm] number of cap sets: 0 worker2 # [ 1.958425] systemd[1]: Reached target Local File Systems. client # [ 1.919423] Console: switching to colour frame buffer device 160x50 client # [ 1.923701] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker2 # [ 1.963997] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 1.923600] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 worker2 # [ 1.978566] systemd[1]: Finished Load Kernel Modules. client # [ 1.939277] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 1.939496] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 1.935583] [drm] features: -virgl +edid -resource_blob -host_visible client # [ 1.939531] systemd[1]: Reached target Local File Systems. lb # [ 1.935606] [drm] features: -context_init lb # [ 1.936386] [drm] number of scanouts: 1 lb # [ 1.936404] [drm] number of cap sets: 0 worker1 # [ 1.928265] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic client # [ 1.944335] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 1.928287] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 lb # [ 1.940235] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 1.940599] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 1.940626] systemd[1]: Reached target Local File Systems. client # [ 1.951566] systemd[1]: Finished Load Kernel Modules. lb # [ 1.944596] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic worker2 # [ 1.986347] systemd[1]: Starting Apply Kernel Variables... lb # [ 1.944615] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 lb # [ 1.956059] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.963556] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 1.956618] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.959192] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 1.961055] Console: switching to colour frame buffer device 160x50 worker2 # [ 2.026839] systemd[1]: Finished Apply Kernel Variables. lb # [ 1.976025] Console: switching to colour frame buffer device 160x50 worker1 # [ 1.984592] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device client # [ 2.007712] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 2.001220] systemd[1]: Finished Load Kernel Modules. worker1 # [ 2.003433] systemd[1]: Starting Apply Kernel Variables... lb # [ 2.011497] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker2 # [ 2.060267] systemd[1]: Started Journal Service. lb # [ 2.016152] systemd[1]: Finished Load Kernel Modules. worker2 # [ 2.052273] systemd-modules-load[74]: Inserted module 'dm_mod' lb # [ 2.009324] systemd-modules-load[75]: Inserted module 'dm_mod' worker1 # [ 2.021336] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 2.053451] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker1 # [ 2.021550] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 2.021587] systemd[1]: Reached target Local File Systems. worker2 # [ 2.054540] systemd-modules-load[74]: Module 'virtio_console' is built in client # [ 2.031294] systemd[1]: Started Journal Service. worker2 # [ 2.055604] systemd-modules-load[74]: Inserted module 'virtio_gpu' lb # [ 2.026201] systemd[1]: Starting Apply Kernel Variables... lb # [ 2.026379] systemd[1]: Started Journal Service. client # [ 2.020310] systemd-modules-load[74]: Inserted module 'dm_mod' client # [ 2.021539] systemd-modules-load[74]: Module 'virtio_balloon' is built in lb # [ 2.019803] systemd-modules-load[75]: Module 'virtio_balloon' is built in lb # [ 2.024336] systemd-modules-load[75]: Module 'virtio_console' is built in worker2 # [ 2.068407] systemd-modules-load[74]: Module 'virtio_rng' is built in lb # [ 2.025388] systemd-modules-load[75]: Inserted module 'virtio_gpu' client # [ 2.032329] systemd-modules-load[74]: Module 'virtio_console' is built in worker2 # [ 2.069524] systemd[1]: Starting Create System Files and Directories... lb # [ 2.026363] systemd-modules-load[75]: Module 'virtio_rng' is built in client # [ 2.033457] systemd-modules-load[74]: Inserted module 'virtio_gpu' client # [ 2.034423] systemd-modules-load[74]: Module 'virtio_rng' is built in worker2 # [ 2.070864] systemd-udevd[80]: Using default interface naming scheme 'v261'. worker1 # [ 2.036331] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 2.035464] systemd[1]: Starting Create System Files and Directories... lb # [ 2.040129] systemd[1]: Starting Create System Files and Directories... client # [ 2.052718] systemd-udevd[80]: Using default interface naming scheme 'v261'. worker2 # [ 2.091757] systemd[1]: Finished Create System Files and Directories. lb # [ 2.052504] systemd-udevd[80]: Using default interface naming scheme 'v261'. worker1 # [ 2.068326] systemd[1]: Finished Apply Kernel Variables. lb # [ 2.057405] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 2.072908] systemd[1]: Started Journal Service. client # [ 2.069976] systemd[1]: Finished Create System Files and Directories. worker1 # [ 2.064395] systemd-modules-load[74]: Inserted module 'dm_mod' worker2 # [ 2.111398] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 2.065633] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker1 # [ 2.075874] systemd-modules-load[74]: Module 'virtio_console' is built in worker1 # [ 2.077199] systemd-modules-load[74]: Inserted module 'virtio_gpu' worker1 # [ 2.078153] systemd-modules-load[74]: Module 'virtio_rng' is built in client # [ 2.088159] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 2.079174] systemd[1]: Starting Create System Files and Directories... lb # [ 2.094303] systemd[1]: Finished Create System Files and Directories. lb # [ 2.103095] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 2.111424] systemd[1]: Finished Create System Files and Directories. worker1 # [ 2.121223] systemd-udevd[81]: Using default interface naming scheme 'v261'. worker2 # [ 2.168129] systemd[1]: Starting Virtual Console Setup... client # [ 2.144690] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.148867] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 2.158500] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.216508] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.219972] systemd[1]: Finished Virtual Console Setup. client # [ 2.196527] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.200176] systemd[1]: Finished Virtual Console Setup. lb # [ 2.212492] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.207964] systemd[1]: Starting Virtual Console Setup... lb # [ 2.216055] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.256481] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.259758] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.811805] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 2.812924] systemd[1]: Reached target System Initialization. worker2 # [ 2.813742] systemd[1]: Reached target Basic System. client # [ 2.813373] systemd[1]: Finished Coldplug All udev Devices. lb # [ 2.806946] systemd[1]: Finished Coldplug All udev Devices. client # [ 2.814419] systemd[1]: Reached target System Initialization. lb # [ 2.807899] systemd[1]: Reached target System Initialization. client # [ 2.815261] systemd[1]: Reached target Basic System. lb # [ 2.808873] systemd[1]: Reached target Basic System. worker1 # [ 2.840858] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 2.843033] systemd[1]: Reached target System Initialization. worker1 # [ 2.843918] systemd[1]: Reached target Basic System. worker2 # [ 2.952298] (udev-worker)[92]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 2.964400] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.940007] (udev-worker)[100]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 2.990974] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.974324] (udev-worker)[93]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 2.980193] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.982140] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.992864] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.989954] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.995387] (udev-worker)[95]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 3.048142] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 3.051452] systemd[1]: Reached target Initrd Root Device. worker2 # [ 3.056971] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 3.018950] (udev-worker)[99]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 3.029026] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line. lb # [ 3.049174] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 3.053026] systemd[1]: Reached target Initrd Root Device. client # [ 3.062302] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 3.066658] systemd[1]: Reached target Initrd Root Device. lb # [ 3.060117] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 3.105975] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 3.072557] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 3.114118] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 3.128243] systemd[1]: Mounting /sysroot... worker1 # [ 3.100786] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 3.106977] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 3.108086] systemd[1]: Reached target Initrd Root Device. worker1 # [ 3.111303] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 3.114887] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 3.177294] EXT4-fs (vda): mounted filesystem fb96e099-efc4-4c5b-9589-f5efd9479053 r/w with ordered data mode. Quota mode: none. client # [ 3.124738] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 3.164925] systemd[1]: Mounted /sysroot. worker2 # [ 3.166815] systemd[1]: Reached target Initrd Root File System. client # [ 3.130460] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 3.168201] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 3.128117] systemd[1]: Mounting /sysroot... client # [ 3.136135] systemd[1]: Mounting /sysroot... worker2 # [ 3.195676] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 3.166901] EXT4-fs (vda): mounted filesystem c2eb829f-f19e-4e6f-ae63-b26aa4c7dcce r/w with ordered data mode. Quota mode: none. lb # [ 3.158255] systemd[1]: Mounted /sysroot. lb # [ 3.159418] systemd[1]: Reached target Initrd Root File System. worker1 # [ 3.156710] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 3.204114] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker2 # [ 3.206473] systemd[1]: Reloading... client # [ 3.187439] EXT4-fs (vda): mounted filesystem b33be005-ca40-4a05-a1fe-ff0acc2ff65a r/w with ordered data mode. Quota mode: none. worker1 # [ 3.164789] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 3.168238] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 3.177868] systemd[1]: Mounted /sysroot. worker1 # [ 3.169027] systemd[1]: Mounting /sysroot... client # [ 3.181319] systemd[1]: Reached target Initrd Root File System. client # [ 3.185148] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 3.191198] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 3.198680] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 3.200442] systemd[1]: Reloading... client # [ 3.213290] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 3.217705] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 3.221921] EXT4-fs (vda): mounted filesystem 8c8dabfc-891b-4801-962e-21c7a7e4239d r/w with ordered data mode. Quota mode: none. worker1 # [ 3.211348] systemd[1]: Mounted /sysroot. worker1 # [ 3.212466] systemd[1]: Reached target Initrd Root File System. client # [ 3.223132] systemd[1]: Reloading... worker1 # [ 3.215740] systemd[1]: Starting Mountpoints Configured in the Real Root... worker1 # [ 3.245634] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 3.251818] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 3.255930] systemd[1]: Reloading... worker2 # [ 3.416805] systemd[1]: Reloading finished in 213 ms. worker2 # [ 3.445946] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.449881] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... lb # [ 3.407127] systemd[1]: Reloading finished in 209 ms. worker2 # [ 3.452892] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 3.460889] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 3.463602] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 3.466448] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 3.433120] systemd[1]: Reloading finished in 213 ms. lb # [ 3.439069] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... lb # [ 3.444230] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... lb # [ 3.447134] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 3.490634] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 3.492406] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 3.456516] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.459502] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.467227] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... client # [ 3.469238] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... worker1 # [ 3.460196] systemd[1]: Reloading finished in 209 ms. lb # [ 3.464223] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 3.475533] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 3.480816] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 3.484211] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.485895] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.483303] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 3.485030] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 3.492403] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... worker1 # [ 3.496647] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... client # [ 3.511834] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 3.513658] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 3.505247] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 3.508165] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 3.510031] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 3.514244] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.536552] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 3.539726] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 3.804256] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.782337] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.822578] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.827743] systemd[1]: Mounting /sysroot/run... client # [ 3.795165] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.841414] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.809493] systemd[1]: Mounting /sysroot/run... lb # [ 3.816970] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.863348] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 3.835390] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 3.835540] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 3.839450] systemd[1]: Mounting /sysroot/run... client # [ 3.848250] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 3.852747] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.853947] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.907750] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 3.872725] systemd[1]: Mounted /sysroot/nix/.rw-store. lb # [ 3.871406] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.870999] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.918333] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.874408] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.934717] systemd[1]: Mounted /sysroot/run. client # [ 3.900555] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 3.893709] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.890829] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.902936] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.939674] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 3.941863] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 3.914646] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.905494] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.954512] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.919388] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 3.924322] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.938079] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 3.977125] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.978233] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.946265] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.939597] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 3.947348] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.954029] systemd[1]: Mounted /sysroot/run. worker1 # [ 3.953026] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 3.961769] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 3.966494] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 3.964674] systemd[1]: Mounted /sysroot/nix/.rw-store. lb # [ 3.974317] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.971963] systemd[1]: Mounted /sysroot/run. lb # [ 3.977351] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.980129] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 3.985120] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 4.000132] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 4.020122] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 4.022421] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 4.024188] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 4.065398] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 4.067585] systemd[1]: Reached target Initrd File Systems. worker1 # [ 4.070880] systemd[1]: Starting Find NixOS closure... worker1 # [ 4.081742] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 4.111748] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 4.134343] systemd[1]: Finished Find NixOS closure. worker1 # [ 4.136211] systemd[1]: Reached target Initrd Default Target. worker1 # [ 4.140845] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 4.170742] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 4.171768] systemd[1]: Stopped target Basic System. worker1 # [ 4.173014] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 4.177406] systemd[1]: Stopped target Path Units. worker1 # [ 4.179132] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 4.181795] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 4.188289] systemd[1]: Stopped target Slice Units. worker1 # [ 4.192306] systemd[1]: Stopped target Socket Units. worker1 # [ 4.193702] systemd[1]: Stopped target System Initialization. worker1 # [ 4.195181] systemd[1]: Stopped target Swaps. worker1 # [ 4.204128] systemd[1]: Stopped target Timer Units. worker1 # [ 4.207165] systemd[1]: dbus.socket: Deactivated successfully. worker1 # [ 4.213481] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 4.216568] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 4.218812] systemd[1]: Stopped Find NixOS closure. worker1 # [ 4.227169] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 4.229516] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 4.230534] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 4.231461] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 4.238638] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 4.245437] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 4.247859] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 4.250813] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 4.251880] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 4.254796] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 4.255691] systemd[1]: Stopped target Local File Systems. worker1 # [ 4.256773] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 4.257708] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 4.258674] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 4.259429] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 4.268166] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.269328] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.270056] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 4.271701] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 4.273102] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 4.274014] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 4.274894] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 4.275846] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 4.276855] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 4.277801] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 4.278757] systemd[1]: systemd-udevd.service: Consumed 1.113s CPU time over 2.242s wall clock time, 18.3M memory peak. worker1 # [ 4.284279] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 4.285307] systemd[1]: Closed udev Control Socket. worker1 # [ 4.288112] systemd[1]: Starting Cleanup udev Database... worker1 # [ 4.288961] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 4.292189] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 4.293113] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 4.296137] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 4.297130] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 4.300123] systemd[1]: Stopped Create List of Static Device Nodes. client # [ 4.319245] (udev-worker)[101]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory worker2 # [ 4.357267] (udev-worker)[96]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory client # [ 4.325067] (udev-worker)[101]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory worker1 # [ 4.320430] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 4.323695] (udev-worker)[93]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory worker1 # [ 4.323150] systemd[1]: Finished Cleanup udev Database. worker1 # [ 4.323939] systemd[1]: Reached target Switch Root. worker2 # [ 4.370059] (udev-worker)[96]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory worker1 # [ 4.328588] systemd[1]: Starting NixOS Activation... lb # [ 4.330265] (udev-worker)[93]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory client # [ 4.345764] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.347190] systemd[1]: Stopped Virtual Console Setup. client # [ 4.352297] systemd[1]: Stopping Virtual Console Setup... worker2 # [ 4.390555] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.354792] systemd[1]: Starting Virtual Console Setup... worker2 # [ 4.396135] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 4.396957] systemd[1]: Stopping Virtual Console Setup... lb # [ 4.354090] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.355733] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 4.400185] systemd[1]: Starting Virtual Console Setup... lb # [ 4.360222] systemd[1]: Stopping Virtual Console Setup... lb # [ 4.361088] systemd[1]: Starting Virtual Console Setup... client # [ 4.370383] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.371921] systemd[1]: Stopped Virtual Console Setup. client # [ 4.376276] systemd[1]: Starting Virtual Console Setup... worker2 # [ 4.412718] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 4.414194] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 4.416792] systemd[1]: Starting Virtual Console Setup... lb # [ 4.376732] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.379189] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.380400] systemd[1]: Starting Virtual Console Setup... client # [ 4.400786] systemd-vconsole-setup[156]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 4.438051] systemd-vconsole-setup[155]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 4.404118] systemd[1]: Finished Virtual Console Setup. worker2 # [ 4.441401] systemd[1]: Finished Virtual Console Setup. lb # [ 4.401547] systemd-vconsole-setup[155]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 4.404574] systemd[1]: Finished Virtual Console Setup. worker1 # [ 4.497035] initrd-nixos-activation-start[172]: booting system configuration /nix/store/vniqsik90d4pd2jhgb9p4y85sl28s16w-nixos-system-worker1-test worker1 # [ 4.563316] initrd-nixos-activation-start[172]: running activation script... worker2 # [ 4.804458] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.784873] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 4.845332] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 4.848190] systemd[1]: Reached target Initrd File Systems. worker2 # [ 4.851170] systemd[1]: Starting Find NixOS closure... client # [ 4.823323] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 4.860370] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 4.824739] systemd[1]: Reached target Initrd File Systems. client # [ 4.827183] systemd[1]: Starting Find NixOS closure... lb # [ 4.820482] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.836355] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 4.904002] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 4.905866] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 4.870931] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 4.872713] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker2 # [ 4.918034] systemd[1]: Finished Find NixOS closure. worker2 # [ 4.920234] systemd[1]: Reached target Initrd Default Target. client # [ 4.885274] systemd[1]: Finished Find NixOS closure. worker2 # [ 4.923254] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 4.887761] systemd[1]: Reached target Initrd Default Target. lb # [ 4.884151] systemd[1]: Mounted /sysroot/nix/store. client # [ 4.892358] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 4.888473] systemd[1]: Reached target Initrd File Systems. lb # [ 4.895419] systemd[1]: Starting Find NixOS closure... lb # [ 4.904982] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 4.952983] systemd[1]: Stopped target Initrd Default Target. client # [ 4.918251] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 4.954989] systemd[1]: Stopped target Basic System. worker2 # [ 4.956507] systemd[1]: Stopped target Initrd Root Device. client # [ 4.920181] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 4.923538] systemd[1]: Stopped target Initrd Default Target. client # [ 4.924618] systemd[1]: Stopped target Basic System. worker2 # [ 4.960666] systemd[1]: Stopped target Path Units. worker2 # [ 4.962328] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 4.928217] systemd[1]: Stopped target Initrd Root Device. client # [ 4.929137] systemd[1]: Stopped target Path Units. worker2 # [ 4.964990] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 4.929916] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 4.968182] systemd[1]: Stopped target Slice Units. worker2 # [ 4.972234] systemd[1]: Stopped target Socket Units. client # [ 4.935816] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 4.973226] systemd[1]: Stopped target System Initialization. client # [ 4.937170] systemd[1]: Stopped target Slice Units. worker2 # [ 4.974227] systemd[1]: Stopped target Swaps. client # [ 4.937910] systemd[1]: Stopped target Socket Units. client # [ 4.938674] systemd[1]: Stopped target System Initialization. worker2 # [ 4.975290] systemd[1]: Stopped target Timer Units. client # [ 4.939498] systemd[1]: Stopped target Swaps. client # [ 4.941010] systemd[1]: Stopped target Timer Units. worker2 # [ 4.977456] systemd[1]: dbus.socket: Deactivated successfully. client # [ 4.941784] systemd[1]: dbus.socket: Deactivated successfully. client # [ 4.942625] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 4.943443] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 4.981237] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 4.985069] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 4.988663] systemd[1]: Stopped Find NixOS closure. client # [ 4.953763] systemd[1]: Stopped Find NixOS closure. client # [ 4.954584] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 4.955636] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 4.993345] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 4.995312] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 4.954988] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 5.002642] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 5.003647] systemd[1]: Stopped Apply Kernel Variables. client # [ 4.968278] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 4.960154] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker2 # [ 5.004812] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 4.971450] systemd[1]: Stopped Apply Kernel Variables. client # [ 4.972647] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 4.973645] systemd[1]: Stopped Load Kernel Modules. client # [ 4.974386] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 4.975466] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 4.972378] systemd[1]: Finished Find NixOS closure. worker2 # [ 5.016302] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 5.018589] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 4.982372] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 4.975770] systemd[1]: Reached target Initrd Default Target. worker2 # [ 5.021695] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 4.980477] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 4.988255] systemd[1]: Stopped Create System Files and Directories. client # [ 4.989293] systemd[1]: Stopped target Local File Systems. client # [ 4.990069] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 4.991012] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 4.991973] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 5.028620] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 5.032350] systemd[1]: Stopped Create System Files and Directories. client # [ 4.996874] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 5.034767] systemd[1]: Stopped target Local File Systems. worker2 # [ 5.036402] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 4.999979] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 5.001628] systemd[1]: Stopped Virtual Console Setup. client # [ 5.002389] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 5.003367] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 5.040243] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 4.994135] initrd-nixos-activation-start[195]: setting up /etc... client # [ 5.004234] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 5.041343] systemd[1]: Stopped Coldplug All udev Devices. client # [ 5.005134] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 5.042505] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 5.006119] systemd[1]: systemd-udevd.service: Consumed 1.382s CPU time over 3.054s wall clock time, 25.2M memory peak. client # [ 5.007518] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 5.046082] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 5.047527] systemd[1]: Stopped Virtual Console Setup. client # [ 5.012236] systemd[1]: Closed udev Control Socket. worker2 # [ 5.052254] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 5.016341] systemd[1]: Starting Cleanup udev Database... worker2 # [ 5.053296] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 5.017311] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker2 # [ 5.054304] systemd[1]: systemd-udevd.service: Consumed 1.422s CPU time over 3.077s wall clock time, 22.3M memory peak. client # [ 5.018529] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 5.011608] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 5.055748] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 5.020356] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 5.058685] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 5.059666] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 5.016625] systemd[1]: Stopped target Basic System. client # [ 5.024150] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 5.060895] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 5.017670] systemd[1]: Stopped target Initrd Root Device. client # [ 5.025164] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker2 # [ 5.061789] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 5.018777] systemd[1]: Stopped target Path Units. worker2 # [ 5.062833] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 5.019746] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 5.063682] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 5.028156] systemd[1]: Stopped Create List of Static Device Nodes. client # [ 5.029033] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 5.024343] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 5.068427] systemd[1]: Closed udev Control Socket. client # [ 5.032477] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 5.070320] systemd[1]: Starting Cleanup udev Database... lb # [ 5.028186] systemd[1]: Stopped target Slice Units. lb # [ 5.029155] systemd[1]: Stopped target Socket Units. worker2 # [ 5.072522] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 5.030986] systemd[1]: Stopped target System Initialization. worker2 # [ 5.076275] systemd[1]: Stopped Create Static Device Nodes in /dev. worker2 # [ 5.077284] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 5.035041] systemd[1]: Stopped target Swaps. lb # [ 5.036811] systemd[1]: Stopped target Timer Units. worker2 # [ 5.080194] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 5.084128] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 5.041052] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 5.085173] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 5.044983] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 5.047277] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 5.055581] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 5.058673] systemd[1]: Finished Cleanup udev Database. client # [ 5.059454] systemd[1]: Reached target Switch Root. client # [ 5.060965] systemd[1]: Starting NixOS Activation... lb # [ 5.056382] systemd[1]: Stopped Find NixOS closure. lb # [ 5.057288] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 5.058293] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 5.059273] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 5.064435] systemd[1]: Stopped Apply Kernel Variables. lb # [ 5.065347] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 5.067521] systemd[1]: Stopped Load Kernel Modules. lb # [ 5.069923] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 5.071263] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 5.114870] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 5.116925] systemd[1]: Finished Cleanup udev Database. worker2 # [ 5.119185] systemd[1]: Reached target Switch Root. worker2 # [ 5.120794] systemd[1]: Starting NixOS Activation... lb # [ 5.082842] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 5.083947] systemd[1]: Stopped Create System Files and Directories. lb # [ 5.091772] systemd[1]: Stopped target Local File Systems. lb # [ 5.094439] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 5.096246] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 5.100208] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 5.101056] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 5.102081] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 5.104976] systemd[1]: Stopped Virtual Console Setup. lb # [ 5.106146] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 5.108192] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 5.109153] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 5.110066] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 5.111047] systemd[1]: systemd-udevd.service: Consumed 1.392s CPU time over 3.136s wall clock time, 22.4M memory peak. lb # [ 5.112794] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 5.113776] systemd[1]: Closed udev Control Socket. lb # [ 5.114462] systemd[1]: Starting Cleanup udev Database... lb # [ 5.115227] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 5.120247] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 5.121156] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 5.124135] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 5.125180] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 5.128210] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 5.129117] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 5.132165] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 5.133042] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 5.136089] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 5.162100] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 5.164466] systemd[1]: Finished Cleanup udev Database. lb # [ 5.166131] systemd[1]: Reached target Switch Root. lb # [ 5.167284] systemd[1]: Starting NixOS Activation... client # [ 5.230888] initrd-nixos-activation-start[182]: booting system configuration /nix/store/kn580alm8i65l8xnw33vjbcfrdhrbapf-nixos-system-client-test worker2 # [ 5.287459] initrd-nixos-activation-start[180]: booting system configuration /nix/store/7125nj8p93qa3r29n9673xywybzmdlgw-nixos-system-worker2-test worker1 # [ 5.265296] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 5.268083] systemd[1]: Finished NixOS Activation. worker1 # [ 5.269307] systemd[1]: Starting Switch Root... client # [ 5.297639] initrd-nixos-activation-start[182]: running activation script... worker1 # [ 5.291581] systemd[1]: Switching root. worker2 # [ 5.350991] initrd-nixos-activation-start[180]: running activation script... lb # [ 5.333220] initrd-nixos-activation-start[181]: booting system configuration /nix/store/sy3pchz5vg22ylc3whvkp4s8qngi8wmd-nixos-system-lb-test lb # [ 5.397592] initrd-nixos-activation-start[181]: running activation script... worker1 # [ 5.487091] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). client # [ 5.717185] initrd-nixos-activation-start[205]: setting up /etc... worker2 # [ 5.763322] initrd-nixos-activation-start[203]: setting up /etc... lb # [ 5.798689] initrd-nixos-activation-start[204]: setting up /etc... worker2 # [ 6.014963] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 6.017767] systemd[1]: Finished NixOS Activation. worker2 # [ 6.018994] systemd[1]: Starting Switch Root... client # [ 5.983603] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 5.992161] systemd[1]: Finished NixOS Activation. client # [ 5.992935] systemd[1]: Starting Switch Root... worker2 # [ 6.039786] systemd[1]: Switching root. client # [ 6.011061] systemd[1]: Switching root. lb # [ 6.051792] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 6.054671] systemd[1]: Finished NixOS Activation. lb # [ 6.056089] systemd[1]: Starting Switch Root... lb # [ 6.079531] systemd[1]: Switching root. worker1 # [ 6.087026] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 6.099674] systemd[1]: Detected virtualization qemu. worker1 # [ 6.102838] systemd[1]: Detected architecture arm64. worker1 # [ 6.106182] systemd[1]: Detected first boot. worker1 # [ 6.112693] systemd[1]: Initializing machine ID from random generator. worker2 # [ 6.233466] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). client # [ 6.198556] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). lb # [ 6.271400] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker1 # [ 6.441698] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 6.627249] systemd[1]: Applying preset policy. worker2 # [ 6.824346] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 6.836663] systemd[1]: Detected virtualization qemu. client # [ 6.789798] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 6.839831] systemd[1]: Detected architecture arm64. client # [ 6.802762] systemd[1]: Detected virtualization qemu. worker2 # [ 6.842998] systemd[1]: Detected first boot. client # [ 6.806006] systemd[1]: Detected architecture arm64. client # [ 6.809986] systemd[1]: Detected first boot. worker2 # [ 6.851502] systemd[1]: Initializing machine ID from random generator. client # [ 6.818476] systemd[1]: Initializing machine ID from random generator. lb # [ 6.866792] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 6.877753] systemd[1]: Detected virtualization qemu. lb # [ 6.880272] systemd[1]: Detected architecture arm64. lb # [ 6.883665] systemd[1]: Detected first boot. lb # [ 6.890891] systemd[1]: Initializing machine ID from random generator. worker1 # [ 7.111548] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 7.170080] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 7.146544] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 7.205142] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 7.338690] systemd[1]: Applying preset policy. client # [ 7.331202] systemd[1]: Applying preset policy. lb # [ 7.359564] systemd[1]: Applying preset policy. worker1 # [ 7.612890] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 7.614192] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 7.618488] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 7.622075] systemd[1]: Created slice Slice /system/getty. worker1 # [ 7.624264] systemd[1]: Created slice User and Session Slice. worker1 # [ 7.626377] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 7.628834] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 7.630170] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 7.631641] systemd[1]: Expecting device /dev/ttyAMA0... worker1 # [ 7.633900] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 7.635844] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 7.637760] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 7.639666] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 7.641695] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 7.643706] systemd[1]: Reached target Path Units. worker1 # [ 7.645539] systemd[1]: Reached target Remote File Systems. worker1 # [ 7.647398] systemd[1]: Reached target Slice Units. worker1 # [ 7.649302] systemd[1]: Reached target Swaps. worker1 # [ 7.653560] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 7.658525] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 7.662775] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 7.666706] systemd[1]: Listening on Factory Reset Management. worker1 # [ 7.667986] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 7.673835] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 7.676101] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 7.681112] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 7.684228] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 7.686614] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.689319] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 7.700280] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 7.700708] systemd[1]: Listening on udev Control Socket. worker1 # [ 7.701051] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 7.707111] systemd[1]: Mounting Huge Pages File System... worker1 # [ 7.711235] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 7.718648] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 7.732823] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 7.744741] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 7.750355] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 7.805807] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 7.756922] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 7.764573] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 7.764954] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 7.765215] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 7.784223] systemd[1]: Starting Load Kernel Module fuse... worker1 # [ 7.784604] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 7.797718] systemd[1]: Starting Journal Service... client # [ 7.814530] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 7.810871] systemd[1]: Starting Load Kernel Modules... lb # [ 7.837759] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 7.871789] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 7.893756] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 7.899723] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.911824] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 7.920701] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 7.922024] systemd[1]: Mounted Huge Pages File System. worker1 # [ 7.922490] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 7.922889] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 7.923259] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 7.923623] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 7.987024] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 7.993335] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 8.026578] systemd-journald[267]: Collecting audit messages is enabled. worker1 # [ 8.044800] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 8.047204] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 8.048999] EXT4-fs (vda): re-mounted 8c8dabfc-891b-4801-962e-21c7a7e4239d. worker1 # [ 8.064055] systemd[1]: Started Journal Service. worker1 # [ 8.050397] systemd[1]: Queued start job for default target Multi-User System. worker1 # [ 8.054511] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 8.066968] systemd-modules-load[268]: Module 'atkbd' is built in worker1 # [ 8.080115] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 8.102428] fuse: init (API version 7.45) worker1 # [ 8.096718] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 8.103927] systemd-modules-load[268]: Module 'loop' is built in worker1 # [ 8.112902] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 8.130196] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 8.150377] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 8.166851] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.188688] systemd[1]: Finished Load Kernel Modules. worker1 # [ 8.193977] systemd[1]: Starting Firewall... worker1 # [ 8.202289] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 8.206865] systemd[1]: modprobe@fuse.service: Deactivated successfully. worker1 # [ 8.218094] systemd[1]: Finished Load Kernel Module fuse. worker1 # [ 8.226633] systemd[1]: Mounting FUSE Control File System... worker1 # [ 8.250185] systemd-journald[267]: Received client request to flush runtime journal. worker2 # [ 8.302049] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 8.303596] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 8.306658] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 8.310766] systemd[1]: Created slice Slice /system/getty. worker2 # [ 8.312857] systemd[1]: Created slice User and Session Slice. worker2 # [ 8.314116] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 8.315783] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 8.317132] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 8.318240] systemd[1]: Expecting device /dev/ttyAMA0... worker2 # [ 8.319309] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 8.320447] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 8.321902] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 8.323436] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 8.325002] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 8.326676] systemd[1]: Reached target Path Units. worker2 # [ 8.328063] systemd[1]: Reached target Remote File Systems. worker2 # [ 8.329555] systemd[1]: Reached target Slice Units. worker2 # [ 8.331435] systemd[1]: Reached target Swaps. worker2 # [ 8.335611] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 8.340650] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 8.344767] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 8.348837] systemd[1]: Listening on Factory Reset Management. worker2 # [ 8.350079] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 8.356182] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 8.358554] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 8.363481] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 8.326167] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 8.365611] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 8.367294] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.327797] systemd[1]: Stopped initrd-switch-root.service. client # [ 8.329658] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 8.369494] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 8.334596] systemd[1]: Created slice Slice /system/getty. client # [ 8.336836] systemd[1]: Created slice User and Session Slice. client # [ 8.338144] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 8.340253] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 8.341988] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 8.381691] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 8.382140] systemd[1]: Listening on udev Control Socket. worker1 # [ 8.319827] systemd[1]: Mounted FUSE Control File System. client # [ 8.343612] systemd[1]: Expecting device /dev/ttyAMA0... worker2 # [ 8.384144] systemd[1]: Listening on udev Varlink Socket. client # [ 8.346029] systemd[1]: Reached target Local Encrypted Volumes. client # [ 8.348123] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 8.388957] systemd[1]: Mounting Huge Pages File System... worker1 # [ 8.325030] systemd-oomd[269]: No swap; memory pressure usage will be degraded client # [ 8.350084] systemd[1]: Stopped target initrd-root-fs.target. client # [ 8.352144] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 8.393166] systemd[1]: Mounting POSIX Message Queue File System... client # [ 8.354329] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 8.330191] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 8.356491] systemd[1]: Reached target Path Units. client # [ 8.358352] systemd[1]: Reached target Remote File Systems. client # [ 8.360352] systemd[1]: Reached target Slice Units. worker1 # [ 8.335779] systemd[1]: Finished Load/Save OS Random Seed. client # [ 8.362082] systemd[1]: Reached target Swaps. worker2 # [ 8.401135] systemd[1]: Mounting Kernel Debug File System... client # [ 8.366217] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 8.339318] systemd[1]: Reached target First Boot Complete. worker1 # [ 8.344607] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 8.345845] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 8.370977] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 8.349625] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 8.374702] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 8.414152] systemd[1]: Mounting Kernel Trace File System... lb # [ 8.370720] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 8.378602] systemd[1]: Listening on Factory Reset Management. client # [ 8.379005] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 8.355105] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 8.372494] systemd[1]: Stopped initrd-switch-root.service. lb # [ 8.374356] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 8.384968] systemd[1]: Starting Journal Log Access Socket... lb # [ 8.379197] systemd[1]: Created slice Slice /system/getty. client # [ 8.387147] systemd[1]: Listening on Journal Audit Socket. lb # [ 8.380934] systemd[1]: Created slice User and Session Slice. worker2 # [ 8.426179] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 8.382070] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 8.391266] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 8.385222] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 8.386189] systemd[1]: Expecting device /dev/hvc0... lb # [ 8.386839] systemd[1]: Expecting device /dev/ttyAMA0... client # [ 8.393088] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 8.394602] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.388157] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 8.388506] systemd[1]: Stopped target initrd-fs.target. lb # [ 8.388773] systemd[1]: Stopped target initrd-root-fs.target. client # [ 8.397265] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 8.389035] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 8.389284] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 8.389544] systemd[1]: Reached target Path Units. lb # [ 8.389790] systemd[1]: Reached target Remote File Systems. lb # [ 8.390026] systemd[1]: Reached target Slice Units. lb # [ 8.390256] systemd[1]: Reached target Swaps. worker2 # [ 8.441693] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 8.399762] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 8.446507] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 8.408535] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 8.404803] systemd[1]: Listening on Process Core Dump Socket. client # [ 8.410770] systemd[1]: Listening on udev Control Socket. client # [ 8.412799] systemd[1]: Listening on udev Varlink Socket. lb # [ 8.408793] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 8.417508] systemd[1]: Mounting Huge Pages File System... lb # [ 8.412654] systemd[1]: Listening on Factory Reset Management. lb # [ 8.413843] systemd[1]: Listening on Hostname Service Socket. client # [ 8.422863] systemd[1]: Mounting POSIX Message Queue File System... lb # [ 8.419636] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 8.464553] systemd[1]: Mounting Kernel Configuration File System... lb # [ 8.421700] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 8.467910] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 8.430152] systemd[1]: Mounting Kernel Debug File System... lb # [ 8.425974] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 8.427547] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 8.472780] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 8.429163] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.432344] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 8.443265] systemd[1]: Mounting Kernel Trace File System... lb # [ 8.443565] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 8.444950] systemd[1]: Listening on udev Control Socket. worker1 # [ 8.427434] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 8.446539] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 8.490315] systemd[1]: Starting Load Kernel Module fuse... worker1 # [ 8.428832] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 8.490708] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 8.455356] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 8.431481] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 8.450862] systemd[1]: Mounting Huge Pages File System... lb # [ 8.455892] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 8.505903] systemd[1]: Starting Journal Service... lb # [ 8.461772] systemd[1]: Mounting Kernel Debug File System... client # [ 8.471585] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 8.474143] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 8.475743] systemd[1]: Mounting Kernel Trace File System... client # [ 8.484195] systemd[1]: Mounting Kernel Configuration File System... client # [ 8.486666] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 8.489626] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 8.533452] systemd[1]: Starting Load Kernel Modules... lb # [ 8.490057] systemd[1]: Starting Create List of Static Device Nodes... client # [ 8.505700] systemd[1]: Starting Load Kernel Module fuse... client # [ 8.507938] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 8.503463] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 8.506239] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 8.520871] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 8.566611] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 8.528424] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 8.531471] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 8.582698] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 8.586458] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.596224] systemd[1]: Starting Coldplug All udev Devices... client # [ 8.558166] systemd[1]: Starting Journal Service... worker2 # [ 8.603753] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 8.606100] systemd[1]: Mounted Huge Pages File System. worker2 # [ 8.608896] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 8.609366] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 8.609741] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 8.610112] systemd[1]: Mounted Kernel Configuration File System. lb # [ 8.595207] systemd[1]: Starting Load Kernel Module fuse... lb # [ 8.598232] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 8.614169] fuse: init (API version 7.45) client # [ 8.617769] systemd[1]: Starting Load Kernel Modules... lb # [ 8.614826] systemd[1]: Starting Journal Service... worker2 # [ 8.664135] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 8.602606] systemd[1]: Mounting /run/wrappers... client # [ 8.630560] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 8.672198] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 8.644498] systemd[1]: Starting Load Kernel Modules... client # [ 8.652409] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 8.659552] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.662827] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 8.651804] systemd-udevd[306]: Using default interface naming scheme 'v261'. worker2 # [ 8.722463] EXT4-fs (vda): re-mounted fb96e099-efc4-4c5b-9589-f5efd9479053. lb # [ 8.683338] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 8.669934] systemd[1]: Mounted /run/wrappers. worker2 # [ 8.735165] systemd[1]: Finished Remount Root and Kernel File Systems. lb # [ 8.690062] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.697414] systemd-journald[276]: Collecting audit messages is enabled. worker2 # [ 8.737858] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 8.673978] systemd[1]: Reached target Local File Systems. worker2 # [ 8.740217] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 8.681641] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 8.701321] fuse: init (API version 7.45) worker2 # [ 8.747328] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 8.749710] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.707453] systemd[1]: Starting Coldplug All udev Devices... client # [ 8.710404] systemd[1]: Listening on Journal Log Access Socket. client # [ 8.710803] systemd[1]: Mounted Huge Pages File System. worker2 # [ 8.756155] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 8.758926] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 8.698106] systemd[1]: Starting register-nix-paths.service... client # [ 8.707633] systemd[1]: Queued start job for default target Multi-User System. worker1 # [ 8.699885] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 8.701806] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 8.725928] systemd[1]: Mounted POSIX Message Queue File System. client # [ 8.714747] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 8.721005] systemd-modules-load[277]: Module 'atkbd' is built in lb # [ 8.728989] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 8.779236] systemd-journald[274]: Collecting audit messages is enabled. client # [ 8.727413] systemd-modules-load[277]: Module 'loop' is built in worker2 # [ 8.782713] systemd[1]: Finished Load Kernel Modules. client # [ 8.744546] systemd[1]: Started Journal Service. worker1 # [ 8.711077] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 8.722686] systemd[1]: Starting Create System Files and Directories... client # [ 8.737265] systemd[1]: Mounted Kernel Debug File System. client # [ 8.740332] systemd[1]: Mounted Kernel Trace File System. lb # [ 8.745720] systemd-journald[275]: Collecting audit messages is enabled. worker2 # [ 8.798068] systemd[1]: Starting Firewall... client # [ 8.757828] EXT4-fs (vda): re-mounted b33be005-ca40-4a05-a1fe-ff0acc2ff65a. client # [ 8.746081] systemd[1]: Finished Create List of Static Device Nodes. client # [ 8.749673] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 8.807898] systemd[1]: Starting Apply Kernel Variables... client # [ 8.757464] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 8.752285] systemd[1]: Queued start job for default target Multi-User System. client # [ 8.760545] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 8.815260] systemd[1]: Started Journal Service. client # [ 8.761479] systemd[1]: modprobe@fuse.service: Deactivated successfully. lb # [ 8.756380] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 8.773491] systemd[1]: Started Journal Service. client # [ 8.764988] systemd[1]: Finished Load Kernel Module fuse. client # [ 8.773610] systemd[1]: Finished Load Kernel Modules. client # [ 8.774391] systemd[1]: Finished Remount Root and Kernel File Systems. lb # [ 8.763163] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 8.812389] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 8.813672] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 8.771094] systemd[1]: Mounted Huge Pages File System. lb # [ 8.776747] systemd-modules-load[276]: Module 'atkbd' is built in worker2 # [ 8.840113] fuse: init (API version 7.45) lb # [ 8.782444] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 8.829402] systemd-modules-load[275]: Module 'atkbd' is built in client # [ 8.787188] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 8.786605] systemd-modules-load[276]: Module 'loop' is built in client # [ 8.796449] systemd[1]: Mounting FUSE Control File System... lb # [ 8.803975] EXT4-fs (vda): re-mounted c2eb829f-f19e-4e6f-ae63-b26aa4c7dcce. lb # [ 8.794014] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 8.840683] systemd-modules-load[275]: Module 'loop' is built in lb # [ 8.800235] systemd[1]: Mounted Kernel Trace File System. lb # [ 8.801162] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 8.802151] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 8.803243] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 8.816649] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 8.809708] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 8.850461] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 8.814099] systemd[1]: Mounted Kernel Configuration File System. lb # [ 8.821576] systemd[1]: modprobe@fuse.service: Deactivated successfully. client # [ 8.819029] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 8.822535] systemd[1]: Finished Load Kernel Module fuse. lb # [ 8.823320] systemd[1]: Finished Load Kernel Modules. client # [ 8.829924] systemd-oomd[278]: No swap; memory pressure usage will be degraded worker1 # [ 8.820661] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 8.827056] systemd[1]: Finished Remount Root and Kernel File Systems. lb # [ 8.828659] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 8.836210] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 8.834235] systemd[1]: Mounting FUSE Control File System... client # [ 8.846236] systemd[1]: Starting Apply Kernel Variables... lb # [ 8.847492] systemd[1]: Starting Firewall... worker2 # [ 8.892394] systemd[1]: modprobe@fuse.service: Deactivated successfully. lb # [ 8.849353] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 8.856154] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 8.900630] systemd[1]: Finished Load Kernel Module fuse. client # [ 8.871420] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 8.907999] systemd-oomd[276]: No swap; memory pressure usage will be degraded client # [ 8.876598] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.872808] systemd-oomd[277]: No swap; memory pressure usage will be degraded client # [ 8.882099] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 8.919330] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 8.925601] systemd[1]: Reached target First Boot Complete. lb # [ 8.885162] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 8.929720] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 8.896866] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 8.964316] systemd-journald[274]: Received client request to flush runtime journal. client # [ 8.936823] systemd-journald[276]: Received client request to flush runtime journal. lb # [ 8.930517] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 8.935882] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.946615] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 8.965125] systemd-journald[275]: Received client request to flush runtime journal. worker1 # [ 8.956441] systemd[1]: Finished Create System Files and Directories. worker1 # [ 8.965258] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 8.969444] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 9.016759] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 9.018858] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 9.023038] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 9.028708] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 9.004413] systemd[1]: Mounted FUSE Control File System. client # [ 9.005424] systemd[1]: Finished Load/Save OS Random Seed. client # [ 9.008987] systemd[1]: Finished Apply Kernel Variables. client # [ 9.010320] systemd[1]: Reached target First Boot Complete. client # [ 9.013567] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 9.007339] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 9.070190] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 9.058831] systemd[1]: Mounted FUSE Control File System. client # [ 9.076381] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 9.066387] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 9.115048] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 9.073148] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 9.118189] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 9.120747] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 9.079483] systemd[1]: Reached target First Boot Complete. worker1 # [ 9.094942] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 9.098463] systemd[1]: Finished Apply Kernel Variables. lb # [ 9.137246] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 9.145580] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 9.170499] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 9.171664] systemd[1]: Reached target Preparation for Local File Systems. client # [ 9.174103] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 9.191445] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 9.196425] systemd[1]: Starting Update is Completed... worker2 # [ 9.246439] systemd-udevd[314]: Using default interface naming scheme 'v261'. lb # [ 9.242070] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 9.288227] systemd[1]: Mounting /run/wrappers... lb # [ 9.244918] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 9.292118] systemd[1]: Mounting FUSE Control File System... lb # [ 9.253360] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 9.282732] systemd-udevd[308]: Using default interface naming scheme 'v261'. worker2 # [ 9.332885] systemd[1]: Mounted FUSE Control File System. worker1 # [ 9.301064] systemd[1]: Finished Update is Completed. client # [ 9.314231] systemd[1]: Mounting /run/wrappers... worker2 # [ 9.353818] systemd[1]: Mounted /run/wrappers. worker2 # [ 9.355105] systemd[1]: Reached target Local File Systems. worker2 # [ 9.359565] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 9.369208] systemd[1]: Starting register-nix-paths.service... worker2 # [ 9.383474] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 9.386163] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 9.397154] systemd[1]: Starting Save Transient machine-id to Disk... client # [ 9.368380] systemd[1]: Mounted /run/wrappers. client # [ 9.370198] systemd[1]: Reached target Local File Systems. worker2 # [ 9.409718] systemd[1]: Starting Create System Files and Directories... client # [ 9.374153] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 9.369422] systemd[1]: Mounting /run/wrappers... client # [ 9.383764] systemd[1]: Starting register-nix-paths.service... client # [ 9.386993] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 9.385378] systemd-udevd[321]: Using default interface naming scheme 'v261'. client # [ 9.392307] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 9.404104] systemd[1]: Starting Save Transient machine-id to Disk... client # [ 9.417803] systemd[1]: Starting Create System Files and Directories... lb # [ 9.419910] systemd[1]: Mounted /run/wrappers. lb # [ 9.423249] systemd[1]: Reached target Local File Systems. lb # [ 9.432246] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 9.437690] systemd[1]: Starting register-nix-paths.service... lb # [ 9.440723] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 9.487852] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 9.444487] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 9.496991] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 9.475923] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 9.490415] systemd[1]: Starting Create System Files and Directories... client # [ 9.499593] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 9.511349] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 9.549874] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 9.594130] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 9.617978] systemd[1]: Finished Create System Files and Directories. worker2 # [ 9.625926] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 9.636921] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 9.606483] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 9.611090] systemd[1]: Finished Create System Files and Directories. client # [ 9.623501] systemd[1]: Starting Rebuild Journal Catalog... client # [ 9.628411] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 9.622277] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 9.673968] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 9.750289] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 9.729723] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 9.735074] systemd[1]: Finished Create System Files and Directories. lb # [ 9.760188] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 9.765238] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 9.783742] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 9.826541] systemd[1]: Finished Rebuild Journal Catalog. client # [ 9.793084] systemd[1]: Starting Update is Completed... worker2 # [ 9.830407] systemd[1]: Starting Update is Completed... worker1 # [ 9.836533] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 9.838015] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 9.853455] systemd[1]: Finished Update is Completed. worker2 # [ 9.910321] systemd[1]: Finished Update is Completed. lb # [ 9.880187] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 9.920497] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 9.930523] systemd[1]: Starting Update is Completed... lb # [ 10.003390] systemd[1]: Finished Update is Completed. worker1 # [ 10.070288] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 worker1 # [ 10.278607] systemd[1]: Finished Firewall. worker2 # [ 10.358902] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 10.360223] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 10.352135] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 10.356362] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 10.389989] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 10.393940] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 10.434141] systemd[1]: Finished Coldplug All udev Devices. client # [ 10.490932] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 10.515483] systemd[1]: Finished Coldplug All udev Devices. client # [ 10.661439] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 10.746743] systemd[1]: Finished Firewall. client # [ 10.727541] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker1 # [ 10.790821] systemd[1]: Finished register-nix-paths.service. worker1 # [ 10.794259] systemd[1]: Reached target System Initialization. worker1 # [ 10.795179] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 10.797837] systemd[1]: Started Daily Cleanup of Temporary Directories. worker1 # [ 10.802163] systemd[1]: Reached target Timer Units. lb # [ 10.808983] systemd[1]: Finished register-nix-paths.service. worker1 # [ 10.803718] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 10.808964] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 10.813295] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 10.820625] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 10.841019] systemd[1]: Reached target Socket Units. worker1 # [ 10.844319] systemd[1]: Reached target Basic System. worker1 # [ 10.846537] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 10.848227] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 10.857319] systemd[1]: Starting Post-Boot Actions... worker1 # [ 10.862538] systemd[1]: Started Reset console on configuration changes. worker1 # [ 10.871815] systemd[1]: Starting resolvconf update... worker2 # [ 10.924710] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 10.880742] systemd[1]: Starting D-Bus System Message Bus... lb # [ 10.951118] systemd[1]: Finished Coldplug All udev Devices. lb # [ 10.953429] systemd[1]: Reached target System Initialization. worker2 # [ 10.994364] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 10.956330] systemd[1]: Finished Post-Boot Actions. lb # [ 10.955587] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 10.961299] systemd[1]: Started niks3 garbage collection timer. lb # [ 10.964218] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 10.971100] systemd[1]: Reached target Timer Units. lb # [ 10.972290] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 10.974518] systemd[1]: Listening on niks3 server socket. lb # [ 10.980290] systemd[1]: Listening on Nix Daemon Socket. lb # [ 10.981083] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 10.982239] systemd[1]: Reached target Socket Units. lb # [ 10.982961] systemd[1]: Reached target Basic System. lb # [ 10.983716] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 10.989659] (udev-worker)[324]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 10.982682] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 10.995420] (udev-worker)[328]: Network interface NamePolicy= disabled on kernel command line. lb # [ 10.991025] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 10.988530] systemd[1]: Reached target Host and Network Name Lookups. client # [ 10.999159] (udev-worker)[324]: Network interface NamePolicy= disabled on kernel command line. lb # [ 10.994949] systemd[1]: Starting Post-Boot Actions... worker1 # [ 10.996561] nsncd[490]: Sep 21 09:34:41.611 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 11.004542] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 11.013077] systemd[1]: Starting User Login Management... worker1 # [ 11.029923] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 11.044637] systemd[1]: Started Reset console on configuration changes. client # [ 11.070324] systemd[1]: Finished register-nix-paths.service. lb # [ 11.065120] systemd[1]: Starting resolvconf update... client # [ 11.075439] systemd[1]: Reached target System Initialization. client # [ 11.077762] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 11.080677] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 11.085951] systemd[1]: Reached target Timer Units. client # [ 11.088558] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 11.082350] systemd[1]: Started rustfs.service. client # [ 11.092349] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 11.084700] dbus-broker-launch[494]: Looking up NSS user entry for 'systemd-timesync'... client # [ 11.095544] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 11.100446] systemd[1]: Reached target Socket Units. client # [ 11.104372] systemd[1]: Reached target Basic System. client # [ 11.106562] systemd[1]: Started backdoor.service. worker1 # [ 11.101155] dbus-broker-launch[494]: NSS returned no entry for 'systemd-timesync' client # [ 11.113102] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 11.115432] systemd[1]: Starting nftables firewall... worker1 # [ 11.104891] dbus-broker-launch[494]: Invalid user-name in /nix/store/a9ijqx61hpssavy5d9lh27li51m8hnl7-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 11.125522] nsncd[493]: Sep 21 09:34:41.761 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 11.145041] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 11.138919] systemd[1]: Starting rustfs-bucket.service... worker2 # [ 11.183336] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 11.151011] systemd[1]: Starting Post-Boot Actions... lb # [ 11.150677] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 11.147926] systemd[1]: Started D-Bus System Message Bus. lb # [ 11.169359] systemd[1]: Finished Post-Boot Actions. worker2 # [ 11.223586] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker1 # [ 11.180309] systemd-logind[502]: New seat seat0. client # [ 11.190496] systemd[1]: Started Reset console on configuration changes. worker1 # [ 11.189309] systemd[1]: Started User Login Management. worker1 # [ 11.192222] systemd[1]: Starting linger-users.service... lb # [ 11.203461] systemd[1]: Finished Firewall. worker1 # [ 11.207622] dbus-broker-launch[494]: Ready client # [ 11.221919] systemd[1]: Starting resolvconf update... lb # [ 11.220494] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 11.224184] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 11.229255] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 11.234920] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 11.240229] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 11.241914] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 11.246128] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 11.249895] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 11.255119] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # connecting to host... worker1 # [ 11.264471] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 11.268220] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 11.273374] systemd[1]: Starting User Login Management... worker1 # [ 11.274500] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 11.329477] systemd[1]: Finished register-nix-paths.service. worker2 # [ 11.332418] systemd[1]: Reached target System Initialization. client # [ 11.297003] systemd[1]: Finished Post-Boot Actions. worker2 # [ 11.335583] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 11.338564] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 11.296942] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 11.340725] systemd[1]: Reached target Timer Units. worker2 # [ 11.342452] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 11.345366] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 11.348828] systemd[1]: Listening on Nix worker-protocol over gRPC. client: Guest shell says: b'Spawning backdoor root shell...\n' worker2 # [ 11.351120] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 11.308570] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 11.357050] systemd[1]: Reached target Socket Units. client # [ 11.332943] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 11.365289] systemd[1]: Reached target Basic System. client # [ 11.334147] nsncd[401]: Sep 21 09:34:41.928 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.368334] systemd[1]: Started backdoor.service. client # [ 11.346973] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 11.373228] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 11.361667] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 11.311574] systemd[1]: Finished linger-users.service. client: connected to guest root shell worker2 # [ 11.384387] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 11.367752] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 11.348525] systemd[1]: Started Name Service Cache Daemon (nsncd). client: (connecting took 11.83 seconds) worker2 # [ 11.390412] systemd[1]: Starting Post-Boot Actions... client # [ 11.376114] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 11.352407] nsncd[559]: Sep 21 09:34:41.975 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client: (finished: waiting for the VM to finish booting, in 11.83 seconds) worker2 # [ 11.391946] systemd[1]: Started Reset console on configuration changes. client # [ 11.387837] systemd[1]: Starting User Login Management... worker2 # [ 11.404339] systemd[1]: Starting resolvconf update... worker1 # [ 11.357500] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 11.416107] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 11.359927] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 11.388222] systemd[1]: Finished resolvconf update. worker1 # [ 11.392838] systemd[1]: Reached target Preparation for Network. worker1 # [ 11.397955] systemd[1]: Starting DHCP Client... worker1 # [ 11.402676] systemd[1]: Starting Extra networking commands.... worker1 # [ 11.426167] systemd[1]: Starting Virtual Console Setup... worker1 # [ 11.450045] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 11.457058] systemd[1]: Stopped Virtual Console Setup. client # [ 11.469670] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 11.463685] systemd[1]: Starting Virtual Console Setup... worker2 # [ 11.516134] systemd[1]: Finished Post-Boot Actions. worker1 # [ 11.491046] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 11.498003] dbus-broker-launch[528]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 11.507886] dbus-broker-launch[528]: NSS returned no entry for 'systemd-timesync' worker2 # [ 11.564476] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # connecting to host... lb # [ 11.515598] dbus-broker-launch[528]: Invalid user-name in /nix/store/kxmx3smba321l9v2dpmh9zahhsbc77yh-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 11.573182] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 11.582781] nsncd[497]: Sep 21 09:34:42.175 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.592106] systemd[1]: Reached target User and Group Name Lookups. lb # [ 11.552915] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 11.600081] systemd[1]: Starting User Login Management... lb # [ 11.566058] systemd-logind[531]: New seat seat0. worker2 # [ 11.612673] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 11.574893] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 11.582606] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 11.589993] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 11.590931] systemd[1]: Stopping User and Group Name Lookups... lb # [ 11.591776] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 11.605481] systemd[1]: Started User Login Management. lb # [ 11.612428] systemd[1]: nscd.service: Deactivated successfully. lb # [ 11.613281] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 11.630586] dbus-broker-launch[432]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 11.628485] dbus-broker-launch[528]: Ready lb # [ 11.632707] systemd[1]: Starting linger-users.service... client # [ 11.640774] systemd-logind[434]: Watching system buttons on /dev/input/event0 (gpio-keys) client # [ 11.654084] systemd-logind[434]: New seat seat0. client # [ 11.654883] dbus-broker-launch[432]: NSS returned no entry for 'systemd-timesync' worker2 # [ 11.693511] dbus-broker-launch[502]: Looking up NSS user entry for 'systemd-timesync'... client # [ 11.655933] dbus-broker-launch[432]: Invalid user-name in /nix/store/ydh4ywywm30g15n5m6x5vfz42682s2cc-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 11.655922] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 11.713621] dbus-broker-launch[502]: NSS returned no entry for 'systemd-timesync' client # [ 11.678485] systemd[1]: Started User Login Management. worker2 # [ 11.721776] dbus-broker-launch[502]: Invalid user-name in /nix/store/a9ijqx61hpssavy5d9lh27li51m8hnl7-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 11.688780] systemd[1]: Starting linger-users.service... client # [ 11.713140] mousedev: PS/2 mouse device common for all mice worker1 # [ 11.692167] dhcpcd[596]: dhcpcd-10.3.2 starting worker2 # [ 11.752979] systemd[1]: Started D-Bus System Message Bus. client # [ 11.718829] systemd[1]: Started D-Bus System Message Bus. worker1 # [ 11.709384] dhcpcd[635]: dev: loaded udev worker1 # [ 11.715384] dhcpcd[635]: no valid interfaces found worker1 # [ 11.719219] dhcpcd[635]: no valid interfaces found worker2 # [ 11.778916] systemd-logind[511]: New seat seat0. worker2 # [ 11.779715] systemd[1]: Started User Login Management. client # [ 11.750026] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 11.788473] systemd[1]: Starting linger-users.service... client # [ 11.754758] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 11.753394] systemd[1]: Finished resolvconf update. client # [ 11.762074] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 11.752769] systemd[1]: Finished Extra networking commands.. client # [ 11.762986] systemd[1]: Stopping User and Group Name Lookups... client # [ 11.763782] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 11.756273] systemd[1]: Reached target Network. worker1 # [ 11.758899] systemd[1]: Starting Permit User Sessions... lb # [ 11.765874] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 11.809667] dbus-broker-launch[502]: Ready client # [ 11.773313] systemd[1]: nscd.service: Deactivated successfully. lb # [ 11.770300] systemd[1]: Finished linger-users.service. client # [ 11.778218] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 11.824006] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 11.779604] nsncd[588]: Sep 21 09:34:42.413 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 11.791821] dbus-broker-launch[432]: Ready worker2 # [ 11.828817] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 11.789171] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 11.792862] systemd[1]: Reached target Preparation for Network. worker2 # [ 11.835525] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 11.796819] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 11.841796] systemd[1]: Stopping User and Group Name Lookups... client # [ 11.807404] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 11.801960] systemd[1]: Reached target User and Group Name Lookups. lb # [ 11.806256] systemd[1]: Starting DHCP Client... worker2 # [ 11.849883] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 11.811224] systemd[1]: linger-users.service: Deactivated successfully. client # [ 11.816317] systemd[1]: Finished linger-users.service. lb # [ 11.813026] systemd[1]: Starting Extra networking commands.... worker1 # [ 11.808694] systemd[1]: Finished Permit User Sessions. worker2 # [ 11.857940] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 11.858833] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 11.814721] systemd[1]: Started Getty on tty1. lb # [ 11.815726] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 11.817380] systemd[1]: Reached target Login Prompts. worker2 # [ 11.860005] (udev-worker)[377]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 11.870744] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 11.878746] (udev-worker)[375]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 11.887647] (udev-worker)[375]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 11.906544] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 11.907513] systemd[1]: Finished linger-users.service. lb # [ 11.876550] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. lb # [ 11.891677] systemd[1]: Started backdoor.service. client # [ 11.904866] nsncd[497]: Sep 21 09:34:42.500 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 11.913334] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 11.949167] nsncd[569]: Sep 21 09:34:42.557 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.951480] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 11.917496] systemd[1]: Reached target Host and Network Name Lookups. client # [ 11.918472] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 11.957321] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 11.961870] systemd[1]: Reached target User and Group Name Lookups. client # [ 11.929371] systemd[1]: Finished resolvconf update. client # [ 11.940368] systemd[1]: Starting DHCP Client... worker2 # [ 11.994700] systemd[1]: Finished resolvconf update. worker2 # [ 11.996799] systemd[1]: Reached target Preparation for Network. worker2 # [ 12.003015] systemd[1]: Starting DHCP Client... worker2 # [ 12.006620] systemd[1]: Starting Extra networking commands.... worker1 # [ 11.963743] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 12.023059] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker1 # [ 12.029654] systemd[1]: Started backdoor.service. lb # connecting to host... worker2 # [ 12.098693] systemd-logind[511]: Watching system buttons on /dev/input/event0 (gpio-keys) worker1 # [ 12.095545] 8021q: 802.1Q VLAN Support v1.8 client # [ 12.101074] systemd-logind[434]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) client # [ 12.157710] dhcpcd[533]: dhcpcd-10.3.2 starting client # [ 12.172936] dhcpcd[544]: dev: loaded udev worker1 # [ 12.165765] systemd-vconsole-setup[593]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 12.187001] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 12.183557] dhcpcd[622]: dhcpcd-10.3.2 starting worker1 # [ 12.179605] systemd[1]: Finished Virtual Console Setup. worker1 # connecting to host... client # [ 12.207113] systemd[1]: Finished nftables firewall. lb # [ 12.201554] dhcpcd[671]: dev: loaded udev client # [ 12.212109] systemd[1]: Reached target Preparation for Network. worker2 # [ 12.252348] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 12.222247] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 12.222747] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' client # [ 12.233502] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 12.258758] systemd[1]: Starting Address configuration of eth1... client # [ 12.222726] systemd[1]: Starting Address configuration of eth1... worker1 # [ 12.227395] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 12.227718] cfg80211: failed to load regulatory.db client # [ 12.227306] systemd[1]: Starting Extra networking commands.... worker2 # [ 12.265430] dhcpcd[606]: dhcpcd-10.3.2 starting worker2 # [ 12.280753] dhcpcd[645]: dev: loaded udev lb # [ 12.248275] systemd[1]: Finished Extra networking commands.. worker1 # [ 12.245351] (udev-worker)[651]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 12.248297] (udev-worker)[656]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 12.313069] mousedev: PS/2 mouse device common for all mice worker1 # [ 12.250402] (udev-worker)[656]: Network interface NamePolicy= disabled on kernel command line. lb # [ 12.253619] systemd[1]: Reached target Network. lb # [ 12.275179] 8021q: 802.1Q VLAN Support v1.8 lb # [ 12.266571] systemd[1]: Starting PostgreSQL Server... worker2 # [ 12.339111] 8021q: 802.1Q VLAN Support v1.8 lb # [ 12.285257] systemd[1]: Starting Permit User Sessions... worker2 # [ 12.360059] systemd[1]: Finished Extra networking commands.. worker2 # [ 12.363982] systemd[1]: Reached target Network. worker2 # [ 12.367018] systemd[1]: Starting Permit User Sessions... client # [ 12.361464] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 12.429080] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 12.396714] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 12.392799] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 12.416944] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 12.458570] 8021q: adding VLAN 0 to HW filter on device eth1 client # [ 12.417445] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 12.401800] systemd[1]: Finished Permit User Sessions. worker1 # [ 12.399045] systemd[1]: Starting Address configuration of eth1... client # [ 12.423287] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 12.423604] cfg80211: failed to load regulatory.db client # [ 12.413391] network-addresses-eth1-start[548]: adding address 192.168.1.1/24... done worker2 # [ 12.468181] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 12.468664] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 12.408561] systemd-logind[502]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker2 # [ 12.477826] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 12.478161] cfg80211: failed to load regulatory.db worker2 # [ 12.459179] systemd[1]: Finished Permit User Sessions. worker2 # [ 12.467557] systemd[1]: Started Getty on tty1. worker2 # [ 12.469365] systemd[1]: Reached target Login Prompts. client # [ 12.431740] network-addresses-eth1-start[548]: adding address 2001:db8:1::1/64... done lb # [ 12.432450] systemd[1]: Started Getty on tty1. lb # [ 12.433319] systemd[1]: Reached target Login Prompts. worker1 # [ 12.437103] systemd-logind[502]: Watching system buttons on /dev/input/event0 (gpio-keys) worker2 # [ 12.488551] network-addresses-eth1-start[643]: adding address 192.168.1.4/24... done lb # [ 12.462566] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 12.466540] systemd[1]: Finished Address configuration of eth1. lb # [ 12.460515] (udev-worker)[466]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 12.508247] network-addresses-eth1-start[643]: adding address 2001:db8:1::4/64... done lb # [ 12.466159] (udev-worker)[366]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 12.476706] (udev-worker)[366]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 12.536496] systemd[1]: Finished Address configuration of eth1. lb # [ 12.508054] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 12.508536] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 12.507103] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 12.494938] dhcpcd[635]: eth0: waiting for carrier lb # [ 12.513340] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 12.513659] cfg80211: failed to load regulatory.db worker1 # [ 12.497665] dhcpcd[635]: eth0: carrier acquired client # [ 12.507422] dhcpcd[593]: /nix/store/grcr27glg0bai58hwyh3zxlj5sf30hhx-openresolv-3.17.4/sbin/.resolvconf-wrapped: line 1250: kill: (553) - Operation not permitted client # [ 12.513533] dhcpcd[593]: .resolvconf-wrapped: clearing stale lock pid 553 worker1 # [ 12.529989] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 12.513605] dhcpcd[635]: DUID 00:01:00:01:32:43:b6:b3:52:54:00:12:34:56 worker1 # [ 12.518375] dhcpcd[635]: eth0: IAID 00:12:34:56 worker1 # [ 12.519121] dhcpcd[635]: eth0: adding address fe80::5054:ff:fe12:3456 worker2 # [ 12.587529] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 12.572682] dhcpcd[645]: eth0: waiting for carrier worker2 # [ 12.573466] dhcpcd[645]: eth0: carrier acquired worker1 # [ 12.537544] network-addresses-eth1-start[678]: adding address 192.168.1.3/24... done worker2 # [ 12.590775] dhcpcd[645]: DUID 00:01:00:01:32:43:b6:b3:52:54:00:12:34:56 worker2 # [ 12.591792] dhcpcd[645]: eth0: IAID 00:12:34:56 worker2 # [ 12.593638] dhcpcd[645]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 12.572600] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 12.560479] dhcpcd[544]: eth0: waiting for carrier worker1 # [ 12.552677] network-addresses-eth1-start[678]: adding address 2001:db8:1::3/64... done client # [ 12.563113] dhcpcd[544]: libudev: received NULL device client # [ 12.565272] dhcpcd[544]: libudev: received NULL device client # [ 12.569010] dhcpcd[544]: eth0: carrier acquired worker2 # [ 12.619598] systemd-logind[511]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker1 # [ 12.575179] systemd[1]: Finished Address configuration of eth1. client # [ 12.583794] systemd[1]: Finished Extra networking commands.. client # [ 12.588156] systemd[1]: Reached target Network. client # [ 12.589938] dhcpcd[544]: DUID 00:01:00:01:32:43:b6:b3:52:54:00:12:34:56 client # [ 12.590911] dhcpcd[544]: eth0: IAID 00:12:34:56 client # [ 12.591540] dhcpcd[544]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 12.596760] systemd[1]: Starting Permit User Sessions... worker1 # [ 12.612057] mousedev: PS/2 mouse device common for all mice lb # [ 12.614820] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 12.634111] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 12.623927] dhcpcd[671]: eth0: waiting for carrier lb # [ 12.626519] dhcpcd[671]: eth0: waiting for carrier lb # [ 12.628890] systemd[1]: Starting Address configuration of eth1... lb # [ 12.633537] dhcpcd[671]: eth0: carrier acquired client # [ 12.641746] systemd[1]: Finished Permit User Sessions. client # [ 12.649368] systemd[1]: Started Getty on tty1. client # [ 12.651872] systemd[1]: Reached target Login Prompts. lb # [ 12.661636] dhcpcd[671]: DUID 00:01:00:01:32:43:b6:b3:52:54:00:12:34:56 lb # [ 12.665009] dhcpcd[671]: eth0: IAID 00:12:34:56 lb # [ 12.667984] dhcpcd[671]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 12.673065] systemd-logind[502]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) lb # [ 12.745190] postgresql-pre-start[701]: The files belonging to this database system will be owned by user "postgres". lb # [ 12.749332] postgresql-pre-start[701]: This user must also own the server process. lb # [ 12.763202] postgresql-pre-start[701]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 12.767553] postgresql-pre-start[701]: The default database encoding has accordingly been set to "UTF8".[ 12.788038] 8021q: adding VLAN 0 to HW filter on device eth1 lb # lb # [ 12.776950] postgresql-pre-start[701]: The default text search configuration will be set to "english". lb # [ 12.778197] postgresql-pre-start[701]: Data page checksums are enabled. lb # [ 12.779059] postgresql-pre-start[701]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 12.790434] postgresql-pre-start[701]: creating subdirectories ... ok lb # [ 12.796136] postgresql-pre-start[701]: selecting dynamic shared memory implementation ... posix client: (finished: waiting for unit network-addresses-eth1.service, in 13.24 seconds) lb # [ 12.815477] network-addresses-eth1-start[712]: adding address 192.168.1.2/24... done client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } lb # [ 12.836093] network-addresses-eth1-start[712]: adding address 2001:db8:1::2/64... done client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.05 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb # [ 12.878305] systemd[1]: Finished Address configuration of eth1. lb: (finished: waiting for unit network-addresses-eth1.service, in 0.14 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } lb # [ 13.022230] postgresql-pre-start[701]: selecting default "max_connections" ... 100 lb # [ 13.032398] systemd-logind[531]: Watching system buttons on /dev/input/event0 (gpio-keys) lb # [ 13.077075] dhcpcd[671]: eth0: soliciting a DHCP lease lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.08 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb # [ 13.085632] dhcpcd[671]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 13.092247] dhcpcd[671]: eth0: probing address 10.0.2.15/24 worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.10 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } client # [ 13.224262] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 13.215074] postgresql-pre-start[701]: selecting default "shared_buffers" ... 128MB worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.05 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker2 # [ 13.348228] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 worker1 # [ 13.304629] dhcpcd[635]: eth0: soliciting a DHCP lease worker1 # [ 13.308553] dhcpcd[635]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 13.316240] dhcpcd[635]: eth0: probing address 10.0.2.15/24 worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.11 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } lb # [ 13.374598] mousedev: PS/2 mouse device common for all mice lb # [ 13.365206] rustfs-bucket-start[752]: mb s3://farm lb # [ 13.377248] systemd[1]: Finished rustfs-bucket.service. worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.05 seconds) lb: waiting for unit niks3.service client # [ 13.518895] systemd[1]: Starting Virtual Console Setup... client # [ 13.538457] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 13.542306] systemd[1]: Stopped Virtual Console Setup. client # [ 13.558544] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. client # [ 13.566130] systemd[1]: Starting Virtual Console Setup... client # [ 13.615775] systemd-logind[434]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 13.622019] systemd-logind[531]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker2 # [ 13.680120] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 13.685979] systemd[1]: Starting Virtual Console Setup... worker2 # [ 13.706611] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 13.713918] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 13.716190] systemd[1]: Starting Virtual Console Setup... worker1 # [ 13.690800] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 13.698856] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 13.699923] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 13.703051] systemd[1]: Stopping Virtual Console Setup... worker1 # [ 13.709432] systemd[1]: Starting Virtual Console Setup... worker2 # [ 13.771010] systemd-logind[511]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 13.723163] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 13.727365] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 13.728825] systemd[1]: Starting Virtual Console Setup... worker1 # [ 13.748468] dhcpcd[635]: eth0: soliciting an IPv6 router worker1 # [ 13.749983] dhcpcd[635]: eth0: Router Advertisement from fe80::2 worker1 # [ 13.751104] dhcpcd[635]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 13.752463] dhcpcd[635]: eth0: adding route to fec0::/64 worker1 # [ 13.753575] dhcpcd[635]: eth0: adding default route via fe80::2 worker2 # [ 13.929871] dhcpcd[645]: eth0: soliciting an IPv6 router worker2 # [ 13.930784] dhcpcd[645]: eth0: Router Advertisement from fe80::2 worker2 # [ 13.931597] dhcpcd[645]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 13.932605] dhcpcd[645]: eth0: adding route to fec0::/64 worker2 # [ 13.933449] dhcpcd[645]: eth0: adding default route via fe80::2 client # [ 13.963546] systemd-vconsole-setup[651]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 13.968076] systemd[1]: Finished Virtual Console Setup. worker1 # [ 14.049081] systemd-vconsole-setup[711]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 14.053806] systemd[1]: Finished Virtual Console Setup. worker2 # [ 14.142388] systemd-vconsole-setup[709]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 14.146385] systemd[1]: Finished Virtual Console Setup. client # [ 14.425430] dhcpcd[544]: eth0: soliciting an IPv6 router client # [ 14.428985] dhcpcd[544]: eth0: Router Advertisement from fe80::2 client # [ 14.431557] dhcpcd[544]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 14.434542] dhcpcd[544]: eth0: adding route to fec0::/64 client # [ 14.436871] dhcpcd[544]: eth0: adding default route via fe80::2 lb # [ 14.518863] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 client # [ 14.518525] dhcpcd[544]: eth0: soliciting a DHCP lease client # [ 14.525030] dhcpcd[544]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 14.528486] dhcpcd[544]: eth0: probing address 10.0.2.15/24 worker2 # [ 14.587382] dhcpcd[645]: eth0: soliciting a DHCP lease worker2 # [ 14.590755] dhcpcd[645]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 14.596468] dhcpcd[645]: eth0: probing address 10.0.2.15/24 lb # [ 14.988088] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 14.999875] systemd[1]: Starting Virtual Console Setup... lb # [ 15.048397] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 15.049454] systemd[1]: Stopped Virtual Console Setup. lb # [ 15.057006] systemd[1]: Starting Virtual Console Setup... lb # [ 15.118403] systemd-logind[531]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 15.127400] dhcpcd[671]: eth0: soliciting an IPv6 router lb # [ 15.128387] dhcpcd[671]: eth0: Router Advertisement from fe80::2 lb # [ 15.129503] dhcpcd[671]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 15.130948] dhcpcd[671]: eth0: adding route to fec0::/64 lb # [ 15.132772] dhcpcd[671]: eth0: adding default route via fe80::2 lb # [ 15.504965] systemd-vconsole-setup[783]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 15.509547] systemd[1]: Finished Virtual Console Setup. lb # [ 15.786759] postgresql-pre-start[701]: selecting default time zone ... UTC lb # [ 15.791599] postgresql-pre-start[701]: creating configuration files ... ok lb # [ 16.137277] postgresql-pre-start[701]: running bootstrap script ... ok lb # [ 16.895900] postgresql-pre-start[701]: performing post-bootstrap initialization ... ok lb # [ 17.094886] postgresql-pre-start[701]: syncing data to disk ... ok lb # [ 17.097717] postgresql-pre-start[701]: initdb: warning: enabling "trust" authentication for local connections lb # [ 17.099330] postgresql-pre-start[701]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 17.103248] postgresql-pre-start[701]: Success. You can now start the database server using: lb # [ 17.104697] postgresql-pre-start[701]: pg_ctl -D /var/lib/postgresql/18 -l logfile start lb # [ 17.246873] postgres[817]: [817] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 17.250925] postgres[817]: [817] LOG: listening on IPv6 address "::1", port 5432 lb # [ 17.252321] postgres[817]: [817] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 17.254087] postgres[817]: [817] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 17.270937] postgres[826]: [826] LOG: database system was shut down at 2026-09-21 09:34:47 GMT lb # [ 17.276652] postgres[817]: [817] LOG: database system is ready to accept connections lb # [ 17.281561] systemd[1]: Started PostgreSQL Server. lb # [ 17.294337] systemd[1]: Starting niks3 server... lb # [ 17.301094] systemd[1]: Starting PostgreSQL Setup Scripts... worker1 # [ 17.594153] dhcpcd[635]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 17.601373] dhcpcd[635]: eth0: adding route to 10.0.2.0/24 worker1 # [ 17.603809] dhcpcd[635]: eth0: adding default route via 10.0.2.2 lb # [ 17.628816] postgres[845]: [845] FATAL: role "niks3" does not exist lb # [ 17.644849] postgres[846]: [846] FATAL: role "niks3" does not exist lb # [ 17.650555] niks3-server[829]: 2026/09/21 09:34:48 ERROR Failed to run server error="failed to connect to database: failed to migrate db: failed to connect to `user=niks3 database=niks3`: /var/run/postgresql/.s.PGSQL.5432 (/var/run/postgresql): server error: FATAL: role \"niks3\" does not exist (SQLSTATE 28000); failed to connect to `user=niks3 database=niks3`: /var/run/postgresql/.s.PGSQL.5432 (/var/run/postgresql): server error: FATAL: role \"niks3\" does not exist (SQLSTATE 28000)" lb # [ 17.668768] systemd[1]: niks3.service: Main process exited, code=exited, status=1/FAILURE lb # [ 17.670077] systemd[1]: niks3.service: Failed with result 'exit-code'. lb # [ 17.679003] systemd[1]: Failed to start niks3 server. lb # [ 17.712869] postgresql-setup-start[842]: CREATE DATABASE lb # [ 17.775985] postgresql-setup-start[853]: CREATE ROLE lb # [ 17.803517] postgresql-setup-start[855]: ALTER DATABASE worker1 # [ 17.807797] systemd[1]: Started DHCP Client. lb # [ 17.811968] systemd[1]: Finished PostgreSQL Setup Scripts. worker1 # [ 17.810394] systemd[1]: Reached target Multi-User System. lb # [ 17.814205] systemd[1]: Reached target PostgreSQL. worker1 # [ 17.811260] systemd[1]: Startup finished in 942ms (kernel) + 4.655s (initrd) + 12.211s (userspace) = 17.809s. lb # [ 18.379460] dhcpcd[671]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 18.387093] dhcpcd[671]: eth0: adding route to 10.0.2.0/24 lb # [ 18.391239] dhcpcd[671]: eth0: adding default route via 10.0.2.2 lb # [ 18.602801] systemd[1]: Started DHCP Client. lb # [ 18.605678] systemd[1]: Reached target Network is Online. lb # [ 18.611545] systemd[1]: Started Envoy reverse proxy. lb # [ 18.620865] systemd[1]: Started mock-oidc.service. lb # [ 18.622410] systemd[1]: Reached target Multi-User System. lb # [ 18.624732] systemd[1]: Startup finished in 931ms (kernel) + 5.442s (initrd) + 12.249s (userspace) = 18.623s. lb # [ 18.730926] mock-oidc-server[918]: Mock OIDC Server running lb # [ 18.732177] mock-oidc-server[918]: OIDC Address: 192.168.1.2:8080 lb # [ 18.733833] mock-oidc-server[918]: Issue Address: 0.0.0.0:8081 lb # [ 18.735168] mock-oidc-server[918]: Issuer: http://192.168.1.2:8080/oidc lb # [ 18.736570] mock-oidc-server[918]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 18.738422] mock-oidc-server[918]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 18.739899] mock-oidc-server[918]: Issue tokens: http://0.0.0.0:8081/issue?sub=... lb # [ 19.385889] envoy[917]: [2026-09-21 09:34:50.021][917][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120) lb # [ 19.388875] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 19.390473] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 19.393087] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 19.409256] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 19.414052] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 19.417602] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 19.421743] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 19.423873] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 19.426096] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 19.429285] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 19.460878] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 19.463775] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 19.472276] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 19.474667] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 19.477198] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 19.479158] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 19.482666] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 19.485145] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 19.487690] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 19.495842] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 19.498771] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 19.501608] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 19.507152] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 19.515992] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 19.518576] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 19.520991] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 19.523794] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 19.525889] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 19.529475] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 19.532574] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 19.535619] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 19.538537] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 19.545855] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 19.556180] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 19.558156] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 19.564716] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 19.567086] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 19.570569] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 19.574296] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 19.581812] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 19.586751] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 19.589456] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 19.591597] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 19.594627] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 19.597876] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 19.599525] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service client # [ 19.613144] dhcpcd[544]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 19.616589] dhcpcd[544]: eth0: adding route to 10.0.2.0/24 lb # [ 19.604406] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port client # [ 19.618468] dhcpcd[544]: eth0: adding default route via 10.0.2.2 lb # [ 19.613461] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 19.615818] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 19.618012] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 19.621317] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 19.623837] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 19.628529] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 19.630837] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 19.632905] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 19.636642] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 19.638672] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 19.641603] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 19.643486] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 19.646590] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 19.651543] envoy[917]: [2026-09-21 09:34:50.024][917][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 19.653777] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 19.656131] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 19.661212] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 19.664238] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 19.666028] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 19.667959] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 19.670976] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain worker2 # [ 19.715281] dhcpcd[645]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 19.673234] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 19.674977] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 19.678552] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr worker2 # [ 19.722146] dhcpcd[645]: eth0: adding route to 10.0.2.0/24 lb # [ 19.681025] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case worker2 # [ 19.725320] dhcpcd[645]: eth0: adding default route via 10.0.2.2 lb # [ 19.683506] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 19.686133] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 19.688550] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 19.694209] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 19.698345] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 19.700272] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 19.703738] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 19.708729] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 19.710826] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 19.714595] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 19.728462] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 19.730335] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 19.733658] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 19.735618] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 19.737607] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 19.740226] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 19.742450] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 19.744401] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 19.747444] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 19.750876] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 19.753303] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 19.755804] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 19.759606] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 19.761528] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 19.765219] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 19.767463] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 19.769819] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation client # [ 19.787719] systemd[1]: Started DHCP Client. lb # [ 19.771975] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params client # [ 19.791378] systemd[1]: Reached target Multi-User System. lb # [ 19.783665] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua client # [ 19.793269] systemd[1]: Startup finished in 976ms (kernel) + 5.332s (initrd) + 13.483s (userspace) = 19.792s. lb # [ 19.785713] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 19.788562] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 19.790593] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 19.792716] envoy[917]: [2026-09-21 09:34:50.025][917][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 19.794747] envoy[917]: [2026-09-21 09:34:50.045][917][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 19.796985] envoy[917]: [2026-09-21 09:34:50.065][917][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 19.812985] envoy[917]: [2026-09-21 09:34:50.065][917][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 19.814562] envoy[917]: [2026-09-21 09:34:50.065][917][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 19.823963] envoy[917]: [2026-09-21 09:34:50.065][917][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 19.825990] envoy[917]: [2026-09-21 09:34:50.317][917][info][main] [source/server/server.cc:968] runtime: {} lb # [ 19.827425] envoy[917]: [2026-09-21 09:34:50.334][917][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 19.829782] envoy[917]: [2026-09-21 09:34:50.334][917][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 19.831601] envoy[917]: [2026-09-21 09:34:50.334][917][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 19.835279] envoy[917]: [2026-09-21 09:34:50.340][917][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 19.837050] envoy[917]: [2026-09-21 09:34:50.340][917][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 19.838782] envoy[917]: [2026-09-21 09:34:50.340][917][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) worker2 # [ 19.907937] systemd[1]: Started DHCP Client. lb # [ 19.865486] envoy[917]: [2026-09-21 09:34:50.501][917][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) worker2 # [ 19.912583] systemd[1]: Reached target Multi-User System. worker2 # [ 19.913467] systemd[1]: Startup finished in 959ms (kernel) + 5.386s (initrd) + 13.565s (userspace) = 19.910s. worker2 # [ 19.917735] systemd[1]: Reached target Network is Online. lb # [ 19.875060] envoy[917]: [2026-09-21 09:34:50.511][917][info][config] [source/server/configuration_impl.cc:164] loading stats configuration worker2 # [ 19.920807] systemd[1]: Starting scheduler-token.service... lb # [ 19.878002] envoy[917]: [2026-09-21 09:34:50.514][917][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 19.881563] envoy[917]: [2026-09-21 09:34:50.514][917][info][main] [source/server/server.cc:1077] starting main dispatch loop worker1 # [ 19.889467] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 20.020539] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 20.022522] systemd[1]: Finished scheduler-token.service. worker2 # [ 20.026555] systemd[1]: scheduler-token.service: Consumed 31ms CPU time over 101ms wall clock time, 2.9M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 20.030058] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 20.169969] nix-grpc-daemon[776]: ts=2026-09-21T09:34:50Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 20.186829] nix-grpc-daemon[776]: ts=2026-09-21T09:34:50Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 20.189347] nix-grpc-daemon[776]: ts=2026-09-21T09:34:50Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 20.264152] nix-grpc-daemon[777]: ts=2026-09-21T09:34:50Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 20.229333] nix-grpc-daemon[776]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 20.230923] nix-grpc-daemon[776]: E0000 00:00:1789983290.856100 776 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 20.279239] nix-grpc-daemon[777]: ts=2026-09-21T09:34:50Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 20.281989] nix-grpc-daemon[777]: ts=2026-09-21T09:34:50Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 20.245564] nix-grpc-daemon[776]: E0000 00:00:1789983290.872388 776 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 20.250466] nix-grpc-daemon[776]: ts=2026-09-21T09:34:50Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 20.254630] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 20.323279] nix-grpc-daemon[777]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 20.325202] nix-grpc-daemon[777]: E0000 00:00:1789983290.932920 777 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 20.284091] nix-grpc-daemon[776]: E0000 00:00:1789983290.910090 818 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 20.338872] nix-grpc-daemon[777]: E0000 00:00:1789983290.948539 777 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 20.342773] nix-grpc-daemon[777]: ts=2026-09-21T09:34:50Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket lb # [ 20.305247] envoy[917]: [2026-09-21 09:34:50.941][917][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization worker2 # [ 20.348992] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 20.313988] envoy[917]: [2026-09-21 09:34:50.941][917][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized worker1 # [ 20.318144] nix-grpc-daemon[776]: E0000 00:00:1789983290.944783 818 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb # [ 20.321256] envoy[917]: [2026-09-21 09:34:50.941][917][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager worker1 # [ 20.324099] nix-grpc-daemon[776]: E0000 00:00:1789983290.948318 818 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 20.374515] nix-grpc-daemon[777]: E0000 00:00:1789983290.983267 819 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 20.331832] envoy[917]: [2026-09-21 09:34:50.968][917][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker1 # [ 20.349862] nix-grpc-daemon[776]: E0000 00:00:1789983290.976820 818 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 20.397560] nix-grpc-daemon[777]: E0000 00:00:1789983291.007429 819 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 20.400682] nix-grpc-daemon[777]: E0000 00:00:1789983291.010758 819 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 20.367679] nix-grpc-daemon[776]: ts=2026-09-21T09:34:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.371346] nix-grpc-daemon[776]: ts=2026-09-21T09:34:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.427001] nix-grpc-daemon[777]: E0000 00:00:1789983291.035976 819 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 20.443869] nix-grpc-daemon[777]: ts=2026-09-21T09:34:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.445862] nix-grpc-daemon[777]: ts=2026-09-21T09:34:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.573349] nix-grpc-daemon[776]: ts=2026-09-21T09:34:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.579064] nix-grpc-daemon[776]: ts=2026-09-21T09:34:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.648771] nix-grpc-daemon[777]: ts=2026-09-21T09:34:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.654141] nix-grpc-daemon[777]: ts=2026-09-21T09:34:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.780312] nix-grpc-daemon[776]: ts=2026-09-21T09:34:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.786361] nix-grpc-daemon[776]: ts=2026-09-21T09:34:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.855748] nix-grpc-daemon[777]: ts=2026-09-21T09:34:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.861526] nix-grpc-daemon[777]: ts=2026-09-21T09:34:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.987618] nix-grpc-daemon[776]: ts=2026-09-21T09:34:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.994462] nix-grpc-daemon[776]: ts=2026-09-21T09:34:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.063186] nix-grpc-daemon[777]: ts=2026-09-21T09:34:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.068899] nix-grpc-daemon[777]: ts=2026-09-21T09:34:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.198815] nix-grpc-daemon[776]: ts=2026-09-21T09:34:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.203198] nix-grpc-daemon[776]: ts=2026-09-21T09:34:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.273283] nix-grpc-daemon[777]: ts=2026-09-21T09:34:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.277508] nix-grpc-daemon[777]: ts=2026-09-21T09:34:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.399807] nix-grpc-daemon[776]: ts=2026-09-21T09:34:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.405737] nix-grpc-daemon[776]: ts=2026-09-21T09:34:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.474553] nix-grpc-daemon[777]: ts=2026-09-21T09:34:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.480253] nix-grpc-daemon[777]: ts=2026-09-21T09:34:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.607508] nix-grpc-daemon[776]: ts=2026-09-21T09:34:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.613422] nix-grpc-daemon[776]: ts=2026-09-21T09:34:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.681697] nix-grpc-daemon[777]: ts=2026-09-21T09:34:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.687290] nix-grpc-daemon[777]: ts=2026-09-21T09:34:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.815000] nix-grpc-daemon[776]: ts=2026-09-21T09:34:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.820972] nix-grpc-daemon[776]: ts=2026-09-21T09:34:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.889271] nix-grpc-daemon[777]: ts=2026-09-21T09:34:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.894664] nix-grpc-daemon[777]: ts=2026-09-21T09:34:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.022177] nix-grpc-daemon[776]: ts=2026-09-21T09:34:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.028085] nix-grpc-daemon[776]: ts=2026-09-21T09:34:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.096723] nix-grpc-daemon[777]: ts=2026-09-21T09:34:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.102649] nix-grpc-daemon[777]: ts=2026-09-21T09:34:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.233219] nix-grpc-daemon[776]: ts=2026-09-21T09:34:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.237619] nix-grpc-daemon[776]: ts=2026-09-21T09:34:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.307196] nix-grpc-daemon[777]: ts=2026-09-21T09:34:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.311606] nix-grpc-daemon[777]: ts=2026-09-21T09:34:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.433636] nix-grpc-daemon[776]: ts=2026-09-21T09:34:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.439519] nix-grpc-daemon[776]: ts=2026-09-21T09:34:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.509028] nix-grpc-daemon[777]: ts=2026-09-21T09:34:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.516457] nix-grpc-daemon[777]: ts=2026-09-21T09:34:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.641001] nix-grpc-daemon[776]: ts=2026-09-21T09:34:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.646465] nix-grpc-daemon[776]: ts=2026-09-21T09:34:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.718812] nix-grpc-daemon[777]: ts=2026-09-21T09:34:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.724822] nix-grpc-daemon[777]: ts=2026-09-21T09:34:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.847435] nix-grpc-daemon[776]: ts=2026-09-21T09:34:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.852742] nix-grpc-daemon[776]: ts=2026-09-21T09:34:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.925427] nix-grpc-daemon[777]: ts=2026-09-21T09:34:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.930223] nix-grpc-daemon[777]: ts=2026-09-21T09:34:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.053559] nix-grpc-daemon[776]: ts=2026-09-21T09:34:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.058707] nix-grpc-daemon[776]: ts=2026-09-21T09:34:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.131788] nix-grpc-daemon[777]: ts=2026-09-21T09:34:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.137107] nix-grpc-daemon[777]: ts=2026-09-21T09:34:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.261434] nix-grpc-daemon[776]: ts=2026-09-21T09:34:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.265538] nix-grpc-daemon[776]: ts=2026-09-21T09:34:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.340162] nix-grpc-daemon[777]: ts=2026-09-21T09:34:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.344406] nix-grpc-daemon[777]: ts=2026-09-21T09:34:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.462057] nix-grpc-daemon[776]: ts=2026-09-21T09:34:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.467245] nix-grpc-daemon[776]: ts=2026-09-21T09:34:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.540757] nix-grpc-daemon[777]: ts=2026-09-21T09:34:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.546120] nix-grpc-daemon[777]: ts=2026-09-21T09:34:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.668101] nix-grpc-daemon[776]: ts=2026-09-21T09:34:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.673186] nix-grpc-daemon[776]: ts=2026-09-21T09:34:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.747243] nix-grpc-daemon[777]: ts=2026-09-21T09:34:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.752679] nix-grpc-daemon[777]: ts=2026-09-21T09:34:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.874096] nix-grpc-daemon[776]: ts=2026-09-21T09:34:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.879341] nix-grpc-daemon[776]: ts=2026-09-21T09:34:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.953997] nix-grpc-daemon[777]: ts=2026-09-21T09:34:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.959013] nix-grpc-daemon[777]: ts=2026-09-21T09:34:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.080564] nix-grpc-daemon[776]: ts=2026-09-21T09:34:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.085792] nix-grpc-daemon[776]: ts=2026-09-21T09:34:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.160107] nix-grpc-daemon[777]: ts=2026-09-21T09:34:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.165077] nix-grpc-daemon[777]: ts=2026-09-21T09:34:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.288761] nix-grpc-daemon[776]: ts=2026-09-21T09:34:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.293030] nix-grpc-daemon[776]: ts=2026-09-21T09:34:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.367696] nix-grpc-daemon[777]: ts=2026-09-21T09:34:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.371851] nix-grpc-daemon[777]: ts=2026-09-21T09:34:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.489229] nix-grpc-daemon[776]: ts=2026-09-21T09:34:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.494645] nix-grpc-daemon[776]: ts=2026-09-21T09:34:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.568249] nix-grpc-daemon[777]: ts=2026-09-21T09:34:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.573030] nix-grpc-daemon[777]: ts=2026-09-21T09:34:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.695450] nix-grpc-daemon[776]: ts=2026-09-21T09:34:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.700923] nix-grpc-daemon[776]: ts=2026-09-21T09:34:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.774251] nix-grpc-daemon[777]: ts=2026-09-21T09:34:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.779308] nix-grpc-daemon[777]: ts=2026-09-21T09:34:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.901841] nix-grpc-daemon[776]: ts=2026-09-21T09:34:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.907190] nix-grpc-daemon[776]: ts=2026-09-21T09:34:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.980404] nix-grpc-daemon[777]: ts=2026-09-21T09:34:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.985273] nix-grpc-daemon[777]: ts=2026-09-21T09:34:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.108261] nix-grpc-daemon[776]: ts=2026-09-21T09:34:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.113601] nix-grpc-daemon[776]: ts=2026-09-21T09:34:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.186281] nix-grpc-daemon[777]: ts=2026-09-21T09:34:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.191367] nix-grpc-daemon[777]: ts=2026-09-21T09:34:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.318163] nix-grpc-daemon[776]: ts=2026-09-21T09:34:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.322340] nix-grpc-daemon[776]: ts=2026-09-21T09:34:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.394203] nix-grpc-daemon[777]: ts=2026-09-21T09:34:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.398283] nix-grpc-daemon[777]: ts=2026-09-21T09:34:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.518447] nix-grpc-daemon[776]: ts=2026-09-21T09:34:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.523751] nix-grpc-daemon[776]: ts=2026-09-21T09:34:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.594773] nix-grpc-daemon[777]: ts=2026-09-21T09:34:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.599888] nix-grpc-daemon[777]: ts=2026-09-21T09:34:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.724682] nix-grpc-daemon[776]: ts=2026-09-21T09:34:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.729912] nix-grpc-daemon[776]: ts=2026-09-21T09:34:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.800884] nix-grpc-daemon[777]: ts=2026-09-21T09:34:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.805814] nix-grpc-daemon[777]: ts=2026-09-21T09:34:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.930770] nix-grpc-daemon[776]: ts=2026-09-21T09:34:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.936151] nix-grpc-daemon[776]: ts=2026-09-21T09:34:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.007176] nix-grpc-daemon[777]: ts=2026-09-21T09:34:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.012326] nix-grpc-daemon[777]: ts=2026-09-21T09:34:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.136959] nix-grpc-daemon[776]: ts=2026-09-21T09:34:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.142087] nix-grpc-daemon[776]: ts=2026-09-21T09:34:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.213270] nix-grpc-daemon[777]: ts=2026-09-21T09:34:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.218286] nix-grpc-daemon[777]: ts=2026-09-21T09:34:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.344709] nix-grpc-daemon[776]: ts=2026-09-21T09:34:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.348787] nix-grpc-daemon[776]: ts=2026-09-21T09:34:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.423043] nix-grpc-daemon[777]: ts=2026-09-21T09:34:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.427273] nix-grpc-daemon[777]: ts=2026-09-21T09:34:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.545075] nix-grpc-daemon[776]: ts=2026-09-21T09:34:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.550245] nix-grpc-daemon[776]: ts=2026-09-21T09:34:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.621904] nix-grpc-daemon[777]: ts=2026-09-21T09:34:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.627026] nix-grpc-daemon[777]: ts=2026-09-21T09:34:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.751042] nix-grpc-daemon[776]: ts=2026-09-21T09:34:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.756633] nix-grpc-daemon[776]: ts=2026-09-21T09:34:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.828140] nix-grpc-daemon[777]: ts=2026-09-21T09:34:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.833080] nix-grpc-daemon[777]: ts=2026-09-21T09:34:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.957404] nix-grpc-daemon[776]: ts=2026-09-21T09:34:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.962444] nix-grpc-daemon[776]: ts=2026-09-21T09:34:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.033999] nix-grpc-daemon[777]: ts=2026-09-21T09:34:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.039010] nix-grpc-daemon[777]: ts=2026-09-21T09:34:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.163358] nix-grpc-daemon[776]: ts=2026-09-21T09:34:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.168511] nix-grpc-daemon[776]: ts=2026-09-21T09:34:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.240152] nix-grpc-daemon[777]: ts=2026-09-21T09:34:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.244962] nix-grpc-daemon[777]: ts=2026-09-21T09:34:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.370968] nix-grpc-daemon[776]: ts=2026-09-21T09:34:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.375095] nix-grpc-daemon[776]: ts=2026-09-21T09:34:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.447342] nix-grpc-daemon[777]: ts=2026-09-21T09:34:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.451508] nix-grpc-daemon[777]: ts=2026-09-21T09:34:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.571409] nix-grpc-daemon[776]: ts=2026-09-21T09:34:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.576692] nix-grpc-daemon[776]: ts=2026-09-21T09:34:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.648177] nix-grpc-daemon[777]: ts=2026-09-21T09:34:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.653267] nix-grpc-daemon[777]: ts=2026-09-21T09:34:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 27.723612] systemd[1]: niks3.service: Scheduled restart job, restart counter is at 1. lb # [ 27.743822] systemd[1]: Starting niks3 server... worker1 # [ 27.777530] nix-grpc-daemon[776]: ts=2026-09-21T09:34:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.782572] nix-grpc-daemon[776]: ts=2026-09-21T09:34:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.854414] nix-grpc-daemon[777]: ts=2026-09-21T09:34:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.859614] nix-grpc-daemon[777]: ts=2026-09-21T09:34:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 27.844451] postgres[979]: [979] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 27.845753] postgres[979]: [979] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC lb # [ 27.883146] niks3-server[974]: 2026/09/21 09:34:58 OK 20241026095416_initial_model.sql (22ms) lb # [ 27.886266] niks3-server[974]: 2026/09/21 09:34:58 OK 20251210153512_drop_unused_gin_index.sql (3.41ms) lb # [ 27.891892] niks3-server[974]: 2026/09/21 09:34:58 OK 20251218171726_add_pins.sql (5.56ms) lb # [ 27.896994] niks3-server[974]: 2026/09/21 09:34:58 OK 20260628120000_add_object_size_and_stats.sql (5.11ms) lb # [ 27.902044] niks3-server[974]: 2026/09/21 09:34:58 OK 20260905000000_add_claims.sql (3.51ms) lb # [ 27.906569] niks3-server[974]: 2026/09/21 09:34:58 OK 20260920000000_drop_claims.sql (4.41ms) lb # [ 27.908672] niks3-server[974]: 2026/09/21 09:34:58 goose: successfully migrated database to version: 20260920000000 lb # [ 27.913156] niks3-server[974]: 2026/09/21 09:34:58 OK 1_commit_pending_closure.sql (6.56ms) lb # [ 27.915674] niks3-server[974]: 2026/09/21 09:34:58 OK 2_object_stats_trigger.sql (2.4ms) lb # [ 27.917166] niks3-server[974]: 2026/09/21 09:34:58 goose: up to current file version: 2 lb # [ 27.920484] niks3-server[974]: 2026/09/21 09:34:58 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key lb # [ 27.965282] niks3-server[974]: 2026/09/21 09:34:58 INFO Read proxy enabled — serving cache objects from S3 lb # [ 27.966585] niks3-server[974]: 2026/09/21 09:34:58 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 27.970327] niks3-server[974]: 2026/09/21 09:34:58 INFO systemd watchdog enabled interval=15s lb # [ 27.974295] systemd[1]: Started niks3 server. lb # [ 27.974984] niks3-server[974]: 2026/09/21 09:34:58 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 27.980267] niks3-server[974]: 2026/09/21 09:34:58 INFO lead: acquired remote=192.168.1.4:55662 worker2 # [ 28.025237] nix-grpc-daemon[777]: ts=2026-09-21T09:34:58Z level=info event=scheduler_take_over worker1 # [ 27.983290] nix-grpc-daemon[776]: ts=2026-09-21T09:34:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.988900] nix-grpc-daemon[776]: ts=2026-09-21T09:34:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.060765] nix-grpc-daemon[777]: ts=2026-09-21T09:34:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.065782] nix-grpc-daemon[777]: ts=2026-09-21T09:34:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.189664] nix-grpc-daemon[776]: ts=2026-09-21T09:34:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.195133] nix-grpc-daemon[776]: ts=2026-09-21T09:34:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.266930] nix-grpc-daemon[777]: ts=2026-09-21T09:34:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.271990] nix-grpc-daemon[777]: ts=2026-09-21T09:34:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.397126] nix-grpc-daemon[776]: ts=2026-09-21T09:34:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.449376] nix-grpc-daemon[777]: ts=2026-09-21T09:34:59Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:45070 worker2 # [ 28.455129] nix-grpc-daemon[777]: ts=2026-09-21T09:34:59Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 28.472984] nix-grpc-daemon[777]: ts=2026-09-21T09:34:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.492148] nix-grpc-daemon[777]: ts=2026-09-21T09:34:59Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 28.497632] nix-grpc-daemon[777]: ts=2026-09-21T09:34:59Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:45070 worker2 # [ 28.502956] nix-grpc-daemon[777]: ts=2026-09-21T09:34:59Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: waiting for unit niks3.service, in 15.48 seconds) lb: waiting for TCP port 5751 on localhost lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.10 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.07 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 29.069258] envoy[917]: conn peer=[::1]:37028 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=3 lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds) worker2 # [ 29.291259] systemd[1]: Starting scheduler-token.service... worker2 # [ 29.383584] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 29.386548] systemd[1]: Finished scheduler-token.service. worker2 # [ 29.387482] systemd[1]: scheduler-token.service: Consumed 31ms CPU time over 94ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.09 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.85 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker1 # [ 30.679113] nix-grpc-daemon[776]: ts=2026-09-21T09:35:01Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 30.698230] systemd[1]: Started Nix Daemon. worker1 # [ 30.998250] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 31.023231] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 4 ms (attempt 1/5) worker1 # [ 31.029969] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 41 ms (attempt 2/5) worker1 # [ 31.073450] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 337 ms (attempt 3/5) worker1 # [ 31.414067] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 689 ms (attempt 4/5) worker1 # [ 32.106523] nix-grpc-daemon[776]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 32.112284] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 32.140426] nix-grpc-daemon[776]: ts=2026-09-21T09:35:02Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 32.156879] nix-grpc-daemon[776]: ts=2026-09-21T09:35:02Z level=debug event=path_info_miss path=kn580alm8i65l8xnw33vjbcfrdhrbapf-nixos-system-client-test error="error: path '/nix/store/kn580alm8i65l8xnw33vjbcfrdhrbapf-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 32.225340] nix-grpc-daemon[777]: ts=2026-09-21T09:35:02Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:43960 worker2 # [ 32.244779] systemd[1]: Started Nix Daemon. worker2 # [ 32.592574] nix-daemon[860]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 32.627210] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 43 ms (attempt 1/5) worker2 # [ 32.670454] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 148 ms (attempt 2/5) worker2 # [ 32.818761] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 295 ms (attempt 3/5) worker2 # [ 33.121389] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 172 ms (attempt 4/5) worker2 # [ 33.303844] nix-grpc-daemon[777]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 33.309954] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 33.324159] nix-grpc-daemon[777]: ts=2026-09-21T09:35:03Z level=debug event=path_info_miss path=kn580alm8i65l8xnw33vjbcfrdhrbapf-nixos-system-client-test error="error: path '/nix/store/kn580alm8i65l8xnw33vjbcfrdhrbapf-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.10 seconds) client: must succeed: install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds) worker2 # [ 33.777795] nix-grpc-daemon[777]: ts=2026-09-21T09:35:04Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:43960 worker2 # [ 33.796173] nix-grpc-daemon[777]: ts=2026-09-21T09:35:04Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:43960 worker2 # [ 33.808429] nix-grpc-daemon[777]: ts=2026-09-21T09:35:04Z level=debug event=path_info_miss path=kn580alm8i65l8xnw33vjbcfrdhrbapf-nixos-system-client-test error="error: path '/nix/store/kn580alm8i65l8xnw33vjbcfrdhrbapf-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 33.778795] nix-grpc-daemon[776]: ts=2026-09-21T09:35:04Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 33.784410] nix-grpc-daemon[776]: ts=2026-09-21T09:35:04Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:52016 worker1 # [ 33.795448] nix-grpc-daemon[776]: ts=2026-09-21T09:35:04Z level=debug event=path_info_miss path=kn580alm8i65l8xnw33vjbcfrdhrbapf-nixos-system-client-test error="error: path '/nix/store/kn580alm8i65l8xnw33vjbcfrdhrbapf-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.04 seconds) worker1 # [ 34.099142] nix-grpc-daemon[776]: ts=2026-09-21T09:35:04Z level=info event=denied method=QueryMissing cn=- role=none worker1 # [ 34.361236] nix-grpc-daemon[776]: ts=2026-09-21T09:35:04Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 4.09 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 worker1 # [ 34.619106] nix-grpc-daemon[776]: ts=2026-09-21T09:35:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:52016 client # don't know how to build these paths: client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker2 # [ 34.679008] nix-grpc-daemon[777]: ts=2026-09-21T09:35:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43960 worker2 # [ 34.714297] nix-grpc-daemon[777]: ts=2026-09-21T09:35:05Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=0 worker2 # [ 34.720116] nix-grpc-daemon[777]: ts=2026-09-21T09:35:05Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 34.713598] nix-grpc-daemon[776]: ts=2026-09-21T09:35:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 34.732908] nix-grpc-daemon[776]: ts=2026-09-21T09:35:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52016 client # copying 1 paths to 'lb:50051'... worker1 # [ 34.748103] nix-grpc-daemon[776]: ts=2026-09-21T09:35:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52016 client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'... worker1 # [ 34.775187] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 34.814971] nix-grpc-daemon[776]: ts=2026-09-21T09:35:05Z level=info event=niks3_push_started pid=852 worker1 # [ 35.096250] nix-grpc-daemon[852]: time=2026-09-21T09:35:05.721Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 35.287417] nix-daemon[839]: accepted connection from pid 865, user nix-grpc-daemon (trusted) worker1 # [ 35.305454] nix-daemon[839]: reaped child process 868, status = succeeded worker1 # [ 35.478022] nix-daemon[839]: accepted connection from pid 870, user nix-grpc-daemon (trusted) worker1 # [ 35.493834] nix-daemon[839]: reaped child process 873, status = succeeded lb # [ 35.508881] niks3-server[974]: 2026/09/21 09:35:06 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 35.529175] nix-grpc-daemon[852]: time=2026-09-21T09:35:06.156Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 35.532553] nix-grpc-daemon[852]: time=2026-09-21T09:35:06.157Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)" lb # [ 35.580964] niks3-server[974]: 2026/09/21 09:35:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 35.594593] niks3-server[974]: 2026/09/21 09:35:06 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst lb # [ 35.634454] niks3-server[974]: 2026/09/21 09:35:06 INFO Signed narinfos id=1 count=1 worker1 # [ 35.635342] nix-grpc-daemon[852]: time=2026-09-21T09:35:06.261Z level=INFO msg="Uploading 1 narinfos" lb # [ 35.650346] niks3-server[974]: 2026/09/21 09:35:06 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls lb # [ 35.660272] niks3-server[974]: 2026/09/21 09:35:06 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 35.669912] niks3-server[974]: 2026/09/21 09:35:06 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo lb # [ 35.677276] niks3-server[974]: 2026/09/21 09:35:06 INFO Completed upload id=1 worker1 # [ 35.674522] nix-grpc-daemon[852]: time=2026-09-21T09:35:06.301Z level=INFO msg="Upload complete. (570ms)" worker1 # [ 35.681204] nix-grpc-daemon[776]: ts=2026-09-21T09:35:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52016 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 35.683786] nix-grpc-daemon[776]: ts=2026-09-21T09:35:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 35.694144] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 35.697799] nix-daemon[839]: reaped child process 850, status = succeeded client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051... worker1 # [ 35.707646] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted) client # farm-a> node-a: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-t1 worker1 # [ 36.947199] nix-daemon[839]: reaped child process 878, status = succeeded worker1 # [ 37.122750] nix-daemon[839]: accepted connection from pid 894, user nix-grpc-daemon (trusted) worker1 # [ 37.140285] nix-daemon[839]: reaped child process 897, status = succeeded lb # [ 37.155910] niks3-server[974]: 2026/09/21 09:35:07 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 37.166271] nix-grpc-daemon[852]: time=2026-09-21T09:35:07.792Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 37.168300] nix-grpc-daemon[852]: time=2026-09-21T09:35:07.792Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)" lb # [ 37.210652] niks3-server[974]: 2026/09/21 09:35:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign worker1 # [ 37.219192] nix-grpc-daemon[852]: time=2026-09-21T09:35:07.845Z level=INFO msg="Uploading 1 narinfos" lb # [ 37.228770] niks3-server[974]: 2026/09/21 09:35:07 INFO Signed narinfos id=2 count=1 lb # [ 37.231637] niks3-server[974]: 2026/09/21 09:35:07 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 37.252645] niks3-server[974]: 2026/09/21 09:35:07 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv lb # [ 37.255926] niks3-server[974]: 2026/09/21 09:35:07 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls lb # [ 37.262012] niks3-server[974]: 2026/09/21 09:35:07 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete lb # [ 37.266247] niks3-server[974]: 2026/09/21 09:35:07 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo worker1 # [ 37.263521] nix-grpc-daemon[852]: time=2026-09-21T09:35:07.890Z level=INFO msg="Upload complete. (347ms)" lb # [ 37.268976] niks3-server[974]: 2026/09/21 09:35:07 INFO Completed upload id=2 worker2 # [ 37.333366] nix-grpc-daemon[777]: ts=2026-09-21T09:35:07Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=0 worker1 # [ 37.277100] nix-grpc-daemon[776]: ts=2026-09-21T09:35:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52016 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=1 worker1 # [ 37.295295] nix-daemon[839]: reaped child process 876, status = succeeded worker2 # [ 37.333680] nix-grpc-daemon[777]: ts=2026-09-21T09:35:07Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 37.340363] nix-grpc-daemon[776]: ts=2026-09-21T09:35:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 37.356348] nix-grpc-daemon[776]: ts=2026-09-21T09:35:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 37.370272] nix-grpc-daemon[852]: time=2026-09-21T09:35:07.997Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 37.380397] nix-grpc-daemon[776]: ts=2026-09-21T09:35:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52016 client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'... worker1 # [ 37.404357] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 37.608262] nix-daemon[839]: accepted connection from pid 901, user nix-grpc-daemon (trusted) worker1 # [ 37.627406] nix-daemon[839]: reaped child process 904, status = succeeded worker1 # [ 37.799766] nix-daemon[839]: accepted connection from pid 906, user nix-grpc-daemon (trusted) worker1 # [ 37.815422] nix-daemon[839]: reaped child process 909, status = succeeded lb # [ 37.829488] niks3-server[974]: 2026/09/21 09:35:08 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 37.837881] nix-grpc-daemon[852]: time=2026-09-21T09:35:08.464Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 37.839323] nix-grpc-daemon[852]: time=2026-09-21T09:35:08.464Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)" lb # [ 37.862387] niks3-server[974]: 2026/09/21 09:35:08 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst worker1 # [ 37.877323] nix-grpc-daemon[852]: time=2026-09-21T09:35:08.504Z level=INFO msg="Uploading 1 narinfos" lb # [ 37.872586] niks3-server[974]: 2026/09/21 09:35:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign lb # [ 37.886337] niks3-server[974]: 2026/09/21 09:35:08 INFO Signed narinfos id=3 count=1 lb # [ 37.893742] niks3-server[974]: 2026/09/21 09:35:08 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls lb # [ 37.905027] niks3-server[974]: 2026/09/21 09:35:08 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete worker1 # [ 37.907169] nix-grpc-daemon[852]: time=2026-09-21T09:35:08.534Z level=INFO msg="Upload complete. (485ms)" lb # [ 37.910980] niks3-server[974]: 2026/09/21 09:35:08 INFO Completed upload id=3 lb # [ 37.914982] niks3-server[974]: 2026/09/21 09:35:08 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo worker1 # [ 37.916231] nix-grpc-daemon[776]: ts=2026-09-21T09:35:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52016 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 37.926072] nix-grpc-daemon[776]: ts=2026-09-21T09:35:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 37.932976] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 37.937874] nix-daemon[839]: reaped child process 899, status = succeeded client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051... client # farm-b> node-a: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker1 # [ 37.952183] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted) client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-t1 worker1 # [ 39.398260] nix-daemon[839]: reaped child process 913, status = succeeded worker1 # [ 39.572302] nix-daemon[839]: accepted connection from pid 930, user nix-grpc-daemon (trusted) worker1 # [ 39.588392] nix-daemon[839]: reaped child process 933, status = succeeded lb # [ 39.605991] niks3-server[974]: 2026/09/21 09:35:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 39.614306] nix-grpc-daemon[852]: time=2026-09-21T09:35:10.240Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 39.615739] nix-grpc-daemon[852]: time=2026-09-21T09:35:10.240Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)" lb # [ 39.637950] niks3-server[974]: 2026/09/21 09:35:10 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv lb # [ 39.652324] niks3-server[974]: 2026/09/21 09:35:10 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst lb # [ 39.664979] niks3-server[974]: 2026/09/21 09:35:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign worker1 # [ 39.666994] nix-grpc-daemon[852]: time=2026-09-21T09:35:10.293Z level=INFO msg="Uploading 1 narinfos" lb # [ 39.674605] niks3-server[974]: 2026/09/21 09:35:10 INFO Signed narinfos id=4 count=1 lb # [ 39.679478] niks3-server[974]: 2026/09/21 09:35:10 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls lb # [ 39.686845] niks3-server[974]: 2026/09/21 09:35:10 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete lb # [ 39.692627] niks3-server[974]: 2026/09/21 09:35:10 INFO Completed upload id=4 worker1 # [ 39.689776] nix-grpc-daemon[852]: time=2026-09-21T09:35:10.316Z level=INFO msg="Upload complete. (327ms)" worker1 # [ 39.700265] nix-grpc-daemon[852]: time=2026-09-21T09:35:10.316Z level=WARN msg="Failed to register uploaded object" key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo error="server returned 404: object is not pending upload\n" worker2 # [ 39.752750] nix-grpc-daemon[777]: ts=2026-09-21T09:35:10Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=0 worker2 # [ 39.753263] nix-grpc-daemon[777]: ts=2026-09-21T09:35:10Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 39.717964] nix-grpc-daemon[776]: ts=2026-09-21T09:35:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52016 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=1 worker1 # [ 39.724640] nix-daemon[839]: reaped child process 911, status = succeeded worker1 # [ 39.755526] nix-grpc-daemon[776]: ts=2026-09-21T09:35:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 39.770548] nix-grpc-daemon[776]: ts=2026-09-21T09:35:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 39.784575] nix-grpc-daemon[852]: time=2026-09-21T09:35:10.411Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 39.794737] nix-grpc-daemon[776]: ts=2026-09-21T09:35:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52016 client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'... worker1 # [ 39.818476] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted) lb # [ 39.868594] envoy[917]: conn peer=[2001:db8:1::1]:34016 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=749 tx=423 ms=2665 lb # [ 39.873464] envoy[917]: conn peer=[2001:db8:1::1]:55444 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=79 lb # [ 39.878694] envoy[917]: conn peer=[2001:db8:1::1]:55448 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=16 lb # [ 39.883198] envoy[917]: conn peer=[2001:db8:1::1]:55458 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=12 worker1 # [ 40.028174] nix-daemon[839]: accepted connection from pid 937, user nix-grpc-daemon (trusted) worker1 # [ 40.045366] nix-daemon[839]: reaped child process 940, status = succeeded worker1 # [ 40.216773] nix-daemon[839]: accepted connection from pid 942, user nix-grpc-daemon (trusted) worker1 # [ 40.232414] nix-daemon[839]: reaped child process 945, status = succeeded lb # [ 40.249083] niks3-server[974]: 2026/09/21 09:35:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 40.255527] nix-grpc-daemon[852]: time=2026-09-21T09:35:10.882Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 40.257168] nix-grpc-daemon[852]: time=2026-09-21T09:35:10.882Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)" lb # [ 40.277441] niks3-server[974]: 2026/09/21 09:35:10 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst lb # [ 40.289378] niks3-server[974]: 2026/09/21 09:35:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign worker1 # [ 40.293866] nix-grpc-daemon[852]: time=2026-09-21T09:35:10.920Z level=INFO msg="Uploading 1 narinfos" lb # [ 40.298038] niks3-server[974]: 2026/09/21 09:35:10 INFO Signed narinfos id=5 count=1 lb # [ 40.304747] niks3-server[974]: 2026/09/21 09:35:10 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls lb # [ 40.314043] niks3-server[974]: 2026/09/21 09:35:10 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete worker1 # [ 40.320937] nix-grpc-daemon[852]: time=2026-09-21T09:35:10.947Z level=INFO msg="Upload complete. (484ms)" lb # [ 40.324322] niks3-server[974]: 2026/09/21 09:35:10 INFO Completed upload id=5 lb # [ 40.326871] niks3-server[974]: 2026/09/21 09:35:10 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo worker1 # [ 40.328127] nix-grpc-daemon[776]: ts=2026-09-21T09:35:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52016 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 40.337390] nix-grpc-daemon[776]: ts=2026-09-21T09:35:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 40.347069] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 40.352521] nix-daemon[839]: reaped child process 935, status = succeeded client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051... worker1 # [ 40.365279] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted) client # farm-top> node-a: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1 worker1 # [ 41.994685] nix-daemon[839]: reaped child process 949, status = succeeded worker1 # [ 42.160284] nix-daemon[839]: accepted connection from pid 965, user nix-grpc-daemon (trusted) worker1 # [ 42.178446] nix-daemon[839]: reaped child process 968, status = succeeded lb # [ 42.194253] niks3-server[974]: 2026/09/21 09:35:12 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 42.203307] nix-grpc-daemon[852]: time=2026-09-21T09:35:12.828Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 42.204957] nix-grpc-daemon[852]: time=2026-09-21T09:35:12.828Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)" lb # [ 42.225993] niks3-server[974]: 2026/09/21 09:35:12 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv lb # [ 42.241516] niks3-server[974]: 2026/09/21 09:35:12 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst lb # [ 42.255172] niks3-server[974]: 2026/09/21 09:35:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign worker1 # [ 42.257693] nix-grpc-daemon[852]: time=2026-09-21T09:35:12.884Z level=INFO msg="Uploading 1 narinfos" lb # [ 42.263638] niks3-server[974]: 2026/09/21 09:35:12 INFO Signed narinfos id=6 count=1 lb # [ 42.268151] niks3-server[974]: 2026/09/21 09:35:12 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls lb # [ 42.276794] niks3-server[974]: 2026/09/21 09:35:12 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 42.280286] niks3-server[974]: 2026/09/21 09:35:12 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo lb # [ 42.283799] niks3-server[974]: 2026/09/21 09:35:12 INFO Completed upload id=6 worker1 # [ 42.281302] nix-grpc-daemon[852]: time=2026-09-21T09:35:12.907Z level=INFO msg="Upload complete. (305ms)" worker1 # [ 42.288459] nix-grpc-daemon[776]: ts=2026-09-21T09:35:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52016 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=1 worker1 # [ 42.297629] nix-daemon[839]: reaped child process 947, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 7.96 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.20 seconds) client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.02 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client # copying 3 paths... client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.29 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 8.58 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.26 seconds) worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.29 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 client # don't know how to build these paths: client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker2 # [ 43.821646] nix-grpc-daemon[777]: ts=2026-09-21T09:35:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:43960 worker2 # [ 43.829431] nix-grpc-daemon[777]: ts=2026-09-21T09:35:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43960 worker2 # [ 43.857033] nix-grpc-daemon[777]: ts=2026-09-21T09:35:14Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.33 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.21 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 1.41 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2 client # don't know how to build these paths: client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker1 # [ 44.818930] nix-grpc-daemon[776]: ts=2026-09-21T09:35:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 44.826298] nix-grpc-daemon[776]: ts=2026-09-21T09:35:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 44.834164] nix-grpc-daemon[852]: time=2026-09-21T09:35:15.458Z level=INFO msg="All 2 paths already cached" worker2 # [ 44.891588] nix-grpc-daemon[777]: ts=2026-09-21T09:35:15Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=0 worker1 # [ 44.889215] nix-grpc-daemon[776]: ts=2026-09-21T09:35:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 44.904798] nix-grpc-daemon[776]: ts=2026-09-21T09:35:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 44.918273] nix-grpc-daemon[852]: time=2026-09-21T09:35:15.545Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'... worker1 # [ 44.927651] nix-grpc-daemon[776]: ts=2026-09-21T09:35:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 44.941252] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 45.144782] nix-daemon[839]: accepted connection from pid 986, user nix-grpc-daemon (trusted) worker1 # [ 45.164400] nix-daemon[839]: reaped child process 989, status = succeeded worker1 # [ 45.334330] nix-daemon[839]: accepted connection from pid 991, user nix-grpc-daemon (trusted) worker1 # [ 45.353288] nix-daemon[839]: reaped child process 994, status = succeeded lb # [ 45.368742] niks3-server[974]: 2026/09/21 09:35:16 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 45.375220] nix-grpc-daemon[852]: time=2026-09-21T09:35:16.001Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 45.376811] nix-grpc-daemon[852]: time=2026-09-21T09:35:16.001Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)" lb # [ 45.394443] niks3-server[974]: 2026/09/21 09:35:16 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst lb # [ 45.408939] niks3-server[974]: 2026/09/21 09:35:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign worker1 # [ 45.413076] nix-grpc-daemon[852]: time=2026-09-21T09:35:16.039Z level=INFO msg="Uploading 1 narinfos" lb # [ 45.421898] niks3-server[974]: 2026/09/21 09:35:16 INFO Signed narinfos id=7 count=1 lb # [ 45.428434] niks3-server[974]: 2026/09/21 09:35:16 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls lb # [ 45.438108] niks3-server[974]: 2026/09/21 09:35:16 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete lb # [ 45.444171] niks3-server[974]: 2026/09/21 09:35:16 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo lb # [ 45.448934] niks3-server[974]: 2026/09/21 09:35:16 INFO Completed upload id=7 worker1 # [ 45.446224] nix-grpc-daemon[852]: time=2026-09-21T09:35:16.073Z level=INFO msg="Upload complete. (488ms)" worker1 # [ 45.454214] nix-grpc-daemon[776]: ts=2026-09-21T09:35:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52016 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 45.467762] nix-grpc-daemon[776]: ts=2026-09-21T09:35:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 45.474318] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker2 # [ 44.897682] nix-grpc-daemon[777]: ts=2026-09-21T09:35:15Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 45.479045] nix-daemon[839]: reaped child process 984, status = succeeded client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051... worker1 # [ 45.490800] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted) client # farm-top> node-a: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1b worker1 # [ 46.717241] nix-daemon[839]: reaped child process 998, status = succeeded worker1 # [ 46.870508] nix-daemon[839]: accepted connection from pid 1015, user nix-grpc-daemon (trusted) worker1 # [ 46.888216] nix-daemon[839]: reaped child process 1018, status = succeeded lb # [ 46.905737] niks3-server[974]: 2026/09/21 09:35:17 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 46.912439] nix-grpc-daemon[852]: time=2026-09-21T09:35:17.539Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 46.916648] nix-grpc-daemon[852]: time=2026-09-21T09:35:17.539Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)" lb # [ 46.943340] niks3-server[974]: 2026/09/21 09:35:17 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst lb # [ 46.955096] niks3-server[974]: 2026/09/21 09:35:17 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker1 # [ 46.961534] nix-grpc-daemon[852]: time=2026-09-21T09:35:17.588Z level=INFO msg="Uploading 1 narinfos" lb # [ 46.966740] niks3-server[974]: 2026/09/21 09:35:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign lb # [ 46.975853] niks3-server[974]: 2026/09/21 09:35:17 INFO Signed narinfos id=8 count=1 lb # [ 46.979138] niks3-server[974]: 2026/09/21 09:35:17 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls lb # [ 46.986091] niks3-server[974]: 2026/09/21 09:35:17 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 46.990295] niks3-server[974]: 2026/09/21 09:35:17 INFO Completed upload id=8 worker1 # [ 46.987644] nix-grpc-daemon[852]: time=2026-09-21T09:35:17.614Z level=INFO msg="Upload complete. (284ms)" lb # [ 46.992707] niks3-server[974]: 2026/09/21 09:35:17 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo worker1 # [ 46.996918] nix-grpc-daemon[776]: ts=2026-09-21T09:35:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52016 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=1 worker1 # [ 47.011306] nix-daemon[839]: reaped child process 996, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.48 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.22 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.10 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup client # [ 47.557277] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: 62b7b24f9ccb4eea81c05671cc912a52 client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.10 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup client # [ 47.817480] nix[880]: don't know how to build these paths: client # [ 47.818644] nix[880]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker2 # [ 47.853382] nix-grpc-daemon[777]: ts=2026-09-21T09:35:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:43960 worker2 # [ 47.866764] nix-grpc-daemon[777]: ts=2026-09-21T09:35:18Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker2 # [ 47.874505] nix-grpc-daemon[777]: ts=2026-09-21T09:35:18Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 47.882257] nix-grpc-daemon[777]: ts=2026-09-21T09:35:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43960 worker2 # [ 47.899906] nix-grpc-daemon[777]: ts=2026-09-21T09:35:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43960 client # [ 47.876111] nix[880]: copying 1 paths to 'lb:50051'... client # [ 47.878743] nix[880]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'... worker2 # [ 47.914896] nix-grpc-daemon[777]: ts=2026-09-21T09:35:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43960 worker2 # [ 47.930894] nix-daemon[860]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 47.957207] nix-grpc-daemon[777]: ts=2026-09-21T09:35:18Z level=info event=niks3_push_started pid=915 worker2 # [ 48.222550] nix-grpc-daemon[915]: time=2026-09-21T09:35:18.831Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 48.414473] nix-daemon[860]: accepted connection from pid 928, user nix-grpc-daemon (trusted) worker2 # [ 48.434608] nix-daemon[860]: reaped child process 931, status = succeeded worker2 # [ 48.609702] nix-daemon[860]: accepted connection from pid 933, user nix-grpc-daemon (trusted) worker2 # [ 48.626483] nix-daemon[860]: reaped child process 936, status = succeeded lb # [ 48.596606] niks3-server[974]: 2026/09/21 09:35:19 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 48.652711] nix-grpc-daemon[915]: time=2026-09-21T09:35:19.262Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 48.656060] nix-grpc-daemon[915]: time=2026-09-21T09:35:19.264Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)" lb # [ 48.634664] niks3-server[974]: 2026/09/21 09:35:19 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst worker2 # [ 48.700256] nix-grpc-daemon[915]: time=2026-09-21T09:35:19.309Z level=INFO msg="Uploading 1 narinfos" lb # [ 48.649569] niks3-server[974]: 2026/09/21 09:35:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign lb # [ 48.660490] niks3-server[974]: 2026/09/21 09:35:19 INFO Signed narinfos id=9 count=1 client # [ 48.667896] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. lb # [ 48.669731] niks3-server[974]: 2026/09/21 09:35:19 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls lb # [ 48.681891] niks3-server[974]: 2026/09/21 09:35:19 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete worker2 # [ 48.732101] nix-grpc-daemon[915]: time=2026-09-21T09:35:19.342Z level=INFO msg="Upload complete. (501ms)" lb # [ 48.688890] niks3-server[974]: 2026/09/21 09:35:19 INFO Completed upload id=9 client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.12 seconds) lb # [ 48.692344] niks3-server[974]: 2026/09/21 09:35:19 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo worker2 # [ 48.740161] nix-grpc-daemon[777]: ts=2026-09-21T09:35:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43960 duration_s=0 paths=1 nar_bytes_in=432 worker2 # [ 48.748406] nix-grpc-daemon[777]: ts=2026-09-21T09:35:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43960 worker2 # [ 48.762079] nix-daemon[860]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 48.765109] nix-daemon[860]: reaped child process 913, status = succeeded client # Running as unit: dedup2.service; invocation ID: 3df2899f1cce494db6e53dfc92684409 client # [ 48.737941] nix[880]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... worker2 # [ 48.777791] nix-daemon[860]: accepted connection from pid 777, user nix-grpc-daemon (trusted) client # [ 49.036840] nix[896]: don't know how to build these paths: client # [ 49.037833] nix[896]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker1 # [ 49.026270] nix-grpc-daemon[776]: ts=2026-09-21T09:35:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:52016 worker2 # [ 49.087245] nix-grpc-daemon[777]: ts=2026-09-21T09:35:19Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 client # [ 49.059117] nix[896]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... worker2 # [ 49.095021] nix-grpc-daemon[777]: ts=2026-09-21T09:35:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43960 lb # [ 49.865045] envoy[917]: conn peer=[2001:db8:1::1]:55474 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9579 tx=4092 ms=7695 lb # [ 49.870084] envoy[917]: conn peer=[2001:db8:1::1]:56698 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=56 lb # [ 49.875055] envoy[917]: conn peer=[2001:db8:1::1]:56712 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4172 tx=1807 ms=2193 client: must succeed: sleep 2 client: (finished: must succeed: sleep 2, in 2.06 seconds) client: waiting for success: ! systemctl is-active dedup1 dedup2 worker2 # [ 52.422250] nix-daemon[860]: reaped child process 940, status = succeeded worker2 # [ 52.600468] nix-daemon[860]: accepted connection from pid 972, user nix-grpc-daemon (trusted) worker2 # [ 52.619237] nix-daemon[860]: reaped child process 975, status = succeeded lb # [ 52.589656] niks3-server[974]: 2026/09/21 09:35:23 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 52.642957] nix-grpc-daemon[915]: time=2026-09-21T09:35:23.251Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 52.644957] nix-grpc-daemon[915]: time=2026-09-21T09:35:23.251Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)" lb # [ 52.635993] niks3-server[974]: 2026/09/21 09:35:23 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker2 # [ 52.691600] nix-grpc-daemon[915]: time=2026-09-21T09:35:23.300Z level=INFO msg="Uploading 1 narinfos" lb # [ 52.650025] niks3-server[974]: 2026/09/21 09:35:23 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 52.658645] niks3-server[974]: 2026/09/21 09:35:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign lb # [ 52.666101] niks3-server[974]: 2026/09/21 09:35:23 INFO Signed narinfos id=10 count=1 worker2 # [ 52.716425] nix-grpc-daemon[915]: time=2026-09-21T09:35:23.326Z level=INFO msg="Upload complete. (325ms)" lb # [ 52.673478] niks3-server[974]: 2026/09/21 09:35:23 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls lb # [ 52.680348] niks3-server[974]: 2026/09/21 09:35:23 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 52.685593] niks3-server[974]: 2026/09/21 09:35:23 INFO Completed upload id=10 worker2 # [ 52.728908] nix-grpc-daemon[777]: ts=2026-09-21T09:35:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43960 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 lb # [ 52.687915] niks3-server[974]: 2026/09/21 09:35:23 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo worker2 # [ 52.740974] nix-grpc-daemon[777]: ts=2026-09-21T09:35:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43960 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker2 # [ 52.746169] nix-daemon[860]: reaped child process 938, status = succeeded client # [ 52.745245] systemd[1]: dedup1.service: Deactivated successfully. client # [ 52.753817] systemd[1]: dedup1.service: Consumed 172ms CPU time over 5.190s wall clock time, 43.4M memory peak, 7.1K incoming IP traffic, 8.4K outgoing IP traffic. client # [ 52.800409] systemd[1]: dedup2.service: Deactivated successfully. client # [ 52.804724] systemd[1]: dedup2.service: Consumed 217ms CPU time over 4.135s wall clock time, 33.2M memory peak, 5.9K incoming IP traffic, 5.7K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.14 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) (finished: subtest: two clients wanting the same drv build it once, in 6.25 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 53.959068] systemd[1]: Started Nix Daemon. client # [ 54.147438] nix-daemon[938]: accepted connection from pid 935, user root (trusted) worker2 # [ 54.401927] nix-grpc-daemon[777]: ts=2026-09-21T09:35:25Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:43960 worker1 # [ 54.360777] nix-grpc-daemon[776]: ts=2026-09-21T09:35:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52016 worker2 # [ 54.418837] nix-grpc-daemon[777]: ts=2026-09-21T09:35:25Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=0 worker2 # [ 54.425081] nix-grpc-daemon[777]: ts=2026-09-21T09:35:25Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 54.417109] nix-grpc-daemon[776]: ts=2026-09-21T09:35:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 54.432485] nix-grpc-daemon[776]: ts=2026-09-21T09:35:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 54.446770] nix-grpc-daemon[776]: ts=2026-09-21T09:35:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 54.461167] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 54.670476] nix-daemon[839]: accepted connection from pid 1043, user nix-grpc-daemon (trusted) worker1 # [ 54.689039] nix-daemon[839]: reaped child process 1046, status = succeeded worker1 # [ 54.856597] nix-daemon[839]: accepted connection from pid 1048, user nix-grpc-daemon (trusted) worker1 # [ 54.874589] nix-daemon[839]: reaped child process 1051, status = succeeded lb # [ 54.889487] niks3-server[974]: 2026/09/21 09:35:25 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 54.896468] nix-grpc-daemon[852]: time=2026-09-21T09:35:25.523Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 54.898347] nix-grpc-daemon[852]: time=2026-09-21T09:35:25.525Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)" lb # [ 54.920078] niks3-server[974]: 2026/09/21 09:35:25 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst worker1 # [ 54.932078] nix-grpc-daemon[852]: time=2026-09-21T09:35:25.558Z level=INFO msg="Uploading 1 narinfos" lb # [ 54.935534] niks3-server[974]: 2026/09/21 09:35:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign lb # [ 54.945847] niks3-server[974]: 2026/09/21 09:35:25 INFO Signed narinfos id=11 count=1 lb # [ 54.952318] niks3-server[974]: 2026/09/21 09:35:25 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls lb # [ 54.962675] niks3-server[974]: 2026/09/21 09:35:25 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete lb # [ 54.971362] niks3-server[974]: 2026/09/21 09:35:25 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo lb # [ 54.977106] niks3-server[974]: 2026/09/21 09:35:25 INFO Completed upload id=11 worker1 # [ 54.974249] nix-grpc-daemon[852]: time=2026-09-21T09:35:25.601Z level=INFO msg="Upload complete. (496ms)" worker1 # [ 54.983625] nix-grpc-daemon[776]: ts=2026-09-21T09:35:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52016 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 54.998695] nix-grpc-daemon[776]: ts=2026-09-21T09:35:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 55.005248] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 55.010320] nix-daemon[839]: reaped child process 1041, status = succeeded worker1 # [ 55.021315] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 56.666570] nix-daemon[839]: reaped child process 1055, status = succeeded worker1 # [ 56.861336] nix-daemon[839]: accepted connection from pid 1071, user nix-grpc-daemon (trusted) worker1 # [ 56.881191] nix-daemon[839]: reaped child process 1074, status = succeeded lb # [ 56.902822] niks3-server[974]: 2026/09/21 09:35:27 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 56.916530] nix-grpc-daemon[852]: time=2026-09-21T09:35:27.541Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 56.918392] nix-grpc-daemon[852]: time=2026-09-21T09:35:27.541Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)" lb # [ 56.976801] niks3-server[974]: 2026/09/21 09:35:27 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 56.993877] niks3-server[974]: 2026/09/21 09:35:27 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv lb # [ 57.003468] niks3-server[974]: 2026/09/21 09:35:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign worker1 # [ 57.005882] nix-grpc-daemon[852]: time=2026-09-21T09:35:27.632Z level=INFO msg="Uploading 1 narinfos" lb # [ 57.012079] niks3-server[974]: 2026/09/21 09:35:27 INFO Signed narinfos id=12 count=1 lb # [ 57.014256] niks3-server[974]: 2026/09/21 09:35:27 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls lb # [ 57.024192] niks3-server[974]: 2026/09/21 09:35:27 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete lb # [ 57.036125] niks3-server[974]: 2026/09/21 09:35:27 INFO Completed upload id=12 worker1 # [ 57.033397] nix-grpc-daemon[852]: time=2026-09-21T09:35:27.660Z level=INFO msg="Upload complete. (398ms)" lb # [ 57.039420] niks3-server[974]: 2026/09/21 09:35:27 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo worker1 # [ 57.045290] nix-grpc-daemon[776]: ts=2026-09-21T09:35:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52016 duration_s=2 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=1 worker2 # [ 57.097966] nix-grpc-daemon[777]: ts=2026-09-21T09:35:27Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:43960 worker1 # [ 57.067139] nix-daemon[839]: reaped child process 1053, status = succeeded worker2 # [ 57.119146] nix-grpc-daemon[777]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'... worker1 # [ 57.126491] nix-grpc-daemon[776]: ts=2026-09-21T09:35:27Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 57.135474] nix-grpc-daemon[776]: ts=2026-09-21T09:35:27Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52016 duration_s=0 paths=1 nar_bytes_out=128 worker2 # [ 57.521138] nix-grpc-daemon[777]: ts=2026-09-21T09:35:28Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:43960 worker1 # [ 57.480499] nix-grpc-daemon[776]: ts=2026-09-21T09:35:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 57.493940] nix-grpc-daemon[852]: time=2026-09-21T09:35:28.120Z level=INFO msg="All 1 paths already cached" worker2 # [ 57.564170] nix-grpc-daemon[777]: ts=2026-09-21T09:35:28Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=0 worker2 # [ 57.570507] nix-grpc-daemon[777]: ts=2026-09-21T09:35:28Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 57.529181] nix-grpc-daemon[776]: ts=2026-09-21T09:35:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 57.551044] nix-grpc-daemon[776]: ts=2026-09-21T09:35:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 57.570343] nix-grpc-daemon[852]: time=2026-09-21T09:35:28.197Z level=INFO msg="All 1 paths already cached" worker1 # [ 57.583149] nix-grpc-daemon[776]: ts=2026-09-21T09:35:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 57.598027] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 57.833703] nix-daemon[839]: accepted connection from pid 1078, user nix-grpc-daemon (trusted) worker1 # [ 57.857114] nix-daemon[839]: reaped child process 1081, status = succeeded worker1 # [ 58.037248] nix-daemon[839]: accepted connection from pid 1083, user nix-grpc-daemon (trusted) worker1 # [ 58.055138] nix-daemon[839]: reaped child process 1086, status = succeeded lb # [ 58.071500] niks3-server[974]: 2026/09/21 09:35:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 58.079153] nix-grpc-daemon[852]: time=2026-09-21T09:35:28.705Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 58.080799] nix-grpc-daemon[852]: time=2026-09-21T09:35:28.705Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)" lb # [ 58.103471] niks3-server[974]: 2026/09/21 09:35:28 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst lb # [ 58.119239] niks3-server[974]: 2026/09/21 09:35:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign worker1 # [ 58.122732] nix-grpc-daemon[852]: time=2026-09-21T09:35:28.749Z level=INFO msg="Uploading 1 narinfos" lb # [ 58.132783] niks3-server[974]: 2026/09/21 09:35:28 INFO Signed narinfos id=13 count=1 lb # [ 58.139674] niks3-server[974]: 2026/09/21 09:35:28 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls lb # [ 58.146749] niks3-server[974]: 2026/09/21 09:35:28 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete worker1 # [ 58.149626] nix-grpc-daemon[852]: time=2026-09-21T09:35:28.776Z level=INFO msg="Upload complete. (532ms)" lb # [ 58.154722] niks3-server[974]: 2026/09/21 09:35:28 INFO Completed upload id=13 lb # [ 58.158313] niks3-server[974]: 2026/09/21 09:35:28 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo worker1 # [ 58.161813] nix-grpc-daemon[776]: ts=2026-09-21T09:35:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52016 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 58.174729] nix-grpc-daemon[776]: ts=2026-09-21T09:35:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 58.180793] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 58.185700] nix-daemon[839]: reaped child process 1076, status = succeeded worker1 # [ 58.199754] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 59.221784] nix-daemon[839]: reaped child process 1090, status = succeeded worker1 # [ 59.373194] nix-daemon[839]: accepted connection from pid 1106, user nix-grpc-daemon (trusted) worker1 # [ 59.392618] nix-daemon[839]: reaped child process 1109, status = succeeded lb # [ 59.409346] niks3-server[974]: 2026/09/21 09:35:30 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 59.415520] nix-grpc-daemon[852]: time=2026-09-21T09:35:30.040Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 59.417168] nix-grpc-daemon[852]: time=2026-09-21T09:35:30.040Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)" lb # [ 59.444495] niks3-server[974]: 2026/09/21 09:35:30 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv lb # [ 59.456452] niks3-server[974]: 2026/09/21 09:35:30 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst lb # [ 59.466962] niks3-server[974]: 2026/09/21 09:35:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign worker1 # [ 59.469662] nix-grpc-daemon[852]: time=2026-09-21T09:35:30.096Z level=INFO msg="Uploading 1 narinfos" lb # [ 59.476715] niks3-server[974]: 2026/09/21 09:35:30 INFO Signed narinfos id=14 count=1 lb # [ 59.479394] niks3-server[974]: 2026/09/21 09:35:30 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls lb # [ 59.489966] niks3-server[974]: 2026/09/21 09:35:30 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 59.495987] niks3-server[974]: 2026/09/21 09:35:30 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo lb # [ 59.502420] niks3-server[974]: 2026/09/21 09:35:30 INFO Completed upload id=14 worker1 # [ 59.499915] nix-grpc-daemon[852]: time=2026-09-21T09:35:30.126Z level=INFO msg="Upload complete. (290ms)" worker2 # [ 59.560873] nix-grpc-daemon[777]: ts=2026-09-21T09:35:30Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:43960 worker1 # [ 59.513024] nix-grpc-daemon[776]: ts=2026-09-21T09:35:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52016 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=1 worker1 # [ 59.526650] nix-daemon[839]: reaped child process 1088, status = succeeded worker2 # [ 59.573913] nix-grpc-daemon[777]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'... worker1 # [ 59.571965] nix-grpc-daemon[776]: ts=2026-09-21T09:35:30Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 59.577336] nix-grpc-daemon[776]: ts=2026-09-21T09:35:30Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52016 duration_s=0 paths=1 nar_bytes_out=176 worker1 # [ 59.847037] nix-grpc-daemon[776]: ts=2026-09-21T09:35:30Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 59.854399] nix-grpc-daemon[776]: ts=2026-09-21T09:35:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 59.860893] nix-grpc-daemon[852]: time=2026-09-21T09:35:30.486Z level=INFO msg="All 2 paths already cached" lb # [ 59.870242] envoy[917]: conn peer=[2001:db8:1::1]:56714 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3018 tx=1453 ms=4898 lb # [ 59.875621] envoy[917]: conn peer=[2001:db8:1::1]:56728 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1430 tx=1085 ms=3725 lb # [ 59.882164] envoy[917]: conn peer=[2001:db8:1::1]:53742 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3420 tx=1850 ms=2841 lb # [ 59.888773] envoy[917]: conn peer=[2001:db8:1::1]:53748 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=334 ms=75 worker2 # [ 59.932935] nix-grpc-daemon[777]: ts=2026-09-21T09:35:30Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=0 lb # [ 59.894247] envoy[917]: conn peer=[2001:db8:1::1]:53764 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=375 ms=25 worker2 # [ 59.938970] nix-grpc-daemon[777]: ts=2026-09-21T09:35:30Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.3:50051 clients=1 lb # [ 59.899694] envoy[917]: conn peer=[2001:db8:1::1]:53758 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3886 tx=2044 ms=2122 worker1 # [ 59.937647] nix-grpc-daemon[776]: ts=2026-09-21T09:35:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 59.953392] nix-grpc-daemon[776]: ts=2026-09-21T09:35:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 59.967532] nix-grpc-daemon[852]: time=2026-09-21T09:35:30.594Z level=INFO msg="All 2 paths already cached" worker1 # [ 59.977302] nix-grpc-daemon[776]: ts=2026-09-21T09:35:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 59.993520] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 60.197145] nix-daemon[839]: accepted connection from pid 1113, user nix-grpc-daemon (trusted) worker1 # [ 60.214790] nix-daemon[839]: reaped child process 1116, status = succeeded worker1 # [ 60.386328] nix-daemon[839]: accepted connection from pid 1118, user nix-grpc-daemon (trusted) worker1 # [ 60.402085] nix-daemon[839]: reaped child process 1121, status = succeeded lb # [ 60.417110] niks3-server[974]: 2026/09/21 09:35:31 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 60.423856] nix-grpc-daemon[852]: time=2026-09-21T09:35:31.050Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 60.425455] nix-grpc-daemon[852]: time=2026-09-21T09:35:31.050Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)" lb # [ 60.444469] niks3-server[974]: 2026/09/21 09:35:31 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst worker1 # [ 60.454882] nix-grpc-daemon[852]: time=2026-09-21T09:35:31.081Z level=INFO msg="Uploading 1 narinfos" lb # [ 60.458275] niks3-server[974]: 2026/09/21 09:35:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign lb # [ 60.468251] niks3-server[974]: 2026/09/21 09:35:31 INFO Signed narinfos id=15 count=1 lb # [ 60.474178] niks3-server[974]: 2026/09/21 09:35:31 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls lb # [ 60.482127] niks3-server[974]: 2026/09/21 09:35:31 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete worker1 # [ 60.483994] nix-grpc-daemon[852]: time=2026-09-21T09:35:31.110Z level=INFO msg="Upload complete. (472ms)" lb # [ 60.486716] niks3-server[974]: 2026/09/21 09:35:31 INFO Completed upload id=15 lb # [ 60.489617] niks3-server[974]: 2026/09/21 09:35:31 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo worker1 # [ 60.490672] nix-grpc-daemon[776]: ts=2026-09-21T09:35:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52016 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 60.503921] nix-grpc-daemon[776]: ts=2026-09-21T09:35:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 60.513367] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 60.516387] nix-daemon[839]: reaped child process 1111, status = succeeded worker1 # [ 60.529830] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 61.349882] nix-daemon[839]: reaped child process 1125, status = succeeded worker1 # [ 61.504898] nix-daemon[839]: accepted connection from pid 1141, user nix-grpc-daemon (trusted) worker1 # [ 61.523554] nix-daemon[839]: reaped child process 1144, status = succeeded lb # [ 61.538970] niks3-server[974]: 2026/09/21 09:35:32 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 61.548800] nix-grpc-daemon[852]: time=2026-09-21T09:35:32.172Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 61.550251] nix-grpc-daemon[852]: time=2026-09-21T09:35:32.172Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)" lb # [ 61.582589] niks3-server[974]: 2026/09/21 09:35:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign worker1 # [ 61.589273] nix-grpc-daemon[852]: time=2026-09-21T09:35:32.216Z level=INFO msg="Uploading 1 narinfos" lb # [ 61.598867] niks3-server[974]: 2026/09/21 09:35:32 INFO Signed narinfos id=16 count=1 lb # [ 61.605665] niks3-server[974]: 2026/09/21 09:35:32 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv lb # [ 61.616772] niks3-server[974]: 2026/09/21 09:35:32 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst worker1 # [ 61.618090] nix-grpc-daemon[852]: time=2026-09-21T09:35:32.244Z level=INFO msg="Upload complete. (279ms)" lb # [ 61.621803] niks3-server[974]: 2026/09/21 09:35:32 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls lb # [ 61.626150] niks3-server[974]: 2026/09/21 09:35:32 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 61.629972] niks3-server[974]: 2026/09/21 09:35:32 INFO Completed upload id=16 lb # [ 61.632443] niks3-server[974]: 2026/09/21 09:35:32 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo worker1 # [ 61.628857] nix-grpc-daemon[776]: ts=2026-09-21T09:35:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52016 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=1 worker2 # [ 61.681783] nix-grpc-daemon[777]: ts=2026-09-21T09:35:32Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:43960 worker1 # [ 61.640846] nix-daemon[839]: reaped child process 1123, status = succeeded worker2 # [ 61.694828] nix-grpc-daemon[777]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'... worker1 # [ 61.690641] nix-grpc-daemon[776]: ts=2026-09-21T09:35:32Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 61.696116] nix-grpc-daemon[776]: ts=2026-09-21T09:35:32Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52016 duration_s=0 paths=1 nar_bytes_out=232 client # [ 61.792966] nix-daemon[938]: reaped child process 940, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.07 seconds) client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 8.19 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.43 seconds) client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.20 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.25 seconds) worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 63.074639] nix-daemon[938]: accepted connection from pid 1020, user root (trusted) client # this derivation will be built: client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 63.326451] nix-grpc-daemon[777]: ts=2026-09-21T09:35:33Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:43960 worker2 # [ 63.334507] nix-grpc-daemon[777]: ts=2026-09-21T09:35:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43960 client # copying 1 paths... client # copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' to 'grpc://lb:50051'... worker2 # [ 63.345488] nix-grpc-daemon[777]: ts=2026-09-21T09:35:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43960 worker2 # [ 63.361087] nix-daemon[860]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 63.572700] nix-daemon[860]: accepted connection from pid 1000, user nix-grpc-daemon (trusted) worker2 # [ 63.593069] nix-daemon[860]: reaped child process 1003, status = succeeded lb # [ 63.561675] niks3-server[974]: 2026/09/21 09:35:34 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 63.616114] nix-grpc-daemon[915]: time=2026-09-21T09:35:34.225Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 63.617572] nix-grpc-daemon[915]: time=2026-09-21T09:35:34.225Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)" lb # [ 63.596917] niks3-server[974]: 2026/09/21 09:35:34 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst worker2 # [ 63.650408] nix-grpc-daemon[915]: time=2026-09-21T09:35:34.260Z level=INFO msg="Uploading 1 narinfos" lb # [ 63.608741] niks3-server[974]: 2026/09/21 09:35:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign lb # [ 63.619541] niks3-server[974]: 2026/09/21 09:35:34 INFO Signed narinfos id=17 count=1 lb # [ 63.625264] niks3-server[974]: 2026/09/21 09:35:34 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls lb # [ 63.635901] niks3-server[974]: 2026/09/21 09:35:34 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete lb # [ 63.641835] niks3-server[974]: 2026/09/21 09:35:34 INFO Completed upload id=17 worker2 # [ 63.685205] nix-grpc-daemon[915]: time=2026-09-21T09:35:34.295Z level=INFO msg="Upload complete. (307ms)" lb # [ 63.644778] niks3-server[974]: 2026/09/21 09:35:34 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo worker2 # [ 63.692145] nix-grpc-daemon[777]: ts=2026-09-21T09:35:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43960 duration_s=0 paths=1 nar_bytes_in=120 worker2 # [ 63.706967] nix-daemon[860]: reaped child process 998, status = succeeded worker2 # [ 63.713505] nix-grpc-daemon[777]: ts=2026-09-21T09:35:34Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=0 worker2 # [ 63.718683] nix-grpc-daemon[777]: ts=2026-09-21T09:35:34Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 63.760108] nix-grpc-daemon[777]: ts=2026-09-21T09:35:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43960 worker2 # [ 63.775935] nix-grpc-daemon[777]: ts=2026-09-21T09:35:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43960 client # copying 2 paths to 'lb:50051'... client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'... worker2 # [ 63.793400] nix-grpc-daemon[777]: ts=2026-09-21T09:35:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43960 client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'... worker2 # [ 63.809175] nix-daemon[860]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 64.009012] nix-daemon[860]: accepted connection from pid 1009, user nix-grpc-daemon (trusted) worker2 # [ 64.026548] nix-daemon[860]: reaped child process 1012, status = succeeded worker2 # [ 64.200111] nix-daemon[860]: accepted connection from pid 1014, user nix-grpc-daemon (trusted) worker2 # [ 64.217558] nix-daemon[860]: reaped child process 1017, status = succeeded lb # [ 64.185352] niks3-server[974]: 2026/09/21 09:35:34 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 64.196133] niks3-server[974]: 2026/09/21 09:35:34 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 64.248559] nix-grpc-daemon[915]: time=2026-09-21T09:35:34.858Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 64.250064] nix-grpc-daemon[915]: time=2026-09-21T09:35:34.858Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)" worker2 # [ 64.251728] nix-grpc-daemon[915]: time=2026-09-21T09:35:34.858Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)" lb # [ 64.239266] niks3-server[974]: 2026/09/21 09:35:34 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst lb # [ 64.251774] niks3-server[974]: 2026/09/21 09:35:34 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls lb # [ 64.257479] niks3-server[974]: 2026/09/21 09:35:34 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst lb # [ 64.264854] niks3-server[974]: 2026/09/21 09:35:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign worker2 # [ 64.309050] nix-grpc-daemon[915]: time=2026-09-21T09:35:34.918Z level=INFO msg="Uploading 3 narinfos" lb # [ 64.271697] niks3-server[974]: 2026/09/21 09:35:34 INFO Signed narinfos id=18 count=1 lb # [ 64.277714] niks3-server[974]: 2026/09/21 09:35:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign lb # [ 64.284520] niks3-server[974]: 2026/09/21 09:35:34 INFO Signed narinfos id=19 count=2 lb # [ 64.286546] niks3-server[974]: 2026/09/21 09:35:34 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls lb # [ 64.300554] niks3-server[974]: 2026/09/21 09:35:34 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo lb # [ 64.307599] niks3-server[974]: 2026/09/21 09:35:34 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo lb # [ 64.311528] niks3-server[974]: 2026/09/21 09:35:34 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 64.315395] niks3-server[974]: 2026/09/21 09:35:34 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo lb # [ 64.318416] niks3-server[974]: 2026/09/21 09:35:34 INFO Completed upload id=18 lb # [ 64.321431] niks3-server[974]: 2026/09/21 09:35:34 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete lb # [ 64.324433] niks3-server[974]: 2026/09/21 09:35:34 INFO Completed upload id=19 worker2 # [ 64.368206] nix-grpc-daemon[915]: time=2026-09-21T09:35:34.978Z level=INFO msg="Upload complete. (540ms)" worker2 # [ 64.381240] nix-grpc-daemon[777]: ts=2026-09-21T09:35:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43960 duration_s=0 paths=2 nar_bytes_in=984 worker2 # [ 64.399869] nix-grpc-daemon[777]: ts=2026-09-21T09:35:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43960 worker2 # [ 64.410292] nix-daemon[860]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 64.420433] nix-daemon[860]: reaped child process 1007, status = succeeded client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051... client # uses-input-w1onlya> worker2: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker2 # [ 64.432178] nix-daemon[860]: accepted connection from pid 777, user nix-grpc-daemon (trusted) client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 65.458266] nix-daemon[860]: reaped child process 1021, status = succeeded worker2 # [ 65.616768] nix-daemon[860]: accepted connection from pid 1037, user nix-grpc-daemon (trusted) worker2 # [ 65.634714] nix-daemon[860]: reaped child process 1040, status = succeeded lb # [ 65.603266] niks3-server[974]: 2026/09/21 09:35:36 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 65.656353] nix-grpc-daemon[915]: time=2026-09-21T09:35:36.266Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 65.634067] niks3-server[974]: 2026/09/21 09:35:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign worker2 # [ 65.684052] nix-grpc-daemon[915]: time=2026-09-21T09:35:36.293Z level=INFO msg="Uploading 1 narinfos" lb # [ 65.648854] niks3-server[974]: 2026/09/21 09:35:36 INFO Signed narinfos id=20 count=1 lb # [ 65.651975] niks3-server[974]: 2026/09/21 09:35:36 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls worker2 # [ 65.711469] nix-grpc-daemon[915]: time=2026-09-21T09:35:36.321Z level=INFO msg="Upload complete. (266ms)" lb # [ 65.662859] niks3-server[974]: 2026/09/21 09:35:36 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv lb # [ 65.673387] niks3-server[974]: 2026/09/21 09:35:36 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete lb # [ 65.677368] niks3-server[974]: 2026/09/21 09:35:36 INFO Completed upload id=20 client # copying 1 paths... lb # [ 65.680004] niks3-server[974]: 2026/09/21 09:35:36 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo worker2 # [ 65.721436] nix-grpc-daemon[777]: ts=2026-09-21T09:35:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43960 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=1 client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'... worker2 # [ 65.733759] nix-grpc-daemon[777]: ts=2026-09-21T09:35:36Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:43960 worker2 # [ 65.737033] nix-daemon[860]: reaped child process 1019, status = succeeded worker2 # [ 65.757380] nix-grpc-daemon[777]: ts=2026-09-21T09:35:36Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43960 worker2 # [ 65.764105] nix-grpc-daemon[777]: ts=2026-09-21T09:35:36Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43960 duration_s=0 paths=1 nar_bytes_out=120 client # [ 65.856867] nix-daemon[938]: reaped child process 1023, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.02 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 66.069060] nix-daemon[938]: accepted connection from pid 1041, user root (trusted) client # this derivation will be built: client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 66.313539] nix-grpc-daemon[777]: ts=2026-09-21T09:35:36Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:43960 worker2 # [ 66.321212] nix-grpc-daemon[777]: ts=2026-09-21T09:35:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43960 worker2 # [ 66.327771] nix-grpc-daemon[915]: time=2026-09-21T09:35:36.936Z level=INFO msg="All 1 paths already cached" worker2 # [ 66.339676] nix-grpc-daemon[777]: ts=2026-09-21T09:35:36Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=0 worker1 # [ 66.298547] nix-grpc-daemon[776]: ts=2026-09-21T09:35:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52016 worker2 # [ 66.346070] nix-grpc-daemon[777]: ts=2026-09-21T09:35:36Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 66.314051] nix-grpc-daemon[776]: ts=2026-09-21T09:35:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52016 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'... worker1 # [ 66.335448] nix-grpc-daemon[776]: ts=2026-09-21T09:35:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 66.350374] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 66.373572] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 8 ms (attempt 1/5) worker1 # [ 66.389197] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 143 ms (attempt 2/5) worker1 # [ 66.539812] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 148 ms (attempt 3/5) worker1 # [ 66.688282] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 747 ms (attempt 4/5) worker1 # [ 67.437215] nix-grpc-daemon[776]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 67.442650] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 67.451810] nix-grpc-daemon[776]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'... worker1 # [ 67.671785] nix-daemon[839]: accepted connection from pid 1158, user nix-grpc-daemon (trusted) worker1 # [ 67.690016] nix-daemon[839]: reaped child process 1161, status = succeeded worker1 # [ 67.861140] nix-daemon[839]: accepted connection from pid 1163, user nix-grpc-daemon (trusted) worker1 # [ 67.877811] nix-daemon[839]: reaped child process 1166, status = succeeded lb # [ 67.894093] niks3-server[974]: 2026/09/21 09:35:38 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 67.902570] nix-grpc-daemon[852]: time=2026-09-21T09:35:38.528Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 67.904088] nix-grpc-daemon[852]: time=2026-09-21T09:35:38.528Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)" lb # [ 67.921818] niks3-server[974]: 2026/09/21 09:35:38 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst lb # [ 67.937836] niks3-server[974]: 2026/09/21 09:35:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign worker1 # [ 67.941493] nix-grpc-daemon[852]: time=2026-09-21T09:35:38.568Z level=INFO msg="Uploading 1 narinfos" lb # [ 67.947929] niks3-server[974]: 2026/09/21 09:35:38 INFO Signed narinfos id=21 count=1 lb # [ 67.950950] niks3-server[974]: 2026/09/21 09:35:38 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls lb # [ 67.961825] niks3-server[974]: 2026/09/21 09:35:38 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete worker1 # [ 67.964726] nix-grpc-daemon[852]: time=2026-09-21T09:35:38.591Z level=INFO msg="Upload complete. (487ms)" lb # [ 67.969329] niks3-server[974]: 2026/09/21 09:35:38 INFO Completed upload id=21 lb # [ 67.972601] niks3-server[974]: 2026/09/21 09:35:38 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo worker1 # [ 67.972153] nix-grpc-daemon[776]: ts=2026-09-21T09:35:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52016 duration_s=1 paths=1 nar_bytes_in=568 worker1 # [ 67.983268] nix-grpc-daemon[776]: ts=2026-09-21T09:35:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 67.993999] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 67.999388] nix-daemon[839]: reaped child process 1151, status = succeeded client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051... worker1 # [ 68.011303] nix-daemon[839]: accepted connection from pid 776, user nix-grpc-daemon (trusted) client # uses-input-w1onlyb> node-a: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 69.055605] nix-daemon[839]: reaped child process 1170, status = succeeded worker1 # [ 69.229587] nix-daemon[839]: accepted connection from pid 1186, user nix-grpc-daemon (trusted) worker1 # [ 69.246962] nix-daemon[839]: reaped child process 1189, status = succeeded lb # [ 69.265869] niks3-server[974]: 2026/09/21 09:35:39 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 69.272765] nix-grpc-daemon[852]: time=2026-09-21T09:35:39.899Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 69.298333] niks3-server[974]: 2026/09/21 09:35:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign worker1 # [ 69.304106] nix-grpc-daemon[852]: time=2026-09-21T09:35:39.930Z level=INFO msg="Uploading 1 narinfos" lb # [ 69.311202] niks3-server[974]: 2026/09/21 09:35:39 INFO Signed narinfos id=22 count=1 lb # [ 69.319815] niks3-server[974]: 2026/09/21 09:35:39 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv lb # [ 69.327170] niks3-server[974]: 2026/09/21 09:35:39 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls lb # [ 69.334785] niks3-server[974]: 2026/09/21 09:35:39 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete lb # [ 69.339583] niks3-server[974]: 2026/09/21 09:35:39 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo lb # [ 69.343845] niks3-server[974]: 2026/09/21 09:35:39 INFO Completed upload id=22 worker1 # [ 69.341014] nix-grpc-daemon[852]: time=2026-09-21T09:35:39.967Z level=INFO msg="Upload complete. (320ms)" client # copying 1 paths... worker1 # [ 69.353063] nix-grpc-daemon[776]: ts=2026-09-21T09:35:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52016 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=1 worker2 # [ 69.403900] nix-grpc-daemon[777]: ts=2026-09-21T09:35:40Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:43960 worker1 # [ 69.367889] nix-daemon[839]: reaped child process 1168, status = succeeded worker2 # [ 69.416730] nix-grpc-daemon[777]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'... client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'... worker1 # [ 69.417532] nix-grpc-daemon[776]: ts=2026-09-21T09:35:40Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 69.423075] nix-grpc-daemon[776]: ts=2026-09-21T09:35:40Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:52016 duration_s=0 paths=1 nar_bytes_out=120 client # [ 69.513943] nix-daemon[938]: reaped child process 1044, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.66 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 69.728568] nix-daemon[938]: accepted connection from pid 1063, user root (trusted) client # this derivation will be built: client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv lb # [ 69.868185] envoy[917]: conn peer=[2001:db8:1::1]:53772 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4313 tx=2302 ms=1860 lb # [ 69.873652] envoy[917]: conn peer=[2001:db8:1::1]:40742 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=412 tx=406 ms=22 lb # [ 69.878762] envoy[917]: conn peer=[2001:db8:1::1]:40754 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=70 lb # [ 69.883785] envoy[917]: conn peer=[2001:db8:1::1]:40750 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4262 tx=1846 ms=2498 lb # [ 69.889375] envoy[917]: conn peer=[2001:db8:1::1]:40764 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3743 tx=2013 ms=3167 lb # [ 69.894469] envoy[917]: conn peer=[2001:db8:1::1]:40776 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=23 worker1 # [ 69.935309] nix-grpc-daemon[776]: ts=2026-09-21T09:35:40Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:52016 client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'... worker1 # [ 69.943738] nix-grpc-daemon[776]: ts=2026-09-21T09:35:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 69.954617] nix-grpc-daemon[852]: time=2026-09-21T09:35:40.581Z level=INFO msg="All 1 paths already cached" worker2 # [ 70.019034] nix-grpc-daemon[777]: ts=2026-09-21T09:35:40Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=0 worker2 # [ 70.029371] nix-grpc-daemon[777]: ts=2026-09-21T09:35:40Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 70.038948] nix-grpc-daemon[777]: ts=2026-09-21T09:35:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43960 worker2 # [ 70.046992] nix-grpc-daemon[777]: ts=2026-09-21T09:35:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43960 worker2 # [ 70.059541] nix-grpc-daemon[915]: time=2026-09-21T09:35:40.668Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'... worker2 # [ 70.070366] nix-grpc-daemon[777]: ts=2026-09-21T09:35:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43960 worker2 # [ 70.085519] nix-daemon[860]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 70.286215] nix-daemon[860]: accepted connection from pid 1049, user nix-grpc-daemon (trusted) worker2 # [ 70.308684] nix-daemon[860]: reaped child process 1052, status = succeeded worker2 # [ 70.480297] nix-daemon[860]: accepted connection from pid 1054, user nix-grpc-daemon (trusted) worker2 # [ 70.501184] nix-daemon[860]: reaped child process 1057, status = succeeded lb # [ 70.469325] niks3-server[974]: 2026/09/21 09:35:41 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 70.653658] nix-grpc-daemon[915]: time=2026-09-21T09:35:41.262Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 70.658561] nix-grpc-daemon[915]: time=2026-09-21T09:35:41.263Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)" lb # [ 70.633701] niks3-server[974]: 2026/09/21 09:35:41 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst worker2 # [ 70.688127] nix-grpc-daemon[915]: time=2026-09-21T09:35:41.298Z level=INFO msg="Uploading 1 narinfos" lb # [ 70.647831] niks3-server[974]: 2026/09/21 09:35:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign lb # [ 70.655715] niks3-server[974]: 2026/09/21 09:35:41 INFO Signed narinfos id=23 count=1 lb # [ 70.662385] niks3-server[974]: 2026/09/21 09:35:41 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls lb # [ 70.673276] niks3-server[974]: 2026/09/21 09:35:41 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete worker2 # [ 70.724447] nix-grpc-daemon[915]: time=2026-09-21T09:35:41.334Z level=INFO msg="Upload complete. (621ms)" lb # [ 70.681843] niks3-server[974]: 2026/09/21 09:35:41 INFO Completed upload id=23 lb # [ 70.685368] niks3-server[974]: 2026/09/21 09:35:41 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo worker2 # [ 70.738192] nix-grpc-daemon[777]: ts=2026-09-21T09:35:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43960 duration_s=0 paths=1 nar_bytes_in=568 worker2 # [ 70.752990] nix-grpc-daemon[777]: ts=2026-09-21T09:35:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43960 worker2 # [ 70.767602] nix-daemon[860]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 70.771119] nix-daemon[860]: reaped child process 1047, status = succeeded client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051... worker2 # [ 70.787639] nix-daemon[860]: accepted connection from pid 777, user nix-grpc-daemon (trusted) client # uses-input-w1onlyc> worker2: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 71.415181] nix-daemon[860]: reaped child process 1061, status = succeeded worker2 # [ 71.575865] nix-daemon[860]: accepted connection from pid 1077, user nix-grpc-daemon (trusted) worker2 # [ 71.596111] nix-daemon[860]: reaped child process 1080, status = succeeded lb # [ 71.566416] niks3-server[974]: 2026/09/21 09:35:42 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 71.623209] nix-grpc-daemon[915]: time=2026-09-21T09:35:42.231Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 71.601528] niks3-server[974]: 2026/09/21 09:35:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign worker2 # [ 71.651629] nix-grpc-daemon[915]: time=2026-09-21T09:35:42.261Z level=INFO msg="Uploading 1 narinfos" lb # [ 71.615837] niks3-server[974]: 2026/09/21 09:35:42 INFO Signed narinfos id=24 count=1 lb # [ 71.624235] niks3-server[974]: 2026/09/21 09:35:42 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv lb # [ 71.630680] niks3-server[974]: 2026/09/21 09:35:42 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls worker2 # [ 71.684588] nix-grpc-daemon[915]: time=2026-09-21T09:35:42.294Z level=INFO msg="Upload complete. (281ms)" lb # [ 71.640921] niks3-server[974]: 2026/09/21 09:35:42 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete lb # [ 71.646512] niks3-server[974]: 2026/09/21 09:35:42 INFO Completed upload id=24 lb # [ 71.649778] niks3-server[974]: 2026/09/21 09:35:42 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo worker2 # [ 71.692148] nix-grpc-daemon[777]: ts=2026-09-21T09:35:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43960 duration_s=0 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=1 client # copying 1 paths... worker2 # [ 71.708098] nix-daemon[860]: reaped child process 1059, status = succeeded worker1 # [ 71.661634] nix-grpc-daemon[776]: ts=2026-09-21T09:35:42Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 71.677107] nix-grpc-daemon[776]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'... client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'... worker2 # [ 71.767832] nix-grpc-daemon[777]: ts=2026-09-21T09:35:42Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43960 worker2 # [ 71.774747] nix-grpc-daemon[777]: ts=2026-09-21T09:35:42Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43960 duration_s=0 paths=1 nar_bytes_out=120 client # [ 71.822647] nix-daemon[938]: reaped child process 1066, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.31 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 9.91 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.46 seconds) client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.44 seconds) client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.20 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.24 seconds) worker2 # [ 73.282234] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 73.382569] nix-grpc-daemon[777]: ts=2026-09-21T09:35:43Z level=info event=signal_exit worker2 # [ 73.611564] nix-grpc-daemon[777]: ts=2026-09-21T09:35:44Z level=info event=scheduler_yield worker2 # [ 73.616855] nix-grpc-daemon[777]: ts=2026-09-21T09:35:44Z level=info event=scheduler_restarting addr=lb:50051 lb # [ 73.573964] niks3-server[974]: 2026/09/21 09:35:44 INFO lead: released remote=192.168.1.4:55662 worker2 # [ 73.622337] nix-grpc-daemon[777]: ts=2026-09-21T09:35:44Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:45070 worker1 # [ 73.580400] nix-grpc-daemon[776]: ts=2026-09-21T09:35:44Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 73.627063] nix-grpc-daemon[777]: ts=2026-09-21T09:35:44Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 73.632561] nix-grpc-daemon[777]: ts=2026-09-21T09:35:44Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:45070 worker2 # [ 73.637029] nix-grpc-daemon[777]: ts=2026-09-21T09:35:44Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 73.818261] nix-grpc-daemon[777]: ts=2026-09-21T09:35:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 73.823292] nix-grpc-daemon[777]: ts=2026-09-21T09:35:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 73.780358] nix-grpc-daemon[776]: ts=2026-09-21T09:35:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 73.785470] nix-grpc-daemon[776]: ts=2026-09-21T09:35:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 74.024393] nix-grpc-daemon[777]: ts=2026-09-21T09:35:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 74.029275] nix-grpc-daemon[777]: ts=2026-09-21T09:35:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 73.986129] nix-grpc-daemon[776]: ts=2026-09-21T09:35:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 73.991231] nix-grpc-daemon[776]: ts=2026-09-21T09:35:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 74.230384] nix-grpc-daemon[777]: ts=2026-09-21T09:35:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 74.235445] nix-grpc-daemon[777]: ts=2026-09-21T09:35:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 74.192691] nix-grpc-daemon[776]: ts=2026-09-21T09:35:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 74.197553] nix-grpc-daemon[776]: ts=2026-09-21T09:35:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 74.438043] nix-grpc-daemon[777]: ts=2026-09-21T09:35:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 74.442289] nix-grpc-daemon[777]: ts=2026-09-21T09:35:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 74.398375] nix-grpc-daemon[776]: ts=2026-09-21T09:35:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 74.403466] nix-grpc-daemon[776]: ts=2026-09-21T09:35:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 74.617712] nix-grpc-daemon[777]: ts=2026-09-21T09:35:45Z level=info event=scheduler_restarting worker1 # [ 74.605999] nix-grpc-daemon[776]: ts=2026-09-21T09:35:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 74.610122] nix-grpc-daemon[776]: ts=2026-09-21T09:35:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 74.661905] nix-grpc-daemon[777]: ts=2026-09-21T09:35:45Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 74.680620] nix-daemon[860]: reaped child process 862, status = succeeded worker1 # [ 74.806576] nix-grpc-daemon[776]: ts=2026-09-21T09:35:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 74.811734] nix-grpc-daemon[776]: ts=2026-09-21T09:35:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 75.012590] nix-grpc-daemon[776]: ts=2026-09-21T09:35:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 75.017633] nix-grpc-daemon[776]: ts=2026-09-21T09:35:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 75.218420] nix-grpc-daemon[776]: ts=2026-09-21T09:35:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 75.223497] nix-grpc-daemon[776]: ts=2026-09-21T09:35:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 75.424209] nix-grpc-daemon[776]: ts=2026-09-21T09:35:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 75.429218] nix-grpc-daemon[776]: ts=2026-09-21T09:35:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 75.488138] nix-grpc-daemon[777]: E0000 00:00:1789983346.096848 822 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker2 # [ 75.508176] nix-grpc-daemon[777]: E0000 00:00:1789983346.118037 822 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 75.631821] nix-grpc-daemon[776]: ts=2026-09-21T09:35:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 75.636106] nix-grpc-daemon[776]: ts=2026-09-21T09:35:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 75.836415] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 75.845283] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 75.847919] systemd[1]: nix-grpc-daemon.service: Consumed 1.931s CPU time over 55.805s wall clock time, 54.8M memory peak, 56.2K incoming IP traffic, 147.9K outgoing IP traffic. worker2 # [ 75.864887] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 75.867065] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 75.869504] systemd[1]: nix-grpc-daemon.socket: Consumed 555us CPU time over 1min 4.526s wall clock time, 256K memory peak, 74.7K incoming IP traffic, 63.7K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 75.832418] nix-grpc-daemon[776]: ts=2026-09-21T09:35:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 75.837329] nix-grpc-daemon[776]: ts=2026-09-21T09:35:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2 worker1 # [ 76.038174] nix-grpc-daemon[776]: ts=2026-09-21T09:35:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 76.043320] nix-grpc-daemon[776]: ts=2026-09-21T09:35:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 76.173268] nix-grpc-daemon[776]: ts=2026-09-21T09:35:46Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:52016 worker1 # [ 76.182619] nix-grpc-daemon[776]: ts=2026-09-21T09:35:46Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:52016 client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.30 seconds) worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache worker1 # [ 76.243968] nix-grpc-daemon[776]: ts=2026-09-21T09:35:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 76.249000] nix-grpc-daemon[776]: ts=2026-09-21T09:35:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds) worker2 # [ 76.369522] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 76.398260] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 76.450187] nix-grpc-daemon[776]: ts=2026-09-21T09:35:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 76.455346] nix-grpc-daemon[776]: ts=2026-09-21T09:35:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 76.657903] nix-grpc-daemon[776]: ts=2026-09-21T09:35:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 76.661964] nix-grpc-daemon[776]: ts=2026-09-21T09:35:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 76.825702] systemd[1]: Starting scheduler-token.service... worker1 # [ 76.858454] nix-grpc-daemon[776]: ts=2026-09-21T09:35:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 76.863410] nix-grpc-daemon[776]: ts=2026-09-21T09:35:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 76.937211] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 76.944973] systemd[1]: Finished scheduler-token.service. worker2 # [ 76.946870] systemd[1]: scheduler-token.service: Consumed 51ms CPU time over 115ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 76.955447] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 77.063980] nix-grpc-daemon[776]: ts=2026-09-21T09:35:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 77.068996] nix-grpc-daemon[776]: ts=2026-09-21T09:35:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 77.146633] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:47Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 77.149051] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:47Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 77.153013] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:47Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 77.160055] nix-grpc-daemon[1104]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 77.161481] nix-grpc-daemon[1104]: E0000 00:00:1789983347.769541 1104 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 77.173525] nix-grpc-daemon[1104]: E0000 00:00:1789983347.775462 1104 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 77.178752] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:47Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 77.183068] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 77.186253] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:47Z level=info event=scheduler_take_over lb # [ 77.142676] niks3-server[974]: 2026/09/21 09:35:47 INFO lead: acquired remote=192.168.1.4:41656 worker2 # [ 77.192065] nix-grpc-daemon[1104]: E0000 00:00:1789983347.799205 1144 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 77.216230] nix-grpc-daemon[1104]: E0000 00:00:1789983347.816752 1144 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 77.218520] nix-grpc-daemon[1104]: E0000 00:00:1789983347.816915 1144 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 77.226951] nix-grpc-daemon[1104]: E0000 00:00:1789983347.836317 1144 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 77.239179] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 77.240801] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 77.269677] nix-grpc-daemon[776]: ts=2026-09-21T09:35:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 77.274677] nix-grpc-daemon[776]: ts=2026-09-21T09:35:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 77.288310] nix-grpc-daemon[776]: ts=2026-09-21T09:35:47Z level=info event=signal_exit worker2 # [ 77.442246] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 77.447165] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 77.475363] nix-grpc-daemon[776]: ts=2026-09-21T09:35:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 77.480681] nix-grpc-daemon[776]: ts=2026-09-21T09:35:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 77.648374] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 77.653475] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 77.683201] nix-grpc-daemon[776]: ts=2026-09-21T09:35:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 77.687331] nix-grpc-daemon[776]: ts=2026-09-21T09:35:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 77.854571] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 77.859786] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 77.883939] nix-grpc-daemon[776]: ts=2026-09-21T09:35:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 77.889007] nix-grpc-daemon[776]: ts=2026-09-21T09:35:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 78.060872] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 78.065974] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 78.089728] nix-grpc-daemon[776]: ts=2026-09-21T09:35:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 78.094766] nix-grpc-daemon[776]: ts=2026-09-21T09:35:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 78.268419] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 78.284138] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:48Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 78.288525] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:48Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:37390 worker2 # [ 78.293820] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:48Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 78.295548] nix-grpc-daemon[776]: ts=2026-09-21T09:35:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 78.343749] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:48Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:37390 worker2 # [ 78.348783] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:48Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 78.546470] nix-grpc-daemon[776]: ts=2026-09-21T09:35:49Z level=info event=scheduler_restarting worker2 # [ 78.603347] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:49Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:37390 worker2 # [ 78.608341] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:49Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 78.587992] nix-grpc-daemon[776]: ts=2026-09-21T09:35:49Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 78.606123] nix-daemon[839]: reaped child process 841, status = succeeded worker1 # [ 79.411432] nix-grpc-daemon[776]: E0000 00:00:1789983350.037022 821 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true worker1 # [ 79.418226] nix-grpc-daemon[776]: E0000 00:00:1789983350.037260 821 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 79.719286] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 79.728304] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 79.730847] systemd[1]: nix-grpc-daemon.service: Consumed 3.520s CPU time over 59.839s wall clock time, 63.2M memory peak, 87.6K incoming IP traffic, 159.9K outgoing IP traffic. worker1 # [ 79.748857] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 79.751884] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 79.754924] systemd[1]: nix-grpc-daemon.socket: Consumed 563us CPU time over 1min 8.952s wall clock time, 256K memory peak, 77.7K incoming IP traffic, 63.6K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2 lb # [ 79.865458] envoy[917]: conn peer=[2001:db8:1::1]:40792 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3739 tx=1994 ms=1810 lb # [ 79.870026] envoy[917]: conn peer=[2001:db8:1::1]:53230 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=26 lb # [ 79.874329] envoy[917]: conn peer=[2001:db8:1::4]:36934 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=34465 tx=1899 ms=54209 lb # [ 79.878973] envoy[917]: conn peer=[2001:db8:1::1]:53236 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=28 lb # [ 79.883528] envoy[917]: conn peer=[2001:db8:1::3]:44964 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=10435 tx=2895 ms=58203 worker2 # [ 80.157311] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37398 worker2 # [ 80.173437] nix-daemon[860]: accepted connection from pid 1104, user nix-grpc-daemon (trusted) worker2 # [ 80.202770] nix-grpc-daemon[1104]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 13 ms (attempt 1/5) worker2 # [ 80.223681] nix-grpc-daemon[1104]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 70 ms (attempt 2/5) worker2 # [ 80.301350] nix-grpc-daemon[1104]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 325 ms (attempt 3/5) worker2 # [ 80.634131] nix-grpc-daemon[1104]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 371 ms (attempt 4/5) worker2 # [ 81.006036] nix-grpc-daemon[1104]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 81.012221] nix-grpc-daemon[1104]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 81.036468] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37398 client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 81.054604] nix-daemon[860]: accepted connection from pid 1104, user nix-grpc-daemon (trusted) worker2 # [ 81.084696] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:51Z level=info event=niks3_push_started pid=1164 worker2 # [ 81.300335] nix-grpc-daemon[1164]: time=2026-09-21T09:35:51.909Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 81.473069] nix-daemon[860]: accepted connection from pid 1177, user nix-grpc-daemon (trusted) worker2 # [ 81.490427] nix-daemon[860]: reaped child process 1180, status = succeeded lb # [ 81.461330] niks3-server[974]: 2026/09/21 09:35:52 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 81.470988] niks3-server[974]: 2026/09/21 09:35:52 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 81.524073] nix-grpc-daemon[1164]: time=2026-09-21T09:35:52.132Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 81.525531] nix-grpc-daemon[1164]: time=2026-09-21T09:35:52.132Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)" worker2 # [ 81.527240] nix-grpc-daemon[1164]: time=2026-09-21T09:35:52.132Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)" lb # [ 81.515155] niks3-server[974]: 2026/09/21 09:35:52 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst lb # [ 81.531073] niks3-server[974]: 2026/09/21 09:35:52 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 81.542166] niks3-server[974]: 2026/09/21 09:35:52 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls lb # [ 81.551647] niks3-server[974]: 2026/09/21 09:35:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign lb # [ 81.560652] niks3-server[974]: 2026/09/21 09:35:52 INFO Signed narinfos id=25 count=1 worker2 # [ 81.604214] nix-grpc-daemon[1164]: time=2026-09-21T09:35:52.213Z level=INFO msg="Uploading 3 narinfos" lb # [ 81.564354] niks3-server[974]: 2026/09/21 09:35:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign lb # [ 81.569693] niks3-server[974]: 2026/09/21 09:35:52 INFO Signed narinfos id=26 count=2 lb # [ 81.574211] niks3-server[974]: 2026/09/21 09:35:52 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls lb # [ 81.594016] niks3-server[974]: 2026/09/21 09:35:52 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo lb # [ 81.600287] niks3-server[974]: 2026/09/21 09:35:52 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete lb # [ 81.604565] niks3-server[974]: 2026/09/21 09:35:52 INFO Completed upload id=25 lb # [ 81.610337] niks3-server[974]: 2026/09/21 09:35:52 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete lb # [ 81.617356] niks3-server[974]: 2026/09/21 09:35:52 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo worker2 # [ 81.659164] nix-grpc-daemon[1164]: time=2026-09-21T09:35:52.269Z level=INFO msg="Upload complete. (354ms)" lb # [ 81.619804] niks3-server[974]: 2026/09/21 09:35:52 INFO Completed upload id=26 worker2 # [ 81.669218] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37398 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 81.688117] nix-grpc-daemon[1164]: time=2026-09-21T09:35:52.287Z level=WARN msg="Failed to register uploaded object" key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo error="server returned 404: object is not pending upload\n" worker2 # [ 81.694925] nix-daemon[860]: reaped child process 1162, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.83 seconds) worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.03 seconds) worker1 # [ 81.791753] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 81.801343] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 82.002366] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:52Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 82.004975] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:52Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 82.009177] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:52Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 82.016059] nix-grpc-daemon[1213]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 82.017518] nix-grpc-daemon[1213]: E0000 00:00:1789983352.642461 1213 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 82.028079] nix-grpc-daemon[1213]: E0000 00:00:1789983352.648939 1213 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 82.031287] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:52Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 82.035636] systemd[1]: Started Nix worker-protocol over gRPC. lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 82.040100] nix-grpc-daemon[1213]: E0000 00:00:1789983352.665776 1252 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 82.068168] nix-grpc-daemon[1213]: E0000 00:00:1789983352.683391 1252 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 82.070471] nix-grpc-daemon[1213]: E0000 00:00:1789983352.683554 1252 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 82.077047] nix-grpc-daemon[1213]: E0000 00:00:1789983352.702751 1252 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 82.088236] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 82.137397] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:52Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:37390 worker2 # [ 82.142997] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:52Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.17 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 11.38 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2 # [ 83.513149] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 84.177381] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:54Z level=info event=signal_exit worker2 # [ 84.388355] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:54Z level=info event=scheduler_yield lb # [ 84.350344] niks3-server[974]: 2026/09/21 09:35:54 INFO lead: released remote=192.168.1.4:41656 worker1 # [ 84.348715] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:54Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 84.395370] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:55Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:37390 worker2 # [ 84.400218] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:55Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 84.407195] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:55Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 84.411396] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:55Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:37390 worker2 # [ 84.415919] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:55Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 84.548727] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 84.553885] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 84.607057] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 84.612225] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 84.754499] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 84.759756] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 84.813264] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 84.818363] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 84.960610] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 84.965629] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 85.019526] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 85.024416] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 85.166566] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 85.171767] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 85.227098] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 85.231189] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 85.393582] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:56Z level=info event=scheduler_restarting worker1 # [ 85.374253] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 85.423587] nix-daemon[860]: reaped child process 1156, status = succeeded worker1 # [ 85.378494] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 85.446733] nix-grpc-daemon[1104]: ts=2026-09-21T09:35:56Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 85.574845] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 85.580130] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 85.780890] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 85.785871] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 85.986642] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 85.991735] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 86.206851] nix-grpc-daemon[1104]: E0000 00:00:1789983356.816626 1149 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker2 # [ 86.207213] nix-grpc-daemon[1104]: E0000 00:00:1789983356.816860 1149 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 86.192639] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 86.197770] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 86.400603] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 86.404903] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 86.601153] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 86.606212] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 86.806863] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 86.811965] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 87.012824] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 87.018094] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 87.037581] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:57Z level=info event=scheduler_take_over lb # [ 87.041235] niks3-server[974]: 2026/09/21 09:35:57 INFO lead: acquired remote=192.168.1.3:39676 worker2 # [ 87.198581] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 87.203121] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 87.211619] systemd[1]: nix-grpc-daemon.service: Consumed 492ms CPU time over 10.246s wall clock time, 33.5M memory peak, 20.5K incoming IP traffic, 30.7K outgoing IP traffic. worker2 # [ 87.223190] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 87.228301] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 87.230131] systemd[1]: nix-grpc-daemon.socket: Consumed 755us CPU time over 10.860s wall clock time, 256K memory peak, 21.2K incoming IP traffic, 16K outgoing IP traffic. worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker1 # [ 87.218911] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 87.230912] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.09 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker1 # [ 87.430167] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 87.435253] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 87.636140] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 87.641286] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 87.841828] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 87.850873] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:58Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:50898 worker1 # [ 87.856489] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:58Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2 worker1 # [ 88.678006] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:59Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50904 worker1 # [ 88.691015] nix-daemon[839]: accepted connection from pid 1213, user nix-grpc-daemon (trusted) client # don't know how to build these paths: client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker1 # [ 88.711417] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50904 worker1 # [ 88.729379] nix-grpc-daemon[1213]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 12 ms (attempt 1/5) worker1 # [ 88.750308] nix-grpc-daemon[1213]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 47 ms (attempt 2/5) worker1 # [ 88.805024] nix-grpc-daemon[1213]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 279 ms (attempt 3/5) worker1 # [ 89.091665] nix-grpc-daemon[1213]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 243 ms (attempt 4/5) worker1 # [ 89.335574] nix-grpc-daemon[1213]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 89.341585] nix-grpc-daemon[1213]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 89.373272] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:59Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=0 worker1 # [ 89.380258] nix-grpc-daemon[1213]: ts=2026-09-21T09:35:59Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 89.421850] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50904 worker1 # [ 89.437349] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50904 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'... worker1 # [ 89.451607] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50904 worker1 # [ 89.466310] nix-daemon[839]: accepted connection from pid 1213, user nix-grpc-daemon (trusted) worker1 # [ 89.495872] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:00Z level=info event=niks3_push_started pid=1287 worker1 # [ 89.708670] nix-grpc-daemon[1287]: time=2026-09-21T09:36:00.335Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" lb # [ 89.865705] envoy[917]: conn peer=[2001:db8:1::1]:53252 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1010 tx=304 ms=1529 lb # [ 89.873165] envoy[917]: conn peer=[2001:db8:1::4]:56798 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=7963 tx=535 ms=8198 worker1 # [ 89.882270] nix-daemon[839]: accepted connection from pid 1300, user nix-grpc-daemon (trusted) worker1 # [ 89.899310] nix-daemon[839]: reaped child process 1303, status = succeeded worker1 # [ 90.074866] nix-daemon[839]: accepted connection from pid 1305, user nix-grpc-daemon (trusted) worker1 # [ 90.091860] nix-daemon[839]: reaped child process 1308, status = succeeded lb # [ 90.107027] niks3-server[974]: 2026/09/21 09:36:00 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 90.114699] nix-grpc-daemon[1287]: time=2026-09-21T09:36:00.740Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 90.116480] nix-grpc-daemon[1287]: time=2026-09-21T09:36:00.740Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)" lb # [ 90.145829] niks3-server[974]: 2026/09/21 09:36:00 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst worker1 # [ 90.156951] nix-grpc-daemon[1287]: time=2026-09-21T09:36:00.783Z level=INFO msg="Uploading 1 narinfos" lb # [ 90.159411] niks3-server[974]: 2026/09/21 09:36:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign lb # [ 90.166250] niks3-server[974]: 2026/09/21 09:36:00 INFO Signed narinfos id=27 count=1 lb # [ 90.174728] niks3-server[974]: 2026/09/21 09:36:00 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls lb # [ 90.188628] niks3-server[974]: 2026/09/21 09:36:00 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete worker1 # [ 90.191323] nix-grpc-daemon[1287]: time=2026-09-21T09:36:00.818Z level=INFO msg="Upload complete. (478ms)" lb # [ 90.195283] niks3-server[974]: 2026/09/21 09:36:00 INFO Completed upload id=27 lb # [ 90.199575] niks3-server[974]: 2026/09/21 09:36:00 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo worker1 # [ 90.200884] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50904 duration_s=0 paths=1 nar_bytes_in=520 worker1 # [ 90.214489] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50904 worker1 # [ 90.224308] nix-daemon[839]: accepted connection from pid 1213, user nix-grpc-daemon (trusted) worker1 # [ 90.227485] nix-daemon[839]: reaped child process 1285, status = succeeded client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051... client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker1 # [ 90.240866] nix-daemon[839]: accepted connection from pid 1213, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-on-standby worker1 # [ 91.286884] nix-daemon[839]: reaped child process 1312, status = succeeded worker1 # [ 91.470412] nix-daemon[839]: accepted connection from pid 1328, user nix-grpc-daemon (trusted) worker1 # [ 91.486903] nix-daemon[839]: reaped child process 1331, status = succeeded lb # [ 91.501805] niks3-server[974]: 2026/09/21 09:36:02 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 91.511773] nix-grpc-daemon[1287]: time=2026-09-21T09:36:02.135Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 91.514068] nix-grpc-daemon[1287]: time=2026-09-21T09:36:02.135Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)" lb # [ 91.535436] niks3-server[974]: 2026/09/21 09:36:02 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv lb # [ 91.556994] niks3-server[974]: 2026/09/21 09:36:02 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 91.567951] niks3-server[974]: 2026/09/21 09:36:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign worker1 # [ 91.571718] nix-grpc-daemon[1287]: time=2026-09-21T09:36:02.197Z level=INFO msg="Uploading 1 narinfos" lb # [ 91.578730] niks3-server[974]: 2026/09/21 09:36:02 INFO Signed narinfos id=28 count=1 lb # [ 91.584824] niks3-server[974]: 2026/09/21 09:36:02 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls lb # [ 91.592632] niks3-server[974]: 2026/09/21 09:36:02 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 91.598447] niks3-server[974]: 2026/09/21 09:36:02 INFO Completed upload id=28 worker1 # [ 91.595188] nix-grpc-daemon[1287]: time=2026-09-21T09:36:02.222Z level=INFO msg="Upload complete. (344ms)" lb # [ 91.600862] niks3-server[974]: 2026/09/21 09:36:02 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo worker1 # [ 91.618530] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50904 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=1 worker1 # [ 91.635557] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:02Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=0 worker1 # [ 91.639006] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:02Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 91.642923] nix-daemon[839]: reaped child process 1310, status = succeeded worker1 # [ 91.667358] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50904 worker1 # [ 91.683451] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50904 worker1 # [ 91.699035] nix-grpc-daemon[1287]: time=2026-09-21T09:36:02.325Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'... worker1 # [ 91.709611] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50904 worker1 # [ 91.723695] nix-daemon[839]: accepted connection from pid 1213, user nix-grpc-daemon (trusted) worker1 # [ 91.928607] nix-daemon[839]: accepted connection from pid 1337, user nix-grpc-daemon (trusted) worker1 # [ 91.948580] nix-daemon[839]: reaped child process 1340, status = succeeded worker1 # [ 92.131116] nix-daemon[839]: accepted connection from pid 1342, user nix-grpc-daemon (trusted) worker1 # [ 92.149222] nix-daemon[839]: reaped child process 1345, status = succeeded lb # [ 92.163197] niks3-server[974]: 2026/09/21 09:36:02 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 92.170757] nix-grpc-daemon[1287]: time=2026-09-21T09:36:02.797Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 92.172394] nix-grpc-daemon[1287]: time=2026-09-21T09:36:02.797Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)" lb # [ 92.191892] niks3-server[974]: 2026/09/21 09:36:02 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst lb # [ 92.207429] niks3-server[974]: 2026/09/21 09:36:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign worker1 # [ 92.210940] nix-grpc-daemon[1287]: time=2026-09-21T09:36:02.837Z level=INFO msg="Uploading 1 narinfos" lb # [ 92.220774] niks3-server[974]: 2026/09/21 09:36:02 INFO Signed narinfos id=29 count=1 lb # [ 92.223870] niks3-server[974]: 2026/09/21 09:36:02 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls lb # [ 92.237968] niks3-server[974]: 2026/09/21 09:36:02 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete worker1 # [ 92.240858] nix-grpc-daemon[1287]: time=2026-09-21T09:36:02.867Z level=INFO msg="Upload complete. (499ms)" lb # [ 92.244914] niks3-server[974]: 2026/09/21 09:36:02 INFO Completed upload id=29 lb # [ 92.250397] niks3-server[974]: 2026/09/21 09:36:02 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo worker1 # [ 92.252135] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50904 duration_s=0 paths=1 nar_bytes_in=640 worker1 # [ 92.263597] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50904 worker1 # [ 92.271571] nix-daemon[839]: accepted connection from pid 1213, user nix-grpc-daemon (trusted) worker1 # [ 92.277466] nix-daemon[839]: reaped child process 1335, status = succeeded client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051... client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker1 # [ 92.292769] nix-daemon[839]: accepted connection from pid 1213, user nix-grpc-daemon (trusted) client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-on-standby worker1 # [ 93.776004] nix-daemon[839]: reaped child process 1349, status = succeeded worker1 # [ 93.963221] nix-daemon[839]: accepted connection from pid 1365, user nix-grpc-daemon (trusted) worker1 # [ 93.982548] nix-daemon[839]: reaped child process 1368, status = succeeded lb # [ 93.998520] niks3-server[974]: 2026/09/21 09:36:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 94.007956] nix-grpc-daemon[1287]: time=2026-09-21T09:36:04.633Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 94.009938] nix-grpc-daemon[1287]: time=2026-09-21T09:36:04.633Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)" lb # [ 94.040374] niks3-server[974]: 2026/09/21 09:36:04 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst lb # [ 94.051828] niks3-server[974]: 2026/09/21 09:36:04 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker1 # [ 94.056188] nix-grpc-daemon[1287]: time=2026-09-21T09:36:04.682Z level=INFO msg="Uploading 1 narinfos" lb # [ 94.060328] niks3-server[974]: 2026/09/21 09:36:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign lb # [ 94.067353] niks3-server[974]: 2026/09/21 09:36:04 INFO Signed narinfos id=30 count=1 lb # [ 94.072963] niks3-server[974]: 2026/09/21 09:36:04 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls lb # [ 94.081805] niks3-server[974]: 2026/09/21 09:36:04 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete lb # [ 94.087938] niks3-server[974]: 2026/09/21 09:36:04 INFO Completed upload id=30 worker1 # [ 94.085284] nix-grpc-daemon[1287]: time=2026-09-21T09:36:04.712Z level=INFO msg="Upload complete. (378ms)" lb # [ 94.090990] niks3-server[974]: 2026/09/21 09:36:04 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo worker1 # [ 94.104573] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50904 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=1 worker1 # [ 94.120399] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:04Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=0 worker1 # [ 94.124315] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:04Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 94.128462] nix-daemon[839]: reaped child process 1347, status = succeeded worker1 # [ 94.149992] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50904 worker1 # [ 94.166402] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50904 client # copying 1 paths to 'lb:50051'... worker1 # [ 94.181164] nix-grpc-daemon[1287]: time=2026-09-21T09:36:04.808Z level=INFO msg="All 2 paths already cached" client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'... worker1 # [ 94.188119] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50904 worker1 # [ 94.201446] nix-daemon[839]: accepted connection from pid 1213, user nix-grpc-daemon (trusted) worker1 # [ 94.397413] nix-daemon[839]: accepted connection from pid 1374, user nix-grpc-daemon (trusted) worker1 # [ 94.414349] nix-daemon[839]: reaped child process 1377, status = succeeded worker1 # [ 94.583271] nix-daemon[839]: accepted connection from pid 1379, user nix-grpc-daemon (trusted) worker1 # [ 94.599259] nix-daemon[839]: reaped child process 1382, status = succeeded lb # [ 94.615587] niks3-server[974]: 2026/09/21 09:36:05 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 94.621445] nix-grpc-daemon[1287]: time=2026-09-21T09:36:05.248Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 94.622938] nix-grpc-daemon[1287]: time=2026-09-21T09:36:05.248Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)" lb # [ 94.641754] niks3-server[974]: 2026/09/21 09:36:05 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst worker1 # [ 94.658092] nix-grpc-daemon[1287]: time=2026-09-21T09:36:05.284Z level=INFO msg="Uploading 1 narinfos" lb # [ 94.655104] niks3-server[974]: 2026/09/21 09:36:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign lb # [ 94.667785] niks3-server[974]: 2026/09/21 09:36:05 INFO Signed narinfos id=31 count=1 lb # [ 94.674288] niks3-server[974]: 2026/09/21 09:36:05 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls lb # [ 94.683530] niks3-server[974]: 2026/09/21 09:36:05 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete worker1 # [ 94.685321] nix-grpc-daemon[1287]: time=2026-09-21T09:36:05.312Z level=INFO msg="Upload complete. (468ms)" lb # [ 94.688645] niks3-server[974]: 2026/09/21 09:36:05 INFO Completed upload id=31 lb # [ 94.692720] niks3-server[974]: 2026/09/21 09:36:05 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo worker1 # [ 94.692139] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50904 duration_s=0 paths=1 nar_bytes_in=768 worker1 # [ 94.705662] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50904 worker1 # [ 94.712624] nix-daemon[839]: accepted connection from pid 1213, user nix-grpc-daemon (trusted) worker1 # [ 94.717204] nix-daemon[839]: reaped child process 1372, status = succeeded client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051... client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker1 # [ 94.729990] nix-daemon[839]: accepted connection from pid 1213, user nix-grpc-daemon (trusted) client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-on-standby worker1 # [ 95.354851] nix-daemon[839]: reaped child process 1386, status = succeeded worker1 # [ 95.528444] nix-daemon[839]: accepted connection from pid 1402, user nix-grpc-daemon (trusted) worker1 # [ 95.546686] nix-daemon[839]: reaped child process 1405, status = succeeded lb # [ 95.561864] niks3-server[974]: 2026/09/21 09:36:06 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 95.568359] nix-grpc-daemon[1287]: time=2026-09-21T09:36:06.195Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 95.571576] nix-grpc-daemon[1287]: time=2026-09-21T09:36:06.196Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)" lb # [ 95.591220] niks3-server[974]: 2026/09/21 09:36:06 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv lb # [ 95.609157] niks3-server[974]: 2026/09/21 09:36:06 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst lb # [ 95.623451] niks3-server[974]: 2026/09/21 09:36:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign worker1 # [ 95.626595] nix-grpc-daemon[1287]: time=2026-09-21T09:36:06.253Z level=INFO msg="Uploading 1 narinfos" lb # [ 95.634731] niks3-server[974]: 2026/09/21 09:36:06 INFO Signed narinfos id=32 count=1 lb # [ 95.640571] niks3-server[974]: 2026/09/21 09:36:06 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls lb # [ 95.646792] niks3-server[974]: 2026/09/21 09:36:06 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 95.653669] niks3-server[974]: 2026/09/21 09:36:06 INFO Completed upload id=32 lb # [ 95.656490] niks3-server[974]: 2026/09/21 09:36:06 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo worker1 # [ 95.650393] nix-grpc-daemon[1287]: time=2026-09-21T09:36:06.277Z level=INFO msg="Upload complete. (310ms)" worker1 # [ 95.665204] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50904 duration_s=0 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=1 worker1 # [ 95.679517] nix-daemon[839]: reaped child process 1384, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 7.31 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.24 seconds) worker2 # [ 96.098924] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 96.107861] systemd[1]: Starting scheduler-token.service... worker2 # [ 96.208777] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 96.214738] systemd[1]: Finished scheduler-token.service. worker2 # [ 96.216393] systemd[1]: scheduler-token.service: Consumed 41ms CPU time over 101ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 96.221958] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 96.401987] nix-grpc-daemon[1204]: ts=2026-09-21T09:36:07Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 96.404799] nix-grpc-daemon[1204]: ts=2026-09-21T09:36:07Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 96.409172] nix-grpc-daemon[1204]: ts=2026-09-21T09:36:07Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 96.416070] nix-grpc-daemon[1204]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 96.417523] nix-grpc-daemon[1204]: E0000 00:00:1789983367.025675 1204 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 96.433288] nix-grpc-daemon[1204]: E0000 00:00:1789983367.032095 1204 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 96.438542] nix-grpc-daemon[1204]: ts=2026-09-21T09:36:07Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 96.452234] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 96.453123] nix-grpc-daemon[1204]: E0000 00:00:1789983367.054517 1243 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 96.479272] nix-grpc-daemon[1204]: E0000 00:00:1789983367.073888 1243 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 96.482169] nix-grpc-daemon[1204]: E0000 00:00:1789983367.074038 1243 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 96.484659] nix-grpc-daemon[1204]: E0000 00:00:1789983367.088466 1243 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 96.496283] nix-grpc-daemon[1204]: ts=2026-09-21T09:36:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 96.460150] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:07Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 96.464967] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:07Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:50898 worker1 # [ 96.470339] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:07Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 13.56 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs client # [ 96.849917] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: d79c9da2c29a418d9aeb9779761a725f client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.09 seconds) worker1 # [ 97.095273] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50904 client # [ 97.113017] nix[1165]: don't know how to build these paths: client # [ 97.114043] nix[1165]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker1 # [ 97.114733] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:07Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=0 worker1 # [ 97.121739] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:07Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 97.161671] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50904 worker1 # [ 97.177510] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50904 client # [ 97.199043] nix[1165]: copying 1 paths to 'lb:50051'... client # [ 97.205070] nix[1165]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'... worker1 # [ 97.194104] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50904 worker1 # [ 97.211112] nix-daemon[839]: accepted connection from pid 1213, user nix-grpc-daemon (trusted) worker1 # [ 97.414354] nix-daemon[839]: accepted connection from pid 1418, user nix-grpc-daemon (trusted) worker1 # [ 97.433110] nix-daemon[839]: reaped child process 1421, status = succeeded worker1 # [ 97.605990] nix-daemon[839]: accepted connection from pid 1423, user nix-grpc-daemon (trusted) worker1 # [ 97.622275] nix-daemon[839]: reaped child process 1426, status = succeeded lb # [ 97.642816] niks3-server[974]: 2026/09/21 09:36:08 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 97.653259] nix-grpc-daemon[1287]: time=2026-09-21T09:36:08.279Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 97.654698] nix-grpc-daemon[1287]: time=2026-09-21T09:36:08.279Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)" lb # [ 97.677112] niks3-server[974]: 2026/09/21 09:36:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign worker1 # [ 97.686241] nix-grpc-daemon[1287]: time=2026-09-21T09:36:08.313Z level=INFO msg="Uploading 1 narinfos" lb # [ 97.693716] niks3-server[974]: 2026/09/21 09:36:08 INFO Signed narinfos id=33 count=1 lb # [ 97.702263] niks3-server[974]: 2026/09/21 09:36:08 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst lb # [ 97.714860] niks3-server[974]: 2026/09/21 09:36:08 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls lb # [ 97.722968] niks3-server[974]: 2026/09/21 09:36:08 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete lb # [ 97.727617] niks3-server[974]: 2026/09/21 09:36:08 INFO Completed upload id=33 worker1 # [ 97.724893] nix-grpc-daemon[1287]: time=2026-09-21T09:36:08.351Z level=INFO msg="Upload complete. (496ms)" lb # [ 97.730347] niks3-server[974]: 2026/09/21 09:36:08 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo worker1 # [ 97.732153] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50904 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 97.746097] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50904 worker1 # [ 97.756073] nix-daemon[839]: accepted connection from pid 1213, user nix-grpc-daemon (trusted) worker1 # [ 97.758570] nix-daemon[839]: reaped child process 1416, status = succeeded client # [ 97.779346] nix[1165]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051... worker1 # [ 97.773207] nix-daemon[839]: accepted connection from pid 1213, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker2 # [ 99.824780] systemd-journald[274]: Received client request to rotate journal, rotating. worker2 # [ 99.847874] systemd-journald[274]: Vacuuming done, freed 0B of archived journals from /var/log/journal/ab255008e5414c8e875cf15eb74662d0. worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.10 seconds) worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker1 # [ 99.862339] systemd[1]: Stopping Nix worker-protocol over gRPC... lb # [ 99.867286] envoy[917]: conn peer=[2001:db8:1::1]:57028 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9610 tx=4103 ms=7004 worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds) client: must succeed: sleep 5.0 worker1 # [ 100.034578] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:10Z level=info event=draining client: (finished: must succeed: sleep 5.0, in 5.06 seconds) worker1 # [ 105.198766] nix-daemon[839]: reaped child process 1430, status = succeeded worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker1 # [ 105.356056] nix-daemon[839]: accepted connection from pid 1471, user nix-grpc-daemon (trusted) worker1 # [ 105.374338] nix-daemon[839]: reaped child process 1474, status = succeeded lb # [ 105.391045] niks3-server[974]: 2026/09/21 09:36:16 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 105.400382] nix-grpc-daemon[1287]: time=2026-09-21T09:36:16.024Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 105.401878] nix-grpc-daemon[1287]: time=2026-09-21T09:36:16.024Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)" lb # [ 105.435660] niks3-server[974]: 2026/09/21 09:36:16 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker1 # [ 105.445140] nix-grpc-daemon[1287]: time=2026-09-21T09:36:16.071Z level=INFO msg="Uploading 1 narinfos" lb # [ 105.448209] niks3-server[974]: 2026/09/21 09:36:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign lb # [ 105.458276] niks3-server[974]: 2026/09/21 09:36:16 INFO Signed narinfos id=34 count=1 lb # [ 105.463811] niks3-server[974]: 2026/09/21 09:36:16 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls worker1 # [ 105.478476] nix-grpc-daemon[1287]: time=2026-09-21T09:36:16.105Z level=INFO msg="Upload complete. (290ms)" lb # [ 105.477021] niks3-server[974]: 2026/09/21 09:36:16 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete lb # [ 105.486876] niks3-server[974]: 2026/09/21 09:36:16 INFO Completed upload id=34 lb # [ 105.492700] niks3-server[974]: 2026/09/21 09:36:16 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo worker1 # [ 105.492961] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50904 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=1 worker1 # [ 105.504317] nix-daemon[839]: reaped child process 1428, status = succeeded lb # [ 105.509367] niks3-server[974]: 2026/09/21 09:36:16 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst client # [ 105.548325] systemd[1]: rs.service: Deactivated successfully. client # [ 105.553556] systemd[1]: rs.service: Consumed 183ms CPU time over 8.699s wall clock time, 41.2M memory peak, 7.1K incoming IP traffic, 8.4K outgoing IP traffic. worker1 # [ 106.035621] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:16Z level=info event=signal_exit worker1 # [ 106.260115] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:16Z level=info event=scheduler_yield lb # [ 106.267774] niks3-server[974]: 2026/09/21 09:36:16 INFO lead: released remote=192.168.1.3:39676 worker1 # [ 106.267264] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:16Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 106.314997] nix-grpc-daemon[1204]: ts=2026-09-21T09:36:16Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 106.273021] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:50898 worker1 # [ 106.277542] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:16Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 106.281471] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:50898 worker1 # [ 106.285831] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:16Z level=info event=worker_gone addr=192.168.1.4:50051 worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 1.13 seconds) client: waiting for success: ! systemctl is-active rs lb # [ 106.393112] niks3-server[974]: 2026/09/21 09:36:17 INFO lead: acquired remote=192.168.1.4:40838 worker2 # [ 106.440625] nix-grpc-daemon[1204]: ts=2026-09-21T09:36:17Z level=info event=scheduler_take_over client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } worker1 # [ 106.468416] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.515140] nix-grpc-daemon[1204]: ts=2026-09-21T09:36:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.524353] nix-grpc-daemon[1204]: ts=2026-09-21T09:36:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.06 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' worker2 # [ 106.529996] nix-grpc-daemon[1204]: ts=2026-09-21T09:36:17Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:42058 worker2 # [ 106.534718] nix-grpc-daemon[1204]: ts=2026-09-21T09:36:17Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=0 running=0 client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker2 # [ 106.723530] nix-grpc-daemon[1204]: ts=2026-09-21T09:36:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.736112] nix-grpc-daemon[1204]: ts=2026-09-21T09:36:17Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 106.739743] nix-grpc-daemon[1204]: ts=2026-09-21T09:36:17Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:42058 worker2 # [ 106.745097] nix-grpc-daemon[1204]: ts=2026-09-21T09:36:17Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 107.319111] nix-grpc-daemon[1204]: ts=2026-09-21T09:36:17Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:42058 worker1 # [ 107.277101] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:17Z level=info event=scheduler_restarting worker2 # [ 107.323882] nix-grpc-daemon[1204]: ts=2026-09-21T09:36:17Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 107.302289] nix-grpc-daemon[1213]: ts=2026-09-21T09:36:17Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 107.329200] nix-daemon[839]: reaped child process 1277, status = succeeded lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker1 # [ 107.756640] nix-grpc-daemon[1213]: E0000 00:00:1789983378.383394 1258 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker1 # [ 107.777610] nix-grpc-daemon[1213]: E0000 00:00:1789983378.404320 1258 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 108.634701] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 108.637877] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 108.643788] systemd[1]: nix-grpc-daemon.service: Consumed 1.850s CPU time over 26.831s wall clock time, 36.8M memory peak, 48.5K incoming IP traffic, 90.5K outgoing IP traffic. worker1 # [ 108.663686] systemd[1]: Starting Nix worker-protocol over gRPC... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1 # [ 108.856482] nix-grpc-daemon[1481]: ts=2026-09-21T09:36:19Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 108.859042] nix-grpc-daemon[1481]: ts=2026-09-21T09:36:19Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 108.863194] nix-grpc-daemon[1481]: ts=2026-09-21T09:36:19Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 108.870755] nix-grpc-daemon[1481]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 108.877525] nix-grpc-daemon[1481]: E0000 00:00:1789983379.497077 1481 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 108.881372] nix-grpc-daemon[1481]: E0000 00:00:1789983379.500793 1481 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 108.884325] nix-grpc-daemon[1481]: ts=2026-09-21T09:36:19Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 108.886241] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 108.892070] nix-grpc-daemon[1481]: E0000 00:00:1789983379.516756 1523 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker1 # [ 108.920047] nix-grpc-daemon[1481]: E0000 00:00:1789983379.534337 1523 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 108.922349] nix-grpc-daemon[1481]: E0000 00:00:1789983379.534510 1523 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 108.927823] nix-grpc-daemon[1481]: E0000 00:00:1789983379.553828 1523 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 108.940320] nix-grpc-daemon[1481]: ts=2026-09-21T09:36:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 108.988553] nix-grpc-daemon[1204]: ts=2026-09-21T09:36:19Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:42058 worker2 # [ 108.994569] nix-grpc-daemon[1204]: ts=2026-09-21T09:36:19Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb # [ 109.868869] envoy[917]: conn peer=[2001:db8:1::1]:35996 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2979 tx=1428 ms=8412 lb # [ 109.873827] envoy[917]: conn peer=[2001:db8:1::3]:43698 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3774 tx=1157 ms=25194 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.30 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid client # [ 110.148708] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid. client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.09 seconds) worker2 # [ 110.446827] nix-grpc-daemon[1204]: ts=2026-09-21T09:36:21Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42066 worker2 # [ 110.461313] nix-daemon[860]: accepted connection from pid 1204, user nix-grpc-daemon (trusted) client # Running as unit: mid.service; invocation ID: a20370c1f3294376802b1ae933e57ab5 client # [ 110.442926] nix[1201]: don't know how to build these paths: client # [ 110.446775] nix[1201]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker2 # [ 110.495798] nix-grpc-daemon[1204]: ts=2026-09-21T09:36:21Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker2 # [ 110.501969] nix-grpc-daemon[1204]: ts=2026-09-21T09:36:21Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 110.543483] nix-grpc-daemon[1204]: ts=2026-09-21T09:36:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42066 worker2 # [ 110.563511] nix-grpc-daemon[1204]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 51 ms (attempt 1/5) worker2 # [ 110.622154] nix-grpc-daemon[1204]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 43 ms (attempt 2/5) worker2 # [ 110.672670] nix-grpc-daemon[1204]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 289 ms (attempt 3/5) worker2 # [ 110.969028] nix-grpc-daemon[1204]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 296 ms (attempt 4/5) worker2 # [ 111.273756] nix-grpc-daemon[1204]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 111.280350] nix-grpc-daemon[1204]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 111.299104] nix-grpc-daemon[1204]: ts=2026-09-21T09:36:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42066 client # [ 111.275858] nix[1201]: copying 1 paths to 'lb:50051'... client # [ 111.280190] nix[1201]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'... worker2 # [ 111.317584] nix-grpc-daemon[1204]: ts=2026-09-21T09:36:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42066 worker2 # [ 111.332637] nix-daemon[860]: accepted connection from pid 1204, user nix-grpc-daemon (trusted) worker2 # [ 111.361482] nix-grpc-daemon[1204]: ts=2026-09-21T09:36:21Z level=info event=niks3_push_started pid=1323 worker2 # [ 111.588640] nix-grpc-daemon[1323]: time=2026-09-21T09:36:22.197Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 111.760608] nix-daemon[860]: accepted connection from pid 1340, user nix-grpc-daemon (trusted) worker2 # [ 111.777560] nix-daemon[860]: reaped child process 1343, status = succeeded worker2 # [ 111.949950] nix-daemon[860]: accepted connection from pid 1345, user nix-grpc-daemon (trusted) worker2 # [ 111.966079] nix-daemon[860]: reaped child process 1348, status = succeeded lb # [ 111.934910] niks3-server[974]: 2026/09/21 09:36:22 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 111.989941] nix-grpc-daemon[1323]: time=2026-09-21T09:36:22.598Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 111.991390] nix-grpc-daemon[1323]: time=2026-09-21T09:36:22.598Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)" lb # [ 111.971189] niks3-server[974]: 2026/09/21 09:36:22 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst worker2 # [ 112.034606] nix-grpc-daemon[1323]: time=2026-09-21T09:36:22.644Z level=INFO msg="Uploading 1 narinfos" lb # [ 111.984858] niks3-server[974]: 2026/09/21 09:36:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign lb # [ 111.997557] niks3-server[974]: 2026/09/21 09:36:22 INFO Signed narinfos id=35 count=1 lb # [ 112.003699] niks3-server[974]: 2026/09/21 09:36:22 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls lb # [ 112.017493] niks3-server[974]: 2026/09/21 09:36:22 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete worker2 # [ 112.065986] nix-grpc-daemon[1323]: time=2026-09-21T09:36:22.675Z level=INFO msg="Upload complete. (473ms)" lb # [ 112.022782] niks3-server[974]: 2026/09/21 09:36:22 INFO Completed upload id=35 lb # [ 112.026624] niks3-server[974]: 2026/09/21 09:36:22 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo worker2 # [ 112.074160] nix-grpc-daemon[1204]: ts=2026-09-21T09:36:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42066 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 112.090136] nix-grpc-daemon[1204]: ts=2026-09-21T09:36:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42066 worker2 # [ 112.100177] nix-daemon[860]: accepted connection from pid 1204, user nix-grpc-daemon (trusted) worker2 # [ 112.102361] nix-daemon[860]: reaped child process 1321, status = succeeded worker2 # [ 112.113296] nix-daemon[860]: accepted connection from pid 1204, user nix-grpc-daemon (trusted) client # [ 112.076571] nix[1201]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker2 # [ 114.192357] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1204 (nix-grpc-daemon) on client request. worker2 # [ 114.193968] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 114.164582] niks3-server[974]: 2026/09/21 09:36:24 INFO lead: released remote=192.168.1.4:40838 worker2 # [ 114.220353] systemd[1]: Starting scheduler-token.service... client # [ 114.180681] nix[1201]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker1 # [ 114.170232] nix-grpc-daemon[1481]: ts=2026-09-21T09:36:24Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination" client # [ 114.181120] nix[1201]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again worker2 # [ 114.238616] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker2 # [ 114.243425] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker2 # [ 114.246376] systemd[1]: nix-grpc-daemon.service: Consumed 568ms CPU time over 18.012s wall clock time, 34.4M memory peak, 15.8K incoming IP traffic, 27.8K outgoing IP traffic. worker2 # [ 114.259259] nix-daemon[860]: reaped child process 1313, status = succeeded worker2 # [ 114.261541] nix-daemon[860]: reaped child process 1350, status = succeeded worker2 # [ 114.268577] nix-daemon[1352]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 114.275585] nix-daemon[860]: reaped child process 1352, status = failed with exit code 1 worker2 # [ 114.321805] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 114.324042] systemd[1]: Finished scheduler-token.service. worker2 # [ 114.324818] systemd[1]: scheduler-token.service: Consumed 23ms CPU time over 103ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 114.328158] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1. worker2 # [ 114.333199] systemd[1]: Starting scheduler-token.service... worker2 # [ 114.401801] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 114.404302] systemd[1]: Finished scheduler-token.service. worker2 # [ 114.405084] systemd[1]: scheduler-token.service: Consumed 21ms CPU time over 70ms wall clock time, 2.2M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 114.410346] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 114.370550] nix-grpc-daemon[1481]: ts=2026-09-21T09:36:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 114.575277] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:25Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 114.577813] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:25Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 114.581754] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:25Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 114.589016] nix-grpc-daemon[1395]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 114.590485] nix-grpc-daemon[1395]: E0000 00:00:1789983385.198236 1395 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 114.564144] niks3-server[974]: 2026/09/21 09:36:25 INFO lead: acquired remote=192.168.1.4:32920 worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.48 seconds) worker2 # [ 114.607962] nix-grpc-daemon[1395]: E0000 00:00:1789983385.204036 1395 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. client: must succeed: sleep 5.0 worker2 # [ 114.632261] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:25Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 114.633861] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:25Z level=info event=scheduler_take_over worker2 # [ 114.634959] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 114.635729] nix-grpc-daemon[1395]: E0000 00:00:1789983385.221819 1434 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 114.652067] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:25Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:48154 worker2 # [ 114.654016] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:25Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 114.655883] nix-grpc-daemon[1395]: E0000 00:00:1789983385.240616 1434 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 114.660859] nix-grpc-daemon[1395]: E0000 00:00:1789983385.240745 1434 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 114.665565] nix-grpc-daemon[1395]: E0000 00:00:1789983385.261449 1434 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 114.668676] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 114.672057] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:25Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 114.673787] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:25Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:48154 worker2 # [ 114.675495] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:25Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 114.722311] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:25Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker2 # [ 114.725587] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:25Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 114.735361] nix-grpc-daemon[1481]: ts=2026-09-21T09:36:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42812 worker1 # [ 114.749810] nix-daemon[839]: accepted connection from pid 1481, user nix-grpc-daemon (trusted) worker1 # [ 114.775820] nix-grpc-daemon[1481]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 81 ms (attempt 1/5) worker1 # [ 114.863842] nix-grpc-daemon[1481]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 179 ms (attempt 2/5) worker1 # [ 115.050564] nix-grpc-daemon[1481]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 181 ms (attempt 3/5) worker1 # [ 115.232902] nix-grpc-daemon[1481]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 378 ms (attempt 4/5) worker1 # [ 115.610795] nix-grpc-daemon[1481]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 115.616314] nix-grpc-daemon[1481]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 115.632975] nix-grpc-daemon[1481]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' from 'http://lb:5751'... worker1 # [ 115.663219] nix-daemon[839]: accepted connection from pid 1481, user nix-grpc-daemon (trusted) worker1 # [ 115.681237] nix-daemon[839]: accepted connection from pid 1481, user nix-grpc-daemon (trusted) client # [ 115.690684] nix[1201]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... client: (finished: must succeed: sleep 5.0, in 5.06 seconds) lb # [ 119.866562] envoy[917]: conn peer=[2001:db8:1::4]:39626 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=2679 tx=399 ms=17731 worker1 # [ 119.904671] nix-grpc-daemon[1481]: ts=2026-09-21T09:36:30Z level=info event=niks3_push_started pid=1587 worker1 # [ 119.920861] nix-daemon[839]: reaped child process 1562, status = succeeded client: waiting for success: ! systemctl is-active mid worker1 # [ 120.102751] nix-grpc-daemon[1587]: time=2026-09-21T09:36:30.728Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 120.274828] nix-daemon[839]: accepted connection from pid 1600, user nix-grpc-daemon (trusted) worker1 # [ 120.291198] nix-daemon[839]: reaped child process 1603, status = succeeded lb # [ 120.307433] niks3-server[974]: 2026/09/21 09:36:30 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 120.314913] nix-grpc-daemon[1587]: time=2026-09-21T09:36:30.940Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 120.317658] nix-grpc-daemon[1587]: time=2026-09-21T09:36:30.940Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)" lb # [ 120.348481] niks3-server[974]: 2026/09/21 09:36:30 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv lb # [ 120.371152] niks3-server[974]: 2026/09/21 09:36:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign lb # [ 120.378950] niks3-server[974]: 2026/09/21 09:36:31 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 120.404205] niks3-server[974]: 2026/09/21 09:36:31 INFO Signed narinfos id=36 count=1 worker1 # [ 120.402989] nix-grpc-daemon[1587]: time=2026-09-21T09:36:31.028Z level=INFO msg="Uploading 1 narinfos" lb # [ 120.421806] niks3-server[974]: 2026/09/21 09:36:31 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete lb # [ 120.430358] niks3-server[974]: 2026/09/21 09:36:31 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls lb # [ 120.440211] niks3-server[974]: 2026/09/21 09:36:31 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo lb # [ 120.446926] niks3-server[974]: 2026/09/21 09:36:31 INFO Completed upload id=36 worker1 # [ 120.444463] nix-grpc-daemon[1587]: time=2026-09-21T09:36:31.071Z level=INFO msg="Upload complete. (337ms)" worker1 # [ 120.456324] nix-grpc-daemon[1481]: ts=2026-09-21T09:36:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42812 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=1 worker1 # [ 120.475411] nix-daemon[839]: reaped child process 1560, status = succeeded client # [ 120.509788] systemd[1]: mid.service: Deactivated successfully. client # [ 120.514047] systemd[1]: mid.service: Consumed 188ms CPU time over 10.364s wall clock time, 41.2M memory peak, 8.6K incoming IP traffic, 10.4K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 11.07 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr client # [ 121.189112] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: b2f1f517321140a29024b2a6b6338551 client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds) worker1 # [ 121.418864] nix-grpc-daemon[1481]: ts=2026-09-21T09:36:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42812 client # [ 121.436530] nix[1237]: don't know how to build these paths: client # [ 121.438134] nix[1237]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker2 # [ 121.489092] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:32Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=0 worker2 # [ 121.489423] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:32Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 121.546090] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53382 worker2 # [ 121.560401] nix-daemon[860]: accepted connection from pid 1395, user nix-grpc-daemon (trusted) worker2 # [ 121.584198] nix-grpc-daemon[1395]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 30 ms (attempt 1/5) worker2 # [ 121.621828] nix-grpc-daemon[1395]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 191 ms (attempt 2/5) worker2 # [ 121.820371] nix-grpc-daemon[1395]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 32 ms (attempt 3/5) worker2 # [ 121.859441] nix-grpc-daemon[1395]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 714 ms (attempt 4/5) worker2 # [ 122.582094] nix-grpc-daemon[1395]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 122.587430] nix-grpc-daemon[1395]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 122.607563] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53382 client # [ 122.585237] nix[1237]: copying 1 paths to 'lb:50051'... worker2 # [ 122.624420] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53382 client # [ 122.590390] nix[1237]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'... worker2 # [ 122.641393] nix-daemon[860]: accepted connection from pid 1395, user nix-grpc-daemon (trusted) worker2 # [ 122.668635] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:33Z level=info event=niks3_push_started pid=1475 worker2 # [ 122.883710] nix-grpc-daemon[1475]: time=2026-09-21T09:36:33.493Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 123.056716] nix-daemon[860]: accepted connection from pid 1488, user nix-grpc-daemon (trusted) worker2 # [ 123.072696] nix-daemon[860]: reaped child process 1491, status = succeeded worker2 # [ 123.248761] nix-daemon[860]: accepted connection from pid 1493, user nix-grpc-daemon (trusted) worker2 # [ 123.264717] nix-daemon[860]: reaped child process 1496, status = succeeded lb # [ 123.234163] niks3-server[974]: 2026/09/21 09:36:33 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 123.290763] nix-grpc-daemon[1475]: time=2026-09-21T09:36:33.899Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 123.292503] nix-grpc-daemon[1475]: time=2026-09-21T09:36:33.899Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)" lb # [ 123.275815] niks3-server[974]: 2026/09/21 09:36:33 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst worker2 # [ 123.331493] nix-grpc-daemon[1475]: time=2026-09-21T09:36:33.941Z level=INFO msg="Uploading 1 narinfos" lb # [ 123.287448] niks3-server[974]: 2026/09/21 09:36:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign lb # [ 123.298409] niks3-server[974]: 2026/09/21 09:36:33 INFO Signed narinfos id=37 count=1 lb # [ 123.308957] niks3-server[974]: 2026/09/21 09:36:33 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls lb # [ 123.317620] niks3-server[974]: 2026/09/21 09:36:33 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete lb # [ 123.323533] niks3-server[974]: 2026/09/21 09:36:33 INFO Completed upload id=37 worker2 # [ 123.366143] nix-grpc-daemon[1475]: time=2026-09-21T09:36:33.976Z level=INFO msg="Upload complete. (477ms)" worker2 # [ 123.375512] nix-grpc-daemon[1475]: time=2026-09-21T09:36:33.979Z level=WARN msg="Failed to register uploaded object" key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo error="server returned 404: object is not pending upload\n" worker2 # [ 123.390340] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53382 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 123.395827] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53382 worker2 # [ 123.403075] nix-daemon[860]: accepted connection from pid 1395, user nix-grpc-daemon (trusted) worker2 # [ 123.405201] nix-daemon[860]: reaped child process 1473, status = succeeded worker2 # [ 123.414424] nix-daemon[860]: accepted connection from pid 1395, user nix-grpc-daemon (trusted) client # [ 123.376525] nix[1237]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051... client: must succeed: systemctl kill -s INT intr worker2 # [ 124.938709] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:35Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv client # [ 124.900900] systemd[1]: intr.service: Sent signal SIGINT to main process 1237 (nix) on client request. client: (finished: must succeed: systemctl kill -s INT intr, in 0.07 seconds) client # [ 124.909121] nix[1237]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client # [ 124.913686] nix[1237]: error: interrupted by the user client # [ 124.962505] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 124.968399] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 124.971045] systemd[1]: intr.service: Consumed 163ms CPU time over 3.777s wall clock time, 41.2M memory peak, 6.5K incoming IP traffic, 8.3K outgoing IP traffic. worker2 # [ 125.045332] nix-daemon[1500]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 125.057264] nix-daemon[860]: reaped child process 1498, status = succeeded worker2 # [ 125.061468] nix-daemon[860]: reaped child process 1500, status = failed with exit code 1 (finished: subtest: interrupting the client stops the build on the worker, in 3.91 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw client # [ 125.119080] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: 879e809df1104ff09d718d94fc40df79 client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.08 seconds) worker1 # [ 125.356993] nix-grpc-daemon[1481]: ts=2026-09-21T09:36:35Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42812 client # [ 125.375095] nix[1257]: don't know how to build these paths: client # [ 125.376641] nix[1257]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker2 # [ 125.421168] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:36Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=0 worker2 # [ 125.426958] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:36Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 125.421310] nix-grpc-daemon[1481]: ts=2026-09-21T09:36:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42812 worker1 # [ 125.436448] nix-grpc-daemon[1481]: ts=2026-09-21T09:36:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42812 client # [ 125.460146] nix[1257]: copying 1 paths to 'lb:50051'... worker1 # [ 125.450947] nix-grpc-daemon[1481]: ts=2026-09-21T09:36:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42812 client # [ 125.462389] nix[1257]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'... worker1 # [ 125.467542] nix-daemon[839]: accepted connection from pid 1481, user nix-grpc-daemon (trusted) worker1 # [ 125.673010] nix-daemon[839]: accepted connection from pid 1631, user nix-grpc-daemon (trusted) worker1 # [ 125.692229] nix-daemon[839]: reaped child process 1634, status = succeeded worker1 # [ 125.861386] nix-daemon[839]: accepted connection from pid 1636, user nix-grpc-daemon (trusted) worker1 # [ 125.878717] nix-daemon[839]: reaped child process 1639, status = succeeded lb # [ 125.893991] niks3-server[974]: 2026/09/21 09:36:36 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 125.902214] nix-grpc-daemon[1587]: time=2026-09-21T09:36:36.528Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 125.903688] nix-grpc-daemon[1587]: time=2026-09-21T09:36:36.528Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)" lb # [ 125.922436] niks3-server[974]: 2026/09/21 09:36:36 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst lb # [ 125.938336] niks3-server[974]: 2026/09/21 09:36:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign worker1 # [ 125.941462] nix-grpc-daemon[1587]: time=2026-09-21T09:36:36.568Z level=INFO msg="Uploading 1 narinfos" lb # [ 125.949806] niks3-server[974]: 2026/09/21 09:36:36 INFO Signed narinfos id=38 count=1 lb # [ 125.955140] niks3-server[974]: 2026/09/21 09:36:36 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls lb # [ 125.963380] niks3-server[974]: 2026/09/21 09:36:36 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 125.970249] niks3-server[974]: 2026/09/21 09:36:36 INFO Completed upload id=38 worker1 # [ 125.966976] nix-grpc-daemon[1587]: time=2026-09-21T09:36:36.593Z level=INFO msg="Upload complete. (482ms)" lb # [ 125.972606] niks3-server[974]: 2026/09/21 09:36:36 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo worker1 # [ 125.977106] nix-grpc-daemon[1481]: ts=2026-09-21T09:36:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42812 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 125.986678] nix-grpc-daemon[1481]: ts=2026-09-21T09:36:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42812 worker1 # [ 125.993572] nix-daemon[839]: accepted connection from pid 1481, user nix-grpc-daemon (trusted) worker1 # [ 125.998321] nix-daemon[839]: reaped child process 1629, status = succeeded client # [ 126.017317] nix[1257]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051... worker1 # [ 126.010656] nix-daemon[839]: accepted connection from pid 1481, user nix-grpc-daemon (trusted) worker1: must succeed: systemctl reload nix-grpc-daemon.service worker1 # [ 127.807541] systemd[1]: Reloading Nix worker-protocol over gRPC... worker1 # [ 127.853128] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.10 seconds) worker1: must succeed: pgrep -f 'read -t [9]0 x' worker1 # [ 127.883336] nix-grpc-daemon[1481]: ts=2026-09-21T09:36:38Z level=info event=draining worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2 worker1 # [ 128.185833] nix-grpc-daemon[1481]: ts=2026-09-21T09:36:38Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42812 client # don't know how to build these paths: client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker1 # [ 128.192912] nix-grpc-daemon[1481]: ts=2026-09-21T09:36:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42812 worker2 # [ 128.264553] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:38Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=0 worker2 # [ 128.269930] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:38Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 128.308091] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53382 worker2 # [ 128.323932] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53382 client # copying 1 paths to 'lb:50051'... worker2 # [ 128.340108] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53382 client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'... worker2 # [ 128.359588] nix-daemon[860]: accepted connection from pid 1395, user nix-grpc-daemon (trusted) worker2 # [ 128.571733] nix-daemon[860]: accepted connection from pid 1551, user nix-grpc-daemon (trusted) worker2 # [ 128.589298] nix-daemon[860]: reaped child process 1554, status = succeeded worker2 # [ 128.774602] nix-daemon[860]: accepted connection from pid 1556, user nix-grpc-daemon (trusted) worker2 # [ 128.792637] nix-daemon[860]: reaped child process 1559, status = succeeded lb # [ 128.763119] niks3-server[974]: 2026/09/21 09:36:39 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 128.816324] nix-grpc-daemon[1475]: time=2026-09-21T09:36:39.425Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 128.817887] nix-grpc-daemon[1475]: time=2026-09-21T09:36:39.425Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)" lb # [ 128.789346] niks3-server[974]: 2026/09/21 09:36:39 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst lb # [ 128.804385] niks3-server[974]: 2026/09/21 09:36:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign worker2 # [ 128.855338] nix-grpc-daemon[1475]: time=2026-09-21T09:36:39.465Z level=INFO msg="Uploading 1 narinfos" lb # [ 128.817535] niks3-server[974]: 2026/09/21 09:36:39 INFO Signed narinfos id=39 count=1 lb # [ 128.823865] niks3-server[974]: 2026/09/21 09:36:39 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls worker2 # [ 128.874918] nix-grpc-daemon[1475]: time=2026-09-21T09:36:39.484Z level=INFO msg="Upload complete. (498ms)" lb # [ 128.832957] niks3-server[974]: 2026/09/21 09:36:39 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete lb # [ 128.838311] niks3-server[974]: 2026/09/21 09:36:39 INFO Completed upload id=39 worker2 # [ 128.881821] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53382 duration_s=0 paths=1 nar_bytes_in=528 lb # [ 128.841749] niks3-server[974]: 2026/09/21 09:36:39 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo worker2 # [ 128.895182] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53382 worker2 # [ 128.901527] nix-daemon[860]: accepted connection from pid 1395, user nix-grpc-daemon (trusted) worker2 # [ 128.906640] nix-daemon[860]: reaped child process 1549, status = succeeded client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051... client # farm-a> worker2: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker2 # [ 128.919677] nix-daemon[860]: accepted connection from pid 1395, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds lb # [ 129.866915] envoy[917]: conn peer=[2001:db8:1::1]:43432 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3927 tx=1877 ms=10085 lb # [ 129.872232] envoy[917]: conn peer=[2001:db8:1::1]:43470 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3000 tx=853 ms=3506 client # farm-a> LOG-farm-a-during-drain worker2 # [ 130.161271] nix-daemon[860]: reaped child process 1563, status = succeeded worker2 # [ 130.343571] nix-daemon[860]: accepted connection from pid 1579, user nix-grpc-daemon (trusted) worker2 # [ 130.358934] nix-daemon[860]: reaped child process 1582, status = succeeded lb # [ 130.331878] niks3-server[974]: 2026/09/21 09:36:40 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 130.388417] nix-grpc-daemon[1475]: time=2026-09-21T09:36:40.997Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 130.390165] nix-grpc-daemon[1475]: time=2026-09-21T09:36:40.997Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)" lb # [ 130.377349] niks3-server[974]: 2026/09/21 09:36:41 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv lb # [ 130.389679] niks3-server[974]: 2026/09/21 09:36:41 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 130.400405] niks3-server[974]: 2026/09/21 09:36:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign worker2 # [ 130.451203] nix-grpc-daemon[1475]: time=2026-09-21T09:36:41.059Z level=INFO msg="Uploading 1 narinfos" lb # [ 130.409865] niks3-server[974]: 2026/09/21 09:36:41 INFO Signed narinfos id=40 count=1 lb # [ 130.416294] niks3-server[974]: 2026/09/21 09:36:41 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls lb # [ 130.425492] niks3-server[974]: 2026/09/21 09:36:41 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete worker2 # [ 130.474004] nix-grpc-daemon[1475]: time=2026-09-21T09:36:41.084Z level=INFO msg="Upload complete. (343ms)" lb # [ 130.432740] niks3-server[974]: 2026/09/21 09:36:41 INFO Completed upload id=40 lb # [ 130.436134] niks3-server[974]: 2026/09/21 09:36:41 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo worker2 # [ 130.490316] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53382 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=1 worker2 # [ 130.510812] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:41Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=0 worker2 # [ 130.517810] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:41Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 130.523364] nix-daemon[860]: reaped child process 1561, status = succeeded worker2 # [ 130.561607] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53382 worker2 # [ 130.576135] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53382 worker2 # [ 130.599165] nix-grpc-daemon[1475]: time=2026-09-21T09:36:41.209Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 130.608138] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53382 client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'... worker2 # [ 130.632281] nix-daemon[860]: accepted connection from pid 1395, user nix-grpc-daemon (trusted) worker2 # [ 130.835289] nix-daemon[860]: accepted connection from pid 1588, user nix-grpc-daemon (trusted) worker2 # [ 130.854334] nix-daemon[860]: reaped child process 1591, status = succeeded worker2 # [ 131.024077] nix-daemon[860]: accepted connection from pid 1593, user nix-grpc-daemon (trusted) worker2 # [ 131.041959] nix-daemon[860]: reaped child process 1596, status = succeeded lb # [ 131.011244] niks3-server[974]: 2026/09/21 09:36:41 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 131.063471] nix-grpc-daemon[1475]: time=2026-09-21T09:36:41.673Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 131.065090] nix-grpc-daemon[1475]: time=2026-09-21T09:36:41.673Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)" lb # [ 131.042842] niks3-server[974]: 2026/09/21 09:36:41 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst worker2 # [ 131.093990] nix-grpc-daemon[1475]: time=2026-09-21T09:36:41.703Z level=INFO msg="Uploading 1 narinfos" lb # [ 131.056652] niks3-server[974]: 2026/09/21 09:36:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign lb # [ 131.066638] niks3-server[974]: 2026/09/21 09:36:41 INFO Signed narinfos id=41 count=1 lb # [ 131.071302] niks3-server[974]: 2026/09/21 09:36:41 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls worker2 # [ 131.125583] nix-grpc-daemon[1475]: time=2026-09-21T09:36:41.735Z level=INFO msg="Upload complete. (476ms)" lb # [ 131.082454] niks3-server[974]: 2026/09/21 09:36:41 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete lb # [ 131.088776] niks3-server[974]: 2026/09/21 09:36:41 INFO Completed upload id=41 worker2 # [ 131.132051] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53382 duration_s=0 paths=1 nar_bytes_in=640 lb # [ 131.092646] niks3-server[974]: 2026/09/21 09:36:41 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo worker2 # [ 131.143417] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53382 worker2 # [ 131.149465] nix-daemon[860]: accepted connection from pid 1395, user nix-grpc-daemon (trusted) worker2 # [ 131.154065] nix-daemon[860]: reaped child process 1586, status = succeeded client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051... worker2 # [ 131.166038] nix-daemon[860]: accepted connection from pid 1395, user nix-grpc-daemon (trusted) client # farm-b> worker2: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-during-drain worker2 # [ 132.212829] nix-daemon[860]: reaped child process 1600, status = succeeded worker2 # [ 132.388110] nix-daemon[860]: accepted connection from pid 1616, user nix-grpc-daemon (trusted) worker2 # [ 132.405031] nix-daemon[860]: reaped child process 1619, status = succeeded lb # [ 132.373832] niks3-server[974]: 2026/09/21 09:36:43 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 132.427108] nix-grpc-daemon[1475]: time=2026-09-21T09:36:43.035Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 132.429754] nix-grpc-daemon[1475]: time=2026-09-21T09:36:43.035Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)" lb # [ 132.407879] niks3-server[974]: 2026/09/21 09:36:43 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv lb # [ 132.419919] niks3-server[974]: 2026/09/21 09:36:43 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst lb # [ 132.431267] niks3-server[974]: 2026/09/21 09:36:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign worker2 # [ 132.479756] nix-grpc-daemon[1475]: time=2026-09-21T09:36:43.089Z level=INFO msg="Uploading 1 narinfos" lb # [ 132.440071] niks3-server[974]: 2026/09/21 09:36:43 INFO Signed narinfos id=42 count=1 lb # [ 132.445858] niks3-server[974]: 2026/09/21 09:36:43 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls lb # [ 132.452109] niks3-server[974]: 2026/09/21 09:36:43 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 132.461193] niks3-server[974]: 2026/09/21 09:36:43 INFO Completed upload id=42 worker2 # [ 132.504747] nix-grpc-daemon[1475]: time=2026-09-21T09:36:43.114Z level=INFO msg="Upload complete. (329ms)" lb # [ 132.464296] niks3-server[974]: 2026/09/21 09:36:43 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo worker2 # [ 132.522265] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53382 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=1 worker2 # [ 132.539262] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:43Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=0 worker2 # [ 132.543696] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:43Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 132.549022] nix-daemon[860]: reaped child process 1598, status = succeeded worker2 # [ 132.567872] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53382 worker2 # [ 132.583044] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53382 worker2 # [ 132.596637] nix-grpc-daemon[1475]: time=2026-09-21T09:36:43.206Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 132.606603] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53382 client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'... worker2 # [ 132.629439] nix-daemon[860]: accepted connection from pid 1395, user nix-grpc-daemon (trusted) worker2 # [ 132.838042] nix-daemon[860]: accepted connection from pid 1625, user nix-grpc-daemon (trusted) worker2 # [ 132.854225] nix-daemon[860]: reaped child process 1628, status = succeeded worker2 # [ 133.027232] nix-daemon[860]: accepted connection from pid 1630, user nix-grpc-daemon (trusted) worker2 # [ 133.043345] nix-daemon[860]: reaped child process 1633, status = succeeded lb # [ 133.011944] niks3-server[974]: 2026/09/21 09:36:43 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 133.064055] nix-grpc-daemon[1475]: time=2026-09-21T09:36:43.674Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 133.065973] nix-grpc-daemon[1475]: time=2026-09-21T09:36:43.675Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)" lb # [ 133.038247] niks3-server[974]: 2026/09/21 09:36:43 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst lb # [ 133.053066] niks3-server[974]: 2026/09/21 09:36:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign worker2 # [ 133.102443] nix-grpc-daemon[1475]: time=2026-09-21T09:36:43.712Z level=INFO msg="Uploading 1 narinfos" lb # [ 133.068410] niks3-server[974]: 2026/09/21 09:36:43 INFO Signed narinfos id=43 count=1 lb # [ 133.075129] niks3-server[974]: 2026/09/21 09:36:43 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls lb # [ 133.085004] niks3-server[974]: 2026/09/21 09:36:43 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete lb # [ 133.089951] niks3-server[974]: 2026/09/21 09:36:43 INFO Completed upload id=43 worker2 # [ 133.133556] nix-grpc-daemon[1475]: time=2026-09-21T09:36:43.743Z level=INFO msg="Upload complete. (487ms)" lb # [ 133.094533] niks3-server[974]: 2026/09/21 09:36:43 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo worker2 # [ 133.140394] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53382 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 133.152657] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53382 worker2 # [ 133.161827] nix-daemon[860]: accepted connection from pid 1395, user nix-grpc-daemon (trusted) worker2 # [ 133.164556] nix-daemon[860]: reaped child process 1623, status = succeeded client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051... client # farm-top> worker2: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker2 # [ 133.177995] nix-daemon[860]: accepted connection from pid 1395, user nix-grpc-daemon (trusted) client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-during-drain worker2 # [ 134.226558] nix-daemon[860]: reaped child process 1637, status = succeeded worker2 # [ 134.404477] nix-daemon[860]: accepted connection from pid 1653, user nix-grpc-daemon (trusted) worker2 # [ 134.420197] nix-daemon[860]: reaped child process 1656, status = succeeded lb # [ 134.394206] niks3-server[974]: 2026/09/21 09:36:45 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 134.446409] nix-grpc-daemon[1475]: time=2026-09-21T09:36:45.054Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 134.447863] nix-grpc-daemon[1475]: time=2026-09-21T09:36:45.054Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)" lb # [ 134.435837] niks3-server[974]: 2026/09/21 09:36:45 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst worker2 # [ 134.490942] nix-grpc-daemon[1475]: time=2026-09-21T09:36:45.100Z level=INFO msg="Uploading 1 narinfos" lb # [ 134.452403] niks3-server[974]: 2026/09/21 09:36:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign lb # [ 134.455917] niks3-server[974]: 2026/09/21 09:36:45 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv lb # [ 134.463118] niks3-server[974]: 2026/09/21 09:36:45 INFO Signed narinfos id=44 count=1 lb # [ 134.469934] niks3-server[974]: 2026/09/21 09:36:45 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls worker2 # [ 134.513569] nix-grpc-daemon[1475]: time=2026-09-21T09:36:45.123Z level=INFO msg="Upload complete. (322ms)" lb # [ 134.473238] niks3-server[974]: 2026/09/21 09:36:45 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 134.477968] niks3-server[974]: 2026/09/21 09:36:45 INFO Completed upload id=44 lb # [ 134.480606] niks3-server[974]: 2026/09/21 09:36:45 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo worker2 # [ 134.525366] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53382 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=1 worker2 # [ 134.539823] nix-daemon[860]: reaped child process 1635, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 6.62 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.23 seconds) worker1: must succeed: pkill -f 'read -t [9]0 x' worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds) client: waiting for success: ! systemctl is-active sw worker1 # [ 135.057541] nix-daemon[839]: reaped child process 1643, status = succeeded worker1 # [ 135.242222] nix-daemon[839]: accepted connection from pid 1685, user nix-grpc-daemon (trusted) worker1 # [ 135.261233] nix-daemon[839]: reaped child process 1688, status = succeeded lb # [ 135.275623] niks3-server[974]: 2026/09/21 09:36:45 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 135.286607] nix-grpc-daemon[1587]: time=2026-09-21T09:36:45.912Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 135.288207] nix-grpc-daemon[1587]: time=2026-09-21T09:36:45.912Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)" lb # [ 135.310148] niks3-server[974]: 2026/09/21 09:36:45 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv lb # [ 135.324191] niks3-server[974]: 2026/09/21 09:36:45 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 135.340734] niks3-server[974]: 2026/09/21 09:36:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign worker1 # [ 135.344166] nix-grpc-daemon[1587]: time=2026-09-21T09:36:45.969Z level=INFO msg="Uploading 1 narinfos" lb # [ 135.347759] niks3-server[974]: 2026/09/21 09:36:45 INFO Signed narinfos id=45 count=1 lb # [ 135.353807] niks3-server[974]: 2026/09/21 09:36:45 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls lb # [ 135.366887] niks3-server[974]: 2026/09/21 09:36:46 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 135.378826] niks3-server[974]: 2026/09/21 09:36:46 INFO Completed upload id=45 worker1 # [ 135.376210] nix-grpc-daemon[1587]: time=2026-09-21T09:36:46.003Z level=INFO msg="Upload complete. (348ms)" lb # [ 135.382026] niks3-server[974]: 2026/09/21 09:36:46 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo worker1 # [ 135.389092] nix-grpc-daemon[1481]: ts=2026-09-21T09:36:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42812 duration_s=9 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=1 worker1 # [ 135.408238] nix-daemon[839]: reaped child process 1641, status = succeeded client # [ 135.441425] systemd[1]: sw.service: Deactivated successfully. client # [ 135.445829] systemd[1]: sw.service: Consumed 174ms CPU time over 10.325s wall clock time, 41.2M memory peak, 7K incoming IP traffic, 8.4K outgoing IP traffic. worker1 # [ 135.885176] nix-grpc-daemon[1481]: ts=2026-09-21T09:36:46Z level=info event=signal_exit client: (finished: waiting for success: ! systemctl is-active sw, in 1.12 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.05 seconds) worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker2 # [ 137.166043] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:47Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:48154 worker1 # [ 137.120914] nix-grpc-daemon[1481]: ts=2026-09-21T09:36:47Z level=info event=scheduler_restarting worker2 # [ 137.170604] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:47Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 137.144792] nix-grpc-daemon[1481]: ts=2026-09-21T09:36:47Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 137.168939] nix-daemon[839]: reaped child process 1553, status = succeeded worker1 # [ 137.675616] nix-grpc-daemon[1481]: E0000 00:00:1789983408.302275 1526 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true worker1 # [ 137.696896] nix-grpc-daemon[1481]: E0000 00:00:1789983408.323699 1526 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 138.937090] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 138.942882] systemd[1]: nix-grpc-daemon.service: Consumed 869ms CPU time over 30.271s wall clock time, 33.6M memory peak, 20.8K incoming IP traffic, 27.3K outgoing IP traffic. worker1 # [ 138.962382] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 139.162054] nix-grpc-daemon[1702]: ts=2026-09-21T09:36:49Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 139.164621] nix-grpc-daemon[1702]: ts=2026-09-21T09:36:49Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 139.168676] nix-grpc-daemon[1702]: ts=2026-09-21T09:36:49Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 139.176067] nix-grpc-daemon[1702]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 139.177527] nix-grpc-daemon[1702]: E0000 00:00:1789983409.801875 1702 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 139.187483] nix-grpc-daemon[1702]: E0000 00:00:1789983409.808107 1702 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 139.190548] nix-grpc-daemon[1702]: ts=2026-09-21T09:36:49Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 139.193741] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 139.200065] nix-grpc-daemon[1702]: E0000 00:00:1789983409.823997 1741 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 3.23 seconds) lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 139.228094] nix-grpc-daemon[1702]: E0000 00:00:1789983409.841939 1741 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 139.233738] nix-grpc-daemon[1702]: E0000 00:00:1789983409.842088 1741 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 139.236683] nix-grpc-daemon[1702]: E0000 00:00:1789983409.859796 1741 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 139.247799] nix-grpc-daemon[1702]: ts=2026-09-21T09:36:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 139.297077] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:49Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:48154 worker2 # [ 139.297495] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:49Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb # [ 139.866925] envoy[917]: conn peer=[2001:db8:1::1]:43484 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9638 tx=4081 ms=6311 lb # [ 139.872233] envoy[917]: conn peer=[2001:db8:1::1]:43474 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2978 tx=1429 ms=10045 lb # [ 139.877283] envoy[917]: conn peer=[2001:db8:1::3]:46106 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=986 tx=448 ms=28187 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.17 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 15.48 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker1 # [ 140.789167] nix-grpc-daemon[1702]: ts=2026-09-21T09:36:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 140.803724] nix-daemon[839]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker2 # [ 140.871888] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53382 worker2 # [ 140.917564] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:51Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=0 worker2 # [ 140.923530] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:51Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 140.929635] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:51Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=0 worker2 # [ 140.934817] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:51Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=0 worker1 # [ 140.917950] nix-grpc-daemon[1702]: ts=2026-09-21T09:36:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 140.935147] nix-grpc-daemon[1702]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 92 ms (attempt 1/5) worker1 # [ 141.036820] nix-grpc-daemon[1702]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 13 ms (attempt 2/5) worker1 # [ 141.057384] nix-grpc-daemon[1702]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 166 ms (attempt 3/5) worker1 # [ 141.230903] nix-grpc-daemon[1702]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 428 ms (attempt 4/5) worker1 # [ 141.659630] nix-grpc-daemon[1702]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 141.666279] nix-grpc-daemon[1702]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 141.684134] nix-grpc-daemon[1702]: ts=2026-09-21T09:36:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 141.699242] nix-grpc-daemon[1702]: ts=2026-09-21T09:36:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 141.713894] nix-daemon[839]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 141.742697] nix-grpc-daemon[1702]: ts=2026-09-21T09:36:52Z level=info event=niks3_push_started pid=1762 worker1 # [ 141.959219] nix-grpc-daemon[1762]: time=2026-09-21T09:36:52.585Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 142.132461] nix-daemon[839]: accepted connection from pid 1775, user nix-grpc-daemon (trusted) worker1 # [ 142.151216] nix-daemon[839]: reaped child process 1778, status = succeeded worker1 # [ 142.324224] nix-daemon[839]: accepted connection from pid 1780, user nix-grpc-daemon (trusted) worker1 # [ 142.342093] nix-daemon[839]: reaped child process 1783, status = succeeded lb # [ 142.357263] niks3-server[974]: 2026/09/21 09:36:52 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 142.366443] nix-grpc-daemon[1762]: time=2026-09-21T09:36:52.992Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 142.367942] nix-grpc-daemon[1762]: time=2026-09-21T09:36:52.992Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)" lb # [ 142.399402] niks3-server[974]: 2026/09/21 09:36:53 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst worker1 # [ 142.406540] nix-grpc-daemon[1762]: time=2026-09-21T09:36:53.032Z level=INFO msg="Uploading 1 narinfos" lb # [ 142.409295] niks3-server[974]: 2026/09/21 09:36:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign lb # [ 142.418062] niks3-server[974]: 2026/09/21 09:36:53 INFO Signed narinfos id=46 count=1 lb # [ 142.426537] niks3-server[974]: 2026/09/21 09:36:53 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls lb # [ 142.438956] niks3-server[974]: 2026/09/21 09:36:53 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete worker1 # [ 142.444344] nix-grpc-daemon[1762]: time=2026-09-21T09:36:53.071Z level=INFO msg="Upload complete. (481ms)" lb # [ 142.447218] niks3-server[974]: 2026/09/21 09:36:53 INFO Completed upload id=46 lb # [ 142.451175] niks3-server[974]: 2026/09/21 09:36:53 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo worker1 # [ 142.452768] nix-grpc-daemon[1702]: ts=2026-09-21T09:36:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51954 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 142.467477] nix-grpc-daemon[1702]: ts=2026-09-21T09:36:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 142.476278] nix-daemon[839]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 142.479453] nix-daemon[839]: reaped child process 1760, status = succeeded worker1 # [ 142.490339] nix-daemon[839]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 143.732003] nix-daemon[839]: reaped child process 1787, status = succeeded worker1 # [ 143.913194] nix-daemon[839]: accepted connection from pid 1803, user nix-grpc-daemon (trusted) worker1 # [ 143.931118] nix-daemon[839]: reaped child process 1806, status = succeeded lb # [ 143.947804] niks3-server[974]: 2026/09/21 09:36:54 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 143.957172] nix-grpc-daemon[1762]: time=2026-09-21T09:36:54.583Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 143.962349] nix-grpc-daemon[1762]: time=2026-09-21T09:36:54.585Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)" lb # [ 143.988992] niks3-server[974]: 2026/09/21 09:36:54 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv lb # [ 144.001845] niks3-server[974]: 2026/09/21 09:36:54 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst worker1 # [ 144.009247] nix-grpc-daemon[1762]: time=2026-09-21T09:36:54.634Z level=INFO msg="Uploading 1 narinfos" lb # [ 144.015722] niks3-server[974]: 2026/09/21 09:36:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign lb # [ 144.022740] niks3-server[974]: 2026/09/21 09:36:54 INFO Signed narinfos id=47 count=1 worker1 # [ 144.024782] nix-grpc-daemon[1762]: time=2026-09-21T09:36:54.651Z level=INFO msg="Upload complete. (321ms)" lb # [ 144.027729] niks3-server[974]: 2026/09/21 09:36:54 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls lb # [ 144.032913] niks3-server[974]: 2026/09/21 09:36:54 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete lb # [ 144.037160] niks3-server[974]: 2026/09/21 09:36:54 INFO Completed upload id=47 worker2 # [ 144.078490] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:54Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 144.032796] nix-grpc-daemon[1702]: ts=2026-09-21T09:36:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51954 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=7 outputs=1 lb # [ 144.039066] niks3-server[974]: 2026/09/21 09:36:54 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo worker2 # [ 144.091337] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:54Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=0 worker1 # [ 144.050846] nix-grpc-daemon[1702]: ts=2026-09-21T09:36:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 144.055143] nix-daemon[839]: reaped child process 1785, status = succeeded worker1 # [ 144.061500] nix-grpc-daemon[1702]: ts=2026-09-21T09:36:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 144.072884] nix-grpc-daemon[1702]: ts=2026-09-21T09:36:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 144.083307] nix-daemon[839]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 144.267935] nix-daemon[839]: accepted connection from pid 1810, user nix-grpc-daemon (trusted) worker1 # [ 144.285717] nix-daemon[839]: reaped child process 1813, status = succeeded worker1 # [ 144.455847] nix-daemon[839]: accepted connection from pid 1815, user nix-grpc-daemon (trusted) worker1 # [ 144.470849] nix-daemon[839]: reaped child process 1818, status = succeeded lb # [ 144.489067] niks3-server[974]: 2026/09/21 09:36:55 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 144.494965] nix-grpc-daemon[1762]: time=2026-09-21T09:36:55.121Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 144.496551] nix-grpc-daemon[1762]: time=2026-09-21T09:36:55.121Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)" lb # [ 144.517264] niks3-server[974]: 2026/09/21 09:36:55 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst worker1 # [ 144.532708] nix-grpc-daemon[1762]: time=2026-09-21T09:36:55.159Z level=INFO msg="Uploading 1 narinfos" lb # [ 144.528117] niks3-server[974]: 2026/09/21 09:36:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign lb # [ 144.540722] niks3-server[974]: 2026/09/21 09:36:55 INFO Signed narinfos id=48 count=1 lb # [ 144.543472] niks3-server[974]: 2026/09/21 09:36:55 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls lb # [ 144.554741] niks3-server[974]: 2026/09/21 09:36:55 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete lb # [ 144.561951] niks3-server[974]: 2026/09/21 09:36:55 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo lb # [ 144.566983] niks3-server[974]: 2026/09/21 09:36:55 INFO Completed upload id=48 worker1 # [ 144.564460] nix-grpc-daemon[1762]: time=2026-09-21T09:36:55.191Z level=INFO msg="Upload complete. (469ms)" worker1 # [ 144.574028] nix-grpc-daemon[1702]: ts=2026-09-21T09:36:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51954 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 144.589050] nix-grpc-daemon[1702]: ts=2026-09-21T09:36:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 144.595105] nix-daemon[839]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 144.604303] nix-daemon[839]: reaped child process 1808, status = succeeded worker1 # [ 144.613746] nix-daemon[839]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 146.058286] nix-daemon[839]: reaped child process 1822, status = succeeded worker1 # [ 146.241495] nix-daemon[839]: accepted connection from pid 1838, user nix-grpc-daemon (trusted) worker1 # [ 146.258765] nix-daemon[839]: reaped child process 1841, status = succeeded lb # [ 146.274292] niks3-server[974]: 2026/09/21 09:36:56 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 146.281475] nix-grpc-daemon[1762]: time=2026-09-21T09:36:56.907Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 146.282915] nix-grpc-daemon[1762]: time=2026-09-21T09:36:56.907Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)" lb # [ 146.304290] niks3-server[974]: 2026/09/21 09:36:56 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv lb # [ 146.317892] niks3-server[974]: 2026/09/21 09:36:56 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 146.331093] niks3-server[974]: 2026/09/21 09:36:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign worker1 # [ 146.333081] nix-grpc-daemon[1762]: time=2026-09-21T09:36:56.959Z level=INFO msg="Uploading 1 narinfos" lb # [ 146.340551] niks3-server[974]: 2026/09/21 09:36:56 INFO Signed narinfos id=49 count=1 lb # [ 146.342777] niks3-server[974]: 2026/09/21 09:36:56 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls lb # [ 146.350232] niks3-server[974]: 2026/09/21 09:36:56 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete lb # [ 146.356171] niks3-server[974]: 2026/09/21 09:36:56 INFO Completed upload id=49 worker1 # [ 146.352974] nix-grpc-daemon[1762]: time=2026-09-21T09:36:56.979Z level=INFO msg="Upload complete. (328ms)" lb # [ 146.358331] niks3-server[974]: 2026/09/21 09:36:56 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo worker2 # [ 146.407348] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:57Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 146.364986] nix-grpc-daemon[1702]: ts=2026-09-21T09:36:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51954 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=8 outputs=1 worker2 # [ 146.420884] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:57Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=0 worker1 # [ 146.381226] nix-daemon[839]: reaped child process 1820, status = succeeded worker1 # [ 146.413670] nix-grpc-daemon[1702]: ts=2026-09-21T09:36:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 146.428695] nix-grpc-daemon[1702]: ts=2026-09-21T09:36:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 146.442786] nix-grpc-daemon[1702]: ts=2026-09-21T09:36:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 146.456154] nix-daemon[839]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 146.661706] nix-daemon[839]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 146.678162] nix-daemon[839]: reaped child process 1848, status = succeeded worker1 # [ 146.849446] nix-daemon[839]: accepted connection from pid 1850, user nix-grpc-daemon (trusted) worker1 # [ 146.866010] nix-daemon[839]: reaped child process 1853, status = succeeded lb # [ 146.881303] niks3-server[974]: 2026/09/21 09:36:57 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 146.886990] nix-grpc-daemon[1762]: time=2026-09-21T09:36:57.513Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 146.888524] nix-grpc-daemon[1762]: time=2026-09-21T09:36:57.513Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)" lb # [ 146.906915] niks3-server[974]: 2026/09/21 09:36:57 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst worker1 # [ 146.917306] nix-grpc-daemon[1762]: time=2026-09-21T09:36:57.544Z level=INFO msg="Uploading 1 narinfos" lb # [ 146.923208] niks3-server[974]: 2026/09/21 09:36:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign lb # [ 146.933774] niks3-server[974]: 2026/09/21 09:36:57 INFO Signed narinfos id=50 count=1 lb # [ 146.939508] niks3-server[974]: 2026/09/21 09:36:57 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls worker1 # [ 146.945591] nix-grpc-daemon[1762]: time=2026-09-21T09:36:57.572Z level=INFO msg="Upload complete. (473ms)" lb # [ 146.948653] niks3-server[974]: 2026/09/21 09:36:57 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete lb # [ 146.953933] niks3-server[974]: 2026/09/21 09:36:57 INFO Completed upload id=50 worker1 # [ 146.952104] nix-grpc-daemon[1702]: ts=2026-09-21T09:36:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51954 duration_s=0 paths=1 nar_bytes_in=512 lb # [ 146.957641] niks3-server[974]: 2026/09/21 09:36:57 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo worker1 # [ 146.959721] nix-grpc-daemon[1702]: ts=2026-09-21T09:36:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 146.970180] nix-daemon[839]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 146.974350] nix-daemon[839]: reaped child process 1843, status = succeeded worker1 # [ 146.986999] nix-daemon[839]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 148.227661] nix-daemon[839]: reaped child process 1857, status = succeeded worker1 # [ 148.405724] nix-daemon[839]: accepted connection from pid 1873, user nix-grpc-daemon (trusted) worker1 # [ 148.421906] nix-daemon[839]: reaped child process 1876, status = succeeded lb # [ 148.438476] niks3-server[974]: 2026/09/21 09:36:59 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 148.447545] nix-grpc-daemon[1762]: time=2026-09-21T09:36:59.072Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 148.449180] nix-grpc-daemon[1762]: time=2026-09-21T09:36:59.073Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)" lb # [ 148.477824] niks3-server[974]: 2026/09/21 09:36:59 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv lb # [ 148.488977] niks3-server[974]: 2026/09/21 09:36:59 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst worker1 # [ 148.502442] nix-grpc-daemon[1762]: time=2026-09-21T09:36:59.129Z level=INFO msg="Uploading 1 narinfos" lb # [ 148.501125] niks3-server[974]: 2026/09/21 09:36:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign lb # [ 148.510497] niks3-server[974]: 2026/09/21 09:36:59 INFO Signed narinfos id=51 count=1 lb # [ 148.514779] niks3-server[974]: 2026/09/21 09:36:59 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls lb # [ 148.522455] niks3-server[974]: 2026/09/21 09:36:59 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 148.526658] niks3-server[974]: 2026/09/21 09:36:59 INFO Completed upload id=51 worker1 # [ 148.523503] nix-grpc-daemon[1762]: time=2026-09-21T09:36:59.150Z level=INFO msg="Upload complete. (326ms)" lb # [ 148.529011] niks3-server[974]: 2026/09/21 09:36:59 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo worker2 # [ 148.578571] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:59Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 148.537017] nix-grpc-daemon[1702]: ts=2026-09-21T09:36:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51954 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=9 outputs=1 worker2 # [ 148.592694] nix-grpc-daemon[1395]: ts=2026-09-21T09:36:59Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=0 worker1 # [ 148.553929] nix-grpc-daemon[1702]: ts=2026-09-21T09:36:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 148.564154] nix-grpc-daemon[1702]: ts=2026-09-21T09:36:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 148.569820] nix-daemon[839]: reaped child process 1855, status = succeeded worker1 # [ 148.573465] nix-grpc-daemon[1762]: time=2026-09-21T09:36:59.200Z level=INFO msg="All 1 paths already cached" worker1 # [ 148.581657] nix-grpc-daemon[1702]: ts=2026-09-21T09:36:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 148.592507] nix-daemon[839]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 148.787886] nix-daemon[839]: accepted connection from pid 1880, user nix-grpc-daemon (trusted) worker1 # [ 148.804908] nix-daemon[839]: reaped child process 1883, status = succeeded worker1 # [ 148.977934] nix-daemon[839]: accepted connection from pid 1885, user nix-grpc-daemon (trusted) worker1 # [ 148.993963] nix-daemon[839]: reaped child process 1888, status = succeeded lb # [ 149.008931] niks3-server[974]: 2026/09/21 09:36:59 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 149.016212] nix-grpc-daemon[1762]: time=2026-09-21T09:36:59.643Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 149.018115] nix-grpc-daemon[1762]: time=2026-09-21T09:36:59.644Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)" lb # [ 149.041809] niks3-server[974]: 2026/09/21 09:36:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign worker1 # [ 149.046532] nix-grpc-daemon[1762]: time=2026-09-21T09:36:59.673Z level=INFO msg="Uploading 1 narinfos" lb # [ 149.056763] niks3-server[974]: 2026/09/21 09:36:59 INFO Signed narinfos id=52 count=1 lb # [ 149.059947] niks3-server[974]: 2026/09/21 09:36:59 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst worker1 # [ 149.074106] nix-grpc-daemon[1762]: time=2026-09-21T09:36:59.701Z level=INFO msg="Upload complete. (468ms)" lb # [ 149.077682] niks3-server[974]: 2026/09/21 09:36:59 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls lb # [ 149.081804] niks3-server[974]: 2026/09/21 09:36:59 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete worker1 # [ 149.080319] nix-grpc-daemon[1702]: ts=2026-09-21T09:36:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51954 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 149.086448] niks3-server[974]: 2026/09/21 09:36:59 INFO Completed upload id=52 lb # [ 149.088593] niks3-server[974]: 2026/09/21 09:36:59 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo worker1 # [ 149.093403] nix-grpc-daemon[1702]: ts=2026-09-21T09:36:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 149.098971] nix-daemon[839]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 149.103226] nix-daemon[839]: reaped child process 1878, status = succeeded worker1 # [ 149.115230] nix-daemon[839]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 150.758465] nix-daemon[839]: reaped child process 1892, status = succeeded worker1 # [ 150.942854] nix-daemon[839]: accepted connection from pid 1908, user nix-grpc-daemon (trusted) worker1 # [ 150.959676] nix-daemon[839]: reaped child process 1911, status = succeeded lb # [ 150.977962] niks3-server[974]: 2026/09/21 09:37:01 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 150.984398] nix-grpc-daemon[1762]: time=2026-09-21T09:37:01.610Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 150.985895] nix-grpc-daemon[1762]: time=2026-09-21T09:37:01.610Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)" lb # [ 151.030560] niks3-server[974]: 2026/09/21 09:37:01 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker1 # [ 151.036453] nix-grpc-daemon[1762]: time=2026-09-21T09:37:01.663Z level=INFO msg="Uploading 1 narinfos" lb # [ 151.037617] niks3-server[974]: 2026/09/21 09:37:01 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst lb # [ 151.051409] niks3-server[974]: 2026/09/21 09:37:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign lb # [ 151.057654] niks3-server[974]: 2026/09/21 09:37:01 INFO Signed narinfos id=53 count=1 lb # [ 151.060805] niks3-server[974]: 2026/09/21 09:37:01 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls lb # [ 151.063715] niks3-server[974]: 2026/09/21 09:37:01 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 151.066954] niks3-server[974]: 2026/09/21 09:37:01 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo lb # [ 151.070570] niks3-server[974]: 2026/09/21 09:37:01 INFO Completed upload id=53 worker1 # [ 151.067761] nix-grpc-daemon[1762]: time=2026-09-21T09:37:01.694Z level=INFO msg="Upload complete. (342ms)" worker2 # [ 151.122189] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:01Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 151.081212] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51954 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=10 outputs=1 worker2 # [ 151.136246] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:01Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=0 worker1 # [ 151.099452] nix-daemon[839]: reaped child process 1890, status = succeeded worker1 # [ 151.129713] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 151.144882] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 151.158265] nix-grpc-daemon[1762]: time=2026-09-21T09:37:01.785Z level=INFO msg="All 1 paths already cached" worker1 # [ 151.167016] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 151.181305] nix-daemon[839]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 151.380071] nix-daemon[839]: accepted connection from pid 1915, user nix-grpc-daemon (trusted) worker1 # [ 151.398404] nix-daemon[839]: reaped child process 1918, status = succeeded worker1 # [ 151.570114] nix-daemon[839]: accepted connection from pid 1920, user nix-grpc-daemon (trusted) worker1 # [ 151.587342] nix-daemon[839]: reaped child process 1923, status = succeeded lb # [ 151.602440] niks3-server[974]: 2026/09/21 09:37:02 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 151.608879] nix-grpc-daemon[1762]: time=2026-09-21T09:37:02.235Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 151.610357] nix-grpc-daemon[1762]: time=2026-09-21T09:37:02.235Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)" lb # [ 151.627973] niks3-server[974]: 2026/09/21 09:37:02 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst worker1 # [ 151.638615] nix-grpc-daemon[1762]: time=2026-09-21T09:37:02.265Z level=INFO msg="Uploading 1 narinfos" lb # [ 151.642791] niks3-server[974]: 2026/09/21 09:37:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign lb # [ 151.653374] niks3-server[974]: 2026/09/21 09:37:02 INFO Signed narinfos id=54 count=1 lb # [ 151.660274] niks3-server[974]: 2026/09/21 09:37:02 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls lb # [ 151.668630] niks3-server[974]: 2026/09/21 09:37:02 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete lb # [ 151.674711] niks3-server[974]: 2026/09/21 09:37:02 INFO Completed upload id=54 worker1 # [ 151.672037] nix-grpc-daemon[1762]: time=2026-09-21T09:37:02.298Z level=INFO msg="Upload complete. (474ms)" lb # [ 151.677546] niks3-server[974]: 2026/09/21 09:37:02 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo worker1 # [ 151.680207] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51954 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 151.691907] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 151.700146] nix-daemon[839]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 151.704820] nix-daemon[839]: reaped child process 1913, status = succeeded worker1 # [ 151.716945] nix-daemon[839]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 153.360625] nix-daemon[839]: reaped child process 1927, status = succeeded worker1 # [ 153.543785] nix-daemon[839]: accepted connection from pid 1943, user nix-grpc-daemon (trusted) worker1 # [ 153.562253] nix-daemon[839]: reaped child process 1946, status = succeeded lb # [ 153.577472] niks3-server[974]: 2026/09/21 09:37:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 153.585986] nix-grpc-daemon[1762]: time=2026-09-21T09:37:04.210Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 153.587792] nix-grpc-daemon[1762]: time=2026-09-21T09:37:04.211Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)" lb # [ 153.612706] niks3-server[974]: 2026/09/21 09:37:04 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst worker1 # [ 153.623724] nix-grpc-daemon[1762]: time=2026-09-21T09:37:04.250Z level=INFO msg="Uploading 1 narinfos" lb # [ 153.626198] niks3-server[974]: 2026/09/21 09:37:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign lb # [ 153.635086] niks3-server[974]: 2026/09/21 09:37:04 INFO Signed narinfos id=55 count=1 lb # [ 153.643187] niks3-server[974]: 2026/09/21 09:37:04 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv lb # [ 153.651155] niks3-server[974]: 2026/09/21 09:37:04 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls lb # [ 153.659966] niks3-server[974]: 2026/09/21 09:37:04 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 153.665194] niks3-server[974]: 2026/09/21 09:37:04 INFO Completed upload id=55 worker1 # [ 153.662008] nix-grpc-daemon[1762]: time=2026-09-21T09:37:04.288Z level=INFO msg="Upload complete. (332ms)" lb # [ 153.668389] niks3-server[974]: 2026/09/21 09:37:04 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo worker2 # [ 153.719838] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:04Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 153.676241] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51954 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=11 outputs=1 worker2 # [ 153.733903] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:04Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=0 worker1 # [ 153.692418] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 153.701476] nix-daemon[839]: reaped child process 1925, status = succeeded worker1 # [ 153.704922] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 153.716335] nix-grpc-daemon[1762]: time=2026-09-21T09:37:04.343Z level=INFO msg="All 1 paths already cached" worker1 # [ 153.724104] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 153.736321] nix-daemon[839]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 153.926623] nix-daemon[839]: accepted connection from pid 1950, user nix-grpc-daemon (trusted) worker1 # [ 153.942890] nix-daemon[839]: reaped child process 1953, status = succeeded worker1 # [ 154.115906] nix-daemon[839]: accepted connection from pid 1955, user nix-grpc-daemon (trusted) worker1 # [ 154.130438] nix-daemon[839]: reaped child process 1958, status = succeeded lb # [ 154.149887] niks3-server[974]: 2026/09/21 09:37:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 154.156833] nix-grpc-daemon[1762]: time=2026-09-21T09:37:04.783Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 154.158274] nix-grpc-daemon[1762]: time=2026-09-21T09:37:04.783Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)" lb # [ 154.179656] niks3-server[974]: 2026/09/21 09:37:04 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst worker1 # [ 154.185863] nix-grpc-daemon[1762]: time=2026-09-21T09:37:04.812Z level=INFO msg="Uploading 1 narinfos" lb # [ 154.194709] niks3-server[974]: 2026/09/21 09:37:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign lb # [ 154.204733] niks3-server[974]: 2026/09/21 09:37:04 INFO Signed narinfos id=56 count=1 lb # [ 154.207541] niks3-server[974]: 2026/09/21 09:37:04 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls lb # [ 154.215147] niks3-server[974]: 2026/09/21 09:37:04 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete lb # [ 154.221884] niks3-server[974]: 2026/09/21 09:37:04 INFO Completed upload id=56 worker1 # [ 154.219267] nix-grpc-daemon[1762]: time=2026-09-21T09:37:04.846Z level=INFO msg="Upload complete. (469ms)" lb # [ 154.224863] niks3-server[974]: 2026/09/21 09:37:04 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo worker1 # [ 154.228265] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51954 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 154.237818] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 154.246456] nix-daemon[839]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 154.248786] nix-daemon[839]: reaped child process 1948, status = succeeded worker1 # [ 154.261793] nix-daemon[839]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 155.286277] nix-daemon[839]: reaped child process 1962, status = succeeded worker1 # [ 155.447839] nix-daemon[839]: accepted connection from pid 1978, user nix-grpc-daemon (trusted) worker1 # [ 155.465364] nix-daemon[839]: reaped child process 1981, status = succeeded lb # [ 155.480997] niks3-server[974]: 2026/09/21 09:37:06 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 155.488384] nix-grpc-daemon[1762]: time=2026-09-21T09:37:06.114Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 155.489814] nix-grpc-daemon[1762]: time=2026-09-21T09:37:06.114Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)" lb # [ 155.521486] niks3-server[974]: 2026/09/21 09:37:06 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker1 # [ 155.527944] nix-grpc-daemon[1762]: time=2026-09-21T09:37:06.154Z level=INFO msg="Uploading 1 narinfos" lb # [ 155.533440] niks3-server[974]: 2026/09/21 09:37:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign lb # [ 155.544343] niks3-server[974]: 2026/09/21 09:37:06 INFO Signed narinfos id=57 count=1 lb # [ 155.549597] niks3-server[974]: 2026/09/21 09:37:06 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst worker1 # [ 155.554750] nix-grpc-daemon[1762]: time=2026-09-21T09:37:06.181Z level=INFO msg="Upload complete. (284ms)" lb # [ 155.557952] niks3-server[974]: 2026/09/21 09:37:06 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls lb # [ 155.563066] niks3-server[974]: 2026/09/21 09:37:06 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 155.566960] niks3-server[974]: 2026/09/21 09:37:06 INFO Completed upload id=57 worker2 # [ 155.607549] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:06Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=1 lb # [ 155.569029] niks3-server[974]: 2026/09/21 09:37:06 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo worker1 # [ 155.564785] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51954 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=12 outputs=1 worker1 # [ 155.577200] nix-daemon[839]: reaped child process 1960, status = succeeded worker2 # [ 155.621534] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:06Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=0 worker1 # [ 155.617749] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 155.633095] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 155.646607] nix-grpc-daemon[1762]: time=2026-09-21T09:37:06.273Z level=INFO msg="All 2 paths already cached" worker1 # [ 155.655375] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 155.669171] nix-daemon[839]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 155.868400] nix-daemon[839]: accepted connection from pid 1985, user nix-grpc-daemon (trusted) worker1 # [ 155.886714] nix-daemon[839]: reaped child process 1988, status = succeeded worker1 # [ 156.059313] nix-daemon[839]: accepted connection from pid 1990, user nix-grpc-daemon (trusted) worker1 # [ 156.076183] nix-daemon[839]: reaped child process 1993, status = succeeded lb # [ 156.092577] niks3-server[974]: 2026/09/21 09:37:06 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 156.099037] nix-grpc-daemon[1762]: time=2026-09-21T09:37:06.725Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 156.100572] nix-grpc-daemon[1762]: time=2026-09-21T09:37:06.725Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)" lb # [ 156.118703] niks3-server[974]: 2026/09/21 09:37:06 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst worker1 # [ 156.128140] nix-grpc-daemon[1762]: time=2026-09-21T09:37:06.754Z level=INFO msg="Uploading 1 narinfos" lb # [ 156.134956] niks3-server[974]: 2026/09/21 09:37:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign lb # [ 156.145263] niks3-server[974]: 2026/09/21 09:37:06 INFO Signed narinfos id=58 count=1 lb # [ 156.150013] niks3-server[974]: 2026/09/21 09:37:06 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls lb # [ 156.157576] niks3-server[974]: 2026/09/21 09:37:06 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete lb # [ 156.162464] niks3-server[974]: 2026/09/21 09:37:06 INFO Completed upload id=58 worker1 # [ 156.159540] nix-grpc-daemon[1762]: time=2026-09-21T09:37:06.786Z level=INFO msg="Upload complete. (474ms)" lb # [ 156.165275] niks3-server[974]: 2026/09/21 09:37:06 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo worker1 # [ 156.168200] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51954 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 156.176468] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 156.184258] nix-daemon[839]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 156.187738] nix-daemon[839]: reaped child process 1983, status = succeeded worker1 # [ 156.199856] nix-daemon[839]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 157.233391] nix-daemon[839]: reaped child process 1997, status = succeeded worker1 # [ 157.393889] nix-daemon[839]: accepted connection from pid 2013, user nix-grpc-daemon (trusted) worker1 # [ 157.411157] nix-daemon[839]: reaped child process 2016, status = succeeded lb # [ 157.434056] niks3-server[974]: 2026/09/21 09:37:08 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 157.444191] nix-grpc-daemon[1762]: time=2026-09-21T09:37:08.067Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 157.445642] nix-grpc-daemon[1762]: time=2026-09-21T09:37:08.067Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)" lb # [ 157.472709] niks3-server[974]: 2026/09/21 09:37:08 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst worker1 # [ 157.479785] nix-grpc-daemon[1762]: time=2026-09-21T09:37:08.106Z level=INFO msg="Uploading 1 narinfos" lb # [ 157.484725] niks3-server[974]: 2026/09/21 09:37:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign lb # [ 157.487844] niks3-server[974]: 2026/09/21 09:37:08 INFO Signed narinfos id=59 count=1 lb # [ 157.501097] niks3-server[974]: 2026/09/21 09:37:08 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv lb # [ 157.503801] niks3-server[974]: 2026/09/21 09:37:08 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 157.508692] niks3-server[974]: 2026/09/21 09:37:08 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls worker1 # [ 157.505916] nix-grpc-daemon[1762]: time=2026-09-21T09:37:08.132Z level=INFO msg="Upload complete. (296ms)" lb # [ 157.511489] niks3-server[974]: 2026/09/21 09:37:08 INFO Completed upload id=59 lb # [ 157.514274] niks3-server[974]: 2026/09/21 09:37:08 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo worker2 # [ 157.559279] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:08Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 157.515509] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51954 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=13 outputs=1 worker1 # [ 157.527061] nix-daemon[839]: reaped child process 1995, status = succeeded worker1 # [ 157.560920] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 157.575531] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 157.589364] nix-grpc-daemon[1762]: time=2026-09-21T09:37:08.216Z level=INFO msg="All 2 paths already cached" worker1 # [ 157.597877] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 157.611723] nix-daemon[839]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 157.806549] nix-daemon[839]: accepted connection from pid 2020, user nix-grpc-daemon (trusted) worker1 # [ 157.825536] nix-daemon[839]: reaped child process 2023, status = succeeded worker1 # [ 157.997973] nix-daemon[839]: accepted connection from pid 2025, user nix-grpc-daemon (trusted) worker1 # [ 158.014684] nix-daemon[839]: reaped child process 2028, status = succeeded lb # [ 158.034188] niks3-server[974]: 2026/09/21 09:37:08 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 158.040027] nix-grpc-daemon[1762]: time=2026-09-21T09:37:08.666Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 158.041499] nix-grpc-daemon[1762]: time=2026-09-21T09:37:08.666Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)" lb # [ 158.060388] niks3-server[974]: 2026/09/21 09:37:08 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst lb # [ 158.073374] niks3-server[974]: 2026/09/21 09:37:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign worker1 # [ 158.078780] nix-grpc-daemon[1762]: time=2026-09-21T09:37:08.705Z level=INFO msg="Uploading 1 narinfos" lb # [ 158.081696] niks3-server[974]: 2026/09/21 09:37:08 INFO Signed narinfos id=60 count=1 lb # [ 158.090242] niks3-server[974]: 2026/09/21 09:37:08 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls lb # [ 158.101245] niks3-server[974]: 2026/09/21 09:37:08 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete worker1 # [ 158.103842] nix-grpc-daemon[1762]: time=2026-09-21T09:37:08.730Z level=INFO msg="Upload complete. (476ms)" lb # [ 158.107637] niks3-server[974]: 2026/09/21 09:37:08 INFO Completed upload id=60 lb # [ 158.111313] niks3-server[974]: 2026/09/21 09:37:08 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo worker1 # [ 158.109934] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51954 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 158.121758] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 158.126859] nix-daemon[839]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 158.131395] nix-daemon[839]: reaped child process 2018, status = succeeded worker1 # [ 158.143945] nix-daemon[839]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 159.569435] nix-daemon[839]: reaped child process 2032, status = succeeded worker1 # [ 159.730544] nix-daemon[839]: accepted connection from pid 2048, user nix-grpc-daemon (trusted) worker1 # [ 159.748437] nix-daemon[839]: reaped child process 2051, status = succeeded lb # [ 159.766801] niks3-server[974]: 2026/09/21 09:37:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 159.776401] nix-grpc-daemon[1762]: time=2026-09-21T09:37:10.402Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 159.777877] nix-grpc-daemon[1762]: time=2026-09-21T09:37:10.402Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)" lb # [ 159.804922] niks3-server[974]: 2026/09/21 09:37:10 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst lb # [ 159.818712] niks3-server[974]: 2026/09/21 09:37:10 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker1 # [ 159.823948] nix-grpc-daemon[1762]: time=2026-09-21T09:37:10.450Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.828876] niks3-server[974]: 2026/09/21 09:37:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign lb # [ 159.837016] niks3-server[974]: 2026/09/21 09:37:10 INFO Signed narinfos id=61 count=1 lb # [ 159.839023] niks3-server[974]: 2026/09/21 09:37:10 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls lb # [ 159.844526] niks3-server[974]: 2026/09/21 09:37:10 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 159.851721] niks3-server[974]: 2026/09/21 09:37:10 INFO Completed upload id=61 worker1 # [ 159.849087] nix-grpc-daemon[1762]: time=2026-09-21T09:37:10.476Z level=INFO msg="Upload complete. (292ms)" lb # [ 159.854258] niks3-server[974]: 2026/09/21 09:37:10 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo worker2 # [ 159.903354] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:10Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 159.858024] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51954 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=14 outputs=1 worker1 # [ 159.873659] nix-daemon[839]: reaped child process 2030, status = succeeded worker1 # [ 159.901389] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 159.915807] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 159.930280] nix-grpc-daemon[1762]: time=2026-09-21T09:37:10.557Z level=INFO msg="All 2 paths already cached" worker1 # [ 159.939257] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 159.953029] nix-daemon[839]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 160.148619] nix-daemon[839]: accepted connection from pid 2055, user nix-grpc-daemon (trusted) worker1 # [ 160.166631] nix-daemon[839]: reaped child process 2058, status = succeeded worker1 # [ 160.340876] nix-daemon[839]: accepted connection from pid 2060, user nix-grpc-daemon (trusted) worker1 # [ 160.358549] nix-daemon[839]: reaped child process 2063, status = succeeded lb # [ 160.374968] niks3-server[974]: 2026/09/21 09:37:11 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 160.385577] nix-grpc-daemon[1762]: time=2026-09-21T09:37:11.012Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 160.387041] nix-grpc-daemon[1762]: time=2026-09-21T09:37:11.012Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)" lb # [ 160.410814] niks3-server[974]: 2026/09/21 09:37:11 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst worker1 # [ 160.419497] nix-grpc-daemon[1762]: time=2026-09-21T09:37:11.046Z level=INFO msg="Uploading 1 narinfos" lb # [ 160.424240] niks3-server[974]: 2026/09/21 09:37:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign lb # [ 160.434001] niks3-server[974]: 2026/09/21 09:37:11 INFO Signed narinfos id=62 count=1 lb # [ 160.440555] niks3-server[974]: 2026/09/21 09:37:11 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls lb # [ 160.453983] niks3-server[974]: 2026/09/21 09:37:11 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete lb # [ 160.459188] niks3-server[974]: 2026/09/21 09:37:11 INFO Completed upload id=62 worker1 # [ 160.455710] nix-grpc-daemon[1762]: time=2026-09-21T09:37:11.082Z level=INFO msg="Upload complete. (487ms)" lb # [ 160.464459] niks3-server[974]: 2026/09/21 09:37:11 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo worker1 # [ 160.465590] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51954 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 160.480370] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51954 worker1 # [ 160.489237] nix-daemon[839]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 160.492443] nix-daemon[839]: reaped child process 2053, status = succeeded worker1 # [ 160.507279] nix-daemon[839]: accepted connection from pid 1702, user nix-grpc-daemon (trusted) worker1 # [ 161.341361] nix-daemon[839]: reaped child process 2067, status = succeeded worker1 # [ 161.516054] nix-daemon[839]: accepted connection from pid 2083, user nix-grpc-daemon (trusted) worker1 # [ 161.536291] nix-daemon[839]: reaped child process 2086, status = succeeded lb # [ 161.553566] niks3-server[974]: 2026/09/21 09:37:12 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 161.563738] nix-grpc-daemon[1762]: time=2026-09-21T09:37:12.186Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 161.565437] nix-grpc-daemon[1762]: time=2026-09-21T09:37:12.186Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)" lb # [ 161.592577] niks3-server[974]: 2026/09/21 09:37:12 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv lb # [ 161.605469] niks3-server[974]: 2026/09/21 09:37:12 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst lb # [ 161.616449] niks3-server[974]: 2026/09/21 09:37:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign worker1 # [ 161.619158] nix-grpc-daemon[1762]: time=2026-09-21T09:37:12.245Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.624190] niks3-server[974]: 2026/09/21 09:37:12 INFO Signed narinfos id=63 count=1 lb # [ 161.629965] niks3-server[974]: 2026/09/21 09:37:12 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls worker1 # [ 161.639572] nix-grpc-daemon[1762]: time=2026-09-21T09:37:12.266Z level=INFO msg="Upload complete. (322ms)" lb # [ 161.642305] niks3-server[974]: 2026/09/21 09:37:12 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete lb # [ 161.647219] niks3-server[974]: 2026/09/21 09:37:12 INFO Completed upload id=63 lb # [ 161.651012] niks3-server[974]: 2026/09/21 09:37:12 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo worker1 # [ 161.653176] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51954 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=15 outputs=1 worker1 # [ 161.667454] nix-daemon[839]: reaped child process 2065, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 21.21 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 161.888737] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # Running as unit: gpu.service; invocation ID: 07e2f986984f4534b2b3302852480d63 client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) client # [ 162.150888] nix[1336]: don't know how to build these paths: client # [ 162.151868] nix[1336]: /nix/store/3i1nziwpdqq19lzpqy4rywzxnm8dlps6-farm-top.drv worker2 # [ 162.186639] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53382 worker1 # [ 162.145384] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:51954 worker2 # [ 162.216576] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:12Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=0 client # [ 162.187115] nix[1336]: warning: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, waiting up to 30s for a worker lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code lb # [ 169.869060] envoy[917]: conn peer=[2001:db8:1::1]:33590 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27187 tx=11430 ms=20889 client # [ 192.188827] nix[1336]: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu} client # [ 192.201765] nix[1336]: error: dependency '1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv' failed client # [ 192.240899] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 192.248956] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 192.252462] systemd[1]: gpu.service: Consumed 183ms CPU time over 30.357s wall clock time, 35.4M memory peak, 5.1K incoming IP traffic, 5K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.24 seconds) client: must succeed: journalctl -u gpu -o cat client: (finished: must succeed: journalctl -u gpu -o cat, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 52.31 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.12 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 194.206660] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:44Z level=info event=unhealthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.12 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2 client # don't know how to build these paths: client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker1 # [ 195.343088] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:51954 worker2 # [ 195.393918] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53382 worker2 # [ 195.419639] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:46Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=0 worker2 # [ 195.425895] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:46Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 195.467418] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53382 worker2 # [ 195.482696] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53382 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'... worker2 # [ 195.498208] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53382 worker2 # [ 195.514206] nix-daemon[860]: accepted connection from pid 1395, user nix-grpc-daemon (trusted) worker2 # [ 195.722539] nix-daemon[860]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) worker2 # [ 195.742093] nix-daemon[860]: reaped child process 1693, status = succeeded worker2 # [ 195.918211] nix-daemon[860]: accepted connection from pid 1695, user nix-grpc-daemon (trusted) worker2 # [ 195.934482] nix-daemon[860]: reaped child process 1698, status = succeeded lb # [ 195.903962] niks3-server[974]: 2026/09/21 09:37:46 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 195.958169] nix-grpc-daemon[1475]: time=2026-09-21T09:37:46.567Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 195.959625] nix-grpc-daemon[1475]: time=2026-09-21T09:37:46.567Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)" lb # [ 195.936953] niks3-server[974]: 2026/09/21 09:37:46 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst worker2 # [ 195.993108] nix-grpc-daemon[1475]: time=2026-09-21T09:37:46.602Z level=INFO msg="Uploading 1 narinfos" lb # [ 195.951297] niks3-server[974]: 2026/09/21 09:37:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign lb # [ 195.961970] niks3-server[974]: 2026/09/21 09:37:46 INFO Signed narinfos id=64 count=1 lb # [ 195.967439] niks3-server[974]: 2026/09/21 09:37:46 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls lb # [ 195.975380] niks3-server[974]: 2026/09/21 09:37:46 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete lb # [ 195.982020] niks3-server[974]: 2026/09/21 09:37:46 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo lb # [ 195.986029] niks3-server[974]: 2026/09/21 09:37:46 INFO Completed upload id=64 worker2 # [ 196.029593] nix-grpc-daemon[1475]: time=2026-09-21T09:37:46.639Z level=INFO msg="Upload complete. (499ms)" worker2 # [ 196.037919] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53382 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 196.052542] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53382 worker2 # [ 196.059058] nix-daemon[860]: accepted connection from pid 1395, user nix-grpc-daemon (trusted) worker2 # [ 196.064078] nix-daemon[860]: reaped child process 1688, status = succeeded client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051... client # farm-a> worker2: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker2 # [ 196.077539] nix-daemon[860]: accepted connection from pid 1395, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-drain worker2 # [ 197.526370] nix-daemon[860]: reaped child process 1702, status = succeeded worker2 # [ 197.705174] nix-daemon[860]: accepted connection from pid 1718, user nix-grpc-daemon (trusted) worker2 # [ 197.725317] nix-daemon[860]: reaped child process 1721, status = succeeded lb # [ 197.694231] niks3-server[974]: 2026/09/21 09:37:48 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 197.748525] nix-grpc-daemon[1475]: time=2026-09-21T09:37:48.356Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 197.750390] nix-grpc-daemon[1475]: time=2026-09-21T09:37:48.357Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)" lb # [ 197.737334] niks3-server[974]: 2026/09/21 09:37:48 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv lb # [ 197.748721] niks3-server[974]: 2026/09/21 09:37:48 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 197.758427] niks3-server[974]: 2026/09/21 09:37:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign worker2 # [ 197.807808] nix-grpc-daemon[1475]: time=2026-09-21T09:37:48.417Z level=INFO msg="Uploading 1 narinfos" lb # [ 197.767015] niks3-server[974]: 2026/09/21 09:37:48 INFO Signed narinfos id=65 count=1 lb # [ 197.775453] niks3-server[974]: 2026/09/21 09:37:48 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls lb # [ 197.784105] niks3-server[974]: 2026/09/21 09:37:48 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete worker2 # [ 197.833307] nix-grpc-daemon[1475]: time=2026-09-21T09:37:48.443Z level=INFO msg="Upload complete. (344ms)" lb # [ 197.792107] niks3-server[974]: 2026/09/21 09:37:48 INFO Completed upload id=65 lb # [ 197.796266] niks3-server[974]: 2026/09/21 09:37:48 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo worker2 # [ 197.849286] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53382 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=16 outputs=1 worker2 # [ 197.871546] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:48Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=0 worker2 # [ 197.876628] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:48Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 197.881812] nix-daemon[860]: reaped child process 1700, status = succeeded worker2 # [ 197.908142] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53382 worker2 # [ 197.925343] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53382 worker2 # [ 197.938760] nix-grpc-daemon[1475]: time=2026-09-21T09:37:48.548Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'... worker2 # [ 197.948951] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53382 worker2 # [ 197.964295] nix-daemon[860]: accepted connection from pid 1395, user nix-grpc-daemon (trusted) worker2 # [ 198.168972] nix-daemon[860]: accepted connection from pid 1727, user nix-grpc-daemon (trusted) worker2 # [ 198.186446] nix-daemon[860]: reaped child process 1730, status = succeeded worker2 # [ 198.356272] nix-daemon[860]: accepted connection from pid 1732, user nix-grpc-daemon (trusted) worker2 # [ 198.371740] nix-daemon[860]: reaped child process 1735, status = succeeded lb # [ 198.341581] niks3-server[974]: 2026/09/21 09:37:48 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 198.394354] nix-grpc-daemon[1475]: time=2026-09-21T09:37:49.004Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 198.395813] nix-grpc-daemon[1475]: time=2026-09-21T09:37:49.004Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)" lb # [ 198.373186] niks3-server[974]: 2026/09/21 09:37:49 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst worker2 # [ 198.426926] nix-grpc-daemon[1475]: time=2026-09-21T09:37:49.036Z level=INFO msg="Uploading 1 narinfos" lb # [ 198.383408] niks3-server[974]: 2026/09/21 09:37:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign lb # [ 198.395838] niks3-server[974]: 2026/09/21 09:37:49 INFO Signed narinfos id=66 count=1 lb # [ 198.403054] niks3-server[974]: 2026/09/21 09:37:49 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls worker2 # [ 198.457549] nix-grpc-daemon[1475]: time=2026-09-21T09:37:49.067Z level=INFO msg="Upload complete. (476ms)" lb # [ 198.414359] niks3-server[974]: 2026/09/21 09:37:49 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete lb # [ 198.419524] niks3-server[974]: 2026/09/21 09:37:49 INFO Completed upload id=66 lb # [ 198.422656] niks3-server[974]: 2026/09/21 09:37:49 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo worker2 # [ 198.466733] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53382 duration_s=0 paths=1 nar_bytes_in=632 worker2 # [ 198.478712] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53382 worker2 # [ 198.484909] nix-daemon[860]: accepted connection from pid 1395, user nix-grpc-daemon (trusted) worker2 # [ 198.489720] nix-daemon[860]: reaped child process 1725, status = succeeded client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051... client # farm-b> worker2: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker2 # [ 198.502761] nix-daemon[860]: accepted connection from pid 1395, user nix-grpc-daemon (trusted) client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-drain lb # [ 199.868620] envoy[917]: conn peer=[2001:db8:1::1]:37916 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=499 ms=30062 worker2 # [ 199.927547] nix-daemon[860]: reaped child process 1739, status = succeeded worker2 # [ 200.094539] nix-daemon[860]: accepted connection from pid 1755, user nix-grpc-daemon (trusted) worker2 # [ 200.111856] nix-daemon[860]: reaped child process 1758, status = succeeded lb # [ 200.083361] niks3-server[974]: 2026/09/21 09:37:50 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 200.139209] nix-grpc-daemon[1475]: time=2026-09-21T09:37:50.745Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 200.140821] nix-grpc-daemon[1475]: time=2026-09-21T09:37:50.745Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)" lb # [ 200.124726] niks3-server[974]: 2026/09/21 09:37:50 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst worker2 # [ 200.178478] nix-grpc-daemon[1475]: time=2026-09-21T09:37:50.788Z level=INFO msg="Uploading 1 narinfos" lb # [ 200.140393] niks3-server[974]: 2026/09/21 09:37:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign lb # [ 200.149039] niks3-server[974]: 2026/09/21 09:37:50 INFO Signed narinfos id=67 count=1 lb # [ 200.151201] niks3-server[974]: 2026/09/21 09:37:50 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv lb # [ 200.155125] niks3-server[974]: 2026/09/21 09:37:50 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls lb # [ 200.161535] niks3-server[974]: 2026/09/21 09:37:50 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 200.165743] niks3-server[974]: 2026/09/21 09:37:50 INFO Completed upload id=67 worker2 # [ 200.209340] nix-grpc-daemon[1475]: time=2026-09-21T09:37:50.819Z level=INFO msg="Upload complete. (296ms)" lb # [ 200.168086] niks3-server[974]: 2026/09/21 09:37:50 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo worker2 # [ 200.228412] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53382 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=17 outputs=1 worker2 # [ 200.238184] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:50Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=0 worker2 # [ 200.241763] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:50Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 200.245372] nix-daemon[860]: reaped child process 1737, status = succeeded worker2 # [ 200.267203] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53382 worker2 # [ 200.280542] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53382 worker2 # [ 200.292921] nix-grpc-daemon[1475]: time=2026-09-21T09:37:50.902Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'... worker2 # [ 200.302058] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53382 worker2 # [ 200.315109] nix-daemon[860]: accepted connection from pid 1395, user nix-grpc-daemon (trusted) worker2 # [ 200.519342] nix-daemon[860]: accepted connection from pid 1764, user nix-grpc-daemon (trusted) worker2 # [ 200.538447] nix-daemon[860]: reaped child process 1767, status = succeeded worker2 # [ 200.713099] nix-daemon[860]: accepted connection from pid 1769, user nix-grpc-daemon (trusted) worker2 # [ 200.729474] nix-daemon[860]: reaped child process 1772, status = succeeded lb # [ 200.697433] niks3-server[974]: 2026/09/21 09:37:51 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 200.749548] nix-grpc-daemon[1475]: time=2026-09-21T09:37:51.359Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 200.751070] nix-grpc-daemon[1475]: time=2026-09-21T09:37:51.359Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)" lb # [ 200.722824] niks3-server[974]: 2026/09/21 09:37:51 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst worker2 # [ 200.780201] nix-grpc-daemon[1475]: time=2026-09-21T09:37:51.390Z level=INFO msg="Uploading 1 narinfos" lb # [ 200.739496] niks3-server[974]: 2026/09/21 09:37:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign lb # [ 200.749657] niks3-server[974]: 2026/09/21 09:37:51 INFO Signed narinfos id=68 count=1 lb # [ 200.759218] niks3-server[974]: 2026/09/21 09:37:51 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls lb # [ 200.763123] niks3-server[974]: 2026/09/21 09:37:51 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete worker2 # [ 200.810702] nix-grpc-daemon[1475]: time=2026-09-21T09:37:51.420Z level=INFO msg="Upload complete. (480ms)" lb # [ 200.767745] niks3-server[974]: 2026/09/21 09:37:51 INFO Completed upload id=68 lb # [ 200.771291] niks3-server[974]: 2026/09/21 09:37:51 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo worker2 # [ 200.817471] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53382 duration_s=0 paths=1 nar_bytes_in=760 worker2 # [ 200.830331] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53382 worker2 # [ 200.835687] nix-daemon[860]: accepted connection from pid 1395, user nix-grpc-daemon (trusted) worker2 # [ 200.840491] nix-daemon[860]: reaped child process 1762, status = succeeded worker2 # [ 200.850844] nix-daemon[860]: accepted connection from pid 1395, user nix-grpc-daemon (trusted) client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051... client # farm-top> worker2: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-drain worker2 # [ 201.472370] nix-daemon[860]: reaped child process 1776, status = succeeded worker2 # [ 201.628433] nix-daemon[860]: accepted connection from pid 1792, user nix-grpc-daemon (trusted) worker2 # [ 201.644853] nix-daemon[860]: reaped child process 1795, status = succeeded lb # [ 201.617856] niks3-server[974]: 2026/09/21 09:37:52 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 201.669904] nix-grpc-daemon[1475]: time=2026-09-21T09:37:52.278Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 201.671351] nix-grpc-daemon[1475]: time=2026-09-21T09:37:52.278Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)" lb # [ 201.653603] niks3-server[974]: 2026/09/21 09:37:52 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst worker2 # [ 201.710022] nix-grpc-daemon[1475]: time=2026-09-21T09:37:52.319Z level=INFO msg="Uploading 1 narinfos" lb # [ 201.668493] niks3-server[974]: 2026/09/21 09:37:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign lb # [ 201.678929] niks3-server[974]: 2026/09/21 09:37:52 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv lb # [ 201.688771] niks3-server[974]: 2026/09/21 09:37:52 INFO Signed narinfos id=69 count=1 lb # [ 201.691393] niks3-server[974]: 2026/09/21 09:37:52 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls worker2 # [ 201.738812] nix-grpc-daemon[1475]: time=2026-09-21T09:37:52.348Z level=INFO msg="Upload complete. (277ms)" lb # [ 201.695829] niks3-server[974]: 2026/09/21 09:37:52 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 201.702380] niks3-server[974]: 2026/09/21 09:37:52 INFO Completed upload id=69 lb # [ 201.705204] niks3-server[974]: 2026/09/21 09:37:52 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo worker2 # [ 201.749440] nix-grpc-daemon[1395]: ts=2026-09-21T09:37:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53382 duration_s=0 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=18 outputs=1 worker2 # [ 201.761271] nix-daemon[860]: reaped child process 1774, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 6.69 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.24 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 203.214022] nix-grpc-daemon[1702]: ts=2026-09-21T09:37:53Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 10.55 seconds) (finished: run the VM test script, in 204.29 seconds) test script finished in 204.58s cleanup kill QemuMachine (pid 49) client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 50) lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 52) worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 51) worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) (finished: cleanup, in 1.08 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh