vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #301
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12client # Disk image does not exist, creating the virtualisation disk image...13lb # Disk image does not exist, creating the virtualisation disk image...14client # Formatting '/build/vm-state-client/tmp.oVebgnESm4', fmt=raw size=107374182415client: QEMU running (pid 49)16lb: QEMU running (pid 50)17worker1 # Disk image does not exist, creating the virtualisation disk image...18worker1: QEMU running (pid 52)19worker2 # Disk image does not exist, creating the virtualisation disk image...20worker1 # Formatting '/build/vm-state-worker1/tmp.D97Q8vUQUd', fmt=raw size=107374182421client # mke2fs 1.47.4 (6-Mar-2025)22worker2 # Formatting '/build/vm-state-worker2/tmp.a42Dxgp3iH', fmt=raw size=107374182423worker1 # mke2fs 1.47.4 (6-Mar-2025)24client # Discarding device blocks: 0/262144 done25worker2 # mke2fs 1.47.4 (6-Mar-2025)26worker1 # Discarding device blocks: 0/262144 done27client # Creating filesystem with 262144 4k blocks and 65536 inodes28worker2 # Discarding device blocks: 0/262144 done29worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes30client # Filesystem UUID: 612c302d-cf82-44d0-93f4-547f03ca725431worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes32worker1 # Filesystem UUID: 0570e385-b4d7-47d3-a3ee-239d800b8cd133client # Superblock backups stored on blocks:34worker2 # Filesystem UUID: af804e7f-fd2f-4d4e-9b7f-468339a1fe5535worker1 # Superblock backups stored on blocks:36client # 32768, 98304, 163840, 22937637worker2 # Superblock backups stored on blocks:38worker1 # 32768, 98304, 163840, 22937639client # 40worker2 # 32768, 98304, 163840, 22937641worker1 # 42client # Allocating group tables: 0/8 done43worker2 # 44worker1 # Allocating group tables: 0/8 done45client # Writing inode tables: 0/8 done46worker2 # Allocating group tables: 0/8 done47worker1 # Writing inode tables: 0/8 done48client # Creating journal (8192 blocks): done49worker2 # Writing inode tables: 0/8 done50worker1 # Creating journal (8192 blocks): done51client # Writing superblocks and filesystem accounting information: 0/8 done52worker2 # Creating journal (8192 blocks): done53worker1 # Writing superblocks and filesystem accounting information: 0/8 done54client # 55worker2 # Writing superblocks and filesystem accounting information: 0/8 done56worker1 # 57client # Virtualisation disk image created.58worker2 # 59worker1 # Virtualisation disk image created.60worker2: QEMU running (pid 51)61lb # Formatting '/build/vm-state-lb/tmp.gkyi6dN6PC', fmt=raw size=107374182462worker2 # Virtualisation disk image created.63lb # mke2fs 1.47.4 (6-Mar-2025)64lb # Discarding device blocks: 0/262144 done65(finished: start all VMs, in 0.46 seconds)66lb # Creating filesystem with 262144 4k blocks and 65536 inodes67client: waiting for unit network-addresses-eth1.service68lb # Filesystem UUID: 782b10ef-e5a9-4bd6-ad24-65cac3c2f2e169client: waiting for the VM to finish booting70lb # Superblock backups stored on blocks:71lb # 32768, 98304, 163840, 22937672lb # 73lb # Allocating group tables: 0/8 done74lb # Writing inode tables: 0/8 done75lb # Creating journal (8192 blocks): done76lb # Writing superblocks and filesystem accounting information: 0/8 done77lb # 78lb # Virtualisation disk image created.79client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]80client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202681client # [ 0.000000] KASLR enabled82client # [ 0.000000] random: crng init done83lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]84client # [ 0.000000] Machine model: linux,dummy-virt85client # [ 0.000000] efi: UEFI not found.86lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202687client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT88lb # [ 0.000000] KASLR enabled89lb # [ 0.000000] random: crng init done90client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]91lb # [ 0.000000] Machine model: linux,dummy-virt92lb # [ 0.000000] efi: UEFI not found.93client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]94client # [ 0.000000] Zone ranges:95lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT96client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]97client # [ 0.000000] DMA32 empty98lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]99client # [ 0.000000] Normal empty100client # [ 0.000000] Device empty101lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]102lb # [ 0.000000] Zone ranges:103client # [ 0.000000] Movable zone start for each node104client # [ 0.000000] Early memory node ranges105lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]106lb # [ 0.000000] DMA32 empty107client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]108lb # [ 0.000000] Normal empty109lb # [ 0.000000] Device empty110client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]111lb # [ 0.000000] Movable zone start for each node112client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000113lb # [ 0.000000] Early memory node ranges114client # [ 0.000000] psci: probing for conduit method from DT.115lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]116client # [ 0.000000] psci: PSCIv1.3 detected in firmware.117lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]118client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs119lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000120client # [ 0.000000] psci: Trusted OS migration not required121client # [ 0.000000] psci: SMC Calling Convention v1.1122lb # [ 0.000000] psci: probing for conduit method from DT.123lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.124client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)125lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs126lb # [ 0.000000] psci: Trusted OS migration not required127client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296128lb # [ 0.000000] psci: SMC Calling Convention v1.1129client # [ 0.000000] Detected PIPT I-cache on CPU0130lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)131client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)132client # [ 0.000000] CPU features: detected: GICv3 CPU interface133lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296134client # [ 0.000000] CPU features: detected: Spectre-v4135lb # [ 0.000000] Detected PIPT I-cache on CPU0136client # [ 0.000000] CPU features: detected: Spectre-BHB137lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)138client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38139lb # [ 0.000000] CPU features: detected: GICv3 CPU interface140client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23141lb # [ 0.000000] CPU features: detected: Spectre-v4142client # [ 0.000000] alternatives: applying boot alternatives143lb # [ 0.000000] CPU features: detected: Spectre-BHB144lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38145lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23146lb # [ 0.000000] alternatives: applying boot alternatives147client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test/init regInfo=/nix/store/fyblb9a3ys5cssd508s2s53prxsdfvcl-closure-info/registration console=ttyAMA0,115200n8 console=tty0148client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/fyblb9a3ys5cssd508s2s53prxsdfvcl-closure-info/registration", will be passed to user space.149lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/14bqwb8zl951hxla1qpmchqzwfgwlqnx-nixos-system-lb-test/init regInfo=/nix/store/hxsww7q411z4rrmrw9s7nvsxa10s5ypn-closure-info/registration console=ttyAMA0,115200n8 console=tty0150client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes151client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)152lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/hxsww7q411z4rrmrw9s7nvsxa10s5ypn-closure-info/registration", will be passed to user space.153client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)154lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes155client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB156client # [ 0.000000] software IO TLB: area num 1.157lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)158client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB159lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)160client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)161lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB162client # [ 0.000000] Fallback order for Node 0: 0163lb # [ 0.000000] software IO TLB: area num 1.164client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216165lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB166client # [ 0.000000] Policy zone: DMA167lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)168client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off169lb # [ 0.000000] Fallback order for Node 0: 0170client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1171lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216172client # [ 0.000000] allocated 3145728 bytes of page_ext173lb # [ 0.000000] Policy zone: DMA174client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages175lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off176client # [ 0.000000] ftrace: allocated 294 pages with 4 groups177lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1178client # [ 0.000000] rcu: Hierarchical RCU implementation.179lb # [ 0.000000] allocated 3145728 bytes of page_ext180client # [ 0.000000] rcu: RCU event tracing is enabled.181lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages182client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.183lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups184client # [ 0.000000] Trampoline variant of Tasks RCU enabled.185lb # [ 0.000000] rcu: Hierarchical RCU implementation.186client # [ 0.000000] Rude variant of Tasks RCU enabled.187lb # [ 0.000000] rcu: RCU event tracing is enabled.188client # [ 0.000000] Tracing variant of Tasks RCU enabled.189lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.190client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.191lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.192lb # [ 0.000000] Rude variant of Tasks RCU enabled.193client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1194lb # [ 0.000000] Tracing variant of Tasks RCU enabled.195client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.196lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.197client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.198lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1199client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.200lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.201client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0202worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]203lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.204client # [ 0.000000] GICv3: 256 SPIs implemented205client # [ 0.000000] GICv3: 0 Extended SPIs implemented206client # [ 0.000000] Root IRQ handler: gic_handle_irq207lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.208worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026209client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI210lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0211worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]212worker2 # [ 0.000000] KASLR enabled213client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0214worker2 # [ 0.000000] random: crng init done215lb # [ 0.000000] GICv3: 256 SPIs implemented216worker2 # [ 0.000000] Machine model: linux,dummy-virt217lb # [ 0.000000] GICv3: 0 Extended SPIs implemented218client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000219worker2 # [ 0.000000] efi: UEFI not found.220lb # [ 0.000000] Root IRQ handler: gic_handle_irq221worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026222client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]223worker1 # [ 0.000000] KASLR enabled224lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI225worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT226worker1 # [ 0.000000] random: crng init done227lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0228client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)229worker1 # [ 0.000000] Machine model: linux,dummy-virt230worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]231worker1 # [ 0.000000] efi: UEFI not found.232lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000233worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]234lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]235client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)236worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT237worker2 # [ 0.000000] Zone ranges:238client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000239worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]240worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]241lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)242worker2 # [ 0.000000] DMA32 empty243worker2 # [ 0.000000] Normal empty244client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000245worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]246worker1 # [ 0.000000] Zone ranges:247worker2 # [ 0.000000] Device empty248lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)249client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.250worker2 # [ 0.000000] Movable zone start for each node251worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]252worker2 # [ 0.000000] Early memory node ranges253lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000254worker1 # [ 0.000000] DMA32 empty255worker1 # [ 0.000000] Normal empty256client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns257worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]258worker1 # [ 0.000000] Device empty259lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000260client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).261worker1 # [ 0.000000] Movable zone start for each node262worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]263lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.264worker1 # [ 0.000000] Early memory node ranges265worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000266worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]267client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns268worker2 # [ 0.000000] psci: probing for conduit method from DT.269lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns270worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.271worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]272client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns273lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).274worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs275client # [ 0.000030] arm-pv: using stolen time PV276worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000277worker1 # [ 0.000000] psci: probing for conduit method from DT.278worker2 # [ 0.000000] psci: Trusted OS migration not required279lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns280worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.281worker2 # [ 0.000000] psci: SMC Calling Convention v1.1282client # [ 0.000528] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)283client # [ 0.000663] Console: colour dummy device 80x25284worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs285lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns286worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)287worker1 # [ 0.000000] psci: Trusted OS migration not required288lb # [ 0.000033] arm-pv: using stolen time PV289client # [ 0.000671] printk: legacy console [tty0] enabled290worker1 # [ 0.000000] psci: SMC Calling Convention v1.1291worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296292worker2 # [ 0.000000] Detected PIPT I-cache on CPU0293client # [ 0.000871] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)294lb # [ 0.000532] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)295worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)296lb # [ 0.000711] Console: colour dummy device 80x25297client # [ 0.000878] pid_max: default: 32768 minimum: 301298worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)299lb # [ 0.000719] printk: legacy console [tty0] enabled300worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296301client # [ 0.000962] LSM: initializing lsm=capability,landlock,yama,bpf,ima302worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface303worker1 # [ 0.000000] Detected PIPT I-cache on CPU0304client # [ 0.001117] landlock: Up and running.305worker2 # [ 0.000000] CPU features: detected: Spectre-v4306client # [ 0.001120] Yama: becoming mindful.307lb # [ 0.000932] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)308worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)309worker2 # [ 0.000000] CPU features: detected: Spectre-BHB310client # [ 0.001670] LSM support for eBPF active311lb # [ 0.000940] pid_max: default: 32768 minimum: 301312worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface313worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38314client # [ 0.001817] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)315lb # [ 0.001009] LSM: initializing lsm=capability,landlock,yama,bpf,ima316worker1 # [ 0.000000] CPU features: detected: Spectre-v4317lb # [ 0.001204] landlock: Up and running.318worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23319worker1 # [ 0.000000] CPU features: detected: Spectre-BHB320client # [ 0.001850] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)321lb # [ 0.001208] Yama: becoming mindful.322worker2 # [ 0.000000] alternatives: applying boot alternatives323lb # [ 0.001778] LSM support for eBPF active324worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38325client # [ 0.002966] cacheinfo: Unable to detect cache hierarchy for CPU 0326worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23327client # [ 0.003677] rcu: Hierarchical SRCU implementation.328lb # [ 0.001926] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)329worker1 # [ 0.000000] alternatives: applying boot alternatives330client # [ 0.003681] rcu: Max phase no-delay instances is 1000.331lb # [ 0.001958] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)332client # [ 0.004885] fsl-mc MSI: its@8080000 domain created333lb # [ 0.003083] cacheinfo: Unable to detect cache hierarchy for CPU 0334client # [ 0.004970] EFI services will not be available.335client # [ 0.005046] smp: Bringing up secondary CPUs ...336lb # [ 0.003741] rcu: Hierarchical SRCU implementation.337client # [ 0.005054] smp: Brought up 1 node, 1 CPU338lb # [ 0.003745] rcu: Max phase no-delay instances is 1000.339worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/jbmz6j4lv6g7mbr4lfjirkfpl1ip7l3n-nixos-system-worker2-test/init regInfo=/nix/store/f22848wr761m7mhl13dj0mscxryf1720-closure-info/registration console=ttyAMA0,115200n8 console=tty0340client # [ 0.005058] SMP: Total of 1 processors activated.341lb # [ 0.004945] fsl-mc MSI: its@8080000 domain created342client # [ 0.005063] CPU: All CPU(s) started at EL1343lb # [ 0.005044] EFI services will not be available.344worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/26z9h8v6khkq1di9bb6h1yw8hdp2av88-nixos-system-worker1-test/init regInfo=/nix/store/amyj3rgkzzcd5a9995vqyvs20ykgifx0-closure-info/registration console=ttyAMA0,115200n8 console=tty0345lb # [ 0.005110] smp: Bringing up secondary CPUs ...346client # [ 0.005073] CPU features: detected: Branch Target Identification347worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/f22848wr761m7mhl13dj0mscxryf1720-closure-info/registration", will be passed to user space.348lb # [ 0.005119] smp: Brought up 1 node, 1 CPU349client # [ 0.005078] CPU features: detected: ARMv8.4 Translation Table Level350worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes351lb # [ 0.005122] SMP: Total of 1 processors activated.352worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/amyj3rgkzzcd5a9995vqyvs20ykgifx0-closure-info/registration", will be passed to user space.353lb # [ 0.005127] CPU: All CPU(s) started at EL1354client # [ 0.005081] CPU features: detected: Instruction cache invalidation not required for I/D coherence355worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)356lb # [ 0.005138] CPU features: detected: Branch Target Identification357worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes358client # [ 0.005085] CPU features: detected: Data cache clean to the PoU not required for I/D coherence359worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)360lb # [ 0.005143] CPU features: detected: ARMv8.4 Translation Table Level361worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)362client # [ 0.005088] CPU features: detected: Common not Private translations363worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB364lb # [ 0.005146] CPU features: detected: Instruction cache invalidation not required for I/D coherence365worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)366worker2 # [ 0.000000] software IO TLB: area num 1.367client # [ 0.005091] CPU features: detected: CRC32 instructions368worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB369worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB370lb # [ 0.005150] CPU features: detected: Data cache clean to the PoU not required for I/D coherence371client # [ 0.005094] CPU features: detected: Data cache clean to Point of Deep Persistence372worker1 # [ 0.000000] software IO TLB: area num 1.373lb # [ 0.005153] CPU features: detected: Common not Private translations374worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)375client # [ 0.005097] CPU features: detected: Data cache clean to Point of Persistence376worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB377worker2 # [ 0.000000] Fallback order for Node 0: 0378lb # [ 0.005157] CPU features: detected: CRC32 instructions379client # [ 0.005100] CPU features: detected: Data independent timing control (DIT)380worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)381worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216382client # [ 0.005103] CPU features: detected: E0PD383lb # [ 0.005159] CPU features: detected: Data cache clean to Point of Deep Persistence384worker2 # [ 0.000000] Policy zone: DMA385worker1 # [ 0.000000] Fallback order for Node 0: 0386client # [ 0.005106] CPU features: detected: Enhanced Counter Virtualization387lb # [ 0.005163] CPU features: detected: Data cache clean to Point of Persistence388worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216389worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off390worker1 # [ 0.000000] Policy zone: DMA391client # [ 0.005109] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)392lb # [ 0.005166] CPU features: detected: Data independent timing control (DIT)393worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1394lb # [ 0.005169] CPU features: detected: E0PD395worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off396client # [ 0.005112] CPU features: detected: Enhanced Virtualization Traps397worker2 # [ 0.000000] allocated 3145728 bytes of page_ext398lb # [ 0.005171] CPU features: detected: Enhanced Counter Virtualization399client # [ 0.005115] CPU features: detected: Fine Grained Traps400worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1401worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages402worker1 # [ 0.000000] allocated 3145728 bytes of page_ext403worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups404lb # [ 0.005174] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)405client # [ 0.005119] CPU features: detected: Generic authentication (architected QARMA5 algorithm)406worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages407worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.408lb # [ 0.005178] CPU features: detected: Enhanced Virtualization Traps409client # [ 0.005123] CPU features: detected: RCpc load-acquire (LDAPR)410worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups411worker2 # [ 0.000000] rcu: RCU event tracing is enabled.412lb # [ 0.005181] CPU features: detected: Fine Grained Traps413client # [ 0.005126] CPU features: detected: LSE atomic instructions414worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.415worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.416worker1 # [ 0.000000] rcu: RCU event tracing is enabled.417client # [ 0.005129] CPU features: detected: Privileged Access Never418lb # [ 0.005185] CPU features: detected: Generic authentication (architected QARMA5 algorithm)419worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.420client # [ 0.005132] CPU features: detected: PMUv3421worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.422lb # [ 0.005190] CPU features: detected: RCpc load-acquire (LDAPR)423worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.424client # [ 0.005134] CPU features: detected: RAS Extension Support425worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.426worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.427lb # [ 0.005193] CPU features: detected: LSE atomic instructions428client # [ 0.005137] CPU features: detected: RASv1p1 Extension Support429worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.430lb # [ 0.005196] CPU features: detected: Privileged Access Never431worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.432worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.433client # [ 0.005139] CPU features: detected: Random Number Generator434lb # [ 0.005198] CPU features: detected: PMUv3435worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1436client # [ 0.005142] CPU features: detected: Speculation barrier (SB)437worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.438lb # [ 0.005201] CPU features: detected: RAS Extension Support439client # [ 0.005144] CPU features: detected: Stage-2 Force Write-Back440worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1441worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.442lb # [ 0.005204] CPU features: detected: RASv1p1 Extension Support443client # [ 0.005147] CPU features: detected: TLB range maintenance instructions444lb # [ 0.005206] CPU features: detected: Random Number Generator445worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.446worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.447client # [ 0.005152] CPU features: detected: Speculative Store Bypassing Safe (SSBS)448lb # [ 0.005209] CPU features: detected: Speculation barrier (SB)449client # [ 0.005192] alternatives: applying system-wide alternatives450lb # [ 0.005212] CPU features: detected: Stage-2 Force Write-Back451worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.452worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.453lb # [ 0.005215] CPU features: detected: TLB range maintenance instructions454client # [ 0.008143] CPU features: detected: BBM Level 2 without TLB conflict abort455worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0456worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.457worker2 # [ 0.000000] GICv3: 256 SPIs implemented458lb # [ 0.005220] CPU features: detected: Speculative Store Bypassing Safe (SSBS)459worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0460worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented461worker1 # [ 0.000000] GICv3: 256 SPIs implemented462lb # [ 0.005259] alternatives: applying system-wide alternatives463worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq464client # [ 0.008307] Memory: 1406540K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)465worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented466worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI467lb # [ 0.008265] CPU features: detected: BBM Level 2 without TLB conflict abort468worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq469worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0470worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI471worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000472worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0473lb # [ 0.008500] Memory: 1406544K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)474worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]475lb # [ 0.008893] devtmpfs: initialized476worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000477worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]478worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)479lb # [ 0.010662] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)480worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)481worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)482worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000483worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)484worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000485worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000486worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.487worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000488worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.489worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns490client # [ 0.008706] devtmpfs: initialized491worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).492worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns493client # [ 0.010679] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)494worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).495worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns496client # [ 0.010700] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).497worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns498client # [ 0.010914] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL499worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns500client # [ 0.010919] 0 pages in range for non-PLT usage501worker2 # [ 0.000029] arm-pv: using stolen time PV502worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns503client # [ 0.010920] 508288 pages in range for PLT usage504worker1 # [ 0.000028] arm-pv: using stolen time PV505lb # [ 0.010683] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).506client # [ 0.011030] pinctrl core: initialized pinctrl subsystem507worker2 # [ 0.000399] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)508client # [ 0.011797] DMI not present or invalid.509lb # [ 0.010876] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL510worker2 # [ 0.000557] Console: colour dummy device 80x25511worker1 # [ 0.000404] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)512lb # [ 0.010880] 0 pages in range for non-PLT usage513client # [ 0.015068] NET: Registered PF_NETLINK/PF_ROUTE protocol family514worker2 # [ 0.000565] printk: legacy console [tty0] enabled515worker1 # [ 0.000563] Console: colour dummy device 80x25516lb # [ 0.010881] 508288 pages in range for PLT usage517client # [ 0.017291] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations518worker1 # [ 0.000570] printk: legacy console [tty0] enabled519lb # [ 0.010977] pinctrl core: initialized pinctrl subsystem520worker2 # [ 0.000759] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)521lb # [ 0.011737] DMI not present or invalid.522client # [ 0.017484] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations523worker2 # [ 0.000766] pid_max: default: 32768 minimum: 301524worker1 # [ 0.000761] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)525lb # [ 0.015156] NET: Registered PF_NETLINK/PF_ROUTE protocol family526worker1 # [ 0.000767] pid_max: default: 32768 minimum: 301527worker2 # [ 0.000840] LSM: initializing lsm=capability,landlock,yama,bpf,ima528client # [ 0.017685] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations529worker2 # [ 0.000981] landlock: Up and running.530lb # [ 0.017369] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations531client # [ 0.017709] audit: initializing netlink subsys (disabled)532worker1 # [ 0.000847] LSM: initializing lsm=capability,landlock,yama,bpf,ima533worker2 # [ 0.000983] Yama: becoming mindful.534worker1 # [ 0.000990] landlock: Up and running.535worker2 # [ 0.001441] LSM support for eBPF active536client # [ 0.018264] thermal_sys: Registered thermal governor 'fair_share'537worker1 # [ 0.000993] Yama: becoming mindful.538lb # [ 0.017553] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations539worker1 # [ 0.001442] LSM support for eBPF active540client # [ 0.018266] thermal_sys: Registered thermal governor 'bang_bang'541worker2 # [ 0.001570] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)542lb # [ 0.017753] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations543worker1 # [ 0.001571] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)544client # [ 0.018270] thermal_sys: Registered thermal governor 'step_wise'545lb # [ 0.017777] audit: initializing netlink subsys (disabled)546worker2 # [ 0.001602] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)547client # [ 0.018275] thermal_sys: Registered thermal governor 'user_space'548lb # [ 0.018418] thermal_sys: Registered thermal governor 'fair_share'549worker1 # [ 0.001603] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)550worker2 # [ 0.002661] cacheinfo: Unable to detect cache hierarchy for CPU 0551client # [ 0.018278] thermal_sys: Registered thermal governor 'power_allocator'552worker2 # [ 0.003398] rcu: Hierarchical SRCU implementation.553lb # [ 0.018420] thermal_sys: Registered thermal governor 'bang_bang'554worker1 # [ 0.002669] cacheinfo: Unable to detect cache hierarchy for CPU 0555worker1 # [ 0.003389] rcu: Hierarchical SRCU implementation.556worker2 # [ 0.003402] rcu: Max phase no-delay instances is 1000.557lb # [ 0.018424] thermal_sys: Registered thermal governor 'step_wise'558client # [ 0.018303] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1559worker2 # [ 0.004598] fsl-mc MSI: its@8080000 domain created560worker1 # [ 0.003392] rcu: Max phase no-delay instances is 1000.561client # [ 0.018311] cpuidle: using governor ladder562lb # [ 0.018429] thermal_sys: Registered thermal governor 'user_space'563worker2 # [ 0.004688] EFI services will not be available.564client # [ 0.018317] cpuidle: using governor menu565worker1 # [ 0.004541] fsl-mc MSI: its@8080000 domain created566lb # [ 0.018432] thermal_sys: Registered thermal governor 'power_allocator'567worker1 # [ 0.004631] EFI services will not be available.568worker2 # [ 0.004751] smp: Bringing up secondary CPUs ...569client # [ 0.018506] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.570worker2 # [ 0.004759] smp: Brought up 1 node, 1 CPU571worker1 # [ 0.004703] smp: Bringing up secondary CPUs ...572lb # [ 0.018456] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1573client # [ 0.018522] ASID allocator initialised with 65536 entries574worker2 # [ 0.004762] SMP: Total of 1 processors activated.575worker1 # [ 0.004710] smp: Brought up 1 node, 1 CPU576lb # [ 0.018465] cpuidle: using governor ladder577client # [ 0.019780] Serial: AMBA PL011 UART driver578worker2 # [ 0.004768] CPU: All CPU(s) started at EL1579worker1 # [ 0.004713] SMP: Total of 1 processors activated.580lb # [ 0.018471] cpuidle: using governor menu581worker1 # [ 0.004718] CPU: All CPU(s) started at EL1582worker2 # [ 0.004778] CPU features: detected: Branch Target Identification583client # [ 0.024980] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1584lb # [ 0.018663] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.585worker1 # [ 0.004729] CPU features: detected: Branch Target Identification586client # [ 0.025096] printk: console [ttyAMA0] enabled587worker2 # [ 0.004783] CPU features: detected: ARMv8.4 Translation Table Level588lb # [ 0.018680] ASID allocator initialised with 65536 entries589worker1 # [ 0.004734] CPU features: detected: ARMv8.4 Translation Table Level590lb # [ 0.019930] Serial: AMBA PL011 UART driver591worker2 # [ 0.004786] CPU features: detected: Instruction cache invalidation not required for I/D coherence592client # [ 0.146251] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages593worker1 # [ 0.004738] CPU features: detected: Instruction cache invalidation not required for I/D coherence594lb # [ 0.025346] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1595client # [ 0.146269] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page596worker2 # [ 0.004790] CPU features: detected: Data cache clean to the PoU not required for I/D coherence597lb # [ 0.025498] printk: console [ttyAMA0] enabled598worker1 # [ 0.004741] CPU features: detected: Data cache clean to the PoU not required for I/D coherence599worker2 # [ 0.004793] CPU features: detected: Common not Private translations600client # [ 0.146275] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages601worker2 # [ 0.004796] CPU features: detected: CRC32 instructions602worker1 # [ 0.004745] CPU features: detected: Common not Private translations603client # [ 0.146279] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page604lb # [ 0.146556] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages605worker1 # [ 0.004748] CPU features: detected: CRC32 instructions606worker2 # [ 0.004799] CPU features: detected: Data cache clean to Point of Deep Persistence607client # [ 0.146284] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages608lb # [ 0.146575] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page609worker1 # [ 0.004751] CPU features: detected: Data cache clean to Point of Deep Persistence610client # [ 0.146288] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page611worker2 # [ 0.004803] CPU features: detected: Data cache clean to Point of Persistence612lb # [ 0.146580] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages613worker1 # [ 0.004755] CPU features: detected: Data cache clean to Point of Persistence614client # [ 0.146293] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages615worker2 # [ 0.004806] CPU features: detected: Data independent timing control (DIT)616lb # [ 0.146584] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page617worker2 # [ 0.004809] CPU features: detected: E0PD618client # [ 0.146297] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page619worker1 # [ 0.004758] CPU features: detected: Data independent timing control (DIT)620lb # [ 0.146589] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages621worker1 # [ 0.004761] CPU features: detected: E0PD622worker2 # [ 0.004811] CPU features: detected: Enhanced Counter Virtualization623lb # [ 0.146592] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page624worker1 # [ 0.004763] CPU features: detected: Enhanced Counter Virtualization625worker2 # [ 0.004814] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)626lb # [ 0.146596] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages627worker1 # [ 0.004766] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)628worker2 # [ 0.004817] CPU features: detected: Enhanced Virtualization Traps629client # [ 0.153429] fbcon: Taking over console630lb # [ 0.146600] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page631worker2 # [ 0.004820] CPU features: detected: Fine Grained Traps632worker1 # [ 0.004770] CPU features: detected: Enhanced Virtualization Traps633client # [ 0.153444] ACPI: Interpreter disabled.634worker1 # [ 0.004772] CPU features: detected: Fine Grained Traps635client # [ 0.155281] iommu: Default domain type: Translated636worker2 # [ 0.004824] CPU features: detected: Generic authentication (architected QARMA5 algorithm)637client # [ 0.155291] iommu: DMA domain TLB invalidation policy: strict mode638worker1 # [ 0.004776] CPU features: detected: Generic authentication (architected QARMA5 algorithm)639worker2 # [ 0.004829] CPU features: detected: RCpc load-acquire (LDAPR)640lb # [ 0.153786] fbcon: Taking over console641worker1 # [ 0.004781] CPU features: detected: RCpc load-acquire (LDAPR)642worker2 # [ 0.004832] CPU features: detected: LSE atomic instructions643client # [ 0.156898] SCSI subsystem initialized644lb # [ 0.153800] ACPI: Interpreter disabled.645worker1 # [ 0.004784] CPU features: detected: LSE atomic instructions646worker2 # [ 0.004835] CPU features: detected: Privileged Access Never647lb # [ 0.155619] iommu: Default domain type: Translated648worker2 # [ 0.004838] CPU features: detected: PMUv3649worker1 # [ 0.004787] CPU features: detected: Privileged Access Never650lb # [ 0.155630] iommu: DMA domain TLB invalidation policy: strict mode651worker1 # [ 0.004790] CPU features: detected: PMUv3652worker2 # [ 0.004840] CPU features: detected: RAS Extension Support653worker1 # [ 0.004792] CPU features: detected: RAS Extension Support654worker2 # [ 0.004843] CPU features: detected: RASv1p1 Extension Support655lb # [ 0.157332] SCSI subsystem initialized656worker1 # [ 0.004795] CPU features: detected: RASv1p1 Extension Support657worker2 # [ 0.004845] CPU features: detected: Random Number Generator658worker1 # [ 0.004797] CPU features: detected: Random Number Generator659worker2 # [ 0.004848] CPU features: detected: Speculation barrier (SB)660worker1 # [ 0.004800] CPU features: detected: Speculation barrier (SB)661worker2 # [ 0.004851] CPU features: detected: Stage-2 Force Write-Back662worker1 # [ 0.004803] CPU features: detected: Stage-2 Force Write-Back663worker2 # [ 0.004854] CPU features: detected: TLB range maintenance instructions664worker1 # [ 0.004806] CPU features: detected: TLB range maintenance instructions665worker2 # [ 0.004858] CPU features: detected: Speculative Store Bypassing Safe (SSBS)666client # [ 0.162420] usbcore: registered new interface driver usbfs667worker1 # [ 0.004810] CPU features: detected: Speculative Store Bypassing Safe (SSBS)668worker2 # [ 0.004895] alternatives: applying system-wide alternatives669client # [ 0.162458] usbcore: registered new interface driver hub670worker1 # [ 0.004847] alternatives: applying system-wide alternatives671client # [ 0.162477] usbcore: registered new device driver usb672worker2 # [ 0.007801] CPU features: detected: BBM Level 2 without TLB conflict abort673client # [ 0.162750] pps_core: LinuxPPS API ver. 1 registered674worker1 # [ 0.007731] CPU features: detected: BBM Level 2 without TLB conflict abort675client # [ 0.162756] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>676worker2 # [ 0.008000] Memory: 1406588K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)677client # [ 0.162766] PTP clock support registered678worker2 # [ 0.008401] devtmpfs: initialized679worker1 # [ 0.007897] Memory: 1406524K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)680client # [ 0.162821] EDAC MC: Ver: 3.0.0681worker1 # [ 0.008278] devtmpfs: initialized682worker2 # [ 0.010123] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)683lb # [ 0.164745] usbcore: registered new interface driver usbfs684client # [ 0.167336] scmi_core: SCMI protocol bus registered685worker1 # [ 0.009983] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)686lb # [ 0.164776] usbcore: registered new interface driver hub687worker2 # [ 0.010145] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).688client # [ 0.168248] FPGA manager framework689worker1 # [ 0.010010] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).690lb # [ 0.164794] usbcore: registered new device driver usb691client # [ 0.169132] vgaarb: loaded692worker2 # [ 0.010344] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL693lb # [ 0.165079] pps_core: LinuxPPS API ver. 1 registered694worker1 # [ 0.010183] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL695worker2 # [ 0.010348] 0 pages in range for non-PLT usage696worker2 # [ 0.010349] 508288 pages in range for PLT usage697client # [ 0.169760] clocksource: Switched to clocksource arch_sys_counter698lb # [ 0.165085] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>699worker1 # [ 0.010188] 0 pages in range for non-PLT usage700worker2 # [ 0.010452] pinctrl core: initialized pinctrl subsystem701lb # [ 0.165094] PTP clock support registered702lb # [ 0.165134] EDAC MC: Ver: 3.0.0703worker2 # [ 0.011154] DMI not present or invalid.704worker1 # [ 0.010188] 508288 pages in range for PLT usage705worker1 # [ 0.010276] pinctrl core: initialized pinctrl subsystem706worker2 # [ 0.014320] NET: Registered PF_NETLINK/PF_ROUTE protocol family707lb # [ 0.169595] scmi_core: SCMI protocol bus registered708worker1 # [ 0.011028] DMI not present or invalid.709worker2 # [ 0.016468] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations710worker1 # [ 0.014204] NET: Registered PF_NETLINK/PF_ROUTE protocol family711lb # [ 0.170540] FPGA manager framework712client # [ 0.173070] VFS: Disk quotas dquot_6.6.0713lb # [ 0.171490] vgaarb: loaded714worker2 # [ 0.016643] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations715worker1 # [ 0.016351] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations716client # [ 0.173099] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)717worker1 # [ 0.016528] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations718worker2 # [ 0.016838] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations719lb # [ 0.172107] clocksource: Switched to clocksource arch_sys_counter720worker2 # [ 0.016858] audit: initializing netlink subsys (disabled)721lb # [ 0.172680] VFS: Disk quotas dquot_6.6.0722worker1 # [ 0.016718] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations723worker2 # [ 0.017409] thermal_sys: Registered thermal governor 'fair_share'724worker1 # [ 0.016738] audit: initializing netlink subsys (disabled)725lb # [ 0.172705] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)726worker2 # [ 0.017411] thermal_sys: Registered thermal governor 'bang_bang'727client # [ 0.176671] netfs: FS-Cache loaded728worker1 # [ 0.017281] thermal_sys: Registered thermal governor 'fair_share'729lb # [ 0.174964] netfs: FS-Cache loaded730client # [ 0.176772] pnp: PnP ACPI: disabled731worker2 # [ 0.017415] thermal_sys: Registered thermal governor 'step_wise'732lb # [ 0.175076] pnp: PnP ACPI: disabled733worker1 # [ 0.017283] thermal_sys: Registered thermal governor 'bang_bang'734worker2 # [ 0.017421] thermal_sys: Registered thermal governor 'user_space'735worker1 # [ 0.017287] thermal_sys: Registered thermal governor 'step_wise'736worker2 # [ 0.017423] thermal_sys: Registered thermal governor 'power_allocator'737worker1 # [ 0.017292] thermal_sys: Registered thermal governor 'user_space'738worker1 # [ 0.017295] thermal_sys: Registered thermal governor 'power_allocator'739worker2 # [ 0.017453] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1740worker2 # [ 0.017463] cpuidle: using governor ladder741worker1 # [ 0.017316] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1742worker2 # [ 0.017469] cpuidle: using governor menu743worker1 # [ 0.017326] cpuidle: using governor ladder744worker1 # [ 0.017331] cpuidle: using governor menu745worker2 # [ 0.017647] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.746client # [ 0.180623] NET: Registered PF_INET protocol family747worker2 # [ 0.017662] ASID allocator initialised with 65536 entries748worker1 # [ 0.017508] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.749worker2 # [ 0.018901] Serial: AMBA PL011 UART driver750client # [ 0.180878] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)751worker1 # [ 0.017523] ASID allocator initialised with 65536 entries752worker1 # [ 0.018705] Serial: AMBA PL011 UART driver753worker2 # [ 0.024016] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1754worker2 # [ 0.024168] printk: console [ttyAMA0] enabled755worker1 # [ 0.023767] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1756worker1 # [ 0.023910] printk: console [ttyAMA0] enabled757lb # [ 0.180747] NET: Registered PF_INET protocol family758lb # [ 0.181027] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)759worker1 # [ 0.140294] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages760worker1 # [ 0.140313] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page761worker1 # [ 0.140318] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages762worker2 # [ 0.144359] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages763worker1 # [ 0.140322] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page764worker2 # [ 0.144379] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page765worker1 # [ 0.140327] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages766worker2 # [ 0.144384] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages767worker1 # [ 0.140331] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page768worker2 # [ 0.144388] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page769worker1 # [ 0.140335] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages770worker2 # [ 0.144393] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages771worker1 # [ 0.140340] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page772worker2 # [ 0.144397] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page773worker2 # [ 0.144401] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages774worker2 # [ 0.144405] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page775worker1 # [ 0.147829] fbcon: Taking over console776worker1 # [ 0.147843] ACPI: Interpreter disabled.777worker2 # [ 0.151941] fbcon: Taking over console778worker2 # [ 0.151956] ACPI: Interpreter disabled.779worker2 # [ 0.153828] iommu: Default domain type: Translated780worker2 # [ 0.153838] iommu: DMA domain TLB invalidation policy: strict mode781worker2 # [ 0.155543] SCSI subsystem initialized782worker1 # [ 0.156850] iommu: Default domain type: Translated783worker1 # [ 0.156860] iommu: DMA domain TLB invalidation policy: strict mode784worker1 # [ 0.157329] SCSI subsystem initialized785worker2 # [ 0.160804] usbcore: registered new interface driver usbfs786worker1 # [ 0.159292] usbcore: registered new interface driver usbfs787worker2 # [ 0.160836] usbcore: registered new interface driver hub788worker1 # [ 0.159330] usbcore: registered new interface driver hub789worker2 # [ 0.160861] usbcore: registered new device driver usb790worker1 # [ 0.159349] usbcore: registered new device driver usb791worker2 # [ 0.161132] pps_core: LinuxPPS API ver. 1 registered792worker1 # [ 0.159629] pps_core: LinuxPPS API ver. 1 registered793worker2 # [ 0.161138] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>794worker2 # [ 0.161149] PTP clock support registered795worker1 # [ 0.159635] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>796worker2 # [ 0.161207] EDAC MC: Ver: 3.0.0797worker1 # [ 0.159645] PTP clock support registered798worker1 # [ 0.159693] EDAC MC: Ver: 3.0.0799worker2 # [ 0.165918] scmi_core: SCMI protocol bus registered800worker1 # [ 0.164355] scmi_core: SCMI protocol bus registered801worker2 # [ 0.166871] FPGA manager framework802worker2 # [ 0.167833] vgaarb: loaded803worker1 # [ 0.165320] FPGA manager framework804worker1 # [ 0.166237] vgaarb: loaded805worker2 # [ 0.168486] clocksource: Switched to clocksource arch_sys_counter806worker1 # [ 0.166870] clocksource: Switched to clocksource arch_sys_counter807client # [ 0.209947] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)808lb # [ 0.210382] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)809client # [ 0.209990] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)810lb # [ 0.210426] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)811client # [ 0.210022] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)812lb # [ 0.210452] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)813client # [ 0.210092] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)814lb # [ 0.210524] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)815client # [ 0.210236] TCP: Hash tables configured (established 16384 bind 16384)816worker2 # [ 0.173158] VFS: Disk quotas dquot_6.6.0817lb # [ 0.210667] TCP: Hash tables configured (established 16384 bind 16384)818client # [ 0.210321] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)819worker2 # [ 0.173192] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)820lb # [ 0.210751] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)821client # [ 0.210355] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)822lb # [ 0.210786] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)823worker1 # [ 0.172919] VFS: Disk quotas dquot_6.6.0824client # [ 0.210391] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)825lb # [ 0.210823] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)826worker1 # [ 0.172961] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)827client # [ 0.210477] NET: Registered PF_UNIX/PF_LOCAL protocol family828lb # [ 0.210918] NET: Registered PF_UNIX/PF_LOCAL protocol family829client # [ 0.210500] NET: Registered PF_XDP protocol family830worker1 # [ 0.174548] netfs: FS-Cache loaded831worker2 # [ 0.176785] netfs: FS-Cache loaded832lb # [ 0.210941] NET: Registered PF_XDP protocol family833worker1 # [ 0.174672] pnp: PnP ACPI: disabled834client # [ 0.210520] PCI: CLS 0 bytes, default 64835worker2 # [ 0.176918] pnp: PnP ACPI: disabled836lb # [ 0.210960] PCI: CLS 0 bytes, default 64837client # [ 0.210762] Trying to unpack rootfs image as initramfs...838lb # [ 0.211213] Trying to unpack rootfs image as initramfs...839worker1 # [ 0.178470] NET: Registered PF_INET protocol family840worker1 # [ 0.178722] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)841worker2 # [ 0.180706] NET: Registered PF_INET protocol family842lb # [ 0.225719] kvm [1]: HYP mode not available843worker2 # [ 0.180965] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)844client # [ 0.233802] kvm [1]: HYP mode not available845worker2 # [ 0.210433] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)846worker1 # [ 0.207677] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)847worker2 # [ 0.210483] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)848worker1 # [ 0.207731] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)849worker2 # [ 0.210512] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)850worker1 # [ 0.207762] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)851worker2 # [ 0.210591] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)852worker1 # [ 0.207837] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)853worker2 # [ 0.210736] TCP: Hash tables configured (established 16384 bind 16384)854worker1 # [ 0.208000] TCP: Hash tables configured (established 16384 bind 16384)855worker2 # [ 0.210818] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)856worker1 # [ 0.208095] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)857worker2 # [ 0.210855] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)858worker1 # [ 0.208132] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)859worker2 # [ 0.210890] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)860worker1 # [ 0.208168] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)861worker2 # [ 0.210979] NET: Registered PF_UNIX/PF_LOCAL protocol family862worker1 # [ 0.208256] NET: Registered PF_UNIX/PF_LOCAL protocol family863worker2 # [ 0.211036] NET: Registered PF_XDP protocol family864worker1 # [ 0.208310] NET: Registered PF_XDP protocol family865worker2 # [ 0.211055] PCI: CLS 0 bytes, default 64866worker1 # [ 0.208329] PCI: CLS 0 bytes, default 64867worker2 # [ 0.211313] Trying to unpack rootfs image as initramfs...868worker1 # [ 0.208584] Trying to unpack rootfs image as initramfs...869worker2 # [ 0.226358] kvm [1]: HYP mode not available870worker1 # [ 0.224714] kvm [1]: HYP mode not available871lb # [ 0.320686] Initialise system trusted keyrings872lb # [ 0.321463] workingset: timestamp_bits=42 max_order=19 bucket_order=0873lb # [ 0.322739] squashfs: version 4.0 (2009/01/31) Phillip Lougher874lb # [ 0.323499] 9p: Installing v9fs 9p2000 file system support875client # [ 0.326343] Initialise system trusted keyrings876client # [ 0.327099] workingset: timestamp_bits=42 max_order=19 bucket_order=0877client # [ 0.328361] squashfs: version 4.0 (2009/01/31) Phillip Lougher878client # [ 0.329130] 9p: Installing v9fs 9p2000 file system support879lb # [ 0.344069] Key type asymmetric registered880lb # [ 0.344094] Asymmetric key parser 'x509' registered881client # [ 0.349675] Key type asymmetric registered882client # [ 0.349699] Asymmetric key parser 'x509' registered883client # [ 0.349759] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)884lb # [ 0.352204] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)885lb # [ 0.353264] io scheduler mq-deadline registered886lb # [ 0.353275] io scheduler kyber registered887client # [ 0.357908] io scheduler mq-deadline registered888client # [ 0.357928] io scheduler kyber registered889worker1 # [ 0.315442] Initialise system trusted keyrings890client # [ 0.365937] pl061_gpio 9030000.pl061: PL061 GPIO chip registered891lb # [ 0.364242] pl061_gpio 9030000.pl061: PL061 GPIO chip registered892worker1 # [ 0.316198] workingset: timestamp_bits=42 max_order=19 bucket_order=0893worker1 # [ 0.317412] squashfs: version 4.0 (2009/01/31) Phillip Lougher894worker2 # [ 0.320294] Initialise system trusted keyrings895worker1 # [ 0.318198] 9p: Installing v9fs 9p2000 file system support896client # [ 0.367243] ledtrig-cpu: registered to indicate activity on CPUs897lb # [ 0.365674] ledtrig-cpu: registered to indicate activity on CPUs898worker2 # [ 0.321139] workingset: timestamp_bits=42 max_order=19 bucket_order=0899client # [ 0.367611] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:900lb # [ 0.366058] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:901worker2 # [ 0.322375] squashfs: version 4.0 (2009/01/31) Phillip Lougher902client # [ 0.367629] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000903lb # [ 0.366076] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000904client # [ 0.367641] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000905lb # [ 0.366089] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000906worker2 # [ 0.323151] 9p: Installing v9fs 9p2000 file system support907client # [ 0.367649] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000908lb # [ 0.366097] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000909client # [ 0.367670] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits910lb # [ 0.366118] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits911client # [ 0.367692] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]912lb # [ 0.366143] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]913client # [ 0.367763] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00914lb # [ 0.366224] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00915client # [ 0.367773] pci_bus 0000:00: root bus resource [bus 00-ff]916lb # [ 0.366234] pci_bus 0000:00: root bus resource [bus 00-ff]917client # [ 0.367779] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]918lb # [ 0.366239] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]919client # [ 0.367785] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]920lb # [ 0.366244] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]921client # [ 0.367790] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]922lb # [ 0.366249] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]923client # [ 0.367856] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint924lb # [ 0.366307] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint925client # [ 0.368293] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint926lb # [ 0.366741] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint927client # [ 0.368479] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]928lb # [ 0.366926] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]929client # [ 0.368495] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]930lb # [ 0.366943] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]931client # [ 0.368525] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]932lb # [ 0.366974] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]933client # [ 0.368541] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]934lb # [ 0.366990] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]935client # [ 0.368993] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint936lb # [ 0.367448] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint937client # [ 0.369175] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]938lb # [ 0.367633] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]939client # [ 0.369191] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]940lb # [ 0.367650] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]941client # [ 0.369220] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]942lb # [ 0.367680] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]943client # [ 0.369680] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint944lb # [ 0.387157] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint945lb # [ 0.387342] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]946lb # [ 0.387359] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]947lb # [ 0.387389] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]948lb # [ 0.387842] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint949lb # [ 0.388018] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]950lb # [ 0.388035] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]951lb # [ 0.388067] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]952worker2 # [ 0.347056] Key type asymmetric registered953worker2 # [ 0.347083] Asymmetric key parser 'x509' registered954worker2 # [ 0.347150] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)955client # [ 0.393899] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]956worker1 # [ 0.346941] Key type asymmetric registered957lb # [ 0.394756] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint958worker1 # [ 0.346970] Asymmetric key parser 'x509' registered959client # [ 0.393924] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]960lb # [ 0.394941] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]961client # [ 0.393954] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]962worker1 # [ 0.347043] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)963lb # [ 0.394957] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]964worker1 # [ 0.349108] io scheduler mq-deadline registered965client # [ 0.394430] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint966worker1 # [ 0.349118] io scheduler kyber registered967lb # [ 0.394987] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]968client # [ 0.394614] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]969client # [ 0.394629] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]970lb # [ 0.395434] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint971lb # [ 0.395614] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]972client # [ 0.394660] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]973lb # [ 0.395630] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]974client # [ 0.395134] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint975lb # [ 0.395660] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]976client # [ 0.395315] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]977client # [ 0.395330] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]978worker2 # [ 0.352545] io scheduler mq-deadline registered979client # [ 0.395360] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]980worker2 # [ 0.352565] io scheduler kyber registered981client # [ 0.395818] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint982client # [ 0.395998] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]983client # [ 0.396013] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]984client # [ 0.396042] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]985client # [ 0.396493] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint986client # [ 0.396676] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]987worker1 # [ 0.358992] pl061_gpio 9030000.pl061: PL061 GPIO chip registered988client # [ 0.396691] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]989client # [ 0.396720] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]990client # [ 0.396736] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]991client # [ 0.397221] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint992worker1 # [ 0.360406] ledtrig-cpu: registered to indicate activity on CPUs993client # [ 0.397406] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]994worker1 # [ 0.360770] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:995client # [ 0.397435] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]996worker1 # [ 0.360787] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000997worker1 # [ 0.360814] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000998worker1 # [ 0.360822] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000999lb # [ 0.408182] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1000lb # [ 0.408378] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1001worker1 # [ 0.360841] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1002lb # [ 0.408395] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1003worker1 # [ 0.360865] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1004lb # [ 0.408425] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1005worker1 # [ 0.360943] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001006lb # [ 0.408441] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1007worker2 # [ 0.364630] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1008worker1 # [ 0.360953] pci_bus 0000:00: root bus resource [bus 00-ff]1009worker2 # [ 0.365256] ledtrig-cpu: registered to indicate activity on CPUs1010lb # [ 0.408920] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1011worker1 # [ 0.360959] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1012worker2 # [ 0.365629] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1013lb # [ 0.409107] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1014worker1 # [ 0.360964] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1015lb # [ 0.409137] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1016worker2 # [ 0.365647] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001017worker1 # [ 0.360969] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1018lb # [ 0.409589] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1019worker2 # [ 0.365660] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001020worker1 # [ 0.361054] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1021lb # [ 0.409775] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1022worker1 # [ 0.361483] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1023worker2 # [ 0.365668] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001024client # [ 0.421997] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1025lb # [ 0.409804] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1026worker1 # [ 0.361668] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1027client # [ 0.422212] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1028worker2 # [ 0.365695] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1029lb # [ 0.410209] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1030worker1 # [ 0.361684] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1031client # [ 0.422244] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1032lb # [ 0.410390] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1033worker2 # [ 0.365719] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1034worker1 # [ 0.361713] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1035client # [ 0.422663] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1036worker1 # [ 0.361729] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1037lb # [ 0.410637] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1038worker2 # [ 0.365797] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001039client # [ 0.422863] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1040lb # [ 0.410909] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1041worker2 # [ 0.365807] pci_bus 0000:00: root bus resource [bus 00-ff]1042worker1 # [ 0.362188] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1043client # [ 0.423117] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1044lb # [ 0.410926] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1045worker2 # [ 0.365813] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1046worker1 # [ 0.362370] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1047client # [ 0.423404] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1048lb # [ 0.410956] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1049worker1 # [ 0.362385] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1050worker2 # [ 0.365819] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1051client # [ 0.423421] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1052lb # [ 0.411406] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1053worker1 # [ 0.362414] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1054worker2 # [ 0.365824] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1055client # [ 0.423451] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1056lb # [ 0.411586] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1057worker1 # [ 0.362863] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1058worker2 # [ 0.365937] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1059client # [ 0.423922] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1060lb # [ 0.411602] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1061worker1 # [ 0.382833] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1062client # [ 0.424107] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1063lb # [ 0.411633] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1064worker2 # [ 0.366395] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1065worker1 # [ 0.382852] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1066client # [ 0.424123] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1067worker2 # [ 0.366581] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1068lb # [ 0.412222] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1069client # [ 0.424153] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1070worker2 # [ 0.366598] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1071lb # [ 0.412234] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1072client # [ 0.424742] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1073worker2 # [ 0.366628] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1074lb # [ 0.412239] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1075client # [ 0.424753] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1076worker2 # [ 0.366644] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1077lb # [ 0.412283] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1078client # [ 0.424759] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1079worker1 # [ 0.384190] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1080worker2 # [ 0.367101] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1081lb # [ 0.412331] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1082worker2 # [ 0.367284] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1083client # [ 0.424805] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1084worker1 # [ 0.384670] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1085worker2 # [ 0.367300] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1086lb # [ 0.412378] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1087worker1 # [ 0.384851] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1088client # [ 0.424852] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1089worker2 # [ 0.367330] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1090worker1 # [ 0.384866] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1091lb # [ 0.412424] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1092client # [ 0.424900] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1093worker1 # [ 0.384898] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1094worker2 # [ 0.367780] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1095lb # [ 0.412471] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1096client # [ 0.424946] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1097worker2 # [ 0.367963] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1098worker1 # [ 0.385355] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1099lb # [ 0.412519] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1100worker2 # [ 0.367979] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1101client # [ 0.424993] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1102worker1 # [ 0.385536] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1103lb # [ 0.412566] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1104worker2 # [ 0.368009] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1105worker1 # [ 0.385551] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1106client # [ 0.425042] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1107worker1 # [ 0.385580] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1108lb # [ 0.412613] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1109worker2 # [ 0.368474] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1110client # [ 0.425090] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1111worker2 # [ 0.368677] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1112worker1 # [ 0.386030] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1113lb # [ 0.412659] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1114client # [ 0.425139] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1115worker2 # [ 0.368692] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1116worker1 # [ 0.386210] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1117lb # [ 0.412721] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1118worker2 # [ 0.368725] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1119worker1 # [ 0.386225] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1120client # [ 0.425187] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1121lb # [ 0.412766] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1122worker1 # [ 0.386255] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1123client # [ 0.425248] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1124worker2 # [ 0.369192] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1125lb # [ 0.412788] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1126worker2 # [ 0.369377] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1127client # [ 0.425294] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1128worker1 # [ 0.386707] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1129lb # [ 0.412823] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1130worker2 # [ 0.369393] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1131client # [ 0.425316] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1132lb # [ 0.412845] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1133worker2 # [ 0.369423] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1134client # [ 0.425338] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1135lb # [ 0.412870] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1136client # [ 0.425359] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1137worker2 # [ 0.369880] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1138lb # [ 0.412892] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1139worker2 # [ 0.370071] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1140client # [ 0.425383] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1141lb # [ 0.412915] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1142worker2 # [ 0.370087] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1143client # [ 0.425404] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1144lb # [ 0.412938] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1145worker2 # [ 0.370117] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1146client # [ 0.425426] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1147lb # [ 0.412961] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1148client # [ 0.425448] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1149worker2 # [ 0.370567] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1150lb # [ 0.412983] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1151worker2 # [ 0.370751] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1152client # [ 0.425470] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1153lb # [ 0.413006] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1154worker2 # [ 0.370767] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1155client # [ 0.425492] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1156lb # [ 0.413029] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1157worker2 # [ 0.370796] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1158client # [ 0.425514] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1159lb # [ 0.413051] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1160worker2 # [ 0.370812] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1161client # [ 0.425536] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1162lb # [ 0.413073] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1163client # [ 0.425558] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1164worker2 # [ 0.371298] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1165lb # [ 0.413096] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1166client # [ 0.425579] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1167worker2 # [ 0.371485] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1168lb # [ 0.413117] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1169client # [ 0.425600] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1170worker2 # [ 0.371515] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1171lb # [ 0.413149] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1172client # [ 0.425622] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1173lb # [ 0.413170] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1174worker2 # [ 0.371966] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1175client # [ 0.425643] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1176lb # [ 0.413193] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1177worker2 # [ 0.372153] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1178client # [ 0.425664] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1179lb # [ 0.413215] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1180worker2 # [ 0.372183] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1181client # [ 0.425686] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1182worker1 # [ 0.402917] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1183lb # [ 0.413238] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1184client # [ 0.425707] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1185worker1 # [ 0.402941] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1186lb # [ 0.413264] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1187client # [ 0.425729] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1188lb # [ 0.413275] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1189worker1 # [ 0.402970] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1190client # [ 0.425756] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1191worker1 # [ 0.402986] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1192lb # [ 0.413280] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1193lb # [ 0.414437] pci 0000:00:0a.0: enabling device (0000 -> 0002)1194worker1 # [ 0.403499] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1195worker1 # [ 0.403687] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1196client # [ 0.464013] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1197worker1 # [ 0.403717] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1198client # [ 0.464023] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1199worker1 # [ 0.404186] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1200client # [ 0.465201] pci 0000:00:0a.0: enabling device (0000 -> 0002)1201worker1 # [ 0.404371] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1202worker1 # [ 0.404400] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1203worker1 # [ 0.404788] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1204worker1 # [ 0.404969] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1205worker1 # [ 0.405213] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1206worker1 # [ 0.405484] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1207worker1 # [ 0.405500] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1208worker1 # [ 0.405529] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1209worker1 # [ 0.405984] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1210worker1 # [ 0.406165] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1211worker2 # [ 0.420664] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1212worker1 # [ 0.406181] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1213worker2 # [ 0.420868] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1214worker1 # [ 0.406210] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1215worker2 # [ 0.421122] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1216worker1 # [ 0.406778] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1217worker2 # [ 0.421419] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1218worker1 # [ 0.406790] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1219worker2 # [ 0.421437] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1220worker1 # [ 0.406795] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1221worker2 # [ 0.421466] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1222worker1 # [ 0.406839] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1223worker2 # [ 0.421935] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1224worker2 # [ 0.422129] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1225worker1 # [ 0.406901] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1226worker2 # [ 0.422145] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1227worker1 # [ 0.406947] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1228worker2 # [ 0.422175] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1229worker1 # [ 0.406992] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1230worker2 # [ 0.422760] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1231worker1 # [ 0.407038] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1232worker2 # [ 0.422771] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1233worker1 # [ 0.407083] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1234worker2 # [ 0.422777] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1235worker1 # [ 0.407129] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1236worker2 # [ 0.422823] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1237worker1 # [ 0.407175] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1238worker2 # [ 0.422871] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1239worker1 # [ 0.407221] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1240worker2 # [ 0.422919] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1241worker1 # [ 0.407282] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1242worker2 # [ 0.422966] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1243worker1 # [ 0.407327] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1244worker2 # [ 0.423014] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1245lb # [ 0.486340] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1246worker1 # [ 0.407348] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1247worker2 # [ 0.423062] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1248worker1 # [ 0.407369] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1249worker2 # [ 0.423111] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1250worker1 # [ 0.407390] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1251worker1 # [ 0.407414] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1252worker2 # [ 0.423159] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1253client # [ 0.493083] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1254worker1 # [ 0.407435] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1255worker2 # [ 0.423207] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1256worker1 # [ 0.407456] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1257worker2 # [ 0.423289] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1258worker1 # [ 0.407478] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1259worker2 # [ 0.423335] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1260worker1 # [ 0.407499] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1261worker2 # [ 0.423357] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1262worker1 # [ 0.407520] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1263worker2 # [ 0.423380] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1264worker1 # [ 0.407543] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1265worker2 # [ 0.423402] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1266worker1 # [ 0.407565] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1267worker2 # [ 0.423427] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1268worker1 # [ 0.407586] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1269worker2 # [ 0.423450] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1270worker1 # [ 0.407607] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1271worker2 # [ 0.423472] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1272worker1 # [ 0.407628] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1273client # [ 0.499169] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1274worker2 # [ 0.423494] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1275worker1 # [ 0.407649] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1276worker1 # [ 0.407670] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1277worker2 # [ 0.423517] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1278worker1 # [ 0.407691] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1279client # [ 0.501116] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1280worker2 # [ 0.423539] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1281worker1 # [ 0.407712] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1282worker2 # [ 0.423562] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1283worker1 # [ 0.407733] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1284worker2 # [ 0.423585] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1285worker1 # [ 0.407755] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1286worker2 # [ 0.423606] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1287worker1 # [ 0.407780] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1288lb # [ 0.496334] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1289worker2 # [ 0.423628] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1290worker1 # [ 0.407790] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1291lb # [ 0.499809] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1292worker2 # [ 0.423649] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1293worker1 # [ 0.407794] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1294lb # [ 0.501766] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1295worker2 # [ 0.423671] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1296worker1 # [ 0.408969] pci 0000:00:0a.0: enabling device (0000 -> 0002)1297lb # [ 0.503710] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1298worker2 # [ 0.423693] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1299worker2 # [ 0.423715] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1300worker2 # [ 0.423737] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1301worker2 # [ 0.423759] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1302worker2 # [ 0.423781] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1303worker2 # [ 0.423808] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1304worker2 # [ 0.423817] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1305worker2 # [ 0.423823] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1306client # [ 0.511261] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1307worker2 # [ 0.424999] pci 0000:00:0a.0: enabling device (0000 -> 0002)1308client # [ 0.513399] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1309lb # [ 0.513937] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1310lb # [ 0.515991] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1311client # [ 0.524482] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1312client # [ 0.527297] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1313lb # [ 0.526999] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1314client # [ 0.529241] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1315worker1 # [ 0.481304] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1316lb # [ 0.533398] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1317lb # [ 0.535210] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1318worker2 # [ 0.490750] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1319client # [ 0.539470] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1320client # [ 0.541201] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1321worker2 # [ 0.493884] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1322worker2 # [ 0.495868] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1323worker1 # [ 0.491132] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1324worker1 # [ 0.494559] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1325lb # [ 0.545636] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1326worker2 # [ 0.502543] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1327client # [ 0.552787] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1328worker1 # [ 0.504173] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1329worker1 # [ 0.508540] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1330worker1 # [ 0.510442] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1331client # [ 0.563144] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1332lb # [ 0.561363] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1333lb # [ 0.563918] msm_serial: driver initialized1334lb # [ 0.564051] SuperH (H)SCI(F) driver initialized1335lb # [ 0.564105] STM32 USART driver initialized1336client # [ 0.565838] msm_serial: driver initialized1337worker2 # [ 0.518097] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1338client # [ 0.566004] SuperH (H)SCI(F) driver initialized1339client # [ 0.566058] STM32 USART driver initialized1340worker2 # [ 0.520118] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1341worker2 # [ 0.523749] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1342worker1 # [ 0.521827] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1343worker2 # [ 0.526684] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1344worker1 # [ 0.528116] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1345worker1 # [ 0.530315] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1346worker2 # [ 0.536696] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1347worker2 # [ 0.538830] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1348worker1 # [ 0.540502] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1349worker1 # [ 0.542767] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1350lb # [ 0.595046] loop: module loaded1351lb # [ 0.595243] virtio_blk virtio5: 1/0/0 default/read/poll queues1352lb # [ 0.595990] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1353client # [ 0.600077] loop: module loaded1354worker2 # [ 0.549134] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1355client # [ 0.600265] virtio_blk virtio5: 1/0/0 default/read/poll queues1356client # [ 0.601048] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1357lb # [ 0.600684] megasas: 07.734.00.00-rc11358lb # [ 0.601484] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1359lb # [ 0.603801] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001360lb # [ 0.603858] Intel/Sharp Extended Query Table at 0x00311361client # [ 0.606373] megasas: 07.734.00.00-rc11362worker2 # [ 0.560884] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1363client # [ 0.607110] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1364worker1 # [ 0.560083] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1365client # [ 0.608888] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001366client # [ 0.608910] Intel/Sharp Extended Query Table at 0x00311367worker2 # [ 0.563552] msm_serial: driver initialized1368worker1 # [ 0.562589] msm_serial: driver initialized1369worker2 # [ 0.563690] SuperH (H)SCI(F) driver initialized1370worker1 # [ 0.562724] SuperH (H)SCI(F) driver initialized1371worker2 # [ 0.563744] STM32 USART driver initialized1372worker1 # [ 0.562778] STM32 USART driver initialized1373lb # [ 0.613134] Using buffer write method1374lb # [ 0.613213] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1375client # [ 0.618589] Using buffer write method1376client # [ 0.618655] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1377client # [ 0.620207] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001378client # [ 0.620237] Intel/Sharp Extended Query Table at 0x00311379lb # [ 0.624153] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001380lb # [ 0.624181] Intel/Sharp Extended Query Table at 0x00311381lb # [ 0.625695] Using buffer write method1382lb # [ 0.625725] Concatenating MTD devices:1383lb # [ 0.625729] (0): "0.flash"1384lb # [ 0.625733] (1): "0.flash"1385lb # [ 0.625736] into device "0.flash"1386client # [ 0.633828] Using buffer write method1387client # [ 0.633856] Concatenating MTD devices:1388client # [ 0.633860] (0): "0.flash"1389client # [ 0.633865] (1): "0.flash"1390client # [ 0.633868] into device "0.flash"1391worker2 # [ 0.594931] loop: module loaded1392worker2 # [ 0.595118] virtio_blk virtio5: 1/0/0 default/read/poll queues1393worker1 # [ 0.593714] loop: module loaded1394worker1 # [ 0.593882] virtio_blk virtio5: 1/0/0 default/read/poll queues1395worker2 # [ 0.595842] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1396worker1 # [ 0.594571] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1397worker2 # [ 0.601121] megasas: 07.734.00.00-rc11398worker2 # [ 0.601825] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1399worker2 # [ 0.603756] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001400worker2 # [ 0.603781] Intel/Sharp Extended Query Table at 0x00311401worker2 # [ 0.613639] Using buffer write method1402worker1 # [ 0.607584] megasas: 07.734.00.00-rc11403worker2 # [ 0.613707] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1404worker1 # [ 0.608341] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1405worker2 # [ 0.615307] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001406worker2 # [ 0.615336] Intel/Sharp Extended Query Table at 0x00311407worker1 # [ 0.610542] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001408worker1 # [ 0.610595] Intel/Sharp Extended Query Table at 0x00311409worker1 # [ 0.612147] Using buffer write method1410worker1 # [ 0.612226] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1411worker1 # [ 0.613939] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001412worker1 # [ 0.613967] Intel/Sharp Extended Query Table at 0x00311413worker2 # [ 0.629061] Using buffer write method1414worker2 # [ 0.629095] Concatenating MTD devices:1415worker2 # [ 0.629099] (0): "0.flash"1416worker2 # [ 0.629104] (1): "0.flash"1417worker2 # [ 0.629107] into device "0.flash"1418worker1 # [ 0.631498] Using buffer write method1419worker1 # [ 0.631542] Concatenating MTD devices:1420worker1 # [ 0.631546] (0): "0.flash"1421worker1 # [ 0.631550] (1): "0.flash"1422worker1 # [ 0.631553] into device "0.flash"1423client # [ 0.856044] Freeing initrd memory: 26160K1424lb # [ 0.858227] Freeing initrd memory: 26140K1425client # [ 0.862180] tun: Universal TUN/TAP device driver, 1.61426lb # [ 0.864261] tun: Universal TUN/TAP device driver, 1.61427lb # [ 0.867910] thunder_xcv, ver 1.01428lb # [ 0.867954] thunder_bgx, ver 1.01429client # [ 0.865931] thunder_xcv, ver 1.01430lb # [ 0.867976] nicpf, ver 1.01431client # [ 0.865969] thunder_bgx, ver 1.01432client # [ 0.865991] nicpf, ver 1.01433client # [ 0.866528] e1000: Intel(R) PRO/1000 Network Driver1434client # [ 0.866536] e1000: Copyright (c) 1999-2006 Intel Corporation.1435client # [ 0.866559] e1000e: Intel(R) PRO/1000 Network Driver1436client # [ 0.866567] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1437client # [ 0.866595] igb: Intel(R) Gigabit Ethernet Network Driver1438client # [ 0.866601] igb: Copyright (c) 2007-2014 Intel Corporation.1439lb # [ 0.869743] e1000: Intel(R) PRO/1000 Network Driver1440client # [ 0.866622] igbvf: Intel(R) Gigabit Virtual Function Network Driver1441lb # [ 0.869756] e1000: Copyright (c) 1999-2006 Intel Corporation.1442client # [ 0.866628] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1443lb # [ 0.869781] e1000e: Intel(R) PRO/1000 Network Driver1444client # [ 0.866761] sky2: driver version 1.301445lb # [ 0.869790] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1446client # [ 0.868309] usbcore: registered new interface driver usb-storage1447lb # [ 0.869820] igb: Intel(R) Gigabit Ethernet Network Driver1448client # [ 0.868383] usbcore: registered new interface driver usbserial_generic1449lb # [ 0.869825] igb: Copyright (c) 2007-2014 Intel Corporation.1450client # [ 0.868399] usbserial: USB Serial support registered for generic1451lb # [ 0.869848] igbvf: Intel(R) Gigabit Virtual Function Network Driver1452client # [ 0.868982] hv_vmbus: registering driver hyperv_keyboard1453lb # [ 0.869853] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1454lb # [ 0.869989] sky2: driver version 1.301455client # [ 0.870255] ehci-pci 0000:00:0a.0: EHCI Host Controller1456lb # [ 0.871591] usbcore: registered new interface driver usb-storage1457client # [ 0.870279] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11458lb # [ 0.871670] usbcore: registered new interface driver usbserial_generic1459client # [ 0.870477] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001460lb # [ 0.871683] usbserial: USB Serial support registered for generic1461client # [ 0.882155] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001462lb # [ 0.872951] ehci-pci 0000:00:0a.0: EHCI Host Controller1463client # [ 0.882473] hub 1-0:1.0: USB hub found1464lb # [ 0.872975] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11465client # [ 0.882499] hub 1-0:1.0: 6 ports detected1466lb # [ 0.873175] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001467client # [ 0.885349] rtc-pl031 9010000.pl031: registered as rtc01468lb # [ 0.883880] hv_vmbus: registering driver hyperv_keyboard1469client # [ 0.885378] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T10:51:23 UTC (1789901483)1470lb # [ 0.884806] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001471client # [ 0.885736] i2c_dev: i2c /dev entries driver1472lb # [ 0.885849] hub 1-0:1.0: USB hub found1473lb # [ 0.886394] hub 1-0:1.0: 6 ports detected1474lb # [ 0.887888] rtc-pl031 9010000.pl031: registered as rtc01475lb # [ 0.887917] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T10:51:23 UTC (1789901483)1476lb # [ 0.889932] i2c_dev: i2c /dev entries driver1477client # [ 0.890595] sdhci: Secure Digital Host Controller Interface driver1478client # [ 0.890605] sdhci: Copyright(c) Pierre Ossman1479client # [ 0.890878] Synopsys Designware Multimedia Card Interface Driver1480client # [ 0.891243] sdhci-pltfm: SDHCI platform and OF driver helper1481client # [ 0.892915] hid: raw HID events driver (C) Jiri Kosina1482client # [ 0.893174] usbcore: registered new interface driver usbhid1483client # [ 0.893181] usbhid: USB HID core driver1484lb # [ 0.893181] sdhci: Secure Digital Host Controller Interface driver1485lb # [ 0.893189] sdhci: Copyright(c) Pierre Ossman1486lb # [ 0.893463] Synopsys Designware Multimedia Card Interface Driver1487lb # [ 0.893847] sdhci-pltfm: SDHCI platform and OF driver helper1488lb # [ 0.895533] hid: raw HID events driver (C) Jiri Kosina1489client # [ 0.898688] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1490lb # [ 0.895767] usbcore: registered new interface driver usbhid1491client # [ 0.900183] drop_monitor: Initializing network drop monitor service1492lb # [ 0.895774] usbhid: USB HID core driver1493client # [ 0.900358] NET: Registered PF_INET6 protocol family1494worker2 # [ 0.853680] Freeing initrd memory: 26148K1495client # [ 0.903405] Segment Routing with IPv61496client # [ 0.903434] In-situ OAM (IOAM) with IPv61497client # [ 0.903464] NET: Registered PF_PACKET protocol family1498lb # [ 0.901367] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1499client # [ 0.905108] 9pnet: Installing 9P2000 support1500lb # [ 0.902910] drop_monitor: Initializing network drop monitor service1501lb # [ 0.903045] NET: Registered PF_INET6 protocol family1502lb # [ 0.906073] Segment Routing with IPv61503lb # [ 0.906102] In-situ OAM (IOAM) with IPv61504worker2 # [ 0.859679] tun: Universal TUN/TAP device driver, 1.61505lb # [ 0.906135] NET: Registered PF_PACKET protocol family1506client # [ 0.907960] Key type dns_resolver registered1507worker1 # [ 0.858896] Freeing initrd memory: 26148K1508lb # [ 0.907784] 9pnet: Installing 9P2000 support1509worker2 # [ 0.863430] thunder_xcv, ver 1.01510worker2 # [ 0.863477] thunder_bgx, ver 1.01511worker2 # [ 0.863501] nicpf, ver 1.01512lb # [ 0.910626] Key type dns_resolver registered1513worker2 # [ 0.864044] e1000: Intel(R) PRO/1000 Network Driver1514worker2 # [ 0.864052] e1000: Copyright (c) 1999-2006 Intel Corporation.1515worker2 # [ 0.864080] e1000e: Intel(R) PRO/1000 Network Driver1516worker1 # [ 0.864998] tun: Universal TUN/TAP device driver, 1.61517worker2 # [ 0.864088] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1518worker2 # [ 0.864117] igb: Intel(R) Gigabit Ethernet Network Driver1519worker2 # [ 0.864123] igb: Copyright (c) 2007-2014 Intel Corporation.1520client # [ 0.914248] registered taskstats version 11521client # [ 0.914393] Loading compiled-in X.509 certificates1522worker2 # [ 0.864146] igbvf: Intel(R) Gigabit Virtual Function Network Driver1523worker2 # [ 0.864151] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1524worker2 # [ 0.864286] sky2: driver version 1.301525worker1 # [ 0.868835] thunder_xcv, ver 1.01526worker1 # [ 0.868886] thunder_bgx, ver 1.01527worker1 # [ 0.868909] nicpf, ver 1.01528lb # [ 0.917177] registered taskstats version 11529worker1 # [ 0.869474] e1000: Intel(R) PRO/1000 Network Driver1530lb # [ 0.917353] Loading compiled-in X.509 certificates1531client # [ 0.922912] Demotion targets for Node 0: null1532worker2 # [ 0.873191] usbcore: registered new interface driver usb-storage1533worker1 # [ 0.869481] e1000: Copyright (c) 1999-2006 Intel Corporation.1534client # [ 0.923019] Key type .fscrypt registered1535worker1 # [ 0.869506] e1000e: Intel(R) PRO/1000 Network Driver1536worker2 # [ 0.873247] usbcore: registered new interface driver usbserial_generic1537client # [ 0.923026] Key type fscrypt-provisioning registered1538worker1 # [ 0.869513] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1539worker2 # [ 0.873262] usbserial: USB Serial support registered for generic1540client # [ 0.923123] ima: No TPM chip found, activating TPM-bypass!1541client # [ 0.923147] ima: Allocated hash algorithm: sha11542worker1 # [ 0.869542] igb: Intel(R) Gigabit Ethernet Network Driver1543worker2 # [ 0.873858] hv_vmbus: registering driver hyperv_keyboard1544client # [ 0.923168] ima: No architecture policies found1545worker1 # [ 0.869548] igb: Copyright (c) 2007-2014 Intel Corporation.1546worker1 # [ 0.869571] igbvf: Intel(R) Gigabit Virtual Function Network Driver1547worker2 # [ 0.878000] ehci-pci 0000:00:0a.0: EHCI Host Controller1548client # [ 0.927110] input: gpio-keys as /devices/platform/gpio-keys/input/input01549worker1 # [ 0.869577] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1550worker2 # [ 0.878030] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11551worker1 # [ 0.869712] sky2: driver version 1.301552lb # [ 0.925695] Demotion targets for Node 0: null1553lb # [ 0.925810] Key type .fscrypt registered1554worker2 # [ 0.878201] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001555lb # [ 0.925816] Key type fscrypt-provisioning registered1556lb # [ 0.925915] ima: No TPM chip found, activating TPM-bypass!1557worker1 # [ 0.878318] usbcore: registered new interface driver usb-storage1558lb # [ 0.925935] ima: Allocated hash algorithm: sha11559worker2 # [ 0.880762] rtc-pl031 9010000.pl031: registered as rtc01560worker1 # [ 0.878413] usbcore: registered new interface driver usbserial_generic1561lb # [ 0.925958] ima: No architecture policies found1562worker1 # [ 0.878428] usbserial: USB Serial support registered for generic1563worker2 # [ 0.880790] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T10:51:23 UTC (1789901483)1564lb # [ 0.929986] input: gpio-keys as /devices/platform/gpio-keys/input/input01565worker2 # [ 0.881139] i2c_dev: i2c /dev entries driver1566worker1 # [ 0.881771] ehci-pci 0000:00:0a.0: EHCI Host Controller1567worker1 # [ 0.881803] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11568worker1 # [ 0.882001] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001569worker1 # [ 0.884530] hv_vmbus: registering driver hyperv_keyboard1570worker1 # [ 0.886019] rtc-pl031 9010000.pl031: registered as rtc01571worker2 # [ 0.886075] sdhci: Secure Digital Host Controller Interface driver1572worker2 # [ 0.886085] sdhci: Copyright(c) Pierre Ossman1573worker1 # [ 0.886046] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T10:51:23 UTC (1789901483)1574worker2 # [ 0.886349] Synopsys Designware Multimedia Card Interface Driver1575worker1 # [ 0.886349] i2c_dev: i2c /dev entries driver1576worker2 # [ 0.886745] sdhci-pltfm: SDHCI platform and OF driver helper1577worker2 # [ 0.888400] hid: raw HID events driver (C) Jiri Kosina1578worker2 # [ 0.888518] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001579worker2 # [ 0.888863] hub 1-0:1.0: USB hub found1580worker2 # [ 0.892998] hub 1-0:1.0: 6 ports detected1581worker2 # [ 0.894493] usbcore: registered new interface driver usbhid1582worker2 # [ 0.894505] usbhid: USB HID core driver1583client # [ 0.944773] clk: Disabling unused clocks1584worker1 # [ 0.891354] sdhci: Secure Digital Host Controller Interface driver1585client # [ 0.944799] PM: genpd: Disabling unused power domains1586worker1 # [ 0.891365] sdhci: Copyright(c) Pierre Ossman1587worker1 # [ 0.891627] Synopsys Designware Multimedia Card Interface Driver1588worker1 # [ 0.892012] sdhci-pltfm: SDHCI platform and OF driver helper1589worker2 # [ 0.896840] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1590worker1 # [ 0.893711] hid: raw HID events driver (C) Jiri Kosina1591worker2 # [ 0.898379] drop_monitor: Initializing network drop monitor service1592worker1 # [ 0.893965] usbcore: registered new interface driver usbhid1593worker2 # [ 0.898526] NET: Registered PF_INET6 protocol family1594client # [ 0.949018] Freeing unused kernel memory: 4736K1595worker1 # [ 0.893971] usbhid: USB HID core driver1596client # [ 0.949225] Run /init as init process1597worker2 # [ 0.901537] Segment Routing with IPv61598worker2 # [ 0.901556] In-situ OAM (IOAM) with IPv61599worker1 # [ 0.899380] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001600worker2 # [ 0.901585] NET: Registered PF_PACKET protocol family1601worker1 # [ 0.899714] hub 1-0:1.0: USB hub found1602worker1 # [ 0.899734] hub 1-0:1.0: 6 ports detected1603lb # [ 0.948454] clk: Disabling unused clocks1604lb # [ 0.948476] PM: genpd: Disabling unused power domains1605worker2 # [ 0.903270] 9pnet: Installing 9P2000 support1606worker1 # [ 0.901909] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1607lb # [ 0.952746] Freeing unused kernel memory: 4736K1608lb # [ 0.952956] Run /init as init process1609worker1 # [ 0.904573] drop_monitor: Initializing network drop monitor service1610worker1 # [ 0.904757] NET: Registered PF_INET6 protocol family1611worker2 # [ 0.905957] Key type dns_resolver registered1612worker1 # [ 0.906629] Segment Routing with IPv61613worker1 # [ 0.906647] In-situ OAM (IOAM) with IPv61614worker1 # [ 0.906676] NET: Registered PF_PACKET protocol family1615worker2 # [ 0.912284] registered taskstats version 11616worker1 # [ 0.908326] 9pnet: Installing 9P2000 support1617worker2 # [ 0.912430] Loading compiled-in X.509 certificates1618worker1 # [ 0.910420] Key type dns_resolver registered1619client # [ 0.964063] systemd[1]: Successfully made /usr/ read-only.1620worker1 # [ 0.917195] registered taskstats version 11621worker1 # [ 0.917342] Loading compiled-in X.509 certificates1622worker2 # [ 0.921176] Demotion targets for Node 0: null1623worker2 # [ 0.921284] Key type .fscrypt registered1624worker2 # [ 0.921290] Key type fscrypt-provisioning registered1625worker2 # [ 0.921384] ima: No TPM chip found, activating TPM-bypass!1626lb # [ 0.970407] systemd[1]: Successfully made /usr/ read-only.1627worker2 # [ 0.921403] ima: Allocated hash algorithm: sha11628worker2 # [ 0.921423] ima: No architecture policies found1629worker2 # [ 0.925728] input: gpio-keys as /devices/platform/gpio-keys/input/input01630worker1 # [ 0.926000] Demotion targets for Node 0: null1631worker1 # [ 0.926109] Key type .fscrypt registered1632worker1 # [ 0.926116] Key type fscrypt-provisioning registered1633worker1 # [ 0.926206] ima: No TPM chip found, activating TPM-bypass!1634worker1 # [ 0.926225] ima: Allocated hash algorithm: sha11635worker1 # [ 0.926245] ima: No architecture policies found1636worker1 # [ 0.930243] input: gpio-keys as /devices/platform/gpio-keys/input/input01637worker2 # [ 0.943961] clk: Disabling unused clocks1638worker2 # [ 0.943990] PM: genpd: Disabling unused power domains1639worker2 # [ 0.948219] Freeing unused kernel memory: 4736K1640worker2 # [ 0.948420] Run /init as init process1641worker1 # [ 0.948214] clk: Disabling unused clocks1642worker1 # [ 0.948242] PM: genpd: Disabling unused power domains1643worker1 # [ 0.952483] Freeing unused kernel memory: 4736K1644worker1 # [ 0.952682] Run /init as init process1645worker2 # [ 0.962736] systemd[1]: Successfully made /usr/ read-only.1646worker1 # [ 0.969166] systemd[1]: Successfully made /usr/ read-only.1647client # [ 1.129841] usb 1-1: new high-speed USB device number 2 using ehci-pci1648lb # [ 1.132190] usb 1-1: new high-speed USB device number 2 using ehci-pci1649worker2 # [ 1.144564] usb 1-1: new high-speed USB device number 2 using ehci-pci1650worker1 # [ 1.146957] usb 1-1: new high-speed USB device number 2 using ehci-pci1651client # [ 1.282179] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11652lb # [ 1.284434] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11653client # [ 1.298539] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1654client # [ 1.310628] systemd[1]: Detected virtualization qemu.1655client # [ 1.312691] systemd[1]: Detected architecture arm64.1656client # [ 1.314657] systemd[1]: Running in initrd.1657lb # [ 1.305256] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1658client # [ 1.317298] systemd[1]: Initializing machine ID from random generator.1659lb # [ 1.317151] systemd[1]: Detected virtualization qemu.1660client # [ 1.320260] systemd[1]: Hostname set to <client>.1661lb # [ 1.319126] systemd[1]: Detected architecture arm64.1662lb # [ 1.321077] systemd[1]: Running in initrd.1663lb # [ 1.323627] systemd[1]: Initializing machine ID from random generator.1664lb # [ 1.326617] systemd[1]: Hostname set to <lb>.1665worker2 # [ 1.296780] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11666worker1 # [ 1.299247] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11667worker2 # [ 1.303215] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1668worker2 # [ 1.315750] systemd[1]: Detected virtualization qemu.1669worker1 # [ 1.305355] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1670worker2 # [ 1.315846] systemd[1]: Detected architecture arm64.1671worker2 # [ 1.315871] systemd[1]: Running in initrd.1672worker1 # [ 1.317588] systemd[1]: Detected virtualization qemu.1673client # [ 1.370055] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01674worker1 # [ 1.317685] systemd[1]: Detected architecture arm64.1675worker2 # [ 1.322365] systemd[1]: Initializing machine ID from random generator.1676worker1 # [ 1.317709] systemd[1]: Running in initrd.1677worker2 # [ 1.325225] systemd[1]: Hostname set to <worker2>.1678worker1 # [ 1.318669] systemd[1]: Initializing machine ID from random generator.1679lb # [ 1.372448] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01680worker1 # [ 1.326994] systemd[1]: Hostname set to <worker1>.1681worker2 # [ 1.380777] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01682worker1 # [ 1.387134] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01683client # [ 1.489854] usb 1-2: new high-speed USB device number 3 using ehci-pci1684lb # [ 1.496198] usb 1-2: new high-speed USB device number 3 using ehci-pci1685worker2 # [ 1.500590] usb 1-2: new high-speed USB device number 3 using ehci-pci1686worker1 # [ 1.506923] usb 1-2: new high-speed USB device number 3 using ehci-pci1687client # [ 1.622272] systemd[1]: bpf-restrict-fs: LSM BPF program attached1688lb # [ 1.637537] systemd[1]: bpf-restrict-fs: LSM BPF program attached1689client # [ 1.650474] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21690lb # [ 1.652433] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21691client # [ 1.655597] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01692lb # [ 1.659132] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01693worker2 # [ 1.629166] systemd[1]: bpf-restrict-fs: LSM BPF program attached1694worker1 # [ 1.645905] systemd[1]: bpf-restrict-fs: LSM BPF program attached1695worker2 # [ 1.660128] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21696worker2 # [ 1.665383] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01697worker1 # [ 1.665456] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21698worker1 # [ 1.665806] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01699client # [ 1.731156] systemd[1]: Queued start job for default target Initrd Default Target.1700client # [ 1.740093] systemd[1]: Created slice Slice /system/modprobe.1701client # [ 1.741260] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1702client # [ 1.742644] systemd[1]: Expecting device /dev/disk/by-label/nixos...1703client # [ 1.743762] systemd[1]: Reached target Path Units.1704client # [ 1.744550] systemd[1]: Reached target Slice Units.1705client # [ 1.745356] systemd[1]: Reached target Swaps.1706client # [ 1.746127] systemd[1]: Reached target Timer Units.1707client # [ 1.747127] systemd[1]: Listening on D-Bus System Message Bus Socket.1708client # [ 1.748331] systemd[1]: Listening on Journal Socket (/dev/log).1709client # [ 1.749424] systemd[1]: Listening on Journal Sockets.1710client # [ 1.750435] systemd[1]: Listening on udev Control Socket.1711client # [ 1.751428] systemd[1]: Listening on udev Kernel Socket.1712lb # [ 1.749480] systemd[1]: Queued start job for default target Initrd Default Target.1713client # [ 1.752305] systemd[1]: Reached target Socket Units.1714client # [ 1.754743] systemd[1]: Starting Create List of Static Device Nodes...1715lb # [ 1.758444] systemd[1]: Created slice Slice /system/modprobe.1716lb # [ 1.759606] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1717lb # [ 1.760967] systemd[1]: Expecting device /dev/disk/by-label/nixos...1718lb # [ 1.761986] systemd[1]: Reached target Path Units.1719lb # [ 1.762764] systemd[1]: Reached target Slice Units.1720client # [ 1.765041] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1721lb # [ 1.763562] systemd[1]: Reached target Swaps.1722lb # [ 1.764325] systemd[1]: Reached target Timer Units.1723lb # [ 1.765315] systemd[1]: Listening on D-Bus System Message Bus Socket.1724client # [ 1.766379] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1725lb # [ 1.766503] systemd[1]: Listening on Journal Socket (/dev/log).1726lb # [ 1.767582] systemd[1]: Listening on Journal Sockets.1727lb # [ 1.768585] systemd[1]: Listening on udev Control Socket.1728lb # [ 1.769607] systemd[1]: Listening on udev Kernel Socket.1729lb # [ 1.770483] systemd[1]: Reached target Socket Units.1730lb # [ 1.773023] systemd[1]: Starting Create List of Static Device Nodes...1731client # [ 1.779436] systemd[1]: Mounting Kernel Configuration File System...1732lb # [ 1.783217] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1733lb # [ 1.784500] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1734worker2 # [ 1.745547] systemd[1]: Queued start job for default target Initrd Default Target.1735client # [ 1.801999] systemd[1]: Starting Journal Service...1736lb # [ 1.797681] systemd[1]: Mounting Kernel Configuration File System...1737worker2 # [ 1.754808] systemd[1]: Created slice Slice /system/modprobe.1738worker2 # [ 1.756002] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1739client # [ 1.806006] systemd[1]: Starting Load Kernel Modules...1740worker2 # [ 1.757408] systemd[1]: Expecting device /dev/disk/by-label/nixos...1741worker2 # [ 1.758493] systemd[1]: Reached target Path Units.1742client # [ 1.806964] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1743worker2 # [ 1.759319] systemd[1]: Reached target Slice Units.1744worker2 # [ 1.760141] systemd[1]: Reached target Swaps.1745worker2 # [ 1.760939] systemd[1]: Reached target Timer Units.1746worker2 # [ 1.761937] systemd[1]: Listening on D-Bus System Message Bus Socket.1747client # [ 1.811071] systemd[1]: Starting Coldplug All udev Devices...1748worker2 # [ 1.763173] systemd[1]: Listening on Journal Socket (/dev/log).1749worker2 # [ 1.764291] systemd[1]: Listening on Journal Sockets.1750worker1 # [ 1.762372] systemd[1]: Queued start job for default target Initrd Default Target.1751worker2 # [ 1.765367] systemd[1]: Listening on udev Control Socket.1752worker2 # [ 1.765494] systemd[1]: Listening on udev Kernel Socket.1753worker2 # [ 1.765517] systemd[1]: Reached target Socket Units.1754worker2 # [ 1.769693] systemd[1]: Starting Create List of Static Device Nodes...1755client # [ 1.822105] systemd[1]: Finished Create List of Static Device Nodes.1756lb # [ 1.820393] systemd[1]: Starting Journal Service...1757client # [ 1.823946] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1758worker1 # [ 1.773353] systemd[1]: Created slice Slice /system/modprobe.1759worker1 # [ 1.774539] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1760lb # [ 1.824284] systemd[1]: Starting Load Kernel Modules...1761worker1 # [ 1.775882] systemd[1]: Expecting device /dev/disk/by-label/nixos...1762lb # [ 1.825244] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1763worker1 # [ 1.776940] systemd[1]: Reached target Path Units.1764worker1 # [ 1.777731] systemd[1]: Reached target Slice Units.1765worker2 # [ 1.780126] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1766worker1 # [ 1.778533] systemd[1]: Reached target Swaps.1767worker1 # [ 1.779323] systemd[1]: Reached target Timer Units.1768worker1 # [ 1.780317] systemd[1]: Listening on D-Bus System Message Bus Socket.1769lb # [ 1.829437] systemd[1]: Starting Coldplug All udev Devices...1770worker2 # [ 1.781525] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1771worker1 # [ 1.781495] systemd[1]: Listening on Journal Socket (/dev/log).1772worker1 # [ 1.782588] systemd[1]: Listening on Journal Sockets.1773worker1 # [ 1.783598] systemd[1]: Listening on udev Control Socket.1774worker1 # [ 1.783720] systemd[1]: Listening on udev Kernel Socket.1775worker1 # [ 1.783743] systemd[1]: Reached target Socket Units.1776worker1 # [ 1.787995] systemd[1]: Starting Create List of Static Device Nodes...1777client # [ 1.838279] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1778lb # [ 1.840373] systemd[1]: Finished Create List of Static Device Nodes.1779lb # [ 1.842358] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1780worker2 # [ 1.794017] systemd[1]: Mounting Kernel Configuration File System...1781worker1 # [ 1.798447] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1782worker1 # [ 1.799751] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1783client # [ 1.855599] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1784lb # [ 1.852634] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1785worker1 # [ 1.808551] systemd[1]: Mounting Kernel Configuration File System...1786worker2 # [ 1.816660] systemd[1]: Starting Journal Service...1787client # [ 1.866397] systemd[1]: Mounted Kernel Configuration File System.1788worker2 # [ 1.820707] systemd[1]: Starting Load Kernel Modules...1789worker2 # [ 1.821641] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1790client # [ 1.873181] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1791worker2 # [ 1.825754] systemd[1]: Starting Coldplug All udev Devices...1792client # [ 1.878013] systemd-journald[73]: Collecting audit messages is disabled.1793worker1 # [ 1.831098] systemd[1]: Starting Journal Service...1794worker1 # [ 1.833488] systemd[1]: Starting Load Kernel Modules...1795worker2 # [ 1.836722] systemd[1]: Finished Create List of Static Device Nodes.1796worker1 # [ 1.834317] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1797client # [ 1.885919] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1798lb # [ 1.880740] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1799worker2 # [ 1.838537] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1800lb # [ 1.885709] systemd[1]: Mounted Kernel Configuration File System.1801client # [ 1.890420] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1802lb # [ 1.891691] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1803client # [ 1.898152] systemd[1]: Starting Create Static Device Nodes in /dev...1804worker2 # [ 1.848990] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1805worker1 # [ 1.848626] systemd[1]: Starting Coldplug All udev Devices...1806lb # [ 1.902842] systemd-journald[73]: Collecting audit messages is disabled.1807client # [ 1.907560] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01808lb # [ 1.906656] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1809client # [ 1.907804] [drm] features: -virgl +edid -resource_blob -host_visible1810client # [ 1.907814] [drm] features: -context_init1811client # [ 1.908547] [drm] number of scanouts: 11812client # [ 1.908565] [drm] number of cap sets: 01813lb # [ 1.908729] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1814client # [ 1.912980] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1815client # [ 1.913002] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01816lb # [ 1.916054] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01817lb # [ 1.917358] systemd[1]: Starting Create Static Device Nodes in /dev...1818worker1 # [ 1.867060] systemd[1]: Finished Create List of Static Device Nodes.1819worker1 # [ 1.868097] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1820worker1 # [ 1.868395] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1821worker1 # [ 1.868636] systemd[1]: Mounted Kernel Configuration File System.1822worker2 # [ 1.876736] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1823lb # [ 1.930045] [drm] features: -virgl +edid -resource_blob -host_visible1824worker2 # [ 1.883427] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1825lb # [ 1.930068] [drm] features: -context_init1826lb # [ 1.930827] [drm] number of scanouts: 11827lb # [ 1.930847] [drm] number of cap sets: 01828worker1 # [ 1.879393] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1829worker2 # [ 1.891098] systemd-journald[73]: Collecting audit messages is disabled.1830lb # [ 1.936534] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1831lb # [ 1.936551] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01832worker2 # [ 1.896946] systemd[1]: Mounted Kernel Configuration File System.1833client # [ 1.942153] Console: switching to colour frame buffer device 160x501834client # [ 1.948549] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1835worker2 # [ 1.904362] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1836worker1 # [ 1.905287] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1837worker2 # [ 1.912412] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01838worker1 # [ 1.914353] systemd-journald[73]: Collecting audit messages is disabled.1839worker2 # [ 1.917189] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1840worker2 # [ 1.919688] systemd[1]: Starting Create Static Device Nodes in /dev...1841lb # [ 1.968761] systemd[1]: Finished Create Static Device Nodes in /dev.1842lb # [ 1.969790] systemd[1]: Reached target Preparation for Local File Systems.1843lb # [ 1.970667] systemd[1]: Reached target Local File Systems.1844client # [ 1.970436] systemd[1]: Finished Create Static Device Nodes in /dev.1845client # [ 1.970638] systemd[1]: Reached target Preparation for Local File Systems.1846client # [ 1.970673] systemd[1]: Reached target Local File Systems.1847worker1 # [ 1.923639] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1848client # [ 1.976464] systemd[1]: Starting Rule-based Manager for Device Events and Files...1849lb # [ 1.972421] Console: switching to colour frame buffer device 160x501850worker2 # [ 1.932712] [drm] features: -virgl +edid -resource_blob -host_visible1851worker2 # [ 1.932733] [drm] features: -context_init1852worker2 # [ 1.933491] [drm] number of scanouts: 11853worker2 # [ 1.933509] [drm] number of cap sets: 01854worker2 # [ 1.936267] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1855worker2 # [ 1.936286] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01856worker1 # [ 1.930948] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1857worker1 # [ 1.935608] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01858worker1 # [ 1.935840] [drm] features: -virgl +edid -resource_blob -host_visible1859worker1 # [ 1.935849] [drm] features: -context_init1860worker1 # [ 1.936580] [drm] number of scanouts: 11861worker1 # [ 1.936597] [drm] number of cap sets: 01862worker1 # [ 1.941186] systemd[1]: Starting Create Static Device Nodes in /dev...1863lb # [ 1.988226] systemd[1]: Starting Rule-based Manager for Device Events and Files...1864client # [ 1.993884] systemd[1]: Finished Load Kernel Modules.1865client # [ 1.997300] systemd[1]: Starting Apply Kernel Variables...1866lb # [ 2.001811] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1867worker1 # [ 1.955305] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1868worker1 # [ 1.955330] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01869lb # [ 2.012879] systemd[1]: Finished Load Kernel Modules.1870lb # [ 2.020538] systemd[1]: Starting Apply Kernel Variables...1871worker2 # [ 1.985133] systemd[1]: Finished Create Static Device Nodes in /dev.1872worker2 # [ 1.985333] systemd[1]: Reached target Preparation for Local File Systems.1873worker2 # [ 1.985357] systemd[1]: Reached target Local File Systems.1874worker2 # [ 1.989287] systemd[1]: Starting Rule-based Manager for Device Events and Files...1875worker2 # [ 1.992628] Console: switching to colour frame buffer device 160x501876client # [ 2.041921] systemd[1]: Finished Apply Kernel Variables.1877worker2 # [ 1.993331] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1878worker1 # [ 1.987543] Console: switching to colour frame buffer device 160x501879worker1 # [ 1.993984] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1880worker1 # [ 1.999625] systemd[1]: Finished Create Static Device Nodes in /dev.1881worker1 # [ 1.999850] systemd[1]: Reached target Preparation for Local File Systems.1882worker1 # [ 1.999884] systemd[1]: Reached target Local File Systems.1883worker1 # [ 2.003957] systemd[1]: Starting Rule-based Manager for Device Events and Files...1884client # [ 2.058776] systemd[1]: Started Journal Service.1885client # [ 2.052309] systemd-modules-load[74]: Inserted module 'dm_mod'1886client # [ 2.057126] systemd-modules-load[74]: Module 'virtio_balloon' is built in1887worker2 # [ 2.020799] systemd[1]: Finished Load Kernel Modules.1888client # [ 2.058241] systemd-modules-load[74]: Module 'virtio_console' is built in1889client # [ 2.059349] systemd-modules-load[74]: Inserted module 'virtio_gpu'1890worker2 # [ 2.024115] systemd[1]: Starting Apply Kernel Variables...1891lb # [ 2.080747] systemd[1]: Finished Apply Kernel Variables.1892client # [ 2.072157] systemd-modules-load[74]: Module 'virtio_rng' is built in1893client # [ 2.074299] systemd[1]: Starting Create System Files and Directories...1894worker1 # [ 2.035176] systemd[1]: Finished Load Kernel Modules.1895worker1 # [ 2.038566] systemd[1]: Starting Apply Kernel Variables...1896lb # [ 2.076785] systemd-modules-load[74]: Inserted module 'dm_mod'1897client # [ 2.084340] systemd-udevd[80]: Using default interface naming scheme 'v261'.1898lb # [ 2.080355] systemd-modules-load[74]: Module 'virtio_balloon' is built in1899lb # [ 2.093962] systemd[1]: Started Journal Service.1900lb # [ 2.084163] systemd-modules-load[74]: Module 'virtio_console' is built in1901lb # [ 2.091472] systemd-modules-load[74]: Inserted module 'virtio_gpu'1902lb # [ 2.092672] systemd-modules-load[74]: Module 'virtio_rng' is built in1903lb # [ 2.095165] systemd-udevd[80]: Using default interface naming scheme 'v261'.1904lb # [ 2.105806] systemd[1]: Starting Create System Files and Directories...1905worker2 # [ 2.060839] systemd-modules-load[74]: Inserted module 'dm_mod'1906worker2 # [ 2.078431] systemd[1]: Started Journal Service.1907client # [ 2.119248] systemd[1]: Finished Create System Files and Directories.1908worker2 # [ 2.071376] systemd-modules-load[74]: Module 'virtio_balloon' is built in1909worker2 # [ 2.076391] systemd-modules-load[74]: Module 'virtio_console' is built in1910client # [ 2.128217] systemd[1]: Started Rule-based Manager for Device Events and Files.1911worker2 # [ 2.077484] systemd-modules-load[74]: Inserted module 'virtio_gpu'1912worker1 # [ 2.091588] systemd[1]: Finished Apply Kernel Variables.1913worker2 # [ 2.078467] systemd-modules-load[74]: Module 'virtio_rng' is built in1914worker2 # [ 2.079612] systemd[1]: Starting Create System Files and Directories...1915lb # [ 2.128258] systemd[1]: Finished Create System Files and Directories.1916lb # [ 2.139160] systemd[1]: Started Rule-based Manager for Device Events and Files.1917worker1 # [ 2.108130] systemd[1]: Started Journal Service.1918worker2 # [ 2.096804] systemd-udevd[80]: Using default interface naming scheme 'v261'.1919worker2 # [ 2.097948] systemd[1]: Finished Apply Kernel Variables.1920worker1 # [ 2.100366] systemd-modules-load[74]: Inserted module 'dm_mod'1921worker1 # [ 2.101657] systemd-modules-load[74]: Module 'virtio_balloon' is built in1922worker1 # [ 2.102728] systemd-modules-load[74]: Module 'virtio_console' is built in1923worker1 # [ 2.103759] systemd-modules-load[74]: Inserted module 'virtio_gpu'1924worker1 # [ 2.110786] systemd-modules-load[74]: Module 'virtio_rng' is built in1925worker2 # [ 2.112778] systemd[1]: Finished Create System Files and Directories.1926worker1 # [ 2.117621] systemd-udevd[79]: Using default interface naming scheme 'v261'.1927worker1 # [ 2.120437] systemd[1]: Starting Create System Files and Directories...1928worker2 # [ 2.128338] systemd[1]: Started Rule-based Manager for Device Events and Files.1929client # [ 2.183563] systemd[1]: Starting Virtual Console Setup...1930worker1 # [ 2.144293] systemd[1]: Finished Create System Files and Directories.1931lb # [ 2.195821] systemd[1]: Starting Virtual Console Setup...1932worker1 # [ 2.158071] systemd[1]: Started Rule-based Manager for Device Events and Files.1933worker2 # [ 2.189948] systemd[1]: Starting Virtual Console Setup...1934client # [ 2.244518] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1935client # [ 2.247950] systemd[1]: Finished Virtual Console Setup.1936lb # [ 2.248508] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1937lb # [ 2.251869] systemd[1]: Finished Virtual Console Setup.1938worker1 # [ 2.220253] systemd[1]: Starting Virtual Console Setup...1939worker2 # [ 2.240483] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1940worker2 # [ 2.243955] systemd[1]: Finished Virtual Console Setup.1941worker1 # [ 2.273208] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1942worker1 # [ 2.275843] systemd[1]: Finished Virtual Console Setup.1943lb # [ 2.854852] systemd[1]: Finished Coldplug All udev Devices.1944lb # [ 2.856489] systemd[1]: Reached target System Initialization.1945lb # [ 2.857368] systemd[1]: Reached target Basic System.1946client # [ 2.879418] systemd[1]: Finished Coldplug All udev Devices.1947client # [ 2.880400] systemd[1]: Reached target System Initialization.1948client # [ 2.881230] systemd[1]: Reached target Basic System.1949worker2 # [ 2.838356] systemd[1]: Finished Coldplug All udev Devices.1950worker2 # [ 2.839307] systemd[1]: Reached target System Initialization.1951worker2 # [ 2.840200] systemd[1]: Reached target Basic System.1952worker1 # [ 2.891125] systemd[1]: Finished Coldplug All udev Devices.1953worker1 # [ 2.892120] systemd[1]: Reached target System Initialization.1954worker1 # [ 2.892929] systemd[1]: Reached target Basic System.1955client # [ 3.012427] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line.1956lb # [ 3.022715] (udev-worker)[98]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1957lb # [ 3.026000] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line.1958lb # [ 3.028980] (udev-worker)[102]: Network interface NamePolicy= disabled on kernel command line.1959client # [ 3.053287] (udev-worker)[93]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1960worker2 # [ 3.003019] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line.1961client # [ 3.058054] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line.1962worker2 # [ 3.024408] (udev-worker)[94]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1963worker2 # [ 3.028497] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line.1964worker1 # [ 3.028008] (udev-worker)[101]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1965client # [ 3.103804] systemd[1]: Found device /dev/disk/by-label/nixos.1966worker1 # [ 3.054565] (udev-worker)[106]: Network interface NamePolicy= disabled on kernel command line.1967client # [ 3.107260] systemd[1]: Reached target Initrd Root Device.1968client # [ 3.109447] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1969lb # [ 3.111243] systemd[1]: Found device /dev/disk/by-label/nixos.1970lb # [ 3.113563] systemd[1]: Reached target Initrd Root Device.1971lb # [ 3.118258] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1972worker1 # [ 3.072287] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line.1973worker2 # [ 3.103878] systemd[1]: Found device /dev/disk/by-label/nixos.1974worker2 # [ 3.106896] systemd[1]: Reached target Initrd Root Device.1975client # [ 3.164255] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1976worker2 # [ 3.116107] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1977lb # [ 3.163761] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1978client # [ 3.172766] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1979client # [ 3.176384] systemd[1]: Mounting /sysroot...1980lb # [ 3.171657] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1981lb # [ 3.176494] systemd[1]: Mounting /sysroot...1982worker1 # [ 3.134227] systemd[1]: Found device /dev/disk/by-label/nixos.1983worker1 # [ 3.140627] systemd[1]: Reached target Initrd Root Device.1984worker1 # [ 3.143638] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1985worker2 # [ 3.158044] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1986lb # [ 3.225265] EXT4-fs (vda): mounted filesystem 782b10ef-e5a9-4bd6-ad24-65cac3c2f2e1 r/w with ordered data mode. Quota mode: none.1987worker2 # [ 3.165850] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1988client # [ 3.229570] EXT4-fs (vda): mounted filesystem 612c302d-cf82-44d0-93f4-547f03ca7254 r/w with ordered data mode. Quota mode: none.1989lb # [ 3.214771] systemd[1]: Mounted /sysroot.1990client # [ 3.220991] systemd[1]: Mounted /sysroot.1991worker2 # [ 3.170145] systemd[1]: Mounting /sysroot...1992lb # [ 3.217305] systemd[1]: Reached target Initrd Root File System.1993client # [ 3.222075] systemd[1]: Reached target Initrd Root File System.1994client # [ 3.226148] systemd[1]: Starting Mountpoints Configured in the Real Root...1995lb # [ 3.222360] systemd[1]: Starting Mountpoints Configured in the Real Root...1996worker1 # [ 3.198330] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1997client # [ 3.251521] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload.1998worker2 # [ 3.219445] EXT4-fs (vda): mounted filesystem af804e7f-fd2f-4d4e-9b7f-468339a1fe55 r/w with ordered data mode. Quota mode: none.1999client # [ 3.256877] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)...2000worker1 # [ 3.206388] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.
loading 1,155 hidden lines…
3156client # [ 12.127027] (udev-worker)[579]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.3157worker1 # [ 12.076791] systemd[1]: Stopping User and Group Name Lookups...3158worker1 # [ 12.082017] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...3159client # [ 12.135334] (udev-worker)[579]: Network interface NamePolicy= disabled on kernel command line.3160client: Guest shell says: b'Spawning backdoor root shell...\n'3161worker1 # [ 12.091752] systemd[1]: nscd.service: Deactivated successfully.3162worker1 # [ 12.098275] systemd[1]: Stopped Name Service Cache Daemon (nsncd).3163worker1 # [ 12.099126] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3164worker2 # [ 12.114752] 8021q: 802.1Q VLAN Support v1.83165lb # [ 12.192839] postgresql-pre-start[681]: The files belonging to this database system will be owned by user "postgres".3166lb # [ 12.197452] postgresql-pre-start[681]: This user must also own the server process.3167worker1 # [ 12.154877] systemd[1]: linger-users.service: Deactivated successfully.3168lb # [ 12.209270] postgresql-pre-start[681]: The database cluster will be initialized with locale "en_US.UTF-8".3169worker1 # [ 12.160332] systemd[1]: Finished linger-users.service.3170lb # [ 12.213271] postgresql-pre-start[681]: The default database encoding has accordingly been set to "UTF8".3171client: connected to guest root shell3172worker2 # connecting to host...3173worker1 # [ 12.185251] systemd[1]: Started Name Service Cache Daemon (nsncd).3174lb # [ 12.216996] postgresql-pre-start[681]: The default text search configuration will be set to "english".3175client: (connecting took 12.60 seconds)3176worker2 # [ 12.207182] cfg80211: Loading compiled-in X.509 certificates for regulatory database3177worker1 # [ 12.188926] nsncd[569]: Sep 20 10:51:34.812 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3178lb # [ 12.220391] postgresql-pre-start[681]: Data page checksums are enabled.3179worker1 # [ 12.190752] systemd[1]: Reached target Host and Network Name Lookups.3180lb # [ 12.223754] postgresql-pre-start[681]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok3181worker1 # [ 12.191568] systemd[1]: Reached target User and Group Name Lookups.3182lb # [ 12.229585] postgresql-pre-start[681]: creating subdirectories ... ok3183client: (finished: waiting for the VM to finish booting, in 12.60 seconds)3184lb # [ 12.231473] postgresql-pre-start[681]: selecting dynamic shared memory implementation ... posix3185worker2 # [ 12.243414] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3186worker2 # [ 12.243926] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3187worker1 # [ 12.230672] systemd[1]: Finished resolvconf update.3188worker1 # [ 12.231960] systemd[1]: Reached target Preparation for Network.3189worker2 # [ 12.249011] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23190worker2 # [ 12.249334] cfg80211: failed to load regulatory.db3191worker1 # [ 12.237074] systemd[1]: Starting DHCP Client...3192worker1 # [ 12.239983] systemd[1]: Starting Extra networking commands....3193lb # [ 12.288876] systemd[1]: Starting Virtual Console Setup...3194worker1 # [ 12.252381] (udev-worker)[383]: Network interface NamePolicy= disabled on kernel command line.3195worker1 # [ 12.269355] (udev-worker)[371]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.3196worker1 # [ 12.271494] (udev-worker)[371]: Network interface NamePolicy= disabled on kernel command line.3197client # [ 12.344201] 8021q: adding VLAN 0 to HW filter on device eth03198worker2 # [ 12.279305] (udev-worker)[651]: Network interface NamePolicy= disabled on kernel command line.3199client # [ 12.333957] dhcpcd[521]: eth0: waiting for carrier3200client # [ 12.337161] dhcpcd[521]: eth0: carrier acquired3201worker2 # [ 12.284515] (udev-worker)[659]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.3202lb # [ 12.333196] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs3203worker2 # [ 12.289619] (udev-worker)[659]: Network interface NamePolicy= disabled on kernel command line.3204worker2 # [ 12.302170] systemd-vconsole-setup[625]: Configuration of first virtual console was skipped, ignoring remaining ones.3205client # [ 12.358110] systemd[1]: Condition check resulted in Virtio network device being skipped.3206worker2 # [ 12.309847] systemd[1]: Finished Virtual Console Setup.3207client # [ 12.362424] dhcpcd[521]: DUID 00:01:00:01:32:42:77:36:52:54:00:12:34:563208client # [ 12.365555] dhcpcd[521]: eth0: IAID 00:12:34:563209client # [ 12.369793] dhcpcd[521]: eth0: adding address fe80::5054:ff:fe12:34563210client # [ 12.372258] systemd[1]: Starting Address configuration of eth1...3211lb # [ 12.453646] postgresql-pre-start[681]: selecting default "max_connections" ... 1003212client # [ 12.486135] 8021q: adding VLAN 0 to HW filter on device eth13213client # [ 12.488841] systemd-logind[417]: Watching system buttons on /dev/input/event0 (gpio-keys)3214worker2 # [ 12.442684] systemd[1]: Condition check resulted in Virtio network device being skipped.3215client # [ 12.496749] network-addresses-eth1-start[618]: adding address 192.168.1.1/24... done3216worker2 # [ 12.446940] systemd[1]: Starting Address configuration of eth1...3217client # [ 12.512398] network-addresses-eth1-start[618]: adding address 2001:db8:1::1/64... done3218worker2 # [ 12.459370] systemd-logind[512]: Watching system buttons on /dev/input/event0 (gpio-keys)3219client # [ 12.532918] systemd[1]: Finished Address configuration of eth1.3220worker1 # [ 12.489429] dhcpcd[604]: dhcpcd-10.3.2 starting3221worker1 # [ 12.503084] dhcpcd[647]: dev: loaded udev3222worker1 # [ 12.514272] systemd-logind[513]: Watching system buttons on /dev/input/event0 (gpio-keys)3223worker2 # [ 12.551075] 8021q: adding VLAN 0 to HW filter on device eth03224worker2 # [ 12.537058] dhcpcd[635]: eth0: waiting for carrier3225worker2 # [ 12.540323] dhcpcd[635]: eth0: carrier acquired3226worker1 # [ 12.557784] 8021q: 802.1Q VLAN Support v1.83227worker1 # [ 12.548913] systemd[1]: Finished Extra networking commands..3228worker1 # [ 12.554897] systemd[1]: Reached target Network.3229worker2 # [ 12.557270] dhcpcd[635]: DUID 00:01:00:01:32:42:77:37:52:54:00:12:34:563230worker1 # [ 12.557973] systemd[1]: Starting Permit User Sessions...3231worker2 # [ 12.559547] dhcpcd[635]: eth0: IAID 00:12:34:563232worker2 # [ 12.561999] dhcpcd[635]: eth0: adding address fe80::5054:ff:fe12:34563233worker2 # [ 12.583125] 8021q: adding VLAN 0 to HW filter on device eth13234worker2 # [ 12.587232] network-addresses-eth1-start[680]: adding address 192.168.1.4/24... done3235client # [ 12.652461] mousedev: PS/2 mouse device common for all mice3236worker1 # [ 12.589997] systemd[1]: Condition check resulted in Virtio network device being skipped.3237worker1 # [ 12.596878] systemd[1]: Starting Address configuration of eth1...3238worker2 # [ 12.604655] network-addresses-eth1-start[680]: adding address 2001:db8:1::4/64... done3239lb # [ 12.666529] postgresql-pre-start[681]: selecting default "shared_buffers" ... 128MB3240worker2 # [ 12.626971] systemd[1]: Finished Address configuration of eth1.3241worker2 # [ 12.644650] mousedev: PS/2 mouse device common for all mice3242worker1 # [ 12.658032] cfg80211: Loading compiled-in X.509 certificates for regulatory database3243client # [ 12.707003] systemd-logind[417]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3244worker1 # [ 12.666257] systemd[1]: Finished Permit User Sessions.3245worker1 # [ 12.671825] systemd[1]: Started Getty on tty1.3246worker1 # [ 12.675921] systemd[1]: Reached target Login Prompts.3247lb # [ 12.725173] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.3248worker1 # [ 12.696155] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3249worker1 # [ 12.696670] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3250worker1 # [ 12.701728] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23251worker1 # [ 12.702062] cfg80211: failed to load regulatory.db3252worker2 # [ 12.742367] systemd-logind[512]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3253lb # [ 12.808193] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.3254worker1 # [ 12.777343] 8021q: adding VLAN 0 to HW filter on device eth13255lb # [ 12.815019] systemd[1]: Started backdoor.service.3256worker1 # [ 12.798302] 8021q: adding VLAN 0 to HW filter on device eth03257worker1 # [ 12.786176] dhcpcd[647]: eth0: waiting for carrier3258worker1 # [ 12.789476] network-addresses-eth1-start[659]: adding address 192.168.1.3/24... done3259worker1 # [ 12.794054] dhcpcd[647]: eth0: waiting for carrier3260worker1 # [ 12.796634] dhcpcd[647]: eth0: carrier acquired3261lb # [ 12.870269] 8021q: 802.1Q VLAN Support v1.83262worker1 # [ 12.809808] network-addresses-eth1-start[659]: adding address 2001:db8:1::3/64... done3263worker1 # [ 12.820122] dhcpcd[647]: DUID 00:01:00:01:32:42:77:37:52:54:00:12:34:563264worker1 # [ 12.822347] dhcpcd[647]: eth0: IAID 00:12:34:563265worker1 # [ 12.824370] dhcpcd[647]: eth0: adding address fe80::5054:ff:fe12:34563266worker1 # [ 12.835340] systemd[1]: Finished Address configuration of eth1.3267worker1 # [ 12.890966] mousedev: PS/2 mouse device common for all mice3268worker1 # [ 12.906862] systemd-logind[513]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3269lb # connecting to host...3270lb # [ 12.957982] (udev-worker)[692]: Network interface NamePolicy= disabled on kernel command line.3271lb # [ 12.969955] (udev-worker)[691]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.3272lb # [ 12.979531] (udev-worker)[691]: Network interface NamePolicy= disabled on kernel command line.3273lb # [ 13.010197] systemd-vconsole-setup[701]: Configuration of first virtual console was skipped, ignoring remaining ones.3274lb # [ 13.038861] cfg80211: Loading compiled-in X.509 certificates for regulatory database3275lb # [ 13.026392] systemd[1]: Finished Virtual Console Setup.3276lb # [ 13.075792] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3277lb # [ 13.078560] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3278lb # [ 13.082667] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23279lb # [ 13.082998] cfg80211: failed to load regulatory.db3280lb # [ 13.191313] systemd[1]: Condition check resulted in Virtio network device being skipped.3281lb # [ 13.198485] systemd[1]: Starting Address configuration of eth1...3282worker1 # [ 13.212764] dhcpcd[647]: eth0: soliciting a DHCP lease3283worker1 # [ 13.220536] dhcpcd[647]: eth0: offered 10.0.2.15 from 10.0.2.23284worker1 # [ 13.228376] dhcpcd[647]: eth0: probing address 10.0.2.15/243285lb # [ 13.312409] 8021q: adding VLAN 0 to HW filter on device eth03286lb # [ 13.303762] dhcpcd[653]: eth0: waiting for carrier3287lb # [ 13.306912] dhcpcd[653]: eth0: carrier acquired3288lb # [ 13.324445] 8021q: adding VLAN 0 to HW filter on device eth13289lb # [ 13.326352] dhcpcd[653]: DUID 00:01:00:01:32:42:77:37:52:54:00:12:34:563290lb # [ 13.329314] dhcpcd[653]: eth0: IAID 00:12:34:563291lb # [ 13.331307] dhcpcd[653]: eth0: adding address fe80::5054:ff:fe12:34563292lb # [ 13.338457] network-addresses-eth1-start[724]: adding address 192.168.1.2/24... done3293lb # [ 13.352450] network-addresses-eth1-start[724]: adding address 2001:db8:1::2/64... done3294lb # [ 13.374889] systemd[1]: Finished Address configuration of eth1.3295lb # [ 13.433634] systemd-logind[529]: Watching system buttons on /dev/input/event0 (gpio-keys)3296client: (finished: waiting for unit network-addresses-eth1.service, in 13.88 seconds)3297client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }3298lb # [ 13.530125] mousedev: PS/2 mouse device common for all mice3299client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.05 seconds)3300lb: waiting for unit network-addresses-eth1.service3301lb: waiting for the VM to finish booting3302lb: Guest shell says: b'Spawning backdoor root shell...\n'3303lb: connected to guest root shell3304lb: (connecting took 0.00 seconds)3305lb: (finished: waiting for the VM to finish booting, in 0.00 seconds)3306client # [ 13.644588] dhcpcd[521]: eth0: soliciting a DHCP lease3307client # [ 13.652523] dhcpcd[521]: eth0: offered 10.0.2.15 from 10.0.2.23308lb: (finished: waiting for unit network-addresses-eth1.service, in 0.10 seconds)3309lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }3310client # [ 13.658355] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3311client # [ 13.659398] systemd[1]: Stopped Virtual Console Setup.3312client # [ 13.663000] systemd[1]: Stopping Virtual Console Setup...3313client # [ 13.663799] dhcpcd[521]: eth0: probing address 10.0.2.15/243314client # [ 13.666810] systemd[1]: Starting Virtual Console Setup...3315client # [ 13.696134] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3316client # [ 13.700193] systemd[1]: Stopped Virtual Console Setup.3317worker1 # [ 13.666089] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input33318lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.05 seconds)3319worker1: waiting for unit network-addresses-eth1.service3320worker1: waiting for the VM to finish booting3321worker1: Guest shell says: b'Spawning backdoor root shell...\n'3322worker1: connected to guest root shell3323worker1: (connecting took 0.00 seconds)3324worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3325client # [ 13.709882] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3326client # [ 13.717123] systemd[1]: Starting Virtual Console Setup...3327worker2 # [ 13.671195] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3328worker2 # [ 13.675447] systemd[1]: Stopped Virtual Console Setup.3329worker2 # [ 13.677955] systemd[1]: Stopping Virtual Console Setup...3330worker2 # [ 13.680918] systemd[1]: Starting Virtual Console Setup...3331lb # [ 13.737191] systemd-logind[529]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)3332worker2 # [ 13.693735] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3333client # [ 13.747188] systemd-logind[417]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3334worker2 # [ 13.714773] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3335worker2 # [ 13.719394] systemd[1]: Stopped Virtual Console Setup.3336worker2 # [ 13.725695] systemd[1]: Starting Virtual Console Setup...3337worker2 # [ 13.755223] systemd-logind[512]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3338worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.10 seconds)3339worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3340worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.05 seconds)3341worker2: waiting for unit network-addresses-eth1.service3342worker2: waiting for the VM to finish booting3343worker2: Guest shell says: b'Spawning backdoor root shell...\n'3344worker2: connected to guest root shell3345worker2: (connecting took 0.00 seconds)3346worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3347worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.07 seconds)3348worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3349worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.04 seconds)3350lb: waiting for unit niks3.service3351client # [ 14.036613] systemd-vconsole-setup[649]: Configuration of first virtual console was skipped, ignoring remaining ones.3352client # [ 14.041002] systemd[1]: Finished Virtual Console Setup.3353worker1 # [ 14.033551] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3354worker1 # [ 14.040462] systemd[1]: Starting Virtual Console Setup...3355worker1 # [ 14.062118] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3356worker1 # [ 14.068184] systemd[1]: Stopped Virtual Console Setup.3357worker2 # [ 14.070931] systemd-vconsole-setup[703]: Configuration of first virtual console was skipped, ignoring remaining ones.3358worker1 # [ 14.072441] systemd[1]: Starting Virtual Console Setup...3359worker2 # [ 14.075052] systemd[1]: Finished Virtual Console Setup.3360worker1 # [ 14.116537] systemd-logind[513]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3361worker2 # [ 14.271239] dhcpcd[635]: eth0: soliciting a DHCP lease3362worker2 # [ 14.274831] dhcpcd[635]: eth0: offered 10.0.2.15 from 10.0.2.23363worker2 # [ 14.280525] dhcpcd[635]: eth0: probing address 10.0.2.15/243364worker1 # [ 14.489858] systemd-vconsole-setup[710]: Configuration of first virtual console was skipped, ignoring remaining ones.3365worker1 # [ 14.494818] systemd[1]: Finished Virtual Console Setup.3366worker2 # [ 14.806751] dhcpcd[635]: eth0: soliciting an IPv6 router3367worker2 # [ 14.810559] dhcpcd[635]: eth0: Router Advertisement from fe80::23368worker2 # [ 14.813308] dhcpcd[635]: eth0: adding address fec0::5054:ff:fe12:3456/643369worker2 # [ 14.816174] dhcpcd[635]: eth0: adding route to fec0::/643370worker2 # [ 14.818567] dhcpcd[635]: eth0: adding default route via fe80::23371lb # [ 14.876087] dhcpcd[653]: eth0: soliciting a DHCP lease3372lb # [ 14.880622] dhcpcd[653]: eth0: offered 10.0.2.15 from 10.0.2.23373lb # [ 14.888248] dhcpcd[653]: eth0: probing address 10.0.2.15/243374client # [ 15.009083] dhcpcd[521]: eth0: soliciting an IPv6 router3375client # [ 15.012519] dhcpcd[521]: eth0: Router Advertisement from fe80::23376client # [ 15.015050] dhcpcd[521]: eth0: adding address fec0::5054:ff:fe12:3456/643377client # [ 15.018097] dhcpcd[521]: eth0: adding route to fec0::/643378client # [ 15.020380] dhcpcd[521]: eth0: adding default route via fe80::23379worker1 # [ 15.009701] dhcpcd[647]: eth0: soliciting an IPv6 router3380worker1 # [ 15.012131] dhcpcd[647]: eth0: Router Advertisement from fe80::23381worker1 # [ 15.014603] dhcpcd[647]: eth0: adding address fec0::5054:ff:fe12:3456/643382worker1 # [ 15.017517] dhcpcd[647]: eth0: adding route to fec0::/643383worker1 # [ 15.019707] dhcpcd[647]: eth0: adding default route via fe80::23384lb # [ 15.342708] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3385lb # [ 15.346263] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3386lb # [ 15.353609] systemd[1]: Stopped Virtual Console Setup.3387lb # [ 15.354373] systemd[1]: Stopping Virtual Console Setup...3388lb # [ 15.358305] systemd[1]: Starting Virtual Console Setup...3389lb # [ 15.388733] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3390lb # [ 15.392102] systemd[1]: Stopped Virtual Console Setup.3391lb # [ 15.402709] systemd[1]: Starting Virtual Console Setup...3392lb # [ 15.428796] systemd-logind[529]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3393lb # [ 15.573910] dhcpcd[653]: eth0: soliciting an IPv6 router3394lb # [ 15.576160] dhcpcd[653]: eth0: Router Advertisement from fe80::23395lb # [ 15.577341] dhcpcd[653]: eth0: adding address fec0::5054:ff:fe12:3456/643396lb # [ 15.578385] dhcpcd[653]: eth0: adding route to fec0::/643397lb # [ 15.579456] dhcpcd[653]: eth0: adding default route via fe80::23398lb # [ 15.618059] postgresql-pre-start[681]: selecting default time zone ... UTC3399lb # [ 15.622359] postgresql-pre-start[681]: creating configuration files ... ok3400lb # [ 15.816508] systemd-vconsole-setup[787]: Configuration of first virtual console was skipped, ignoring remaining ones.3401lb # [ 15.822825] systemd[1]: Finished Virtual Console Setup.3402lb # [ 15.935716] postgresql-pre-start[681]: running bootstrap script ... ok3403lb # [ 16.593350] postgresql-pre-start[681]: performing post-bootstrap initialization ... ok3404lb # [ 16.739590] postgresql-pre-start[681]: syncing data to disk ... ok3405lb # [ 16.742324] postgresql-pre-start[681]: initdb: warning: enabling "trust" authentication for local connections3406lb # [ 16.743769] postgresql-pre-start[681]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3407lb # [ 16.746177] postgresql-pre-start[681]: Success. You can now start the database server using:3408lb # [ 16.747478] postgresql-pre-start[681]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3409lb # [ 16.873801] postgres[806]: [806] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit3410lb # [ 16.877971] postgres[806]: [806] LOG: listening on IPv6 address "::1", port 54323411lb # [ 16.879144] postgres[806]: [806] LOG: listening on IPv4 address "127.0.0.1", port 54323412lb # [ 16.881220] postgres[806]: [806] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3413lb # [ 16.894937] postgres[815]: [815] LOG: database system was shut down at 2026-09-20 10:51:39 GMT3414lb # [ 16.899602] postgres[806]: [806] LOG: database system is ready to accept connections3415lb # [ 16.905060] systemd[1]: Started PostgreSQL Server.3416lb # [ 16.914167] systemd[1]: Starting PostgreSQL Setup Scripts...3417lb # [ 17.156260] postgresql-setup-start[826]: CREATE DATABASE3418lb # [ 17.206368] postgresql-setup-start[831]: CREATE ROLE3419lb # [ 17.229477] postgresql-setup-start[833]: ALTER DATABASE3420lb # [ 17.236799] systemd[1]: Finished PostgreSQL Setup Scripts.3421lb # [ 17.238734] systemd[1]: Reached target PostgreSQL.3422client # [ 18.540873] dhcpcd[521]: eth0: leased 10.0.2.15 for 86400 seconds3423worker1 # [ 18.534253] dhcpcd[647]: eth0: leased 10.0.2.15 for 86400 seconds3424worker1 # [ 18.537822] dhcpcd[647]: eth0: adding route to 10.0.2.0/243425worker1 # [ 18.541056] dhcpcd[647]: eth0: adding default route via 10.0.2.23426client # [ 18.544297] dhcpcd[521]: eth0: adding route to 10.0.2.0/243427client # [ 18.544497] dhcpcd[521]: eth0: adding default route via 10.0.2.23428client # [ 18.715801] systemd[1]: Started DHCP Client.3429client # [ 18.720793] systemd[1]: Reached target Multi-User System.3430client # [ 18.722455] systemd[1]: Startup finished in 939ms (kernel) + 4.597s (initrd) + 13.184s (userspace) = 18.722s.3431worker1 # [ 18.693847] systemd[1]: Started DHCP Client.3432worker1 # [ 18.695756] systemd[1]: Reached target Multi-User System.3433worker1 # [ 18.697031] systemd[1]: Startup finished in 942ms (kernel) + 5.526s (initrd) + 12.226s (userspace) = 18.695s.3434worker2 # [ 19.112429] dhcpcd[635]: eth0: leased 10.0.2.15 for 86400 seconds3435worker2 # [ 19.116200] dhcpcd[635]: eth0: adding route to 10.0.2.0/243436worker2 # [ 19.118801] dhcpcd[635]: eth0: adding default route via 10.0.2.23437worker2 # [ 19.267848] systemd[1]: Started DHCP Client.3438worker2 # [ 19.269943] systemd[1]: Reached target Multi-User System.3439worker2 # [ 19.270766] systemd[1]: Startup finished in 936ms (kernel) + 4.575s (initrd) + 13.757s (userspace) = 19.269s.3440lb # [ 20.178471] dhcpcd[653]: eth0: leased 10.0.2.15 for 86400 seconds3441lb # [ 20.181814] dhcpcd[653]: eth0: adding route to 10.0.2.0/243442lb # [ 20.181990] dhcpcd[653]: eth0: adding default route via 10.0.2.23443lb # [ 20.343921] systemd[1]: Started DHCP Client.3444lb # [ 20.350432] systemd[1]: Reached target Network is Online.3445lb # [ 20.353463] systemd[1]: Started Envoy reverse proxy.3446lb # [ 20.358212] systemd[1]: Started mock-oidc.service.3447lb # [ 20.458869] mock-oidc-server[925]: Mock OIDC Server running3448lb # [ 20.459779] mock-oidc-server[925]: OIDC Address: 192.168.1.2:80803449lb # [ 20.461123] mock-oidc-server[925]: Issue Address: 0.0.0.0:80813450lb # [ 20.462745] mock-oidc-server[925]: Issuer: http://192.168.1.2:8080/oidc3451lb # [ 20.464162] mock-oidc-server[925]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3452lb # [ 20.465728] mock-oidc-server[925]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3453lb # [ 20.467577] mock-oidc-server[925]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3454lb # [ 21.029901] envoy[924]: [2026-09-20 10:51:43.657][924][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120)3455lb # [ 21.032829] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:469] statically linked extensions:3456lb # [ 21.034485] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3457lb # [ 21.037173] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3458lb # [ 21.054130] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3459lb # [ 21.059144] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3460lb # [ 21.063059] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3461lb # [ 21.066966] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3462lb # [ 21.069363] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83463lb # [ 21.071571] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3464lb # [ 21.074652] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3465lb # [ 21.107977] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3466lb # [ 21.110900] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3467lb # [ 21.118504] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3468lb # [ 21.121141] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3469lb # [ 21.123436] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3470lb # [ 21.125557] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3471lb # [ 21.129194] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3472lb # [ 21.131502] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats3473lb # [ 21.135895] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3474lb # [ 21.148068] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3475lb # [ 21.150644] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3476lb # [ 21.153802] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3477lb # [ 21.159076] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3478lb # [ 21.161320] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3479lb # [ 21.163809] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3480lb # [ 21.167775] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override3481lb # [ 21.170798] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3482lb # [ 21.173371] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert3483lb # [ 21.175294] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3484lb # [ 21.178206] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3485lb # [ 21.184127] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3486lb # [ 21.186098] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3487lb # [ 21.193824] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector3488lb # [ 21.200799] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3489lb # [ 21.202798] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection3490lb # [ 21.209852] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3491lb # [ 21.212366] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3492lb # [ 21.218337] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23493lb # [ 21.220134] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3494lb # [ 21.227538] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3495lb # [ 21.232907] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor3496lb # [ 21.235490] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3497lb # [ 21.237793] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3498lb # [ 21.240876] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3499lb # [ 21.243930] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo3500lb # [ 21.245733] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3501lb # [ 21.250526] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3502lb # [ 21.259481] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple3503lb # [ 21.262078] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default3504lb # [ 21.264244] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy3505lb # [ 21.267304] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3506lb # [ 21.270149] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based3507lb # [ 21.274701] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3508lb # [ 21.277467] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default3509lb # [ 21.279238] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3510lb # [ 21.283232] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter3511lb # [ 21.285620] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator3512lb # [ 21.288268] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection3513lb # [ 21.290199] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3514lb # [ 21.293256] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction3515lb # [ 21.298185] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3516lb # [ 21.300293] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3517lb # [ 21.302579] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3518lb # [ 21.307890] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3519lb # [ 21.310862] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3520lb # [ 21.313047] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3521lb # [ 21.314966] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3522lb # [ 21.317907] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3523lb # [ 21.319919] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default3524lb # [ 21.322223] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3525lb # [ 21.325962] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3526lb # [ 21.327833] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case3527lb # [ 21.330788] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3528lb # [ 21.332808] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3529lb # [ 21.335164] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3530lb # [ 21.342437] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso3531lb # [ 21.344809] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3532lb # [ 21.346630] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3533lb # [ 21.351251] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3534lb # [ 21.356783] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable3535lb # [ 21.358820] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default3536lb # [ 21.361053] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy3537lb # [ 21.374830] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23538lb # [ 21.376797] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3539lb # [ 21.379486] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3540lb # [ 21.382038] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind3541lb # [ 21.383851] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth23542lb # [ 21.386547] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13543lb # [ 21.389432] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic3544lb # [ 21.391273] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3545lb # [ 21.394561] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy3546lb # [ 21.397656] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3547lb # [ 21.399848] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3548lb # [ 21.402628] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3549lb # [ 21.406240] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid3550lb # [ 21.407910] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift3551lb # [ 21.411665] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3552lb # [ 21.414464] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3553lb # [ 21.416624] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3554lb # [ 21.418752] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params3555lb # [ 21.430314] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua3556lb # [ 21.432481] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3557lb # [ 21.435350] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3558lb # [ 21.437675] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3559lb # [ 21.439609] envoy[924]: [2026-09-20 10:51:43.660][924][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default3560lb # [ 21.442034] envoy[924]: [2026-09-20 10:51:43.680][924][info][main] [source/server/server.cc:531] HTTP header map info:3561lb # [ 21.443621] envoy[924]: [2026-09-20 10:51:43.691][924][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id3562lb # [ 21.460266] envoy[924]: [2026-09-20 10:51:43.691][924][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:3563lb # [ 21.462168] envoy[924]: [2026-09-20 10:51:43.691][924][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id3564lb # [ 21.471696] envoy[924]: [2026-09-20 10:51:43.691][924][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status3565lb # [ 21.474491] envoy[924]: [2026-09-20 10:51:43.958][924][info][main] [source/server/server.cc:968] runtime: {}3566lb # [ 21.475899] envoy[924]: [2026-09-20 10:51:43.984][924][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.3567lb # [ 21.479368] envoy[924]: [2026-09-20 10:51:43.984][924][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99013568lb # [ 21.481561] envoy[924]: [2026-09-20 10:51:43.984][924][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99013569lb # [ 21.483212] envoy[924]: [2026-09-20 10:51:44.002][924][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration3570lb # [ 21.485176] envoy[924]: [2026-09-20 10:51:44.002][924][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)3571lb # [ 21.486853] envoy[924]: [2026-09-20 10:51:44.002][924][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)3572lb # [ 21.514227] envoy[924]: [2026-09-20 10:51:44.142][924][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)3573lb # [ 21.524670] envoy[924]: [2026-09-20 10:51:44.152][924][info][config] [source/server/configuration_impl.cc:164] loading stats configuration3574lb # [ 21.527481] envoy[924]: [2026-09-20 10:51:44.155][924][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.3575lb # [ 21.531152] envoy[924]: [2026-09-20 10:51:44.155][924][info][main] [source/server/server.cc:1077] starting main dispatch loop3576worker2 # [ 21.483445] systemd[1]: Starting Nix worker-protocol over gRPC...3577worker1 # [ 21.488952] systemd[1]: Starting Nix worker-protocol over gRPC...3578worker1 # [ 21.758878] nix-grpc-daemon[775]: ts=2026-09-20T10:51:44Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3579lb # [ 21.820613] rustfs-bucket-start[947]: mb s3://farm3580worker1 # [ 21.772586] nix-grpc-daemon[775]: ts=2026-09-20T10:51:44Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=13581lb # [ 21.830335] systemd[1]: Finished rustfs-bucket.service.3582worker2 # [ 21.793590] nix-grpc-daemon[777]: ts=2026-09-20T10:51:44Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3583lb # [ 21.841850] systemd[1]: Starting niks3 server...3584worker2 # [ 21.805718] nix-grpc-daemon[777]: ts=2026-09-20T10:51:44Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=13585worker1 # [ 21.822003] nix-grpc-daemon[775]: ts=2026-09-20T10:51:44Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3586worker1 # [ 21.827200] systemd[1]: Started Nix worker-protocol over gRPC.3587worker2 # [ 21.854582] nix-grpc-daemon[777]: ts=2026-09-20T10:51:44Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3588worker2 # [ 21.860141] systemd[1]: Started Nix worker-protocol over gRPC.3589lb # [ 21.928099] envoy[924]: [2026-09-20 10:51:44.554][924][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization3590lb # [ 21.929938] envoy[924]: [2026-09-20 10:51:44.554][924][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized3591lb # [ 21.931967] envoy[924]: [2026-09-20 10:51:44.554][924][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager3592worker1 # [ 21.901454] nix-grpc-daemon[775]: ts=2026-09-20T10:51:44Z level=info event=scheduler_connected addr=lb:500513593lb # [ 21.953214] envoy[924]: [2026-09-20 10:51:44.554][924][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers3594worker1 # [ 21.912964] nix-grpc-daemon[775]: ts=2026-09-20T10:51:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3595worker2 # [ 21.919269] nix-grpc-daemon[777]: ts=2026-09-20T10:51:44Z level=info event=scheduler_connected addr=lb:500513596worker2 # [ 21.921397] nix-grpc-daemon[777]: ts=2026-09-20T10:51:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3597lb # [ 22.122523] postgres[965]: [965] ERROR: relation "goose_db_version" does not exist at character 363598lb # [ 22.123847] postgres[965]: [965] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC3599worker1 # [ 22.114884] nix-grpc-daemon[775]: ts=2026-09-20T10:51:44Z level=info event=scheduler_connected addr=lb:500513600lb # [ 22.166702] niks3-server[954]: 2026/09/20 10:51:44 OK 20241026095416_initial_model.sql (26.28ms)3601worker1 # [ 22.120470] nix-grpc-daemon[775]: ts=2026-09-20T10:51:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3602worker2 # [ 22.122773] nix-grpc-daemon[777]: ts=2026-09-20T10:51:44Z level=info event=scheduler_connected addr=lb:500513603lb # [ 22.170912] niks3-server[954]: 2026/09/20 10:51:44 OK 20251210153512_drop_unused_gin_index.sql (4.17ms)3604lb # [ 22.177362] niks3-server[954]: 2026/09/20 10:51:44 OK 20251218171726_add_pins.sql (6.82ms)3605worker2 # [ 22.129003] nix-grpc-daemon[777]: ts=2026-09-20T10:51:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3606lb # [ 22.182696] niks3-server[954]: 2026/09/20 10:51:44 OK 20260628120000_add_object_size_and_stats.sql (5.24ms)3607lb # [ 22.188262] niks3-server[954]: 2026/09/20 10:51:44 OK 20260905000000_add_claims.sql (5.59ms)3608lb # [ 22.193055] niks3-server[954]: 2026/09/20 10:51:44 OK 20260920000000_drop_claims.sql (4.66ms)3609lb # [ 22.194343] niks3-server[954]: 2026/09/20 10:51:44 goose: successfully migrated database to version: 202609200000003610lb # [ 22.199798] niks3-server[954]: 2026/09/20 10:51:44 OK 1_commit_pending_closure.sql (6.71ms)3611lb # [ 22.202657] niks3-server[954]: 2026/09/20 10:51:44 OK 2_object_stats_trigger.sql (2.72ms)3612lb # [ 22.204075] niks3-server[954]: 2026/09/20 10:51:44 goose: up to current file version: 23613lb # [ 22.208265] niks3-server[954]: 2026/09/20 10:51:44 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key3614lb # [ 22.255948] niks3-server[954]: 2026/09/20 10:51:44 INFO Read proxy enabled — serving cache objects from S33615lb # [ 22.258017] niks3-server[954]: 2026/09/20 10:51:44 INFO Using socket-activated listener address=0.0.0.0:57513616lb # [ 22.262922] systemd[1]: Started niks3 server.3617lb # [ 22.263651] niks3-server[954]: 2026/09/20 10:51:44 INFO systemd watchdog enabled interval=15s3618lb # [ 22.268562] niks3-server[954]: 2026/09/20 10:51:44 INFO Starting HTTP server address=0.0.0.0:57513619lb # [ 22.272108] systemd[1]: Reached target Multi-User System.3620lb # [ 22.272978] systemd[1]: Startup finished in 941ms (kernel) + 4.641s (initrd) + 16.685s (userspace) = 22.268s.3621lb # [ 22.279615] niks3-server[954]: 2026/09/20 10:51:44 INFO lead: acquired remote=192.168.1.3:346903622worker1 # [ 22.231881] nix-grpc-daemon[775]: ts=2026-09-20T10:51:44Z level=info event=scheduler_take_over3623worker1 # [ 22.321507] nix-grpc-daemon[775]: ts=2026-09-20T10:51:44Z level=info event=scheduler_connected addr=lb:500513624worker1 # [ 22.327149] nix-grpc-daemon[775]: ts=2026-09-20T10:51:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3625worker2 # [ 22.330244] nix-grpc-daemon[777]: ts=2026-09-20T10:51:44Z level=info event=scheduler_connected addr=lb:500513626worker2 # [ 22.334842] nix-grpc-daemon[777]: ts=2026-09-20T10:51:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3627worker1 # [ 22.530644] nix-grpc-daemon[775]: ts=2026-09-20T10:51:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3628worker2 # [ 22.533355] nix-grpc-daemon[777]: ts=2026-09-20T10:51:45Z level=info event=scheduler_connected addr=lb:500513629worker2 # [ 22.539298] nix-grpc-daemon[777]: ts=2026-09-20T10:51:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3630worker2 # [ 22.740301] nix-grpc-daemon[777]: ts=2026-09-20T10:51:45Z level=info event=scheduler_connected addr=lb:500513631worker2 # [ 22.746073] nix-grpc-daemon[777]: ts=2026-09-20T10:51:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3632worker1 # [ 22.935550] nix-grpc-daemon[775]: ts=2026-09-20T10:51:45Z level=info event=scheduler_connected addr=lb:500513633worker2 # [ 22.950416] nix-grpc-daemon[777]: ts=2026-09-20T10:51:45Z level=info event=scheduler_connected addr=lb:500513634worker1 # [ 22.964705] nix-grpc-daemon[775]: ts=2026-09-20T10:51:45Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=03635worker1 # [ 22.971254] nix-grpc-daemon[775]: ts=2026-09-20T10:51:45Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=03636lb: (finished: waiting for unit niks3.service, in 9.16 seconds)3637lb: waiting for TCP port 5751 on localhost3638lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!3639lb: (finished: waiting for TCP port 5751 on localhost, in 0.08 seconds)3640lb: waiting for unit envoy.service3641lb: (finished: waiting for unit envoy.service, in 0.07 seconds)3642lb: waiting for TCP port 50051 on localhost3643lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!3644lb # [ 23.313714] envoy[924]: conn peer=[::1]:43172 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=33645lb: (finished: waiting for TCP port 50051 on localhost, in 0.05 seconds)3646lb: waiting until exactly no endpoints of aarch64-linux are unhealthy3647??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.3648 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1283649lb: must succeed: curl -sf localhost:9901/clusters3650lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.12 seconds)3651lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.12 seconds)3652subtest: one node schedules and both builders hold a WorkerSession on it3653lb: must succeed: curl -sf localhost:9901/clusters3654lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)3655worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics3656worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds)3657(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.16 seconds)3658subtest: balancer auth: client cert, bearer token, nothing, unknown CN3659worker2 # [ 24.130279] nix-grpc-daemon[777]: ts=2026-09-20T10:51:46Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:513423660worker2 # [ 24.153027] systemd[1]: Started Nix Daemon.3661worker2 # [ 24.475564] nix-daemon[832]: accepted connection from pid 777, user nix-grpc-daemon (trusted)3662worker2 # [ 24.533672] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 79 ms (attempt 1/5)3663worker2 # [ 24.616563] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 97 ms (attempt 2/5)3664worker2 # [ 24.721752] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 121 ms (attempt 3/5)3665worker2 # [ 24.851029] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 83 ms (attempt 4/5)3666worker2 # [ 24.937079] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3667worker2 # [ 24.969315] nix-grpc-daemon[777]: ts=2026-09-20T10:51:47Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:513423668worker2 # [ 24.987076] nix-grpc-daemon[777]: ts=2026-09-20T10:51:47Z level=debug event=path_info_miss path=w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test error="error: path '/nix/store/w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test' is required, but there is no substituter that can build it"3669worker2 # [ 25.000828] nix-grpc-daemon[777]: ts=2026-09-20T10:51:47Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:513423670worker2 # [ 25.017136] nix-grpc-daemon[777]: ts=2026-09-20T10:51:47Z level=debug event=path_info_miss path=w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test error="error: path '/nix/store/w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test' is required, but there is no substituter that can build it"3671client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt3672client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.13 seconds)3673client: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key3674client: (finished: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.06 seconds)3675worker1 # [ 25.577702] nix-grpc-daemon[775]: ts=2026-09-20T10:51:48Z level=info event=oidc_jwks provider=mock keys=13676worker1 # [ 25.585467] nix-grpc-daemon[775]: ts=2026-09-20T10:51:48Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:440223677worker1 # [ 25.609238] systemd[1]: Started Nix Daemon.3678worker1 # [ 25.983463] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3679worker1 # [ 26.014548] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 94 ms (attempt 1/5)3680worker1 # [ 26.111594] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 16 ms (attempt 2/5)3681worker1 # [ 26.127927] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 46 ms (attempt 3/5)3682worker1 # [ 26.182091] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 609 ms (attempt 4/5)3683worker1 # [ 26.803602] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3684worker2 # [ 26.850961] nix-grpc-daemon[777]: ts=2026-09-20T10:51:49Z level=info event=oidc_jwks provider=mock keys=13685worker2 # [ 26.856620] nix-grpc-daemon[777]: ts=2026-09-20T10:51:49Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:513423686worker2 # [ 26.867047] nix-grpc-daemon[777]: ts=2026-09-20T10:51:49Z level=debug event=path_info_miss path=w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test error="error: path '/nix/store/w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test' is required, but there is no substituter that can build it"3687worker2 # [ 26.883264] nix-grpc-daemon[777]: ts=2026-09-20T10:51:49Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:513423688worker2 # [ 26.892356] nix-grpc-daemon[777]: ts=2026-09-20T10:51:49Z level=debug event=path_info_miss path=w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test error="error: path '/nix/store/w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test' is required, but there is no substituter that can build it"3689client: must succeed: rm -r /var/lib/nix-grpc-store3690client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.06 seconds)3691worker1 # [ 29.261077] nix-grpc-daemon[775]: ts=2026-09-20T10:51:51Z level=info event=denied method=QueryMissing cn=- role=none3692worker1 # [ 29.536859] nix-grpc-daemon[775]: ts=2026-09-20T10:51:52Z level=info event=denied method=QueryMissing cn=stranger role=none3693(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 5.82 seconds)3694subtest: DAG build is scheduled across workers and lands in the cache3695client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&23696worker2 # [ 29.805859] nix-grpc-daemon[777]: ts=2026-09-20T10:51:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:513423697client # don't know how to build these paths:3698client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3699worker1 # [ 29.822910] nix-grpc-daemon[775]: ts=2026-09-20T10:51:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:440223700worker1 # [ 29.877162] nix-grpc-daemon[775]: ts=2026-09-20T10:51:52Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=03701worker1 # [ 29.884867] nix-grpc-daemon[775]: ts=2026-09-20T10:51:52Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.3:50051 clients=13702worker1 # [ 29.936316] nix-grpc-daemon[775]: ts=2026-09-20T10:51:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:440223703worker1 # [ 29.962109] nix-grpc-daemon[775]: ts=2026-09-20T10:51:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:440223704client # copying 1 paths to 'lb:50051'...3705worker1 # [ 29.980070] nix-grpc-daemon[775]: ts=2026-09-20T10:51:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:440223706client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...3707worker1 # [ 30.014484] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3708worker1 # [ 30.053263] nix-grpc-daemon[775]: ts=2026-09-20T10:51:52Z level=info event=niks3_push_started pid=8463709worker1 # [ 30.557255] nix-daemon[833]: accepted connection from pid 859, user nix-grpc-daemon (trusted)3710worker1 # [ 30.578942] nix-daemon[833]: reaped child process 862, status = succeeded3711worker1 # [ 30.765419] nix-daemon[833]: accepted connection from pid 864, user nix-grpc-daemon (trusted)3712worker1 # [ 30.784187] nix-daemon[833]: reaped child process 867, status = succeeded3713lb # [ 30.847816] niks3-server[954]: 2026/09/20 10:51:53 INFO Received uploads request method=POST path=/api/pending_closures3714worker1 # [ 30.837433] nix-grpc-daemon[846]: time=2026-09-20T10:51:53.463Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3715worker1 # [ 30.839971] nix-grpc-daemon[846]: time=2026-09-20T10:51:53.464Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"3716lb # [ 30.953546] niks3-server[954]: 2026/09/20 10:51:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign3717lb # [ 30.962629] niks3-server[954]: 2026/09/20 10:51:53 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst3718lb # [ 30.994136] niks3-server[954]: 2026/09/20 10:51:53 INFO Signed narinfos id=1 count=13719worker1 # [ 30.950394] nix-grpc-daemon[846]: time=2026-09-20T10:51:53.578Z level=INFO msg="Uploading 1 narinfos"3720lb # [ 31.011279] niks3-server[954]: 2026/09/20 10:51:53 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete3721lb # [ 31.017534] niks3-server[954]: 2026/09/20 10:51:53 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls3722lb # [ 31.024110] niks3-server[954]: 2026/09/20 10:51:53 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo3723lb # [ 31.029049] niks3-server[954]: 2026/09/20 10:51:53 INFO Completed upload id=13724worker1 # [ 30.982065] nix-grpc-daemon[846]: time=2026-09-20T10:51:53.610Z level=INFO msg="Upload complete. (623ms)"3725worker1 # [ 30.997478] nix-grpc-daemon[775]: ts=2026-09-20T10:51:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44022 duration_s=1 paths=1 nar_bytes_in=5043726worker1 # [ 31.017026] nix-grpc-daemon[775]: ts=2026-09-20T10:51:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:440223727worker1 # [ 31.028815] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3728worker1 # [ 31.038568] nix-daemon[833]: reaped child process 844, status = succeeded3729client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...3730worker1 # [ 31.047488] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3731client # farm-a> node-a: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3732lb # [ 31.519585] envoy[924]: conn peer=[2001:db8:1::1]:33684 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=715 tx=365 ms=9393733lb # [ 31.524955] envoy[924]: conn peer=[2001:db8:1::1]:33692 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=365 ms=13683734lb # [ 31.529879] envoy[924]: conn peer=[2001:db8:1::1]:33696 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=163735lb # [ 31.535525] envoy[924]: conn peer=[2001:db8:1::1]:33712 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=153736client # farm-a> LOG-farm-a-t13737worker1 # [ 31.874190] nix-daemon[833]: reaped child process 871, status = succeeded3738worker1 # [ 32.047121] nix-daemon[833]: accepted connection from pid 886, user nix-grpc-daemon (trusted)3739worker1 # [ 32.066238] nix-daemon[833]: reaped child process 889, status = succeeded3740lb # [ 32.128786] niks3-server[954]: 2026/09/20 10:51:54 INFO Received uploads request method=POST path=/api/pending_closures3741worker1 # [ 32.095787] nix-grpc-daemon[846]: time=2026-09-20T10:51:54.723Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3742worker1 # [ 32.097954] nix-grpc-daemon[846]: time=2026-09-20T10:51:54.723Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"3743lb # [ 32.174467] niks3-server[954]: 2026/09/20 10:51:54 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3744lb # [ 32.189444] niks3-server[954]: 2026/09/20 10:51:54 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst3745lb # [ 32.204824] niks3-server[954]: 2026/09/20 10:51:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign3746worker1 # [ 32.158576] nix-grpc-daemon[846]: time=2026-09-20T10:51:54.786Z level=INFO msg="Uploading 1 narinfos"3747lb # [ 32.215940] niks3-server[954]: 2026/09/20 10:51:54 INFO Signed narinfos id=2 count=13748lb # [ 32.221571] niks3-server[954]: 2026/09/20 10:51:54 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls3749lb # [ 32.229023] niks3-server[954]: 2026/09/20 10:51:54 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete3750lb # [ 32.237381] niks3-server[954]: 2026/09/20 10:51:54 INFO Completed upload id=23751worker1 # [ 32.190173] nix-grpc-daemon[846]: time=2026-09-20T10:51:54.818Z level=INFO msg="Upload complete. (328ms)"3752lb # [ 32.240502] niks3-server[954]: 2026/09/20 10:51:54 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo3753worker1 # [ 32.216680] nix-grpc-daemon[775]: ts=2026-09-20T10:51:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44022 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=13754worker1 # [ 32.228521] nix-grpc-daemon[775]: ts=2026-09-20T10:51:54Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=03755worker1 # [ 32.231967] nix-grpc-daemon[775]: ts=2026-09-20T10:51:54Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.3:50051 clients=13756worker1 # [ 32.236537] nix-daemon[833]: reaped child process 869, status = succeeded3757worker1 # [ 32.257088] nix-grpc-daemon[775]: ts=2026-09-20T10:51:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:440223758worker1 # [ 32.271320] nix-grpc-daemon[775]: ts=2026-09-20T10:51:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:440223759worker1 # [ 32.286638] nix-grpc-daemon[846]: time=2026-09-20T10:51:54.915Z level=INFO msg="All 1 paths already cached"3760client # copying 1 paths to 'lb:50051'...3761worker1 # [ 32.297041] nix-grpc-daemon[775]: ts=2026-09-20T10:51:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:440223762client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...3763worker1 # [ 32.319167] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3764worker1 # [ 32.536199] nix-daemon[833]: accepted connection from pid 895, user nix-grpc-daemon (trusted)3765worker1 # [ 32.571273] nix-daemon[833]: reaped child process 898, status = succeeded3766worker1 # [ 32.746540] nix-daemon[833]: accepted connection from pid 900, user nix-grpc-daemon (trusted)3767worker1 # [ 32.767306] nix-daemon[833]: reaped child process 904, status = succeeded3768lb # [ 32.826050] niks3-server[954]: 2026/09/20 10:51:55 INFO Received uploads request method=POST path=/api/pending_closures3769worker1 # [ 32.789160] nix-grpc-daemon[846]: time=2026-09-20T10:51:55.417Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3770worker1 # [ 32.790655] nix-grpc-daemon[846]: time=2026-09-20T10:51:55.417Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"3771lb # [ 32.857292] niks3-server[954]: 2026/09/20 10:51:55 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst3772lb # [ 32.869590] niks3-server[954]: 2026/09/20 10:51:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign3773worker1 # [ 32.829195] nix-grpc-daemon[846]: time=2026-09-20T10:51:55.457Z level=INFO msg="Uploading 1 narinfos"3774lb # [ 32.881191] niks3-server[954]: 2026/09/20 10:51:55 INFO Signed narinfos id=3 count=13775lb # [ 32.883909] niks3-server[954]: 2026/09/20 10:51:55 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls3776lb # [ 32.894826] niks3-server[954]: 2026/09/20 10:51:55 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete3777lb # [ 32.901820] niks3-server[954]: 2026/09/20 10:51:55 INFO Completed upload id=33778worker1 # [ 32.854496] nix-grpc-daemon[846]: time=2026-09-20T10:51:55.483Z level=INFO msg="Upload complete. (517ms)"3779lb # [ 32.904336] niks3-server[954]: 2026/09/20 10:51:55 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo3780worker1 # [ 32.863633] nix-grpc-daemon[775]: ts=2026-09-20T10:51:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44022 duration_s=0 paths=1 nar_bytes_in=6243781worker1 # [ 32.876238] nix-grpc-daemon[775]: ts=2026-09-20T10:51:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:440223782worker1 # [ 32.882459] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3783worker1 # [ 32.887010] nix-daemon[833]: reaped child process 893, status = succeeded3784client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...3785worker1 # [ 32.899298] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3786client # farm-b> node-a: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3787client # farm-b> LOG-farm-b-t13788worker1 # [ 34.130118] nix-daemon[833]: reaped child process 908, status = succeeded3789worker1 # [ 34.300419] nix-daemon[833]: accepted connection from pid 923, user nix-grpc-daemon (trusted)3790worker1 # [ 34.318315] nix-daemon[833]: reaped child process 926, status = succeeded3791lb # [ 34.379280] niks3-server[954]: 2026/09/20 10:51:57 INFO Received uploads request method=POST path=/api/pending_closures3792worker1 # [ 34.342474] nix-grpc-daemon[846]: time=2026-09-20T10:51:56.970Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3793worker1 # [ 34.343952] nix-grpc-daemon[846]: time=2026-09-20T10:51:56.970Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"3794worker1 # [ 34.383661] nix-grpc-daemon[846]: time=2026-09-20T10:51:57.012Z level=INFO msg="Uploading 1 narinfos"3795lb # [ 34.419219] niks3-server[954]: 2026/09/20 10:51:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign3796lb # [ 34.439734] niks3-server[954]: 2026/09/20 10:51:57 INFO Signed narinfos id=4 count=13797lb # [ 34.446825] niks3-server[954]: 2026/09/20 10:51:57 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst3798lb # [ 34.462796] niks3-server[954]: 2026/09/20 10:51:57 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3799lb # [ 34.467247] niks3-server[954]: 2026/09/20 10:51:57 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete3800worker1 # [ 34.424247] nix-grpc-daemon[846]: time=2026-09-20T10:51:57.052Z level=INFO msg="Upload complete. (311ms)"3801lb # [ 34.472092] niks3-server[954]: 2026/09/20 10:51:57 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls3802lb # [ 34.477648] niks3-server[954]: 2026/09/20 10:51:57 INFO Completed upload id=43803lb # [ 34.480431] niks3-server[954]: 2026/09/20 10:51:57 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo3804worker1 # [ 34.437943] nix-grpc-daemon[775]: ts=2026-09-20T10:51:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44022 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=13805worker1 # [ 34.456323] nix-grpc-daemon[775]: ts=2026-09-20T10:51:57Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=03806worker1 # [ 34.461108] nix-grpc-daemon[775]: ts=2026-09-20T10:51:57Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.3:50051 clients=13807worker1 # [ 34.465725] nix-daemon[833]: reaped child process 906, status = succeeded3808worker1 # [ 34.497158] nix-grpc-daemon[775]: ts=2026-09-20T10:51:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:440223809worker1 # [ 34.512261] nix-grpc-daemon[775]: ts=2026-09-20T10:51:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:440223810worker1 # [ 34.526329] nix-grpc-daemon[846]: time=2026-09-20T10:51:57.154Z level=INFO msg="All 2 paths already cached"3811client # copying 1 paths to 'lb:50051'...3812worker1 # [ 34.536555] nix-grpc-daemon[775]: ts=2026-09-20T10:51:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:440223813client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...3814worker1 # [ 34.558820] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3815worker1 # [ 34.766248] nix-daemon[833]: accepted connection from pid 932, user nix-grpc-daemon (trusted)3816worker1 # [ 34.786441] nix-daemon[833]: reaped child process 935, status = succeeded3817worker1 # [ 34.960860] nix-daemon[833]: accepted connection from pid 937, user nix-grpc-daemon (trusted)3818worker1 # [ 34.978456] nix-daemon[833]: reaped child process 940, status = succeeded3819lb # [ 35.037168] niks3-server[954]: 2026/09/20 10:51:57 INFO Received uploads request method=POST path=/api/pending_closures3820worker1 # [ 34.999389] nix-grpc-daemon[846]: time=2026-09-20T10:51:57.627Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3821worker1 # [ 35.001093] nix-grpc-daemon[846]: time=2026-09-20T10:51:57.627Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"3822lb # [ 35.063371] niks3-server[954]: 2026/09/20 10:51:57 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst3823lb # [ 35.078115] niks3-server[954]: 2026/09/20 10:51:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign3824worker1 # [ 35.036800] nix-grpc-daemon[846]: time=2026-09-20T10:51:57.665Z level=INFO msg="Uploading 1 narinfos"3825lb # [ 35.091198] niks3-server[954]: 2026/09/20 10:51:57 INFO Signed narinfos id=5 count=13826lb # [ 35.096557] niks3-server[954]: 2026/09/20 10:51:57 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls3827worker1 # [ 35.056331] nix-grpc-daemon[846]: time=2026-09-20T10:51:57.685Z level=INFO msg="Upload complete. (479ms)"3828lb # [ 35.105543] niks3-server[954]: 2026/09/20 10:51:57 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete3829lb # [ 35.110556] niks3-server[954]: 2026/09/20 10:51:57 INFO Completed upload id=53830lb # [ 35.113672] niks3-server[954]: 2026/09/20 10:51:57 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo3831worker1 # [ 35.062387] nix-grpc-daemon[775]: ts=2026-09-20T10:51:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44022 duration_s=0 paths=1 nar_bytes_in=7523832worker1 # [ 35.076235] nix-grpc-daemon[775]: ts=2026-09-20T10:51:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:440223833worker1 # [ 35.082783] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3834worker1 # [ 35.087399] nix-daemon[833]: reaped child process 930, status = succeeded3835worker1 # [ 35.097762] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3836client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...3837client # farm-top> node-a: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3838client # farm-top> LOG-farm-top-t13839worker1 # [ 36.343071] nix-daemon[833]: reaped child process 944, status = succeeded3840worker1 # [ 36.526728] nix-daemon[833]: accepted connection from pid 960, user nix-grpc-daemon (trusted)3841worker1 # [ 36.545245] nix-daemon[833]: reaped child process 963, status = succeeded3842lb # [ 36.604591] niks3-server[954]: 2026/09/20 10:51:59 INFO Received uploads request method=POST path=/api/pending_closures3843worker1 # [ 36.568435] nix-grpc-daemon[846]: time=2026-09-20T10:51:59.195Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3844worker1 # [ 36.570087] nix-grpc-daemon[846]: time=2026-09-20T10:51:59.195Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"3845lb # [ 36.639590] niks3-server[954]: 2026/09/20 10:51:59 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3846lb # [ 36.655428] niks3-server[954]: 2026/09/20 10:51:59 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst3847worker1 # [ 36.622270] nix-grpc-daemon[846]: time=2026-09-20T10:51:59.250Z level=INFO msg="Uploading 1 narinfos"3848lb # [ 36.670002] niks3-server[954]: 2026/09/20 10:51:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign3849lb # [ 36.676332] niks3-server[954]: 2026/09/20 10:51:59 INFO Signed narinfos id=6 count=13850lb # [ 36.683463] niks3-server[954]: 2026/09/20 10:51:59 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls3851lb # [ 36.691470] niks3-server[954]: 2026/09/20 10:51:59 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete3852lb # [ 36.698263] niks3-server[954]: 2026/09/20 10:51:59 INFO Completed upload id=63853worker1 # [ 36.650375] nix-grpc-daemon[846]: time=2026-09-20T10:51:59.279Z level=INFO msg="Upload complete. (341ms)"3854lb # [ 36.700732] niks3-server[954]: 2026/09/20 10:51:59 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo3855worker1 # [ 36.665308] nix-grpc-daemon[775]: ts=2026-09-20T10:51:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44022 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=13856worker1 # [ 36.681226] nix-daemon[833]: reaped child process 942, status = succeeded3857client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 7.15 seconds)3858client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath3859client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.24 seconds)3860client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3861client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.03 seconds)3862client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3863client # copying 3 paths...3864client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...3865client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...3866client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...3867client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.31 seconds)3868(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 7.85 seconds)3869subtest: repeat is answered Cached by the scheduler without building3870worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3871worker1 # finding garbage collector roots...3872worker1 # deleting specified paths...3873worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'3874worker1 # deleting unused links...3875worker1 # note: hard linking is currently saving 0.0 KiB3876worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.28 seconds)3877worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3878worker2 # finding garbage collector roots...3879worker2 # deleting specified paths...3880worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'3881worker2 # deleting unused links...3882worker2 # note: hard linking is currently saving 0.0 KiB3883worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.30 seconds)3884client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&23885client # don't know how to build these paths:3886client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3887worker2 # [ 38.246033] nix-grpc-daemon[777]: ts=2026-09-20T10:52:00Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:513423888worker2 # [ 38.256527] nix-grpc-daemon[777]: ts=2026-09-20T10:52:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:513423889worker1 # [ 38.279421] nix-grpc-daemon[775]: ts=2026-09-20T10:52:00Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=13890client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.32 seconds)3891client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath3892client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.21 seconds)3893lb: must succeed: curl -sf localhost:9901/clusters3894lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)3895lb: must succeed: curl -sf localhost:9901/clusters3896lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)3897worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics3898worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)3899(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.43 seconds)3900subtest: inputs already in the cache are not sent to the scheduler3901lb: must succeed: curl -sf localhost:9901/clusters3902lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)3903lb: must succeed: curl -sf localhost:9901/clusters3904lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)3905worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true3906worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds)3907client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&23908worker1 # [ 39.279013] nix-grpc-daemon[775]: ts=2026-09-20T10:52:01Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:440223909client # don't know how to build these paths:3910client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv3911worker1 # [ 39.285045] nix-grpc-daemon[775]: ts=2026-09-20T10:52:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:440223912worker1 # [ 39.293223] nix-grpc-daemon[846]: time=2026-09-20T10:52:01.921Z level=INFO msg="All 2 paths already cached"3913worker1 # [ 39.305633] nix-grpc-daemon[775]: ts=2026-09-20T10:52:01Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=03914worker1 # [ 39.310875] nix-grpc-daemon[775]: ts=2026-09-20T10:52:01Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.3:50051 clients=13915worker1 # [ 39.353114] nix-grpc-daemon[775]: ts=2026-09-20T10:52:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:440223916worker1 # [ 39.368896] nix-grpc-daemon[775]: ts=2026-09-20T10:52:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:440223917worker1 # [ 39.383252] nix-grpc-daemon[846]: time=2026-09-20T10:52:02.011Z level=INFO msg="All 2 paths already cached"3918client # copying 1 paths to 'lb:50051'...3919client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'...3920worker1 # [ 39.393432] nix-grpc-daemon[775]: ts=2026-09-20T10:52:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:440223921worker1 # [ 39.407978] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3922worker1 # [ 39.605354] nix-daemon[833]: accepted connection from pid 993, user nix-grpc-daemon (trusted)3923worker1 # [ 39.625700] nix-daemon[833]: reaped child process 996, status = succeeded3924worker1 # [ 39.799403] nix-daemon[833]: accepted connection from pid 998, user nix-grpc-daemon (trusted)3925worker1 # [ 39.815354] nix-daemon[833]: reaped child process 1001, status = succeeded3926lb # [ 39.878833] niks3-server[954]: 2026/09/20 10:52:02 INFO Received uploads request method=POST path=/api/pending_closures3927worker1 # [ 39.844072] nix-grpc-daemon[846]: time=2026-09-20T10:52:02.472Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3928worker1 # [ 39.845563] nix-grpc-daemon[846]: time=2026-09-20T10:52:02.472Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)"3929lb # [ 39.912444] niks3-server[954]: 2026/09/20 10:52:02 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst3930worker1 # [ 39.876211] nix-grpc-daemon[846]: time=2026-09-20T10:52:02.504Z level=INFO msg="Uploading 1 narinfos"3931lb # [ 39.926482] niks3-server[954]: 2026/09/20 10:52:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign3932lb # [ 39.936184] niks3-server[954]: 2026/09/20 10:52:02 INFO Signed narinfos id=7 count=13933lb # [ 39.940675] niks3-server[954]: 2026/09/20 10:52:02 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls3934lb # [ 39.950925] niks3-server[954]: 2026/09/20 10:52:02 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete3935lb # [ 39.955767] niks3-server[954]: 2026/09/20 10:52:02 INFO Completed upload id=73936worker1 # [ 39.908402] nix-grpc-daemon[846]: time=2026-09-20T10:52:02.537Z level=INFO msg="Upload complete. (484ms)"3937lb # [ 39.958719] niks3-server[954]: 2026/09/20 10:52:02 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo3938worker1 # [ 39.915365] nix-grpc-daemon[775]: ts=2026-09-20T10:52:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44022 duration_s=0 paths=1 nar_bytes_in=7523939worker1 # [ 39.931588] nix-grpc-daemon[775]: ts=2026-09-20T10:52:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:440223940worker1 # [ 39.938677] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3941worker1 # [ 39.943817] nix-daemon[833]: reaped child process 991, status = succeeded3942client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051...3943client # farm-top> node-a: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv3944worker1 # [ 39.959386] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3945client # farm-top> LOG-farm-top-t1b3946worker1 # [ 40.806202] nix-daemon[833]: reaped child process 1005, status = succeeded3947worker1 # [ 40.993480] nix-daemon[833]: accepted connection from pid 1020, user nix-grpc-daemon (trusted)3948worker1 # [ 41.012654] nix-daemon[833]: reaped child process 1023, status = succeeded3949lb # [ 41.075734] niks3-server[954]: 2026/09/20 10:52:03 INFO Received uploads request method=POST path=/api/pending_closures3950worker1 # [ 41.040409] nix-grpc-daemon[846]: time=2026-09-20T10:52:03.667Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3951worker1 # [ 41.041954] nix-grpc-daemon[846]: time=2026-09-20T10:52:03.667Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)"3952lb # [ 41.119108] niks3-server[954]: 2026/09/20 10:52:03 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv3953worker1 # [ 41.083724] nix-grpc-daemon[846]: time=2026-09-20T10:52:03.712Z level=INFO msg="Uploading 1 narinfos"3954lb # [ 41.131135] niks3-server[954]: 2026/09/20 10:52:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign3955lb # [ 41.142729] niks3-server[954]: 2026/09/20 10:52:03 INFO Signed narinfos id=8 count=13956lb # [ 41.150912] niks3-server[954]: 2026/09/20 10:52:03 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls3957lb # [ 41.162135] niks3-server[954]: 2026/09/20 10:52:03 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst3958worker1 # [ 41.119546] nix-grpc-daemon[846]: time=2026-09-20T10:52:03.748Z level=INFO msg="Upload complete. (349ms)"3959lb # [ 41.167584] niks3-server[954]: 2026/09/20 10:52:03 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete3960lb # [ 41.171731] niks3-server[954]: 2026/09/20 10:52:03 INFO Completed upload id=83961lb # [ 41.173921] niks3-server[954]: 2026/09/20 10:52:03 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo3962worker1 # [ 41.137238] nix-grpc-daemon[775]: ts=2026-09-20T10:52:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44022 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=13963worker1 # [ 41.151543] nix-daemon[833]: reaped child process 1003, status = succeeded3964client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.14 seconds)3965client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath3966client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.24 seconds)3967lb: must succeed: curl -sf localhost:9901/clusters3968lb # [ 41.521344] envoy[924]: conn peer=[2001:db8:1::1]:33726 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9562 tx=3834 ms=68883969lb # [ 41.526901] envoy[924]: conn peer=[2001:db8:1::1]:43702 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=563970lb # [ 41.532726] envoy[924]: conn peer=[2001:db8:1::1]:43706 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4172 tx=1728 ms=18683971lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)3972lb: must succeed: curl -sf localhost:9901/clusters3973lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)3974worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true3975worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds)3976(finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.80 seconds)3977subtest: two clients wanting the same drv build it once3978client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup3979client # [ 41.775488] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.3980client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.10 seconds)3981client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup3982client # Running as unit: dedup1.service; invocation ID: 07649c1e20f64c12af745e785f0fbe643983client # [ 42.052697] nix[884]: don't know how to build these paths:3984client # [ 42.054822] nix[884]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv3985worker2 # [ 42.000948] nix-grpc-daemon[777]: ts=2026-09-20T10:52:04Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:513423986worker1 # [ 42.014505] nix-grpc-daemon[775]: ts=2026-09-20T10:52:04Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=03987worker1 # [ 42.014962] nix-grpc-daemon[775]: ts=2026-09-20T10:52:04Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=13988worker2 # [ 42.061483] nix-grpc-daemon[777]: ts=2026-09-20T10:52:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:513423989worker2 # [ 42.087339] nix-grpc-daemon[777]: ts=2026-09-20T10:52:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:513423990client # [ 42.152253] nix[884]: copying 1 paths to 'lb:50051'...3991client # [ 42.155532] nix[884]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...3992worker2 # [ 42.102844] nix-grpc-daemon[777]: ts=2026-09-20T10:52:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:513423993worker2 # [ 42.119587] nix-daemon[832]: accepted connection from pid 777, user nix-grpc-daemon (trusted)3994worker2 # [ 42.148551] nix-grpc-daemon[777]: ts=2026-09-20T10:52:04Z level=info event=niks3_push_started pid=8593995worker2 # [ 42.627689] nix-daemon[832]: accepted connection from pid 873, user nix-grpc-daemon (trusted)3996worker2 # [ 42.647562] nix-daemon[832]: reaped child process 876, status = succeeded3997worker2 # [ 42.827955] nix-daemon[832]: accepted connection from pid 878, user nix-grpc-daemon (trusted)3998worker2 # [ 42.845656] nix-daemon[832]: reaped child process 881, status = succeeded3999client # [ 42.883534] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4000lb # [ 42.907396] niks3-server[954]: 2026/09/20 10:52:05 INFO Received uploads request method=POST path=/api/pending_closures4001client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.12 seconds)4002worker2 # [ 42.873001] nix-grpc-daemon[859]: time=2026-09-20T10:52:05.506Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4003worker2 # [ 42.874634] nix-grpc-daemon[859]: time=2026-09-20T10:52:05.506Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4004lb # [ 42.947052] niks3-server[954]: 2026/09/20 10:52:05 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4005lb # [ 42.961161] niks3-server[954]: 2026/09/20 10:52:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4006worker2 # [ 42.920871] nix-grpc-daemon[859]: time=2026-09-20T10:52:05.555Z level=INFO msg="Uploading 1 narinfos"4007lb # [ 42.978658] niks3-server[954]: 2026/09/20 10:52:05 INFO Signed narinfos id=9 count=14008lb # [ 42.989223] niks3-server[954]: 2026/09/20 10:52:05 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4009worker2 # [ 42.958146] nix-grpc-daemon[859]: time=2026-09-20T10:52:05.593Z level=INFO msg="Upload complete. (519ms)"4010lb # [ 43.004749] niks3-server[954]: 2026/09/20 10:52:05 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4011lb # [ 43.016316] niks3-server[954]: 2026/09/20 10:52:05 INFO Completed upload id=94012lb # [ 43.018450] niks3-server[954]: 2026/09/20 10:52:05 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4013worker2 # [ 42.971234] nix-grpc-daemon[777]: ts=2026-09-20T10:52:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51342 duration_s=0 paths=1 nar_bytes_in=4324014worker2 # [ 42.982106] nix-grpc-daemon[777]: ts=2026-09-20T10:52:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:513424015worker2 # [ 42.998740] nix-daemon[832]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4016worker2 # [ 43.009553] nix-daemon[832]: reaped child process 857, status = succeeded4017client # Running as unit: dedup2.service; invocation ID: a0a3c7d26d8e4a2184b6e9450c2ed3ee4018client # [ 43.075017] nix[884]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4019worker2 # [ 43.028724] nix-daemon[832]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4020client # [ 43.200308] nix[901]: don't know how to build these paths:4021client # [ 43.202310] nix[901]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4022worker1 # [ 43.147595] nix-grpc-daemon[775]: ts=2026-09-20T10:52:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:440224023worker1 # [ 43.162736] nix-grpc-daemon[775]: ts=2026-09-20T10:52:05Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04024worker2 # [ 43.170929] nix-grpc-daemon[777]: ts=2026-09-20T10:52:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:513424025client # [ 43.230091] nix[901]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4026client: must succeed: sleep 24027client: (finished: must succeed: sleep 2, in 2.06 seconds)4028??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4029 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394030client: waiting for success: ! systemctl is-active dedup1 dedup24031??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4032 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394033worker2 # [ 47.663131] nix-daemon[832]: reaped child process 889, status = succeeded4034worker2 # [ 47.824854] nix-daemon[832]: accepted connection from pid 919, user nix-grpc-daemon (trusted)4035worker2 # [ 47.842959] nix-daemon[832]: reaped child process 922, status = succeeded4036lb # [ 47.904987] niks3-server[954]: 2026/09/20 10:52:10 INFO Received uploads request method=POST path=/api/pending_closures4037worker2 # [ 47.870284] nix-grpc-daemon[859]: time=2026-09-20T10:52:10.504Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4038worker2 # [ 47.872281] nix-grpc-daemon[859]: time=2026-09-20T10:52:10.504Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4039lb # [ 47.943157] niks3-server[954]: 2026/09/20 10:52:10 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4040lb # [ 47.965653] niks3-server[954]: 2026/09/20 10:52:10 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4041worker2 # [ 47.927639] nix-grpc-daemon[859]: time=2026-09-20T10:52:10.561Z level=INFO msg="Uploading 1 narinfos"4042lb # [ 47.976452] niks3-server[954]: 2026/09/20 10:52:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4043lb # [ 47.986257] niks3-server[954]: 2026/09/20 10:52:10 INFO Signed narinfos id=10 count=14044worker2 # [ 47.950297] nix-grpc-daemon[859]: time=2026-09-20T10:52:10.585Z level=INFO msg="Upload complete. (299ms)"4045lb # [ 47.997414] niks3-server[954]: 2026/09/20 10:52:10 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4046lb # [ 48.004998] niks3-server[954]: 2026/09/20 10:52:10 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4047lb # [ 48.010393] niks3-server[954]: 2026/09/20 10:52:10 INFO Completed upload id=104048worker2 # [ 47.960113] nix-grpc-daemon[777]: ts=2026-09-20T10:52:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51342 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14049lb # [ 48.013207] niks3-server[954]: 2026/09/20 10:52:10 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4050worker2 # [ 47.974802] nix-grpc-daemon[777]: ts=2026-09-20T10:52:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51342 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14051worker2 # [ 47.981327] nix-daemon[832]: reaped child process 886, status = succeeded4052client # [ 48.058999] systemd[1]: dedup1.service: Deactivated successfully.4053client # [ 48.066380] systemd[1]: dedup1.service: Consumed 153ms CPU time over 6.288s wall clock time, 37.2M memory peak, 8.4K incoming IP traffic, 9K outgoing IP traffic.4054client # [ 48.112666] systemd[1]: dedup2.service: Deactivated successfully.4055client # [ 48.116259] systemd[1]: dedup2.service: Consumed 182ms CPU time over 5.232s wall clock time, 31.1M memory peak, 7.4K incoming IP traffic, 6.4K outgoing IP traffic.4056client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.14 seconds)4057client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4058client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds)4059worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4060worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4061worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4062worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4063worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4064worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)4065worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4066worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)4067(finished: subtest: two clients wanting the same drv build it once, in 7.51 seconds)4068subtest: build hook: nix-daemon with builders = grpc://lb4069client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log4070client # [ 49.446331] systemd[1]: Started Nix Daemon.4071client # [ 49.642190] nix-daemon[944]: accepted connection from pid 941, user root (trusted)4072worker2 # [ 49.801271] nix-grpc-daemon[777]: ts=2026-09-20T10:52:12Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:513424073worker1 # [ 49.814335] nix-grpc-daemon[775]: ts=2026-09-20T10:52:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:440224074worker1 # [ 49.835544] nix-grpc-daemon[775]: ts=2026-09-20T10:52:12Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04075worker1 # [ 49.842991] nix-grpc-daemon[775]: ts=2026-09-20T10:52:12Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.3:50051 clients=14076worker1 # [ 49.881287] nix-grpc-daemon[775]: ts=2026-09-20T10:52:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:440224077worker1 # [ 49.897543] nix-grpc-daemon[775]: ts=2026-09-20T10:52:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:440224078worker1 # [ 49.913936] nix-grpc-daemon[775]: ts=2026-09-20T10:52:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:440224079worker1 # [ 49.933408] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4080worker1 # [ 50.148306] nix-daemon[833]: accepted connection from pid 1065, user nix-grpc-daemon (trusted)4081worker1 # [ 50.169336] nix-daemon[833]: reaped child process 1068, status = succeeded4082worker1 # [ 50.346214] nix-daemon[833]: accepted connection from pid 1070, user nix-grpc-daemon (trusted)4083worker1 # [ 50.364566] nix-daemon[833]: reaped child process 1073, status = succeeded4084lb # [ 50.424929] niks3-server[954]: 2026/09/20 10:52:13 INFO Received uploads request method=POST path=/api/pending_closures4085worker1 # [ 50.387679] nix-grpc-daemon[846]: time=2026-09-20T10:52:13.015Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4086worker1 # [ 50.389400] nix-grpc-daemon[846]: time=2026-09-20T10:52:13.015Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4087lb # [ 50.456099] niks3-server[954]: 2026/09/20 10:52:13 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4088worker1 # [ 50.426725] nix-grpc-daemon[846]: time=2026-09-20T10:52:13.055Z level=INFO msg="Uploading 1 narinfos"4089lb # [ 50.474673] niks3-server[954]: 2026/09/20 10:52:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4090lb # [ 50.481374] niks3-server[954]: 2026/09/20 10:52:13 INFO Signed narinfos id=11 count=14091lb # [ 50.493965] niks3-server[954]: 2026/09/20 10:52:13 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4092worker1 # [ 50.451130] nix-grpc-daemon[846]: time=2026-09-20T10:52:13.079Z level=INFO msg="Upload complete. (500ms)"4093lb # [ 50.500966] niks3-server[954]: 2026/09/20 10:52:13 INFO Completed upload id=114094lb # [ 50.504653] niks3-server[954]: 2026/09/20 10:52:13 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4095lb # [ 50.509010] niks3-server[954]: 2026/09/20 10:52:13 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4096worker1 # [ 50.460304] nix-grpc-daemon[775]: ts=2026-09-20T10:52:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44022 duration_s=0 paths=1 nar_bytes_in=5124097worker1 # [ 50.471726] nix-grpc-daemon[775]: ts=2026-09-20T10:52:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:440224098worker1 # [ 50.479013] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4099worker1 # [ 50.483709] nix-daemon[833]: reaped child process 1063, status = succeeded4100worker1 # [ 50.497798] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4101lb # [ 51.517720] envoy[924]: conn peer=[2001:db8:1::1]:57180 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2962 tx=1357 ms=59824102lb # [ 51.518059] envoy[924]: conn peer=[2001:db8:1::1]:57194 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1430 tx=1085 ms=48884103worker1 # [ 52.144629] nix-daemon[833]: reaped child process 1077, status = succeeded4104worker1 # [ 52.324986] nix-daemon[833]: accepted connection from pid 1092, user nix-grpc-daemon (trusted)4105worker1 # [ 52.343144] nix-daemon[833]: reaped child process 1095, status = succeeded4106lb # [ 52.403368] niks3-server[954]: 2026/09/20 10:52:15 INFO Received uploads request method=POST path=/api/pending_closures4107worker1 # [ 52.368666] nix-grpc-daemon[846]: time=2026-09-20T10:52:14.994Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4108worker1 # [ 52.370788] nix-grpc-daemon[846]: time=2026-09-20T10:52:14.994Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4109lb # [ 52.456498] niks3-server[954]: 2026/09/20 10:52:15 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4110lb # [ 52.467095] niks3-server[954]: 2026/09/20 10:52:15 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4111worker1 # [ 52.427168] nix-grpc-daemon[846]: time=2026-09-20T10:52:15.055Z level=INFO msg="Uploading 1 narinfos"4112lb # [ 52.476841] niks3-server[954]: 2026/09/20 10:52:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4113lb # [ 52.487088] niks3-server[954]: 2026/09/20 10:52:15 INFO Signed narinfos id=12 count=14114lb # [ 52.495696] niks3-server[954]: 2026/09/20 10:52:15 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4115lb # [ 52.501984] niks3-server[954]: 2026/09/20 10:52:15 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4116lb # [ 52.506109] niks3-server[954]: 2026/09/20 10:52:15 INFO Completed upload id=124117lb # [ 52.509363] niks3-server[954]: 2026/09/20 10:52:15 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4118worker1 # [ 52.454149] nix-grpc-daemon[846]: time=2026-09-20T10:52:15.082Z level=INFO msg="Upload complete. (345ms)"4119worker1 # [ 52.467692] nix-grpc-daemon[775]: ts=2026-09-20T10:52:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44022 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=14120worker2 # [ 52.473801] nix-grpc-daemon[777]: ts=2026-09-20T10:52:15Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:513424121worker1 # [ 52.487409] nix-daemon[833]: reaped child process 1075, status = succeeded4122worker2 # [ 52.489982] nix-grpc-daemon[777]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4123worker1 # [ 52.534792] nix-grpc-daemon[775]: ts=2026-09-20T10:52:15Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:440224124worker1 # [ 52.542913] nix-grpc-daemon[775]: ts=2026-09-20T10:52:15Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:44022 duration_s=0 paths=1 nar_bytes_out=1284125worker1 # [ 52.856468] nix-grpc-daemon[775]: ts=2026-09-20T10:52:15Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:440224126worker1 # [ 52.863961] nix-grpc-daemon[775]: ts=2026-09-20T10:52:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:440224127worker1 # [ 52.870479] nix-grpc-daemon[846]: time=2026-09-20T10:52:15.498Z level=INFO msg="All 1 paths already cached"4128worker1 # [ 52.883432] nix-grpc-daemon[775]: ts=2026-09-20T10:52:15Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04129worker1 # [ 52.890586] nix-grpc-daemon[775]: ts=2026-09-20T10:52:15Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.3:50051 clients=14130worker1 # [ 52.899120] nix-grpc-daemon[775]: ts=2026-09-20T10:52:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:440224131worker1 # [ 52.910360] nix-grpc-daemon[775]: ts=2026-09-20T10:52:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:440224132worker1 # [ 52.926494] nix-grpc-daemon[846]: time=2026-09-20T10:52:15.555Z level=INFO msg="All 1 paths already cached"4133worker1 # [ 52.935782] nix-grpc-daemon[775]: ts=2026-09-20T10:52:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:440224134worker1 # [ 52.949775] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4135worker1 # [ 53.153934] nix-daemon[833]: accepted connection from pid 1101, user nix-grpc-daemon (trusted)4136worker1 # [ 53.174241] nix-daemon[833]: reaped child process 1104, status = succeeded4137worker1 # [ 53.350039] nix-daemon[833]: accepted connection from pid 1106, user nix-grpc-daemon (trusted)4138worker1 # [ 53.367190] nix-daemon[833]: reaped child process 1109, status = succeeded4139lb # [ 53.427496] niks3-server[954]: 2026/09/20 10:52:16 INFO Received uploads request method=POST path=/api/pending_closures4140worker1 # [ 53.392389] nix-grpc-daemon[846]: time=2026-09-20T10:52:16.020Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4141worker1 # [ 53.393896] nix-grpc-daemon[846]: time=2026-09-20T10:52:16.020Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4142lb # [ 53.465635] niks3-server[954]: 2026/09/20 10:52:16 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4143worker1 # [ 53.426388] nix-grpc-daemon[846]: time=2026-09-20T10:52:16.054Z level=INFO msg="Uploading 1 narinfos"4144lb # [ 53.477558] niks3-server[954]: 2026/09/20 10:52:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4145lb # [ 53.487575] niks3-server[954]: 2026/09/20 10:52:16 INFO Signed narinfos id=13 count=14146lb # [ 53.491575] niks3-server[954]: 2026/09/20 10:52:16 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4147lb # [ 53.502447] niks3-server[954]: 2026/09/20 10:52:16 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4148worker1 # [ 53.460407] nix-grpc-daemon[846]: time=2026-09-20T10:52:16.089Z level=INFO msg="Upload complete. (494ms)"4149lb # [ 53.507928] niks3-server[954]: 2026/09/20 10:52:16 INFO Completed upload id=134150lb # [ 53.510919] niks3-server[954]: 2026/09/20 10:52:16 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4151worker1 # [ 53.468704] nix-grpc-daemon[775]: ts=2026-09-20T10:52:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44022 duration_s=0 paths=1 nar_bytes_in=6244152worker1 # [ 53.479972] nix-grpc-daemon[775]: ts=2026-09-20T10:52:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:440224153worker1 # [ 53.486341] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4154worker1 # [ 53.491604] nix-daemon[833]: reaped child process 1099, status = succeeded4155worker1 # [ 53.504248] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4156worker1 # [ 54.948741] nix-daemon[833]: reaped child process 1113, status = succeeded4157worker1 # [ 55.136648] nix-daemon[833]: accepted connection from pid 1128, user nix-grpc-daemon (trusted)4158worker1 # [ 55.154067] nix-daemon[833]: reaped child process 1131, status = succeeded4159lb # [ 55.215196] niks3-server[954]: 2026/09/20 10:52:17 INFO Received uploads request method=POST path=/api/pending_closures4160worker1 # [ 55.178290] nix-grpc-daemon[846]: time=2026-09-20T10:52:17.806Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4161worker1 # [ 55.179753] nix-grpc-daemon[846]: time=2026-09-20T10:52:17.806Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4162lb # [ 55.253567] niks3-server[954]: 2026/09/20 10:52:17 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4163lb # [ 55.266878] niks3-server[954]: 2026/09/20 10:52:17 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4164lb # [ 55.277746] niks3-server[954]: 2026/09/20 10:52:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4165worker1 # [ 55.237986] nix-grpc-daemon[846]: time=2026-09-20T10:52:17.866Z level=INFO msg="Uploading 1 narinfos"4166lb # [ 55.285221] niks3-server[954]: 2026/09/20 10:52:17 INFO Signed narinfos id=14 count=14167lb # [ 55.293531] niks3-server[954]: 2026/09/20 10:52:17 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4168lb # [ 55.304343] niks3-server[954]: 2026/09/20 10:52:17 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4169lb # [ 55.311481] niks3-server[954]: 2026/09/20 10:52:17 INFO Completed upload id=144170worker1 # [ 55.264201] nix-grpc-daemon[846]: time=2026-09-20T10:52:17.892Z level=INFO msg="Upload complete. (349ms)"4171lb # [ 55.314651] niks3-server[954]: 2026/09/20 10:52:17 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4172worker1 # [ 55.277356] nix-grpc-daemon[775]: ts=2026-09-20T10:52:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44022 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=14173worker2 # [ 55.282689] nix-grpc-daemon[777]: ts=2026-09-20T10:52:17Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:513424174worker1 # [ 55.296648] nix-daemon[833]: reaped child process 1111, status = succeeded4175worker2 # [ 55.296194] nix-grpc-daemon[777]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4176worker1 # [ 55.340138] nix-grpc-daemon[775]: ts=2026-09-20T10:52:17Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:440224177worker1 # [ 55.346727] nix-grpc-daemon[775]: ts=2026-09-20T10:52:17Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:44022 duration_s=0 paths=1 nar_bytes_out=1764178worker1 # [ 55.663319] nix-grpc-daemon[775]: ts=2026-09-20T10:52:18Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:440224179worker1 # [ 55.671044] nix-grpc-daemon[775]: ts=2026-09-20T10:52:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:440224180worker1 # [ 55.677919] nix-grpc-daemon[846]: time=2026-09-20T10:52:18.305Z level=INFO msg="All 2 paths already cached"4181worker1 # [ 55.691988] nix-grpc-daemon[775]: ts=2026-09-20T10:52:18Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04182worker1 # [ 55.700959] nix-grpc-daemon[775]: ts=2026-09-20T10:52:18Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.3:50051 clients=14183worker1 # [ 55.709664] nix-grpc-daemon[775]: ts=2026-09-20T10:52:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:440224184worker1 # [ 55.717563] nix-grpc-daemon[775]: ts=2026-09-20T10:52:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:440224185worker1 # [ 55.728236] nix-grpc-daemon[846]: time=2026-09-20T10:52:18.356Z level=INFO msg="All 2 paths already cached"4186worker1 # [ 55.738183] nix-grpc-daemon[775]: ts=2026-09-20T10:52:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:440224187worker1 # [ 55.752123] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4188worker1 # [ 55.951151] nix-daemon[833]: accepted connection from pid 1137, user nix-grpc-daemon (trusted)4189worker1 # [ 55.972878] nix-daemon[833]: reaped child process 1140, status = succeeded4190worker1 # [ 56.151830] nix-daemon[833]: accepted connection from pid 1142, user nix-grpc-daemon (trusted)4191worker1 # [ 56.170437] nix-daemon[833]: reaped child process 1145, status = succeeded4192lb # [ 56.230479] niks3-server[954]: 2026/09/20 10:52:18 INFO Received uploads request method=POST path=/api/pending_closures4193worker1 # [ 56.194245] nix-grpc-daemon[846]: time=2026-09-20T10:52:18.822Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4194worker1 # [ 56.195748] nix-grpc-daemon[846]: time=2026-09-20T10:52:18.822Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4195lb # [ 56.264930] niks3-server[954]: 2026/09/20 10:52:18 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4196lb # [ 56.283056] niks3-server[954]: 2026/09/20 10:52:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4197worker1 # [ 56.240481] nix-grpc-daemon[846]: time=2026-09-20T10:52:18.868Z level=INFO msg="Uploading 1 narinfos"4198lb # [ 56.294251] niks3-server[954]: 2026/09/20 10:52:18 INFO Signed narinfos id=15 count=14199lb # [ 56.299943] niks3-server[954]: 2026/09/20 10:52:18 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4200lb # [ 56.312427] niks3-server[954]: 2026/09/20 10:52:18 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4201lb # [ 56.320110] niks3-server[954]: 2026/09/20 10:52:18 INFO Completed upload id=154202worker1 # [ 56.271933] nix-grpc-daemon[846]: time=2026-09-20T10:52:18.900Z level=INFO msg="Upload complete. (502ms)"4203lb # [ 56.323687] niks3-server[954]: 2026/09/20 10:52:18 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4204worker1 # [ 56.280926] nix-grpc-daemon[775]: ts=2026-09-20T10:52:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44022 duration_s=0 paths=1 nar_bytes_in=7524205worker1 # [ 56.298648] nix-grpc-daemon[775]: ts=2026-09-20T10:52:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:440224206worker1 # [ 56.308607] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4207worker1 # [ 56.311811] nix-daemon[833]: reaped child process 1135, status = succeeded4208worker1 # [ 56.325079] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4209worker1 # [ 57.371928] nix-daemon[833]: reaped child process 1149, status = succeeded4210worker1 # [ 57.552137] nix-daemon[833]: accepted connection from pid 1164, user nix-grpc-daemon (trusted)4211worker1 # [ 57.569570] nix-daemon[833]: reaped child process 1167, status = succeeded4212lb # [ 57.633590] niks3-server[954]: 2026/09/20 10:52:20 INFO Received uploads request method=POST path=/api/pending_closures4213worker1 # [ 57.596393] nix-grpc-daemon[846]: time=2026-09-20T10:52:20.223Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4214worker1 # [ 57.597905] nix-grpc-daemon[846]: time=2026-09-20T10:52:20.223Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4215lb # [ 57.675668] niks3-server[954]: 2026/09/20 10:52:20 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4216lb # [ 57.688820] niks3-server[954]: 2026/09/20 10:52:20 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4217worker1 # [ 57.653139] nix-grpc-daemon[846]: time=2026-09-20T10:52:20.281Z level=INFO msg="Uploading 1 narinfos"4218lb # [ 57.701890] niks3-server[954]: 2026/09/20 10:52:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4219lb # [ 57.709986] niks3-server[954]: 2026/09/20 10:52:20 INFO Signed narinfos id=16 count=14220lb # [ 57.714124] niks3-server[954]: 2026/09/20 10:52:20 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4221lb # [ 57.723155] niks3-server[954]: 2026/09/20 10:52:20 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4222lb # [ 57.728992] niks3-server[954]: 2026/09/20 10:52:20 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4223worker1 # [ 57.681548] nix-grpc-daemon[846]: time=2026-09-20T10:52:20.310Z level=INFO msg="Upload complete. (342ms)"4224lb # [ 57.732486] niks3-server[954]: 2026/09/20 10:52:20 INFO Completed upload id=164225worker2 # [ 57.697981] nix-grpc-daemon[777]: ts=2026-09-20T10:52:20Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:513424226worker1 # [ 57.697449] nix-grpc-daemon[775]: ts=2026-09-20T10:52:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44022 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=14227worker1 # [ 57.711692] nix-daemon[833]: reaped child process 1147, status = succeeded4228worker2 # [ 57.712362] nix-grpc-daemon[777]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...4229worker1 # [ 57.754538] nix-grpc-daemon[775]: ts=2026-09-20T10:52:20Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:440224230worker1 # [ 57.761508] nix-grpc-daemon[775]: ts=2026-09-20T10:52:20Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:44022 duration_s=0 paths=1 nar_bytes_out=2324231client # [ 57.903384] nix-daemon[944]: reaped child process 946, status = succeeded4232client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.72 seconds)4233client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4234client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds)4235client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4236client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds)4237client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4238client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.04 seconds)4239(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 8.85 seconds)4240subtest: an input only one worker has still reaches the builder4241client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4242client # this derivation will be built:4243client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4244client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4245client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.44 seconds)4246client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4247client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.20 seconds)4248worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4249worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.25 seconds)4250worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4251worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds)4252client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24253client # [ 59.222858] nix-daemon[944]: accepted connection from pid 1027, user root (trusted)4254client # this derivation will be built:4255client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4256client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4257worker1 # [ 59.372312] nix-grpc-daemon[775]: ts=2026-09-20T10:52:21Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:440224258worker2 # [ 59.376892] nix-grpc-daemon[777]: ts=2026-09-20T10:52:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:513424259client # copying 1 paths...4260client # copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' to 'grpc://lb:50051'...4261worker2 # [ 59.393635] nix-grpc-daemon[777]: ts=2026-09-20T10:52:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:513424262worker2 # [ 59.409675] nix-daemon[832]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4263worker2 # [ 59.634844] nix-daemon[832]: accepted connection from pid 941, user nix-grpc-daemon (trusted)4264worker2 # [ 59.655714] nix-daemon[832]: reaped child process 944, status = succeeded4265lb # [ 59.715528] niks3-server[954]: 2026/09/20 10:52:22 INFO Received uploads request method=POST path=/api/pending_closures4266worker2 # [ 59.679095] nix-grpc-daemon[859]: time=2026-09-20T10:52:22.314Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4267worker2 # [ 59.680887] nix-grpc-daemon[859]: time=2026-09-20T10:52:22.314Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4268lb # [ 59.742615] niks3-server[954]: 2026/09/20 10:52:22 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4269lb # [ 59.759110] niks3-server[954]: 2026/09/20 10:52:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4270worker2 # [ 59.717989] nix-grpc-daemon[859]: time=2026-09-20T10:52:22.353Z level=INFO msg="Uploading 1 narinfos"4271lb # [ 59.771676] niks3-server[954]: 2026/09/20 10:52:22 INFO Signed narinfos id=17 count=14272lb # [ 59.777624] niks3-server[954]: 2026/09/20 10:52:22 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4273worker2 # [ 59.741055] nix-grpc-daemon[859]: time=2026-09-20T10:52:22.376Z level=INFO msg="Upload complete. (314ms)"4274lb # [ 59.788778] niks3-server[954]: 2026/09/20 10:52:22 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4275lb # [ 59.794150] niks3-server[954]: 2026/09/20 10:52:22 INFO Completed upload id=174276worker2 # [ 59.748141] nix-grpc-daemon[777]: ts=2026-09-20T10:52:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51342 duration_s=0 paths=1 nar_bytes_in=1204277lb # [ 59.797654] niks3-server[954]: 2026/09/20 10:52:22 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4278worker2 # [ 59.762344] nix-daemon[832]: reaped child process 939, status = succeeded4279worker1 # [ 59.763391] nix-grpc-daemon[775]: ts=2026-09-20T10:52:22Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04280worker1 # [ 59.770501] nix-grpc-daemon[775]: ts=2026-09-20T10:52:22Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=14281worker2 # [ 59.808860] nix-grpc-daemon[777]: ts=2026-09-20T10:52:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:513424282worker2 # [ 59.824672] nix-grpc-daemon[777]: ts=2026-09-20T10:52:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:513424283client # copying 2 paths to 'lb:50051'...4284client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4285worker2 # [ 59.841703] nix-grpc-daemon[777]: ts=2026-09-20T10:52:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:513424286client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4287worker2 # [ 59.856878] nix-daemon[832]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4288worker2 # [ 60.064314] nix-daemon[832]: accepted connection from pid 948, user nix-grpc-daemon (trusted)4289worker2 # [ 60.082772] nix-daemon[832]: reaped child process 951, status = succeeded4290worker2 # [ 60.255256] nix-daemon[832]: accepted connection from pid 953, user nix-grpc-daemon (trusted)4291worker2 # [ 60.271273] nix-daemon[832]: reaped child process 956, status = succeeded4292lb # [ 60.333444] niks3-server[954]: 2026/09/20 10:52:22 INFO Received uploads request method=POST path=/api/pending_closures4293lb # [ 60.342926] niks3-server[954]: 2026/09/20 10:52:22 INFO Received uploads request method=POST path=/api/pending_closures4294worker2 # [ 60.305396] nix-grpc-daemon[859]: time=2026-09-20T10:52:22.940Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4295worker2 # [ 60.306940] nix-grpc-daemon[859]: time=2026-09-20T10:52:22.940Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4296worker2 # [ 60.308794] nix-grpc-daemon[859]: time=2026-09-20T10:52:22.940Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4297lb # [ 60.380996] niks3-server[954]: 2026/09/20 10:52:23 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4298lb # [ 60.394510] niks3-server[954]: 2026/09/20 10:52:23 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4299lb # [ 60.407640] niks3-server[954]: 2026/09/20 10:52:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4300worker2 # [ 60.365339] nix-grpc-daemon[859]: time=2026-09-20T10:52:22.999Z level=INFO msg="Uploading 3 narinfos"4301lb # [ 60.414736] niks3-server[954]: 2026/09/20 10:52:23 INFO Signed narinfos id=18 count=14302lb # [ 60.419121] niks3-server[954]: 2026/09/20 10:52:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4303lb # [ 60.424773] niks3-server[954]: 2026/09/20 10:52:23 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4304lb # [ 60.427141] niks3-server[954]: 2026/09/20 10:52:23 INFO Signed narinfos id=19 count=24305lb # [ 60.432969] niks3-server[954]: 2026/09/20 10:52:23 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4306lb # [ 60.439086] niks3-server[954]: 2026/09/20 10:52:23 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4307lb # [ 60.443361] niks3-server[954]: 2026/09/20 10:52:23 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4308lb # [ 60.448794] niks3-server[954]: 2026/09/20 10:52:23 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4309lb # [ 60.453751] niks3-server[954]: 2026/09/20 10:52:23 INFO Completed upload id=184310lb # [ 60.455967] niks3-server[954]: 2026/09/20 10:52:23 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4311worker2 # [ 60.409060] nix-grpc-daemon[859]: time=2026-09-20T10:52:23.044Z level=INFO msg="Upload complete. (532ms)"4312lb # [ 60.458914] niks3-server[954]: 2026/09/20 10:52:23 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4313lb # [ 60.462400] niks3-server[954]: 2026/09/20 10:52:23 INFO Completed upload id=194314worker2 # [ 60.421346] nix-grpc-daemon[777]: ts=2026-09-20T10:52:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51342 duration_s=0 paths=2 nar_bytes_in=9844315worker2 # [ 60.436668] nix-grpc-daemon[777]: ts=2026-09-20T10:52:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:513424316worker2 # [ 60.448533] nix-daemon[832]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4317worker2 # [ 60.452811] nix-daemon[832]: reaped child process 946, status = succeeded4318client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4319client # uses-input-w1onlya> worker2: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4320worker2 # [ 60.467633] nix-daemon[832]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4321lb # [ 61.521233] envoy[924]: conn peer=[2001:db8:1::1]:57202 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3404 tx=1775 ms=28024322lb # [ 61.526918] envoy[924]: conn peer=[2001:db8:1::1]:50432 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=333 ms=704323lb # [ 61.531990] envoy[924]: conn peer=[2001:db8:1::1]:50448 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3888 tx=1989 ms=25494324lb # [ 61.537656] envoy[924]: conn peer=[2001:db8:1::1]:50450 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=375 ms=714325lb # [ 61.544900] envoy[924]: conn peer=[2001:db8:1::1]:50452 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4339 tx=2199 ms=21164326lb # [ 61.550841] envoy[924]: conn peer=[2001:db8:1::1]:50464 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=412 tx=406 ms=304327worker2 # [ 61.917460] nix-daemon[832]: reaped child process 960, status = succeeded4328worker2 # [ 62.103203] nix-daemon[832]: accepted connection from pid 975, user nix-grpc-daemon (trusted)4329worker2 # [ 62.121300] nix-daemon[832]: reaped child process 978, status = succeeded4330lb # [ 62.181336] niks3-server[954]: 2026/09/20 10:52:24 INFO Received uploads request method=POST path=/api/pending_closures4331worker2 # [ 62.144419] nix-grpc-daemon[859]: time=2026-09-20T10:52:24.779Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4332lb # [ 62.215385] niks3-server[954]: 2026/09/20 10:52:24 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4333lb # [ 62.227470] niks3-server[954]: 2026/09/20 10:52:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4334worker2 # [ 62.186072] nix-grpc-daemon[859]: time=2026-09-20T10:52:24.821Z level=INFO msg="Uploading 1 narinfos"4335lb # [ 62.237015] niks3-server[954]: 2026/09/20 10:52:24 INFO Signed narinfos id=20 count=14336lb # [ 62.239520] niks3-server[954]: 2026/09/20 10:52:24 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4337lb # [ 62.249826] niks3-server[954]: 2026/09/20 10:52:24 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4338lb # [ 62.254938] niks3-server[954]: 2026/09/20 10:52:24 INFO Completed upload id=204339worker2 # [ 62.207782] nix-grpc-daemon[859]: time=2026-09-20T10:52:24.843Z level=WARN msg="Failed to register uploaded object" key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo error="server returned 404: object is not pending upload\n"4340worker2 # [ 62.224591] nix-grpc-daemon[859]: time=2026-09-20T10:52:24.843Z level=INFO msg="Upload complete. (327ms)"4341worker2 # [ 62.234207] nix-grpc-daemon[777]: ts=2026-09-20T10:52:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51342 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=14342worker2 # [ 62.240954] nix-daemon[832]: reaped child process 958, status = succeeded4343client # copying 1 paths...4344worker1 # [ 62.269276] nix-grpc-daemon[775]: ts=2026-09-20T10:52:24Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:440224345worker1 # [ 62.285602] nix-grpc-daemon[775]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'...4346client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4347worker1 # [ 62.338937] nix-grpc-daemon[775]: ts=2026-09-20T10:52:24Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:440224348worker1 # [ 62.344405] nix-grpc-daemon[775]: ts=2026-09-20T10:52:24Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:44022 duration_s=0 paths=1 nar_bytes_out=1204349client # [ 62.518535] nix-daemon[944]: reaped child process 1030, status = succeeded4350client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.55 seconds)4351client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24352client # [ 62.747733] nix-daemon[944]: accepted connection from pid 1049, user root (trusted)4353client # this derivation will be built:4354client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4355worker1 # [ 62.894491] nix-grpc-daemon[775]: ts=2026-09-20T10:52:25Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:440224356client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4357worker2 # [ 62.899688] nix-grpc-daemon[777]: ts=2026-09-20T10:52:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:513424358worker2 # [ 62.910297] nix-grpc-daemon[859]: time=2026-09-20T10:52:25.545Z level=INFO msg="All 1 paths already cached"4359worker1 # [ 62.926827] nix-grpc-daemon[775]: ts=2026-09-20T10:52:25Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04360worker1 # [ 62.936962] nix-grpc-daemon[775]: ts=2026-09-20T10:52:25Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=14361worker1 # [ 62.946164] nix-grpc-daemon[775]: ts=2026-09-20T10:52:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:440224362worker1 # [ 62.954128] nix-grpc-daemon[775]: ts=2026-09-20T10:52:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:440224363client # copying 1 paths to 'lb:50051'...4364client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4365worker1 # [ 62.967264] nix-grpc-daemon[775]: ts=2026-09-20T10:52:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:440224366worker1 # [ 62.983005] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4367worker1 # [ 63.005443] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 26 ms (attempt 1/5)4368worker1 # [ 63.037326] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 125 ms (attempt 2/5)4369worker1 # [ 63.170124] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 243 ms (attempt 3/5)4370worker1 # [ 63.422015] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 218 ms (attempt 4/5)4371worker1 # [ 63.640076] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4372worker1 # [ 63.649913] nix-grpc-daemon[775]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4373worker1 # [ 63.888673] nix-daemon[833]: accepted connection from pid 1185, user nix-grpc-daemon (trusted)4374worker1 # [ 63.907293] nix-daemon[833]: reaped child process 1188, status = succeeded4375worker1 # [ 64.081176] nix-daemon[833]: accepted connection from pid 1190, user nix-grpc-daemon (trusted)4376worker1 # [ 64.097485] nix-daemon[833]: reaped child process 1193, status = succeeded4377lb # [ 64.157626] niks3-server[954]: 2026/09/20 10:52:26 INFO Received uploads request method=POST path=/api/pending_closures4378worker1 # [ 64.120935] nix-grpc-daemon[846]: time=2026-09-20T10:52:26.749Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4379worker1 # [ 64.122391] nix-grpc-daemon[846]: time=2026-09-20T10:52:26.749Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4380lb # [ 64.187100] niks3-server[954]: 2026/09/20 10:52:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4381worker1 # [ 64.150129] nix-grpc-daemon[846]: time=2026-09-20T10:52:26.778Z level=INFO msg="Uploading 1 narinfos"4382lb # [ 64.202259] niks3-server[954]: 2026/09/20 10:52:26 INFO Signed narinfos id=21 count=14383lb # [ 64.210953] niks3-server[954]: 2026/09/20 10:52:26 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4384lb # [ 64.219628] niks3-server[954]: 2026/09/20 10:52:26 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4385lb # [ 64.230719] niks3-server[954]: 2026/09/20 10:52:26 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4386worker1 # [ 64.189696] nix-grpc-daemon[846]: time=2026-09-20T10:52:26.818Z level=INFO msg="Upload complete. (507ms)"4387lb # [ 64.237151] niks3-server[954]: 2026/09/20 10:52:26 INFO Completed upload id=214388lb # [ 64.240301] niks3-server[954]: 2026/09/20 10:52:26 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4389worker1 # [ 64.196129] nix-grpc-daemon[775]: ts=2026-09-20T10:52:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44022 duration_s=1 paths=1 nar_bytes_in=5684390worker1 # [ 64.204981] nix-grpc-daemon[775]: ts=2026-09-20T10:52:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:440224391worker1 # [ 64.216361] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4392worker1 # [ 64.221030] nix-daemon[833]: reaped child process 1179, status = succeeded4393client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4394worker1 # [ 64.234725] nix-daemon[833]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4395client # uses-input-w1onlyb> node-a: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4396worker1 # [ 65.077730] nix-daemon[833]: reaped child process 1197, status = succeeded4397worker1 # [ 65.259461] nix-daemon[833]: accepted connection from pid 1212, user nix-grpc-daemon (trusted)4398worker1 # [ 65.278232] nix-daemon[833]: reaped child process 1215, status = succeeded4399lb # [ 65.338264] niks3-server[954]: 2026/09/20 10:52:27 INFO Received uploads request method=POST path=/api/pending_closures4400worker1 # [ 65.301412] nix-grpc-daemon[846]: time=2026-09-20T10:52:27.929Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4401lb # [ 65.364990] niks3-server[954]: 2026/09/20 10:52:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4402worker1 # [ 65.326065] nix-grpc-daemon[846]: time=2026-09-20T10:52:27.954Z level=INFO msg="Uploading 1 narinfos"4403lb # [ 65.378288] niks3-server[954]: 2026/09/20 10:52:28 INFO Signed narinfos id=22 count=14404lb # [ 65.385787] niks3-server[954]: 2026/09/20 10:52:28 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4405worker1 # [ 65.353431] nix-grpc-daemon[846]: time=2026-09-20T10:52:27.982Z level=INFO msg="Upload complete. (308ms)"4406lb # [ 65.400960] niks3-server[954]: 2026/09/20 10:52:28 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4407lb # [ 65.405773] niks3-server[954]: 2026/09/20 10:52:28 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4408lb # [ 65.410322] niks3-server[954]: 2026/09/20 10:52:28 INFO Completed upload id=224409client # copying 1 paths...4410lb # [ 65.413135] niks3-server[954]: 2026/09/20 10:52:28 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4411worker1 # [ 65.363679] nix-grpc-daemon[775]: ts=2026-09-20T10:52:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44022 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=14412client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4413worker1 # [ 65.377998] nix-grpc-daemon[775]: ts=2026-09-20T10:52:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:440224414worker1 # [ 65.381664] nix-daemon[833]: reaped child process 1195, status = succeeded4415worker2 # [ 65.401714] nix-grpc-daemon[777]: ts=2026-09-20T10:52:28Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:513424416worker2 # [ 65.415155] nix-grpc-daemon[777]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'...4417worker2 # [ 65.434024] nix-grpc-daemon[777]: ts=2026-09-20T10:52:28Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:51342 duration_s=0 paths=1 nar_bytes_out=1204418client # [ 65.618091] nix-daemon[944]: reaped child process 1052, status = succeeded4419client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.09 seconds)4420client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24421client # [ 65.834006] nix-daemon[944]: accepted connection from pid 1071, user root (trusted)4422client # this derivation will be built:4423client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4424worker1 # [ 65.994190] nix-grpc-daemon[775]: ts=2026-09-20T10:52:28Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:440224425client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4426worker2 # [ 66.007778] nix-grpc-daemon[777]: ts=2026-09-20T10:52:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:513424427worker2 # [ 66.020800] nix-grpc-daemon[859]: time=2026-09-20T10:52:28.655Z level=INFO msg="All 1 paths already cached"4428worker1 # [ 66.042012] nix-grpc-daemon[775]: ts=2026-09-20T10:52:28Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04429worker1 # [ 66.049189] nix-grpc-daemon[775]: ts=2026-09-20T10:52:28Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=14430worker2 # [ 66.092115] nix-grpc-daemon[777]: ts=2026-09-20T10:52:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:513424431worker2 # [ 66.114745] nix-grpc-daemon[777]: ts=2026-09-20T10:52:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:513424432worker2 # [ 66.133603] nix-grpc-daemon[859]: time=2026-09-20T10:52:28.768Z level=INFO msg="All 1 paths already cached"4433client # copying 1 paths to 'lb:50051'...4434client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4435worker2 # [ 66.148812] nix-grpc-daemon[777]: ts=2026-09-20T10:52:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:513424436worker2 # [ 66.165216] nix-daemon[832]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4437worker2 # [ 66.394579] nix-daemon[832]: accepted connection from pid 983, user nix-grpc-daemon (trusted)4438worker2 # [ 66.419170] nix-daemon[832]: reaped child process 986, status = succeeded4439worker2 # [ 66.622078] nix-daemon[832]: accepted connection from pid 988, user nix-grpc-daemon (trusted)4440worker2 # [ 66.642754] nix-daemon[832]: reaped child process 991, status = succeeded4441lb # [ 66.706239] niks3-server[954]: 2026/09/20 10:52:29 INFO Received uploads request method=POST path=/api/pending_closures4442worker2 # [ 66.674460] nix-grpc-daemon[859]: time=2026-09-20T10:52:29.309Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4443worker2 # [ 66.676058] nix-grpc-daemon[859]: time=2026-09-20T10:52:29.309Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4444lb # [ 66.745324] niks3-server[954]: 2026/09/20 10:52:29 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4445lb # [ 66.760603] niks3-server[954]: 2026/09/20 10:52:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4446worker2 # [ 66.719657] nix-grpc-daemon[859]: time=2026-09-20T10:52:29.354Z level=INFO msg="Uploading 1 narinfos"4447lb # [ 66.772504] niks3-server[954]: 2026/09/20 10:52:29 INFO Signed narinfos id=23 count=14448lb # [ 66.778775] niks3-server[954]: 2026/09/20 10:52:29 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4449lb # [ 66.791033] niks3-server[954]: 2026/09/20 10:52:29 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4450lb # [ 66.796076] niks3-server[954]: 2026/09/20 10:52:29 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4451lb # [ 66.799843] niks3-server[954]: 2026/09/20 10:52:29 INFO Completed upload id=234452worker2 # [ 66.752849] nix-grpc-daemon[859]: time=2026-09-20T10:52:29.388Z level=INFO msg="Upload complete. (569ms)"4453worker2 # [ 66.763422] nix-grpc-daemon[777]: ts=2026-09-20T10:52:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51342 duration_s=0 paths=1 nar_bytes_in=5684454worker2 # [ 66.780677] nix-grpc-daemon[777]: ts=2026-09-20T10:52:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:513424455worker2 # [ 66.787551] nix-daemon[832]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4456worker2 # [ 66.793935] nix-daemon[832]: reaped child process 981, status = succeeded4457client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4458worker2 # [ 66.807352] nix-daemon[832]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4459client # uses-input-w1onlyc> worker2: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4460worker2 # [ 68.262236] nix-daemon[832]: reaped child process 995, status = succeeded4461worker2 # [ 68.465333] nix-daemon[832]: accepted connection from pid 1010, user nix-grpc-daemon (trusted)4462worker2 # [ 68.485025] nix-daemon[832]: reaped child process 1013, status = succeeded4463lb # [ 68.546068] niks3-server[954]: 2026/09/20 10:52:31 INFO Received uploads request method=POST path=/api/pending_closures4464worker2 # [ 68.511648] nix-grpc-daemon[859]: time=2026-09-20T10:52:31.145Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4465lb # [ 68.582053] niks3-server[954]: 2026/09/20 10:52:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4466worker2 # [ 68.545365] nix-grpc-daemon[859]: time=2026-09-20T10:52:31.180Z level=INFO msg="Uploading 1 narinfos"4467lb # [ 68.597092] niks3-server[954]: 2026/09/20 10:52:31 INFO Signed narinfos id=24 count=14468lb # [ 68.604911] niks3-server[954]: 2026/09/20 10:52:31 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4469lb # [ 68.619042] niks3-server[954]: 2026/09/20 10:52:31 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4470lb # [ 68.629298] niks3-server[954]: 2026/09/20 10:52:31 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4471lb # [ 68.638715] niks3-server[954]: 2026/09/20 10:52:31 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4472lb # [ 68.644585] niks3-server[954]: 2026/09/20 10:52:31 INFO Completed upload id=244473worker2 # [ 68.597941] nix-grpc-daemon[859]: time=2026-09-20T10:52:31.233Z level=INFO msg="Upload complete. (378ms)"4474worker2 # [ 68.613378] nix-grpc-daemon[777]: ts=2026-09-20T10:52:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51342 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=14475worker2 # [ 68.632274] nix-daemon[832]: reaped child process 993, status = succeeded4476client # copying 1 paths...4477worker2 # [ 68.654636] nix-grpc-daemon[777]: ts=2026-09-20T10:52:31Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:513424478client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4479worker2 # [ 68.699408] nix-grpc-daemon[777]: ts=2026-09-20T10:52:31Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:513424480worker2 # [ 68.704780] nix-grpc-daemon[777]: ts=2026-09-20T10:52:31Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:51342 duration_s=0 paths=1 nar_bytes_out=1204481client # [ 68.890581] nix-daemon[944]: reaped child process 1074, status = succeeded4482client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 3.27 seconds)4483(finished: subtest: an input only one worker has still reaches the builder, in 10.84 seconds)4484subtest: upload whose reference the worker lacks is completed from the cache4485client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4486client # this derivation will be built:4487client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4488client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4489client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.52 seconds)4490client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4491client # this derivation will be built:4492client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4493client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4494client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.49 seconds)4495client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4496client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.25 seconds)4497worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4498worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.30 seconds)4499worker2 # [ 70.489999] systemd[1]: Stopping Nix worker-protocol over gRPC...4500worker2 # [ 70.893892] nix-grpc-daemon[777]: ts=2026-09-20T10:52:33Z level=info event=signal_exit4501lb # [ 71.521555] envoy[924]: conn peer=[2001:db8:1::1]:50478 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4276 tx=1885 ms=30264502lb # [ 71.527648] envoy[924]: conn peer=[2001:db8:1::1]:41658 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=654503lb # [ 71.527856] envoy[924]: conn peer=[2001:db8:1::1]:41660 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3700 tx=1801 ms=25984504lb # [ 71.527989] envoy[924]: conn peer=[2001:db8:1::1]:41670 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=964505lb # [ 71.528172] envoy[924]: conn peer=[2001:db8:1::1]:41674 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3744 tx=1823 ms=27724506lb # [ 71.528293] envoy[924]: conn peer=[2001:db8:1::1]:41678 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=724507worker2 # [ 72.158403] nix-grpc-daemon[777]: ts=2026-09-20T10:52:34Z level=info event=scheduler_restarting4508worker1 # [ 72.158113] nix-grpc-daemon[775]: ts=2026-09-20T10:52:34Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:440184509worker1 # [ 72.164346] nix-grpc-daemon[775]: ts=2026-09-20T10:52:34Z level=info event=worker_gone addr=192.168.1.4:500514510worker2 # [ 72.193277] nix-grpc-daemon[777]: ts=2026-09-20T10:52:34Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4511worker2 # [ 72.223231] nix-daemon[832]: reaped child process 834, status = succeeded4512worker2 # [ 73.008046] nix-grpc-daemon[777]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4513worker2 # [ 73.008566] nix-grpc-daemon[777]: E0000 00:00:1789901555.643337 820 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true4514worker2 # [ 73.039962] nix-grpc-daemon[777]: E0000 00:00:1789901555.675340 820 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4515worker2 # [ 73.231095] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4516worker2 # [ 73.242715] systemd[1]: Stopped Nix worker-protocol over gRPC.4517worker2 # [ 73.249183] systemd[1]: nix-grpc-daemon.service: Consumed 1.952s CPU time over 51.747s wall clock time, 50.7M memory peak, 43K incoming IP traffic, 72.4K outgoing IP traffic.4518worker2 # [ 73.261445] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4519worker2 # [ 73.267471] systemd[1]: Closed Nix worker-protocol over gRPC.4520worker2 # [ 73.279822] systemd[1]: nix-grpc-daemon.socket: Consumed 608us CPU time over 1min 2.494s wall clock time, 256K memory peak, 56.2K incoming IP traffic, 47.3K outgoing IP traffic.4521lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4522lb: must succeed: curl -sf localhost:9901/clusters4523lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.12 seconds)4524lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.13 seconds)4525client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24526worker1 # [ 73.741701] nix-grpc-daemon[775]: ts=2026-09-20T10:52:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:440224527worker1 # [ 73.749131] nix-grpc-daemon[775]: ts=2026-09-20T10:52:36Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:440224528client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4529client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.37 seconds)4530worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4531worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)4532worker2 # [ 73.906385] systemd[1]: Listening on Nix worker-protocol over gRPC.4533worker1 # [ 73.997622] systemd[1]: Stopping Nix worker-protocol over gRPC...4534worker2 # [ 74.220486] systemd[1]: Starting Nix worker-protocol over gRPC...4535worker2 # [ 74.477201] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:37Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4536worker2 # [ 74.482152] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:37Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14537worker2 # [ 74.492101] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:37Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4538worker2 # [ 74.516088] systemd[1]: Started Nix worker-protocol over gRPC.4539worker2 # [ 74.542185] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:37Z level=info event=scheduler_connected addr=lb:500514540worker1 # [ 74.544081] nix-grpc-daemon[775]: ts=2026-09-20T10:52:37Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04541worker1 # [ 74.869239] nix-grpc-daemon[775]: ts=2026-09-20T10:52:37Z level=info event=signal_exit4542worker1 # [ 75.127737] nix-grpc-daemon[775]: ts=2026-09-20T10:52:37Z level=info event=scheduler_yield4543worker2 # [ 75.131110] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:37Z level=info event=scheduler_restarting addr=lb:500514544lb # [ 75.179747] niks3-server[954]: 2026/09/20 10:52:37 INFO lead: released remote=192.168.1.3:346904545worker1 # [ 75.141894] nix-grpc-daemon[775]: ts=2026-09-20T10:52:37Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:440184546worker1 # [ 75.148511] nix-grpc-daemon[775]: ts=2026-09-20T10:52:37Z level=info event=worker_gone addr=192.168.1.4:500514547worker1 # [ 75.154546] nix-grpc-daemon[775]: ts=2026-09-20T10:52:37Z level=info event=scheduler_restarting addr=lb:500514548worker1 # [ 75.158684] nix-grpc-daemon[775]: ts=2026-09-20T10:52:37Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:440184549worker1 # [ 75.163168] nix-grpc-daemon[775]: ts=2026-09-20T10:52:37Z level=info event=worker_gone addr=192.168.1.3:500514550worker2 # [ 75.332378] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:37Z level=info event=scheduler_connected addr=lb:500514551worker2 # [ 75.337603] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4552worker1 # [ 75.349502] nix-grpc-daemon[775]: ts=2026-09-20T10:52:37Z level=info event=scheduler_connected addr=lb:500514553worker1 # [ 75.354818] nix-grpc-daemon[775]: ts=2026-09-20T10:52:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4554worker2 # [ 75.540192] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:38Z level=info event=scheduler_connected addr=lb:500514555worker2 # [ 75.544427] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4556worker1 # [ 75.555741] nix-grpc-daemon[775]: ts=2026-09-20T10:52:38Z level=info event=scheduler_connected addr=lb:500514557worker1 # [ 75.561170] nix-grpc-daemon[775]: ts=2026-09-20T10:52:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4558worker2 # [ 75.740540] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:38Z level=info event=scheduler_connected addr=lb:500514559worker2 # [ 75.745544] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4560worker1 # [ 75.762013] nix-grpc-daemon[775]: ts=2026-09-20T10:52:38Z level=info event=scheduler_connected addr=lb:500514561worker1 # [ 75.767170] nix-grpc-daemon[775]: ts=2026-09-20T10:52:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4562worker2 # [ 75.946234] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:38Z level=info event=scheduler_connected addr=lb:500514563worker2 # [ 75.951167] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4564worker1 # [ 75.969597] nix-grpc-daemon[775]: ts=2026-09-20T10:52:38Z level=info event=scheduler_connected addr=lb:500514565worker1 # [ 75.974158] nix-grpc-daemon[775]: ts=2026-09-20T10:52:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4566worker1 # [ 76.134503] nix-grpc-daemon[775]: ts=2026-09-20T10:52:38Z level=info event=scheduler_restarting4567worker2 # [ 76.152091] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:38Z level=info event=scheduler_connected addr=lb:500514568worker2 # [ 76.157260] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4569worker1 # [ 76.202609] nix-grpc-daemon[775]: ts=2026-09-20T10:52:38Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4570worker1 # [ 76.207214] nix-daemon[833]: reaped child process 836, status = succeeded4571worker2 # [ 76.358121] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:38Z level=info event=scheduler_connected addr=lb:500514572worker2 # [ 76.363311] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4573worker2 # [ 76.565938] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:39Z level=info event=scheduler_connected addr=lb:500514574worker2 # [ 76.570217] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4575worker2 # [ 76.766362] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:39Z level=info event=scheduler_connected addr=lb:500514576worker2 # [ 76.771728] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4577worker2 # [ 76.972939] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:39Z level=info event=scheduler_connected addr=lb:500514578worker2 # [ 76.978260] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4579worker1 # [ 77.029712] nix-grpc-daemon[775]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4580worker1 # [ 77.034417] nix-grpc-daemon[775]: E0000 00:00:1789901559.656901 818 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true4581worker1 # [ 77.040926] nix-grpc-daemon[775]: E0000 00:00:1789901559.657265 818 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4582worker1 # [ 77.140422] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4583worker1 # [ 77.143426] systemd[1]: Stopped Nix worker-protocol over gRPC.4584worker1 # [ 77.154631] systemd[1]: nix-grpc-daemon.service: Consumed 3.644s CPU time over 55.658s wall clock time, 66M memory peak, 82.7K incoming IP traffic, 157.7K outgoing IP traffic.4585worker1 # [ 77.170089] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4586worker1 # [ 77.174183] systemd[1]: Closed Nix worker-protocol over gRPC.4587worker1 # [ 77.176140] systemd[1]: nix-grpc-daemon.socket: Consumed 582us CPU time over 1min 5.584s wall clock time, 256K memory peak, 92K incoming IP traffic, 75K outgoing IP traffic.4588lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4589lb: must succeed: curl -sf localhost:9901/clusters4590worker2 # [ 77.179156] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:39Z level=info event=scheduler_connected addr=lb:500514591worker2 # [ 77.184759] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4592lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4593lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4594client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24595worker2 # [ 77.385684] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:40Z level=info event=scheduler_connected addr=lb:500514596worker2 # [ 77.391176] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4597worker2 # [ 77.523184] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:516744598worker2 # [ 77.540975] nix-daemon[832]: accepted connection from pid 1034, user nix-grpc-daemon (trusted)4599worker2 # [ 77.569970] nix-grpc-daemon[1034]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 39 ms (attempt 1/5)4600worker2 # [ 77.591960] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:40Z level=info event=scheduler_connected addr=lb:500514601worker2 # [ 77.597189] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4602worker2 # [ 77.615641] nix-grpc-daemon[1034]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 65 ms (attempt 2/5)4603worker2 # [ 77.688433] nix-grpc-daemon[1034]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 223 ms (attempt 3/5)4604worker2 # [ 77.798012] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:40Z level=info event=scheduler_connected addr=lb:500514605worker2 # [ 77.803351] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4606worker2 # [ 77.919126] nix-grpc-daemon[1034]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 210 ms (attempt 4/5)4607worker2 # [ 78.004061] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:40Z level=info event=scheduler_connected addr=lb:500514608worker2 # [ 78.009277] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4609worker2 # [ 78.137884] nix-grpc-daemon[1034]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4610client # copying 2 paths...4611client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...4612worker2 # [ 78.164690] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:516744613client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...4614worker2 # [ 78.182753] nix-daemon[832]: accepted connection from pid 1034, user nix-grpc-daemon (trusted)4615worker2 # [ 78.211976] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:40Z level=info event=scheduler_connected addr=lb:500514616worker2 # [ 78.221216] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4617worker2 # [ 78.230848] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:40Z level=info event=niks3_push_started pid=10904618worker2 # [ 78.420958] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:41Z level=info event=scheduler_connected addr=lb:500514619worker2 # [ 78.440244] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4620worker2 # [ 78.625286] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:41Z level=info event=scheduler_connected addr=lb:500514621worker2 # [ 78.644583] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4622worker2 # [ 78.649966] nix-daemon[832]: accepted connection from pid 1103, user nix-grpc-daemon (trusted)4623worker2 # [ 78.668619] nix-daemon[832]: reaped child process 1106, status = succeeded4624lb # [ 78.729241] niks3-server[954]: 2026/09/20 10:52:41 INFO Received uploads request method=POST path=/api/pending_closures4625lb # [ 78.739849] niks3-server[954]: 2026/09/20 10:52:41 INFO Received uploads request method=POST path=/api/pending_closures4626worker2 # [ 78.703704] nix-grpc-daemon[1090]: time=2026-09-20T10:52:41.337Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4627worker2 # [ 78.706403] nix-grpc-daemon[1090]: time=2026-09-20T10:52:41.337Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"4628worker2 # [ 78.708595] nix-grpc-daemon[1090]: time=2026-09-20T10:52:41.337Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"4629lb # [ 78.788611] niks3-server[954]: 2026/09/20 10:52:41 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst4630lb # [ 78.800354] niks3-server[954]: 2026/09/20 10:52:41 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst4631lb # [ 78.811492] niks3-server[954]: 2026/09/20 10:52:41 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls4632lb # [ 78.819854] niks3-server[954]: 2026/09/20 10:52:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4633lb # [ 78.826009] niks3-server[954]: 2026/09/20 10:52:41 INFO Signed narinfos id=25 count=14634worker2 # [ 78.780109] nix-grpc-daemon[1090]: time=2026-09-20T10:52:41.414Z level=INFO msg="Uploading 3 narinfos"4635lb # [ 78.828483] niks3-server[954]: 2026/09/20 10:52:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4636lb # [ 78.832656] niks3-server[954]: 2026/09/20 10:52:41 INFO Signed narinfos id=26 count=24637lb # [ 78.834805] niks3-server[954]: 2026/09/20 10:52:41 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls4638lb # [ 78.854481] niks3-server[954]: 2026/09/20 10:52:41 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo4639lb # [ 78.863209] niks3-server[954]: 2026/09/20 10:52:41 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4640lb # [ 78.869487] niks3-server[954]: 2026/09/20 10:52:41 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4641lb # [ 78.872168] niks3-server[954]: 2026/09/20 10:52:41 INFO Completed upload id=254642lb # [ 78.874295] niks3-server[954]: 2026/09/20 10:52:41 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4643worker2 # [ 78.827434] nix-grpc-daemon[1090]: time=2026-09-20T10:52:41.462Z level=INFO msg="Upload complete. (356ms)"4644lb # [ 78.877210] niks3-server[954]: 2026/09/20 10:52:41 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4645lb # [ 78.882784] niks3-server[954]: 2026/09/20 10:52:41 INFO Completed upload id=264646worker2 # [ 78.840513] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51674 duration_s=0 paths=2 nar_bytes_in=3124647worker2 # [ 78.852377] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:41Z level=info event=scheduler_connected addr=lb:500514648worker2 # [ 78.855694] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4649worker2 # [ 78.862936] nix-daemon[832]: reaped child process 1088, status = succeeded4650client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.61 seconds)4651worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache4652worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.03 seconds)4653worker1 # [ 78.995129] systemd[1]: Listening on Nix worker-protocol over gRPC.4654worker1 # [ 79.005544] systemd[1]: Starting Nix worker-protocol over gRPC...4655worker2 # [ 79.037520] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:41Z level=info event=scheduler_connected addr=lb:500514656worker2 # [ 79.042760] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4657worker1 # [ 79.208092] nix-grpc-daemon[1240]: ts=2026-09-20T10:52:41Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4658worker1 # [ 79.211187] nix-grpc-daemon[1240]: ts=2026-09-20T10:52:41Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14659worker1 # [ 79.220001] nix-grpc-daemon[1240]: ts=2026-09-20T10:52:41Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4660worker1 # [ 79.232611] systemd[1]: Started Nix worker-protocol over gRPC.4661worker1 # [ 79.240144] nix-grpc-daemon[1240]: ts=2026-09-20T10:52:41Z level=info event=scheduler_take_over4662lb # [ 79.280895] niks3-server[954]: 2026/09/20 10:52:41 INFO lead: acquired remote=192.168.1.3:511804663worker2 # [ 79.243569] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:41Z level=info event=scheduler_connected addr=lb:500514664worker2 # [ 79.249016] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4665lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4666lb: must succeed: curl -sf localhost:9901/clusters4667worker1 # [ 79.272941] nix-grpc-daemon[1240]: ts=2026-09-20T10:52:41Z level=info event=scheduler_connected addr=lb:500514668worker1 # [ 79.279213] nix-grpc-daemon[1240]: ts=2026-09-20T10:52:41Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04669lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4670lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.10 seconds)4671(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.50 seconds)4672subtest: scheduler down: the other node takes the lock and keeps it4673lb: must succeed: curl -sf localhost:9901/clusters4674lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4675lb: must succeed: curl -sf localhost:9901/clusters4676worker2 # [ 79.449694] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:42Z level=info event=scheduler_connected addr=lb:500514677worker1 # [ 79.451006] nix-grpc-daemon[1240]: ts=2026-09-20T10:52:42Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04678lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4679lb: must succeed: curl -sf localhost:9901/clusters4680lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4681lb: must succeed: curl -sf localhost:9901/clusters4682lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4683worker1 # [ 79.620575] systemd[1]: Stopping Nix worker-protocol over gRPC...4684worker1 # [ 80.221625] nix-grpc-daemon[1240]: ts=2026-09-20T10:52:42Z level=info event=signal_exit4685worker1 # [ 80.433062] nix-grpc-daemon[1240]: ts=2026-09-20T10:52:43Z level=info event=scheduler_yield4686lb # [ 80.486614] niks3-server[954]: 2026/09/20 10:52:43 INFO lead: released remote=192.168.1.3:511804687worker2 # [ 80.440738] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:43Z level=info event=scheduler_restarting addr=lb:500514688worker1 # [ 80.440674] nix-grpc-daemon[1240]: ts=2026-09-20T10:52:43Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:348004689worker1 # [ 80.445305] nix-grpc-daemon[1240]: ts=2026-09-20T10:52:43Z level=info event=worker_gone addr=192.168.1.4:500514690worker1 # [ 80.452393] nix-grpc-daemon[1240]: ts=2026-09-20T10:52:43Z level=info event=scheduler_restarting addr=lb:500514691worker1 # [ 80.456400] nix-grpc-daemon[1240]: ts=2026-09-20T10:52:43Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:348004692worker1 # [ 80.460797] nix-grpc-daemon[1240]: ts=2026-09-20T10:52:43Z level=info event=worker_gone addr=192.168.1.3:500514693worker2 # [ 80.640377] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:43Z level=info event=scheduler_connected addr=lb:500514694worker2 # [ 80.648128] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4695worker1 # [ 80.651337] nix-grpc-daemon[1240]: ts=2026-09-20T10:52:43Z level=info event=scheduler_connected addr=lb:500514696worker1 # [ 80.657829] nix-grpc-daemon[1240]: ts=2026-09-20T10:52:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4697worker2 # [ 80.854926] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:43Z level=info event=scheduler_connected addr=lb:500514698worker1 # [ 80.858631] nix-grpc-daemon[1240]: ts=2026-09-20T10:52:43Z level=info event=scheduler_connected addr=lb:500514699worker2 # [ 80.860145] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4700worker1 # [ 80.864855] nix-grpc-daemon[1240]: ts=2026-09-20T10:52:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4701worker2 # [ 81.060888] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:43Z level=info event=scheduler_connected addr=lb:500514702worker1 # [ 81.065697] nix-grpc-daemon[1240]: ts=2026-09-20T10:52:43Z level=info event=scheduler_connected addr=lb:500514703worker2 # [ 81.066118] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4704worker1 # [ 81.072228] nix-grpc-daemon[1240]: ts=2026-09-20T10:52:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4705worker2 # [ 81.266995] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:43Z level=info event=scheduler_connected addr=lb:500514706worker2 # [ 81.272292] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4707worker1 # [ 81.274884] nix-grpc-daemon[1240]: ts=2026-09-20T10:52:43Z level=info event=scheduler_connected addr=lb:500514708worker1 # [ 81.279125] nix-grpc-daemon[1240]: ts=2026-09-20T10:52:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4709worker1 # [ 81.438664] nix-grpc-daemon[1240]: ts=2026-09-20T10:52:44Z level=info event=scheduler_restarting4710worker2 # [ 81.474233] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:44Z level=info event=scheduler_connected addr=lb:500514711lb # [ 81.521430] envoy[924]: conn peer=[2001:db8:1::4]:46438 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1718 tx=639 ms=502514712worker2 # [ 81.479458] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4713lb # [ 81.528700] envoy[924]: conn peer=[2001:db8:1::1]:42292 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=523 ms=414714lb # [ 81.533507] envoy[924]: conn peer=[2001:db8:1::3]:32960 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3014 tx=1204 ms=542884715lb # [ 81.538750] envoy[924]: conn peer=[2001:db8:1::1]:42304 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1009 tx=305 ms=13304716worker2 # [ 81.680276] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:44Z level=info event=scheduler_connected addr=lb:500514717worker2 # [ 81.685539] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4718worker2 # [ 81.886283] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:44Z level=info event=scheduler_connected addr=lb:500514719worker2 # [ 81.891502] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4720worker2 # [ 82.092489] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:44Z level=info event=scheduler_connected addr=lb:500514721worker2 # [ 82.097678] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4722worker1 # [ 82.253067] nix-grpc-daemon[1240]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4723worker1 # [ 82.253458] nix-grpc-daemon[1240]: E0000 00:00:1789901564.881437 1283 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true4724worker1 # [ 82.265137] nix-grpc-daemon[1240]: E0000 00:00:1789901564.893720 1283 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4725worker2 # [ 82.298466] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:44Z level=info event=scheduler_connected addr=lb:500514726worker2 # [ 82.303592] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4727worker2 # [ 82.505671] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:45Z level=info event=scheduler_connected addr=lb:500514728worker2 # [ 82.510421] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4729worker2 # [ 82.707204] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:45Z level=info event=scheduler_connected addr=lb:500514730worker2 # [ 82.712485] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4731worker2 # [ 82.913308] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:45Z level=info event=scheduler_connected addr=lb:500514732worker2 # [ 82.918360] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4733worker2 # [ 83.119428] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:45Z level=info event=scheduler_connected addr=lb:500514734worker2 # [ 83.125020] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4735worker1 # [ 83.255611] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4736worker1 # [ 83.260888] systemd[1]: Stopped Nix worker-protocol over gRPC.4737worker1 # [ 83.263385] systemd[1]: nix-grpc-daemon.service: Consumed 205ms CPU time over 4.246s wall clock time, 13.1M memory peak, 7.4K incoming IP traffic, 7.1K outgoing IP traffic.4738worker1 # [ 83.278878] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4739worker1 # [ 83.283019] systemd[1]: Closed Nix worker-protocol over gRPC.4740worker1 # [ 83.285950] systemd[1]: nix-grpc-daemon.socket: Consumed 1ms CPU time over 4.297s wall clock time, 256K memory peak, 17.5K incoming IP traffic, 13.3K outgoing IP traffic.4741worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over4742worker2 # [ 83.326219] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:45Z level=info event=scheduler_connected addr=lb:500514743worker2 # [ 83.332999] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4744worker2 # [ 83.534402] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:46Z level=info event=scheduler_connected addr=lb:500514745worker2 # [ 83.538809] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4746worker2 # [ 83.735052] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:46Z level=info event=scheduler_connected addr=lb:500514747worker2 # [ 83.740527] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4748worker2 # [ 83.941272] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:46Z level=info event=scheduler_connected addr=lb:500514749worker2 # [ 83.946462] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4750worker2 # [ 84.147407] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:46Z level=info event=scheduler_connected addr=lb:500514751worker2 # [ 84.152757] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4752worker2 # [ 84.353596] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:46Z level=info event=scheduler_connected addr=lb:500514753worker2 # [ 84.358715] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4754worker2 # [ 84.510685] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:47Z level=info event=scheduler_take_over4755lb # [ 84.558521] niks3-server[954]: 2026/09/20 10:52:47 INFO lead: acquired remote=192.168.1.4:512504756worker2 # [ 84.560885] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:47Z level=info event=scheduler_connected addr=lb:500514757worker2 # [ 84.581509] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:47Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04758worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 2.26 seconds)4759worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4760worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)4761client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&24762worker2 # [ 85.859151] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:516744763client # don't know how to build these paths:4764client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4765worker2 # [ 85.871356] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:516744766worker2 # [ 85.899259] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:48Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=04767worker2 # [ 85.906502] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:48Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.4:50051 clients=14768worker2 # [ 85.945511] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:516744769worker2 # [ 85.961377] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:516744770client # copying 1 paths to 'lb:50051'...4771client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...4772worker2 # [ 85.976918] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:516744773worker2 # [ 85.989138] nix-daemon[832]: accepted connection from pid 1034, user nix-grpc-daemon (trusted)4774worker2 # [ 86.199073] nix-daemon[832]: accepted connection from pid 1136, user nix-grpc-daemon (trusted)4775worker2 # [ 86.217579] nix-daemon[832]: reaped child process 1139, status = succeeded4776worker2 # [ 86.391025] nix-daemon[832]: accepted connection from pid 1141, user nix-grpc-daemon (trusted)4777worker2 # [ 86.409274] nix-daemon[832]: reaped child process 1144, status = succeeded4778lb # [ 86.469847] niks3-server[954]: 2026/09/20 10:52:49 INFO Received uploads request method=POST path=/api/pending_closures4779worker2 # [ 86.433492] nix-grpc-daemon[1090]: time=2026-09-20T10:52:49.068Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4780worker2 # [ 86.435049] nix-grpc-daemon[1090]: time=2026-09-20T10:52:49.068Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"4781lb # [ 86.504387] niks3-server[954]: 2026/09/20 10:52:49 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst4782lb # [ 86.518592] niks3-server[954]: 2026/09/20 10:52:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign4783lb # [ 86.534849] niks3-server[954]: 2026/09/20 10:52:49 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls4784lb # [ 86.552807] niks3-server[954]: 2026/09/20 10:52:49 INFO Signed narinfos id=27 count=14785worker2 # [ 86.505766] nix-grpc-daemon[1090]: time=2026-09-20T10:52:49.140Z level=INFO msg="Uploading 1 narinfos"4786lb # [ 86.564125] niks3-server[954]: 2026/09/20 10:52:49 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete4787lb # [ 86.575554] niks3-server[954]: 2026/09/20 10:52:49 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo4788lb # [ 86.590101] niks3-server[954]: 2026/09/20 10:52:49 INFO Completed upload id=274789worker2 # [ 86.543362] nix-grpc-daemon[1090]: time=2026-09-20T10:52:49.178Z level=INFO msg="Upload complete. (533ms)"4790worker2 # [ 86.556360] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51674 duration_s=0 paths=1 nar_bytes_in=5204791worker2 # [ 86.574704] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:516744792worker2 # [ 86.584265] nix-daemon[832]: accepted connection from pid 1034, user nix-grpc-daemon (trusted)4793worker2 # [ 86.592367] nix-daemon[832]: reaped child process 1134, status = succeeded4794client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...4795client # farm-a> worker2: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4796worker2 # [ 86.601465] nix-daemon[832]: accepted connection from pid 1034, user nix-grpc-daemon (trusted)4797client # farm-a> LOG-farm-a-on-standby4798worker2 # [ 87.445276] nix-daemon[832]: reaped child process 1148, status = succeeded4799worker2 # [ 87.630875] nix-daemon[832]: accepted connection from pid 1163, user nix-grpc-daemon (trusted)4800worker2 # [ 87.649265] nix-daemon[832]: reaped child process 1166, status = succeeded4801lb # [ 87.708659] niks3-server[954]: 2026/09/20 10:52:50 INFO Received uploads request method=POST path=/api/pending_closures4802worker2 # [ 87.676447] nix-grpc-daemon[1090]: time=2026-09-20T10:52:50.310Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4803worker2 # [ 87.678210] nix-grpc-daemon[1090]: time=2026-09-20T10:52:50.310Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"4804lb # [ 87.742637] niks3-server[954]: 2026/09/20 10:52:50 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4805lb # [ 87.764665] niks3-server[954]: 2026/09/20 10:52:50 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst4806lb # [ 87.774967] niks3-server[954]: 2026/09/20 10:52:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign4807worker2 # [ 87.735281] nix-grpc-daemon[1090]: time=2026-09-20T10:52:50.369Z level=INFO msg="Uploading 1 narinfos"4808lb # [ 87.786534] niks3-server[954]: 2026/09/20 10:52:50 INFO Signed narinfos id=28 count=14809lb # [ 87.791825] niks3-server[954]: 2026/09/20 10:52:50 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls4810lb # [ 87.799361] niks3-server[954]: 2026/09/20 10:52:50 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete4811lb # [ 87.805389] niks3-server[954]: 2026/09/20 10:52:50 INFO Completed upload id=284812worker2 # [ 87.758540] nix-grpc-daemon[1090]: time=2026-09-20T10:52:50.394Z level=INFO msg="Upload complete. (346ms)"4813lb # [ 87.807879] niks3-server[954]: 2026/09/20 10:52:50 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo4814worker2 # [ 87.785173] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51674 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=14815worker2 # [ 87.796256] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:50Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=04816worker2 # [ 87.802516] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:50Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.4:50051 clients=14817worker2 # [ 87.806498] nix-daemon[832]: reaped child process 1146, status = succeeded4818worker2 # [ 87.828372] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:516744819worker2 # [ 87.843046] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:516744820worker2 # [ 87.858584] nix-grpc-daemon[1090]: time=2026-09-20T10:52:50.494Z level=INFO msg="All 1 paths already cached"4821client # copying 1 paths to 'lb:50051'...4822client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...4823worker2 # [ 87.869408] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:516744824worker2 # [ 87.883146] nix-daemon[832]: accepted connection from pid 1034, user nix-grpc-daemon (trusted)4825worker2 # [ 88.083904] nix-daemon[832]: accepted connection from pid 1172, user nix-grpc-daemon (trusted)4826worker2 # [ 88.101997] nix-daemon[832]: reaped child process 1175, status = succeeded4827worker2 # [ 88.277891] nix-daemon[832]: accepted connection from pid 1177, user nix-grpc-daemon (trusted)4828worker2 # [ 88.295970] nix-daemon[832]: reaped child process 1180, status = succeeded4829lb # [ 88.354531] niks3-server[954]: 2026/09/20 10:52:50 INFO Received uploads request method=POST path=/api/pending_closures4830worker2 # [ 88.317661] nix-grpc-daemon[1090]: time=2026-09-20T10:52:50.952Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4831worker2 # [ 88.319236] nix-grpc-daemon[1090]: time=2026-09-20T10:52:50.952Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"4832lb # [ 88.385875] niks3-server[954]: 2026/09/20 10:52:51 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst4833lb # [ 88.396633] niks3-server[954]: 2026/09/20 10:52:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign4834worker2 # [ 88.358307] nix-grpc-daemon[1090]: time=2026-09-20T10:52:50.993Z level=INFO msg="Uploading 1 narinfos"4835lb # [ 88.408669] niks3-server[954]: 2026/09/20 10:52:51 INFO Signed narinfos id=29 count=14836lb # [ 88.411419] niks3-server[954]: 2026/09/20 10:52:51 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls4837lb # [ 88.422452] niks3-server[954]: 2026/09/20 10:52:51 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete4838lb # [ 88.429597] niks3-server[954]: 2026/09/20 10:52:51 INFO Completed upload id=294839worker2 # [ 88.382593] nix-grpc-daemon[1090]: time=2026-09-20T10:52:51.018Z level=INFO msg="Upload complete. (483ms)"4840lb # [ 88.432102] niks3-server[954]: 2026/09/20 10:52:51 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo4841worker2 # [ 88.392425] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51674 duration_s=0 paths=1 nar_bytes_in=6404842worker2 # [ 88.402849] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:516744843worker2 # [ 88.409901] nix-daemon[832]: accepted connection from pid 1034, user nix-grpc-daemon (trusted)4844worker2 # [ 88.414928] nix-daemon[832]: reaped child process 1170, status = succeeded4845client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...4846client # farm-b> worker2: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv4847worker2 # [ 88.428249] nix-daemon[832]: accepted connection from pid 1034, user nix-grpc-daemon (trusted)4848client # farm-b> LOG-farm-b-on-standby4849worker2 # [ 89.875315] nix-daemon[832]: reaped child process 1184, status = succeeded4850worker2 # [ 90.059002] nix-daemon[832]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)4851worker2 # [ 90.078535] nix-daemon[832]: reaped child process 1202, status = succeeded4852lb # [ 90.139885] niks3-server[954]: 2026/09/20 10:52:52 INFO Received uploads request method=POST path=/api/pending_closures4853worker2 # [ 90.103452] nix-grpc-daemon[1090]: time=2026-09-20T10:52:52.738Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4854worker2 # [ 90.105223] nix-grpc-daemon[1090]: time=2026-09-20T10:52:52.738Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"4855lb # [ 90.179045] niks3-server[954]: 2026/09/20 10:52:52 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst4856worker2 # [ 90.142954] nix-grpc-daemon[1090]: time=2026-09-20T10:52:52.778Z level=INFO msg="Uploading 1 narinfos"4857lb # [ 90.195145] niks3-server[954]: 2026/09/20 10:52:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign4858lb # [ 90.205046] niks3-server[954]: 2026/09/20 10:52:52 INFO Signed narinfos id=30 count=14859lb # [ 90.207263] niks3-server[954]: 2026/09/20 10:52:52 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls4860lb # [ 90.211320] niks3-server[954]: 2026/09/20 10:52:52 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv4861lb # [ 90.218129] niks3-server[954]: 2026/09/20 10:52:52 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete4862lb # [ 90.222063] niks3-server[954]: 2026/09/20 10:52:52 INFO Completed upload id=304863worker2 # [ 90.174674] nix-grpc-daemon[1090]: time=2026-09-20T10:52:52.810Z level=INFO msg="Upload complete. (334ms)"4864lb # [ 90.224433] niks3-server[954]: 2026/09/20 10:52:52 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo4865worker2 # [ 90.190093] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51674 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=14866worker2 # [ 90.205052] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:52Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=04867worker2 # [ 90.208828] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:52Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.4:50051 clients=14868worker2 # [ 90.212729] nix-daemon[832]: reaped child process 1182, status = succeeded4869worker2 # [ 90.233560] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:516744870worker2 # [ 90.248498] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:516744871worker2 # [ 90.261937] nix-grpc-daemon[1090]: time=2026-09-20T10:52:52.897Z level=INFO msg="All 2 paths already cached"4872client # copying 1 paths to 'lb:50051'...4873client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...4874worker2 # [ 90.272089] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:516744875worker2 # [ 90.286168] nix-daemon[832]: accepted connection from pid 1034, user nix-grpc-daemon (trusted)4876worker2 # [ 90.479221] nix-daemon[832]: accepted connection from pid 1208, user nix-grpc-daemon (trusted)4877worker2 # [ 90.499159] nix-daemon[832]: reaped child process 1211, status = succeeded4878worker2 # [ 90.678198] nix-daemon[832]: accepted connection from pid 1213, user nix-grpc-daemon (trusted)4879worker2 # [ 90.696283] nix-daemon[832]: reaped child process 1216, status = succeeded4880lb # [ 90.755562] niks3-server[954]: 2026/09/20 10:52:53 INFO Received uploads request method=POST path=/api/pending_closures4881worker2 # [ 90.717947] nix-grpc-daemon[1090]: time=2026-09-20T10:52:53.353Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4882worker2 # [ 90.719877] nix-grpc-daemon[1090]: time=2026-09-20T10:52:53.355Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"4883lb # [ 90.787582] niks3-server[954]: 2026/09/20 10:52:53 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst4884worker2 # [ 90.749715] nix-grpc-daemon[1090]: time=2026-09-20T10:52:53.385Z level=INFO msg="Uploading 1 narinfos"4885lb # [ 90.800456] niks3-server[954]: 2026/09/20 10:52:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign4886lb # [ 90.811101] niks3-server[954]: 2026/09/20 10:52:53 INFO Signed narinfos id=31 count=14887worker2 # [ 90.773676] nix-grpc-daemon[1090]: time=2026-09-20T10:52:53.409Z level=INFO msg="Upload complete. (471ms)"4888lb # [ 90.820952] niks3-server[954]: 2026/09/20 10:52:53 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls4889lb # [ 90.826056] niks3-server[954]: 2026/09/20 10:52:53 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete4890worker2 # [ 90.780115] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51674 duration_s=0 paths=1 nar_bytes_in=7684891lb # [ 90.830947] niks3-server[954]: 2026/09/20 10:52:53 INFO Completed upload id=314892lb # [ 90.833393] niks3-server[954]: 2026/09/20 10:52:53 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo4893worker2 # [ 90.791979] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:516744894worker2 # [ 90.797782] nix-daemon[832]: accepted connection from pid 1034, user nix-grpc-daemon (trusted)4895worker2 # [ 90.802177] nix-daemon[832]: reaped child process 1206, status = succeeded4896client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...4897worker2 # [ 90.813988] nix-daemon[832]: accepted connection from pid 1034, user nix-grpc-daemon (trusted)4898client # farm-top> worker2: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4899lb # [ 91.517731] envoy[924]: conn peer=[2001:db8:1::3]:41754 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1028 tx=378 ms=22194900client # farm-top> LOG-farm-top-on-standby4901worker2 # [ 92.440976] nix-daemon[832]: reaped child process 1220, status = succeeded4902worker2 # [ 92.614347] nix-daemon[832]: accepted connection from pid 1235, user nix-grpc-daemon (trusted)4903worker2 # [ 92.632499] nix-daemon[832]: reaped child process 1238, status = succeeded4904lb # [ 92.692843] niks3-server[954]: 2026/09/20 10:52:55 INFO Received uploads request method=POST path=/api/pending_closures4905worker2 # [ 92.659813] nix-grpc-daemon[1090]: time=2026-09-20T10:52:55.293Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4906worker2 # [ 92.661545] nix-grpc-daemon[1090]: time=2026-09-20T10:52:55.293Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"4907lb # [ 92.723159] niks3-server[954]: 2026/09/20 10:52:55 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst4908lb # [ 92.736914] niks3-server[954]: 2026/09/20 10:52:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign4909worker2 # [ 92.690306] nix-grpc-daemon[1090]: time=2026-09-20T10:52:55.325Z level=INFO msg="Uploading 1 narinfos"4910lb # [ 92.742383] niks3-server[954]: 2026/09/20 10:52:55 INFO Signed narinfos id=32 count=14911lb # [ 92.746669] niks3-server[954]: 2026/09/20 10:52:55 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls4912lb # [ 92.752649] niks3-server[954]: 2026/09/20 10:52:55 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4913lb # [ 92.757715] niks3-server[954]: 2026/09/20 10:52:55 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete4914lb # [ 92.764091] niks3-server[954]: 2026/09/20 10:52:55 INFO Completed upload id=324915worker2 # [ 92.715852] nix-grpc-daemon[1090]: time=2026-09-20T10:52:55.351Z level=INFO msg="Upload complete. (290ms)"4916lb # [ 92.765589] niks3-server[954]: 2026/09/20 10:52:55 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo4917worker2 # [ 92.728338] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51674 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=14918worker2 # [ 92.737856] nix-daemon[832]: reaped child process 1218, status = succeeded4919client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 8.17 seconds)4920client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath4921client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.23 seconds)4922worker1 # [ 94.098338] systemd[1]: Listening on Nix worker-protocol over gRPC.4923worker1 # [ 94.106981] systemd[1]: Starting Nix worker-protocol over gRPC...4924worker1 # [ 94.316877] nix-grpc-daemon[1304]: ts=2026-09-20T10:52:56Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4925worker1 # [ 94.319241] nix-grpc-daemon[1304]: ts=2026-09-20T10:52:56Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14926worker1 # [ 94.326956] nix-grpc-daemon[1304]: ts=2026-09-20T10:52:56Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4927worker1 # [ 94.344241] systemd[1]: Started Nix worker-protocol over gRPC.4928lb: must succeed: curl -sf localhost:9901/clusters4929worker1 # [ 94.378002] nix-grpc-daemon[1304]: ts=2026-09-20T10:52:57Z level=info event=scheduler_connected addr=lb:500514930worker2 # [ 94.382162] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:57Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04931lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4932worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4933worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)4934lb: must succeed: curl -sf localhost:9901/clusters4935lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4936lb: must succeed: curl -sf localhost:9901/clusters4937lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4938worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4939worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)4940(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 15.38 seconds)4941subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise4942client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs4943client # [ 94.856648] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.4944client # Running as unit: rs.service; invocation ID: a971bcf2cafa442481af1cb35ce853954945client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.10 seconds)4946client # [ 95.089549] nix[1173]: don't know how to build these paths:4947client # [ 95.090550] nix[1173]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv4948worker2 # [ 95.036665] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:516744949worker2 # [ 95.050046] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:57Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=04950worker2 # [ 95.057307] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:57Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.4:50051 clients=14951worker2 # [ 95.096960] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:516744952worker2 # [ 95.112484] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:516744953client # [ 95.175931] nix[1173]: copying 1 paths to 'lb:50051'...4954client # [ 95.181641] nix[1173]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...4955worker2 # [ 95.129790] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:516744956worker2 # [ 95.145032] nix-daemon[832]: accepted connection from pid 1034, user nix-grpc-daemon (trusted)4957worker2 # [ 95.353164] nix-daemon[832]: accepted connection from pid 1251, user nix-grpc-daemon (trusted)4958worker2 # [ 95.372765] nix-daemon[832]: reaped child process 1254, status = succeeded4959worker2 # [ 95.546298] nix-daemon[832]: accepted connection from pid 1256, user nix-grpc-daemon (trusted)4960worker2 # [ 95.566794] nix-daemon[832]: reaped child process 1259, status = succeeded4961lb # [ 95.626296] niks3-server[954]: 2026/09/20 10:52:58 INFO Received uploads request method=POST path=/api/pending_closures4962worker2 # [ 95.588849] nix-grpc-daemon[1090]: time=2026-09-20T10:52:58.223Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4963worker2 # [ 95.590381] nix-grpc-daemon[1090]: time=2026-09-20T10:52:58.223Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"4964lb # [ 95.657011] niks3-server[954]: 2026/09/20 10:52:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign4965worker2 # [ 95.617012] nix-grpc-daemon[1090]: time=2026-09-20T10:52:58.252Z level=INFO msg="Uploading 1 narinfos"4966lb # [ 95.668823] niks3-server[954]: 2026/09/20 10:52:58 INFO Signed narinfos id=33 count=14967lb # [ 95.677248] niks3-server[954]: 2026/09/20 10:52:58 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst4968lb # [ 95.691918] niks3-server[954]: 2026/09/20 10:52:58 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls4969worker2 # [ 95.650686] nix-grpc-daemon[1090]: time=2026-09-20T10:52:58.286Z level=INFO msg="Upload complete. (489ms)"4970lb # [ 95.698994] niks3-server[954]: 2026/09/20 10:52:58 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete4971lb # [ 95.705866] niks3-server[954]: 2026/09/20 10:52:58 INFO Completed upload id=334972worker2 # [ 95.658911] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51674 duration_s=0 paths=1 nar_bytes_in=4164973lb # [ 95.709343] niks3-server[954]: 2026/09/20 10:52:58 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo4974worker2 # [ 95.671678] nix-grpc-daemon[1034]: ts=2026-09-20T10:52:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:516744975worker2 # [ 95.679139] nix-daemon[832]: accepted connection from pid 1034, user nix-grpc-daemon (trusted)4976worker2 # [ 95.684061] nix-daemon[832]: reaped child process 1249, status = succeeded4977client # [ 95.745866] nix[1173]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...4978worker2 # [ 95.697777] nix-daemon[832]: accepted connection from pid 1034, user nix-grpc-daemon (trusted)4979lb: must succeed: curl -sf localhost:9901/clusters4980lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4981lb: must succeed: curl -sf localhost:9901/clusters4982lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4983lb: must succeed: curl -sf localhost:9901/clusters4984lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4985lb: must succeed: curl -sf localhost:9901/clusters4986lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4987worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true4988worker1 # [ 97.776104] systemd-journald[274]: Received client request to rotate journal, rotating.4989worker1 # [ 97.801424] systemd-journald[274]: Vacuuming done, freed 0B of archived journals from /var/log/journal/55cc582b412840089b4afe456b0cc70f.4990worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.10 seconds)4991worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service4992worker2 # [ 97.859102] systemd[1]: Stopping Nix worker-protocol over gRPC...4993worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds)4994??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.4995 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5734996client: must succeed: sleep 5.04997worker2 # [ 98.514275] nix-grpc-daemon[1034]: ts=2026-09-20T10:53:01Z level=info event=draining4998lb # [ 101.519720] envoy[924]: conn peer=[2001:db8:1::1]:46850 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9627 tx=3879 ms=68854999client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5000worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5001worker2 # [ 103.328843] nix-daemon[832]: reaped child process 1263, status = succeeded5002worker2 # [ 103.494286] nix-daemon[832]: accepted connection from pid 1303, user nix-grpc-daemon (trusted)5003worker2 # [ 103.513152] nix-daemon[832]: reaped child process 1306, status = succeeded5004lb # [ 103.575009] niks3-server[954]: 2026/09/20 10:53:06 INFO Received uploads request method=POST path=/api/pending_closures5005worker2 # [ 103.544260] nix-grpc-daemon[1090]: time=2026-09-20T10:53:06.177Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5006worker2 # [ 103.545820] nix-grpc-daemon[1090]: time=2026-09-20T10:53:06.177Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5007lb # [ 103.628306] niks3-server[954]: 2026/09/20 10:53:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5008lb # [ 103.645336] niks3-server[954]: 2026/09/20 10:53:06 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5009lb # [ 103.658502] niks3-server[954]: 2026/09/20 10:53:06 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5010worker2 # [ 103.619916] nix-grpc-daemon[1090]: time=2026-09-20T10:53:06.254Z level=INFO msg="Uploading 1 narinfos"5011lb # [ 103.666559] niks3-server[954]: 2026/09/20 10:53:06 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5012lb # [ 103.671167] niks3-server[954]: 2026/09/20 10:53:06 INFO Signed narinfos id=34 count=15013lb # [ 103.679944] niks3-server[954]: 2026/09/20 10:53:06 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5014lb # [ 103.691397] niks3-server[954]: 2026/09/20 10:53:06 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5015lb # [ 103.702753] niks3-server[954]: 2026/09/20 10:53:06 INFO Completed upload id=345016worker2 # [ 103.658033] nix-grpc-daemon[1090]: time=2026-09-20T10:53:06.293Z level=INFO msg="Upload complete. (345ms)"5017worker2 # [ 103.673336] nix-grpc-daemon[1034]: ts=2026-09-20T10:53:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51674 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15018worker2 # [ 103.691817] nix-daemon[832]: reaped child process 1261, status = succeeded5019client # [ 103.764811] systemd[1]: rs.service: Deactivated successfully.5020client # [ 103.769484] systemd[1]: rs.service: Consumed 154ms CPU time over 8.911s wall clock time, 37M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.5021worker2 # [ 104.516584] nix-grpc-daemon[1034]: ts=2026-09-20T10:53:07Z level=info event=signal_exit5022worker2 # [ 104.537767] nix-grpc-daemon[1034]: ts=2026-09-20T10:53:07Z level=info event=scheduler_yield5023lb # [ 104.589454] niks3-server[954]: 2026/09/20 10:53:07 INFO lead: released remote=192.168.1.4:512505024worker2 # [ 104.544475] nix-grpc-daemon[1034]: ts=2026-09-20T10:53:07Z level=info event=scheduler_restarting addr=lb:500515025worker1 # [ 104.545415] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:07Z level=info event=scheduler_restarting addr=lb:500515026worker2 # [ 104.550235] nix-grpc-daemon[1034]: ts=2026-09-20T10:53:07Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:346605027worker2 # [ 104.555007] nix-grpc-daemon[1034]: ts=2026-09-20T10:53:07Z level=info event=worker_gone addr=192.168.1.3:500515028worker2 # [ 104.559123] nix-grpc-daemon[1034]: ts=2026-09-20T10:53:07Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:346605029worker2 # [ 104.563687] nix-grpc-daemon[1034]: ts=2026-09-20T10:53:07Z level=info event=worker_gone addr=192.168.1.4:500515030worker1 # [ 104.745354] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:07Z level=info event=scheduler_connected addr=lb:500515031worker2 # [ 104.746916] nix-grpc-daemon[1034]: ts=2026-09-20T10:53:07Z level=info event=scheduler_connected addr=lb:500515032worker1 # [ 104.750720] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5033worker2 # [ 104.752477] nix-grpc-daemon[1034]: ts=2026-09-20T10:53:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5034worker1 # [ 104.951562] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:07Z level=info event=scheduler_connected addr=lb:500515035worker2 # [ 104.953234] nix-grpc-daemon[1034]: ts=2026-09-20T10:53:07Z level=info event=scheduler_connected addr=lb:500515036worker1 # [ 104.957025] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5037worker2 # [ 104.958800] nix-grpc-daemon[1034]: ts=2026-09-20T10:53:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5038worker1 # [ 105.157811] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:07Z level=info event=scheduler_connected addr=lb:500515039worker2 # [ 105.159567] nix-grpc-daemon[1034]: ts=2026-09-20T10:53:07Z level=info event=scheduler_connected addr=lb:500515040worker1 # [ 105.163083] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5041worker2 # [ 105.165271] nix-grpc-daemon[1034]: ts=2026-09-20T10:53:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5042worker1 # [ 105.364115] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:07Z level=info event=scheduler_connected addr=lb:500515043worker2 # [ 105.366296] nix-grpc-daemon[1034]: ts=2026-09-20T10:53:08Z level=info event=scheduler_connected addr=lb:500515044worker2 # [ 105.371618] nix-grpc-daemon[1034]: ts=2026-09-20T10:53:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5045worker1 # [ 105.371513] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5046worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.23 seconds)5047client: waiting for success: ! systemctl is-active rs5048client: (finished: waiting for success: ! systemctl is-active rs, in 0.08 seconds)5049client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5050worker2 # [ 105.543358] nix-grpc-daemon[1034]: ts=2026-09-20T10:53:08Z level=info event=scheduler_restarting5051worker1 # [ 105.572751] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:08Z level=info event=scheduler_connected addr=lb:500515052worker1 # [ 105.577531] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5053client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.06 seconds)5054client: must fail: journalctl -u rs | grep -q 'reconnecting'5055worker2 # [ 105.588630] nix-grpc-daemon[1034]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5056worker2 # [ 105.604661] nix-grpc-daemon[1034]: E0000 00:00:1789901588.210040 1077 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true5057worker2 # [ 105.614342] nix-grpc-daemon[1034]: E0000 00:00:1789901588.210252 1077 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5058worker2 # [ 105.620224] nix-grpc-daemon[1034]: ts=2026-09-20T10:53:08Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5059worker2 # [ 105.625003] nix-daemon[832]: reaped child process 1083, status = succeeded5060client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.04 seconds)5061lb: must succeed: curl -sf localhost:9901/clusters5062lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5063worker1 # [ 105.773719] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:08Z level=info event=scheduler_connected addr=lb:500515064worker1 # [ 105.779124] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5065worker1 # [ 105.979959] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:08Z level=info event=scheduler_connected addr=lb:500515066worker1 # [ 105.985138] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5067worker1 # [ 106.186008] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:08Z level=info event=scheduler_connected addr=lb:500515068worker1 # [ 106.191241] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5069worker1 # [ 106.391857] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:09Z level=info event=scheduler_connected addr=lb:500515070worker1 # [ 106.397587] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5071worker2 # [ 106.572683] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5072worker2 # [ 106.577546] systemd[1]: Stopped Nix worker-protocol over gRPC.5073worker2 # [ 106.585080] systemd[1]: nix-grpc-daemon.service: Consumed 2.074s CPU time over 32.357s wall clock time, 36.4M memory peak, 60.2K incoming IP traffic, 114.4K outgoing IP traffic.5074worker1 # [ 106.599578] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:09Z level=info event=scheduler_connected addr=lb:500515075worker2 # [ 106.603624] systemd[1]: Starting Nix worker-protocol over gRPC...5076worker1 # [ 106.603851] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5077lb: must succeed: curl -sf localhost:9901/clusters5078lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5079worker1 # [ 106.800454] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:09Z level=info event=scheduler_connected addr=lb:500515080worker2 # [ 106.804237] nix-grpc-daemon[1313]: ts=2026-09-20T10:53:09Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5081worker2 # [ 106.806925] nix-grpc-daemon[1313]: ts=2026-09-20T10:53:09Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15082worker1 # [ 106.805564] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5083worker2 # [ 106.815313] nix-grpc-daemon[1313]: ts=2026-09-20T10:53:09Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5084worker2 # [ 106.819152] systemd[1]: Started Nix worker-protocol over gRPC.5085lb # [ 106.872526] niks3-server[954]: 2026/09/20 10:53:09 INFO lead: acquired remote=192.168.1.4:565765086worker2 # [ 106.829901] nix-grpc-daemon[1313]: ts=2026-09-20T10:53:09Z level=info event=scheduler_take_over5087worker2 # [ 106.853309] nix-grpc-daemon[1313]: ts=2026-09-20T10:53:09Z level=info event=scheduler_connected addr=lb:500515088worker2 # [ 106.855219] nix-grpc-daemon[1313]: ts=2026-09-20T10:53:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5089worker1 # [ 107.006566] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:09Z level=info event=scheduler_connected addr=lb:500515090worker1 # [ 107.011748] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5091worker2 # [ 107.056498] nix-grpc-daemon[1313]: ts=2026-09-20T10:53:09Z level=info event=scheduler_connected addr=lb:500515092worker2 # [ 107.061815] nix-grpc-daemon[1313]: ts=2026-09-20T10:53:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5093worker1 # [ 107.212634] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:09Z level=info event=scheduler_connected addr=lb:500515094worker1 # [ 107.217737] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5095worker2 # [ 107.262607] nix-grpc-daemon[1313]: ts=2026-09-20T10:53:09Z level=info event=scheduler_connected addr=lb:500515096worker2 # [ 107.268116] nix-grpc-daemon[1313]: ts=2026-09-20T10:53:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5097worker1 # [ 107.418479] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:10Z level=info event=scheduler_connected addr=lb:500515098worker1 # [ 107.423916] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5099worker2 # [ 107.468966] nix-grpc-daemon[1313]: ts=2026-09-20T10:53:10Z level=info event=scheduler_connected addr=lb:500515100worker2 # [ 107.474188] nix-grpc-daemon[1313]: ts=2026-09-20T10:53:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5101worker1 # [ 107.626256] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:10Z level=info event=scheduler_connected addr=lb:500515102worker2 # [ 107.631876] nix-grpc-daemon[1313]: ts=2026-09-20T10:53:10Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05103worker2 # [ 107.674892] nix-grpc-daemon[1313]: ts=2026-09-20T10:53:10Z level=info event=scheduler_connected addr=lb:500515104worker2 # [ 107.680516] nix-grpc-daemon[1313]: ts=2026-09-20T10:53:10Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05105lb: must succeed: curl -sf localhost:9901/clusters5106lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5107worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5108worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5109(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.24 seconds)5110subtest: scheduler restart mid-build: build finishes, no double build5111client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5112client # [ 108.089125] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5113client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.09 seconds)5114worker1 # [ 108.287100] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:436785115worker1 # [ 108.299495] nix-daemon[833]: accepted connection from pid 1304, user nix-grpc-daemon (trusted)5116client # Running as unit: mid.service; invocation ID: 34e12bf271a143cfab4b999c55ab953e5117client # [ 108.375764] nix[1209]: don't know how to build these paths:5118client # [ 108.379344] nix[1209]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5119worker2 # [ 108.339868] nix-grpc-daemon[1313]: ts=2026-09-20T10:53:10Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05120worker2 # [ 108.346379] nix-grpc-daemon[1313]: ts=2026-09-20T10:53:10Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=15121worker1 # [ 108.393373] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436785122worker1 # [ 108.415136] nix-grpc-daemon[1304]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 100 ms (attempt 1/5)5123worker1 # [ 108.523400] nix-grpc-daemon[1304]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 60 ms (attempt 2/5)5124worker1 # [ 108.584352] nix-grpc-daemon[1304]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 94 ms (attempt 3/5)5125worker1 # [ 108.679311] nix-grpc-daemon[1304]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 102 ms (attempt 4/5)5126worker1 # [ 108.789952] nix-grpc-daemon[1304]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5127worker1 # [ 108.811096] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:436785128client # [ 108.876156] nix[1209]: copying 1 paths to 'lb:50051'...5129client # [ 108.881790] nix[1209]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5130worker1 # [ 108.829703] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:436785131worker1 # [ 108.844323] nix-daemon[833]: accepted connection from pid 1304, user nix-grpc-daemon (trusted)5132worker1 # [ 108.873763] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:11Z level=info event=niks3_push_started pid=14145133worker1 # [ 109.280561] nix-daemon[833]: accepted connection from pid 1427, user nix-grpc-daemon (trusted)5134worker1 # [ 109.310388] nix-daemon[833]: reaped child process 1433, status = succeeded5135worker1 # [ 109.490553] nix-daemon[833]: accepted connection from pid 1436, user nix-grpc-daemon (trusted)5136worker1 # [ 109.508570] nix-daemon[833]: reaped child process 1439, status = succeeded5137lb # [ 109.569958] niks3-server[954]: 2026/09/20 10:53:12 INFO Received uploads request method=POST path=/api/pending_closures5138worker1 # [ 109.536594] nix-grpc-daemon[1414]: time=2026-09-20T10:53:12.164Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5139worker1 # [ 109.540088] nix-grpc-daemon[1414]: time=2026-09-20T10:53:12.166Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5140lb # [ 109.608951] niks3-server[954]: 2026/09/20 10:53:12 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5141lb # [ 109.623196] niks3-server[954]: 2026/09/20 10:53:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5142worker1 # [ 109.581856] nix-grpc-daemon[1414]: time=2026-09-20T10:53:12.210Z level=INFO msg="Uploading 1 narinfos"5143lb # [ 109.634821] niks3-server[954]: 2026/09/20 10:53:12 INFO Signed narinfos id=35 count=15144lb # [ 109.641775] niks3-server[954]: 2026/09/20 10:53:12 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5145lb # [ 109.652723] niks3-server[954]: 2026/09/20 10:53:12 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5146lb # [ 109.659904] niks3-server[954]: 2026/09/20 10:53:12 INFO Completed upload id=355147worker1 # [ 109.612754] nix-grpc-daemon[1414]: time=2026-09-20T10:53:12.241Z level=INFO msg="Upload complete. (508ms)"5148lb # [ 109.663034] niks3-server[954]: 2026/09/20 10:53:12 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo5149worker1 # [ 109.624357] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43678 duration_s=0 paths=1 nar_bytes_in=4245150worker1 # [ 109.635686] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436785151worker1 # [ 109.643277] nix-daemon[833]: accepted connection from pid 1304, user nix-grpc-daemon (trusted)5152worker1 # [ 109.648879] nix-daemon[833]: reaped child process 1412, status = succeeded5153client # [ 109.711866] nix[1209]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5154worker1 # [ 109.662431] nix-daemon[833]: accepted connection from pid 1304, user nix-grpc-daemon (trusted)5155lb: must succeed: curl -sf localhost:9901/clusters5156lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5157lb: must succeed: curl -sf localhost:9901/clusters5158lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5159worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5160worker2 # [ 110.921907] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1313 (nix-grpc-daemon) on client request.5161worker2 # [ 110.940715] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5162lb # [ 110.995368] niks3-server[954]: 2026/09/20 10:53:13 INFO lead: released remote=192.168.1.4:565765163worker1 # [ 110.953763] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:13Z level=info event=scheduler_disconnected addr=lb:50051 error="Stream removed (RST_STREAM (Received RST_STREAM with error code 2))"5164client # [ 111.006847] nix[1209]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5165worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.10 seconds)5166client: must succeed: sleep 5.05167worker2 # [ 110.979290] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5168worker2 # [ 110.983022] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5169worker2 # [ 110.984994] systemd[1]: nix-grpc-daemon.service: Consumed 190ms CPU time over 4.373s wall clock time, 13.6M memory peak, 7.9K incoming IP traffic, 9.1K outgoing IP traffic.5170worker1 # [ 111.153919] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:13Z level=info event=scheduler_connected addr=lb:500515171worker2 # [ 111.158783] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5172worker2 # [ 111.171030] systemd[1]: Starting Nix worker-protocol over gRPC...5173worker2 # [ 111.383449] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:14Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5174worker2 # [ 111.386085] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:14Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15175worker2 # [ 111.393860] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:14Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5176worker2 # [ 111.395611] systemd[1]: Started Nix worker-protocol over gRPC.5177worker2 # [ 111.404949] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:14Z level=info event=scheduler_take_over5178lb # [ 111.452087] niks3-server[954]: 2026/09/20 10:53:14 INFO lead: acquired remote=192.168.1.4:397685179worker2 # [ 111.420054] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:14Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=15180worker2 # [ 111.437112] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:14Z level=info event=scheduler_connected addr=lb:500515181worker2 # [ 111.439068] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:14Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05182lb # [ 111.519225] envoy[924]: conn peer=[2001:db8:1::1]:33224 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2953 tx=1351 ms=86455183lb # [ 111.525785] envoy[924]: conn peer=[2001:db8:1::4]:45384 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=7226 tx=2129 ms=310405184lb # [ 111.531241] envoy[924]: conn peer=[2001:db8:1::4]:41298 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=947 tx=362 ms=41085185client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5186worker1 # [ 116.286856] nix-daemon[833]: reaped child process 1443, status = succeeded5187client: waiting for success: ! systemctl is-active mid5188worker1 # [ 116.450513] nix-daemon[833]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)5189worker1 # [ 116.469056] nix-daemon[833]: reaped child process 1478, status = succeeded5190lb # [ 116.531438] niks3-server[954]: 2026/09/20 10:53:19 INFO Received uploads request method=POST path=/api/pending_closures5191worker1 # [ 116.496424] nix-grpc-daemon[1414]: time=2026-09-20T10:53:19.122Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5192worker1 # [ 116.497908] nix-grpc-daemon[1414]: time=2026-09-20T10:53:19.122Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5193lb # [ 116.567279] niks3-server[954]: 2026/09/20 10:53:19 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5194lb # [ 116.583831] niks3-server[954]: 2026/09/20 10:53:19 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5195lb # [ 116.598370] niks3-server[954]: 2026/09/20 10:53:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5196lb # [ 116.607162] niks3-server[954]: 2026/09/20 10:53:19 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls5197worker1 # [ 116.575497] nix-grpc-daemon[1414]: time=2026-09-20T10:53:19.202Z level=INFO msg="Uploading 1 narinfos"5198lb # [ 116.621203] niks3-server[954]: 2026/09/20 10:53:19 INFO Signed narinfos id=36 count=15199lb # [ 116.635534] niks3-server[954]: 2026/09/20 10:53:19 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5200worker1 # [ 116.594068] nix-grpc-daemon[1414]: time=2026-09-20T10:53:19.222Z level=INFO msg="Upload complete. (318ms)"5201lb # [ 116.643750] niks3-server[954]: 2026/09/20 10:53:19 INFO Completed upload id=365202lb # [ 116.646691] niks3-server[954]: 2026/09/20 10:53:19 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo5203worker1 # [ 116.605235] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43678 duration_s=6 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15204worker1 # [ 116.626033] nix-daemon[833]: reaped child process 1441, status = succeeded5205client # [ 116.703257] systemd[1]: mid.service: Deactivated successfully.5206client # [ 116.708288] systemd[1]: mid.service: Consumed 163ms CPU time over 8.617s wall clock time, 37.2M memory peak, 8.8K incoming IP traffic, 9.2K outgoing IP traffic.5207client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds)5208client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5209client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds)5210(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 9.58 seconds)5211subtest: interrupting the client stops the build on the worker5212client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5213client # [ 117.634311] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5214client # Running as unit: intr.service; invocation ID: 4854e2f9338843d8902c8237062c07f55215client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.05 seconds)5216worker2 # [ 117.810652] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:405465217worker2 # [ 117.826595] nix-daemon[832]: accepted connection from pid 1390, user nix-grpc-daemon (trusted)5218client # [ 117.895757] nix[1244]: don't know how to build these paths:5219client # [ 117.897595] nix[1244]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5220worker2 # [ 117.855473] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:20Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05221worker2 # [ 117.862382] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:20Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.4:50051 clients=15222worker2 # [ 117.901766] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:405465223worker2 # [ 117.918926] nix-grpc-daemon[1390]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 42 ms (attempt 1/5)5224worker2 # [ 117.968736] nix-grpc-daemon[1390]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 48 ms (attempt 2/5)5225worker2 # [ 118.024239] nix-grpc-daemon[1390]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 157 ms (attempt 3/5)5226worker2 # [ 118.188764] nix-grpc-daemon[1390]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 604 ms (attempt 4/5)5227worker2 # [ 118.801005] nix-grpc-daemon[1390]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5228worker2 # [ 118.824601] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:405465229client # [ 118.887766] nix[1244]: copying 1 paths to 'lb:50051'...5230worker2 # [ 118.835923] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:405465231client # [ 118.888298] nix[1244]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5232worker2 # [ 118.853201] nix-daemon[832]: accepted connection from pid 1390, user nix-grpc-daemon (trusted)5233worker2 # [ 118.897715] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:21Z level=info event=niks3_push_started pid=14645234worker2 # [ 119.280916] nix-daemon[832]: accepted connection from pid 1477, user nix-grpc-daemon (trusted)5235worker2 # [ 119.297856] nix-daemon[832]: reaped child process 1480, status = succeeded5236worker2 # [ 119.477269] nix-daemon[832]: accepted connection from pid 1482, user nix-grpc-daemon (trusted)5237worker2 # [ 119.494957] nix-daemon[832]: reaped child process 1485, status = succeeded5238lb # [ 119.554422] niks3-server[954]: 2026/09/20 10:53:22 INFO Received uploads request method=POST path=/api/pending_closures5239worker2 # [ 119.519196] nix-grpc-daemon[1464]: time=2026-09-20T10:53:22.153Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5240worker2 # [ 119.521043] nix-grpc-daemon[1464]: time=2026-09-20T10:53:22.153Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5241lb # [ 119.588204] niks3-server[954]: 2026/09/20 10:53:22 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5242lb # [ 119.600608] niks3-server[954]: 2026/09/20 10:53:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5243worker2 # [ 119.561125] nix-grpc-daemon[1464]: time=2026-09-20T10:53:22.196Z level=INFO msg="Uploading 1 narinfos"5244lb # [ 119.616995] niks3-server[954]: 2026/09/20 10:53:22 INFO Signed narinfos id=37 count=15245lb # [ 119.634006] niks3-server[954]: 2026/09/20 10:53:22 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5246worker2 # [ 119.597672] nix-grpc-daemon[1464]: time=2026-09-20T10:53:22.233Z level=INFO msg="Upload complete. (488ms)"5247lb # [ 119.644856] niks3-server[954]: 2026/09/20 10:53:22 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5248lb # [ 119.649595] niks3-server[954]: 2026/09/20 10:53:22 INFO Completed upload id=375249lb # [ 119.653642] niks3-server[954]: 2026/09/20 10:53:22 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5250worker2 # [ 119.607244] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40546 duration_s=0 paths=1 nar_bytes_in=4245251worker2 # [ 119.622540] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:405465252worker2 # [ 119.628430] nix-daemon[832]: accepted connection from pid 1390, user nix-grpc-daemon (trusted)5253worker2 # [ 119.633173] nix-daemon[832]: reaped child process 1460, status = succeeded5254worker2 # [ 119.645175] nix-daemon[832]: accepted connection from pid 1390, user nix-grpc-daemon (trusted)5255client # [ 119.695449] nix[1244]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5256client: must succeed: systemctl kill -s INT intr5257client # [ 121.401692] systemd[1]: intr.service: Sent signal SIGINT to main process 1244 (nix) on client request.5258client # [ 121.411774] nix[1244]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5259client # [ 121.420132] nix[1244]: error: interrupted by the user5260client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds)5261client # [ 121.450453] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5262client # [ 121.454592] systemd[1]: intr.service: Failed with result 'exit-code'.5263client # [ 121.456520] systemd[1]: intr.service: Consumed 141ms CPU time over 3.818s wall clock time, 37.2M memory peak, 7.7K incoming IP traffic, 8.7K outgoing IP traffic.5264lb # [ 121.518075] envoy[924]: conn peer=[2001:db8:1::1]:34650 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3035 tx=1422 ms=83545265lb # [ 121.523166] envoy[924]: conn peer=[2001:db8:1::1]:59024 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=757 ms=35765266worker2 # [ 121.483229] nix-daemon[832]: reaped child process 1487, status = succeeded5267worker2 # [ 121.486306] nix-daemon[1489]: unexpected Nix daemon error: error: interrupted by the user5268worker2 # [ 121.497549] nix-daemon[832]: reaped child process 1489, status = failed with exit code 15269(finished: subtest: interrupting the client stops the build on the worker, in 3.98 seconds)5270subtest: a deploy mid-build drains: the build finishes, the new generation takes over5271client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5272client # [ 121.644478] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5273client # Running as unit: sw.service; invocation ID: 385a540343fb4295bd359b8359b8c8945274client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.09 seconds)5275client # [ 121.894326] nix[1264]: don't know how to build these paths:5276client # [ 121.896294] nix[1264]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5277worker1 # [ 121.839965] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:436785278worker2 # [ 121.857163] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:24Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05279worker2 # [ 121.862806] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:24Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.3:50051 clients=15280worker1 # [ 121.904999] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436785281worker1 # [ 121.922193] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:436785282client # [ 121.988178] nix[1264]: copying 1 paths to 'lb:50051'...5283worker1 # [ 121.937690] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:436785284client # [ 121.992163] nix[1264]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5285worker1 # [ 121.955573] nix-daemon[833]: accepted connection from pid 1304, user nix-grpc-daemon (trusted)5286worker1 # [ 122.160338] nix-daemon[833]: accepted connection from pid 1506, user nix-grpc-daemon (trusted)5287worker1 # [ 122.180433] nix-daemon[833]: reaped child process 1509, status = succeeded5288worker1 # [ 122.354590] nix-daemon[833]: accepted connection from pid 1511, user nix-grpc-daemon (trusted)5289worker1 # [ 122.374320] nix-daemon[833]: reaped child process 1514, status = succeeded5290lb # [ 122.434119] niks3-server[954]: 2026/09/20 10:53:25 INFO Received uploads request method=POST path=/api/pending_closures5291worker1 # [ 122.402700] nix-grpc-daemon[1414]: time=2026-09-20T10:53:25.030Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5292worker1 # [ 122.404315] nix-grpc-daemon[1414]: time=2026-09-20T10:53:25.030Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5293lb # [ 122.468586] niks3-server[954]: 2026/09/20 10:53:25 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5294lb # [ 122.485624] niks3-server[954]: 2026/09/20 10:53:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5295worker1 # [ 122.443891] nix-grpc-daemon[1414]: time=2026-09-20T10:53:25.072Z level=INFO msg="Uploading 1 narinfos"5296lb # [ 122.496309] niks3-server[954]: 2026/09/20 10:53:25 INFO Signed narinfos id=38 count=15297lb # [ 122.498649] niks3-server[954]: 2026/09/20 10:53:25 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5298lb # [ 122.508076] niks3-server[954]: 2026/09/20 10:53:25 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5299lb # [ 122.515281] niks3-server[954]: 2026/09/20 10:53:25 INFO Completed upload id=385300worker1 # [ 122.467352] nix-grpc-daemon[1414]: time=2026-09-20T10:53:25.096Z level=INFO msg="Upload complete. (494ms)"5301lb # [ 122.517630] niks3-server[954]: 2026/09/20 10:53:25 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5302worker1 # [ 122.476846] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43678 duration_s=0 paths=1 nar_bytes_in=4165303worker1 # [ 122.487622] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:436785304worker1 # [ 122.494827] nix-daemon[833]: accepted connection from pid 1304, user nix-grpc-daemon (trusted)5305worker1 # [ 122.499598] nix-daemon[833]: reaped child process 1504, status = succeeded5306client # [ 122.561443] nix[1264]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5307worker1 # [ 122.512238] nix-daemon[833]: accepted connection from pid 1304, user nix-grpc-daemon (trusted)5308worker1: must succeed: systemctl reload nix-grpc-daemon.service5309worker1 # [ 124.288298] systemd[1]: Reloading Nix worker-protocol over gRPC...5310worker1 # [ 124.341152] systemd[1]: Reloaded Nix worker-protocol over gRPC.5311worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.11 seconds)5312worker1: must succeed: pgrep -f 'read -t [9]0 x'5313worker1 # [ 124.348186] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:26Z level=info event=draining5314worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds)5315client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&25316worker2 # [ 124.663184] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:27Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:405465317client # don't know how to build these paths:5318client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5319worker2 # [ 124.674876] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:405465320worker2 # [ 124.701580] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:27Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05321worker2 # [ 124.708678] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:27Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.4:50051 clients=15322worker2 # [ 124.754453] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:405465323worker2 # [ 124.770892] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:405465324client # copying 1 paths to 'lb:50051'...5325worker2 # [ 124.786897] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:405465326client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5327worker2 # [ 124.810844] nix-daemon[832]: accepted connection from pid 1390, user nix-grpc-daemon (trusted)5328worker2 # [ 125.023945] nix-daemon[832]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)5329worker2 # [ 125.043857] nix-daemon[832]: reaped child process 1542, status = succeeded5330worker2 # [ 125.218725] nix-daemon[832]: accepted connection from pid 1544, user nix-grpc-daemon (trusted)5331worker2 # [ 125.236102] nix-daemon[832]: reaped child process 1547, status = succeeded5332worker2 # [ 125.260198] nix-grpc-daemon[1464]: time=2026-09-20T10:53:27.895Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5333worker2 # [ 125.261728] nix-grpc-daemon[1464]: time=2026-09-20T10:53:27.895Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5334lb # [ 125.295905] niks3-server[954]: 2026/09/20 10:53:27 INFO Received uploads request method=POST path=/api/pending_closures5335lb # [ 125.326587] niks3-server[954]: 2026/09/20 10:53:27 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5336worker2 # [ 125.292276] nix-grpc-daemon[1464]: time=2026-09-20T10:53:27.927Z level=INFO msg="Uploading 1 narinfos"5337lb # [ 125.343021] niks3-server[954]: 2026/09/20 10:53:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5338lb # [ 125.352250] niks3-server[954]: 2026/09/20 10:53:27 INFO Signed narinfos id=39 count=15339lb # [ 125.355951] niks3-server[954]: 2026/09/20 10:53:27 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5340lb # [ 125.366538] niks3-server[954]: 2026/09/20 10:53:27 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5341lb # [ 125.371698] niks3-server[954]: 2026/09/20 10:53:27 INFO Completed upload id=395342lb # [ 125.374924] niks3-server[954]: 2026/09/20 10:53:28 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5343worker2 # [ 125.324739] nix-grpc-daemon[1464]: time=2026-09-20T10:53:27.960Z level=INFO msg="Upload complete. (495ms)"5344worker2 # [ 125.336117] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40546 duration_s=0 paths=1 nar_bytes_in=5285345worker2 # [ 125.346294] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:405465346worker2 # [ 125.353608] nix-daemon[832]: accepted connection from pid 1390, user nix-grpc-daemon (trusted)5347worker2 # [ 125.358354] nix-daemon[832]: reaped child process 1537, status = succeeded5348client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5349client # farm-a> worker2: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5350worker2 # [ 125.370980] nix-daemon[832]: accepted connection from pid 1390, user nix-grpc-daemon (trusted)5351client # farm-a> LOG-farm-a-during-drain5352worker2 # [ 126.210537] nix-daemon[832]: reaped child process 1551, status = succeeded5353worker2 # [ 126.389355] nix-daemon[832]: accepted connection from pid 1566, user nix-grpc-daemon (trusted)5354worker2 # [ 126.407203] nix-daemon[832]: reaped child process 1569, status = succeeded5355lb # [ 126.467173] niks3-server[954]: 2026/09/20 10:53:29 INFO Received uploads request method=POST path=/api/pending_closures5356worker2 # [ 126.432478] nix-grpc-daemon[1464]: time=2026-09-20T10:53:29.064Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5357worker2 # [ 126.434068] nix-grpc-daemon[1464]: time=2026-09-20T10:53:29.065Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5358lb # [ 126.499647] niks3-server[954]: 2026/09/20 10:53:29 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5359lb # [ 126.517424] niks3-server[954]: 2026/09/20 10:53:29 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5360lb # [ 126.532621] niks3-server[954]: 2026/09/20 10:53:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5361worker2 # [ 126.491453] nix-grpc-daemon[1464]: time=2026-09-20T10:53:29.125Z level=INFO msg="Uploading 1 narinfos"5362lb # [ 126.543702] niks3-server[954]: 2026/09/20 10:53:29 INFO Signed narinfos id=40 count=15363lb # [ 126.549856] niks3-server[954]: 2026/09/20 10:53:29 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5364lb # [ 126.556091] niks3-server[954]: 2026/09/20 10:53:29 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5365lb # [ 126.564739] niks3-server[954]: 2026/09/20 10:53:29 INFO Completed upload id=405366worker2 # [ 126.517382] nix-grpc-daemon[1464]: time=2026-09-20T10:53:29.152Z level=INFO msg="Upload complete. (336ms)"5367lb # [ 126.567193] niks3-server[954]: 2026/09/20 10:53:29 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo5368worker2 # [ 126.537049] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40546 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=3 outputs=15369worker2 # [ 126.551517] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:29Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05370worker2 # [ 126.555270] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:29Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.4:50051 clients=15371worker2 # [ 126.559099] nix-daemon[832]: reaped child process 1549, status = succeeded5372worker2 # [ 126.588070] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:405465373worker2 # [ 126.603522] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:405465374worker2 # [ 126.618556] nix-grpc-daemon[1464]: time=2026-09-20T10:53:29.254Z level=INFO msg="All 1 paths already cached"5375client # copying 1 paths to 'lb:50051'...5376worker2 # [ 126.628806] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:405465377client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5378worker2 # [ 126.652199] nix-daemon[832]: accepted connection from pid 1390, user nix-grpc-daemon (trusted)5379worker2 # [ 126.855987] nix-daemon[832]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5380worker2 # [ 126.876092] nix-daemon[832]: reaped child process 1578, status = succeeded5381worker2 # [ 127.054311] nix-daemon[832]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)5382worker2 # [ 127.071940] nix-daemon[832]: reaped child process 1583, status = succeeded5383lb # [ 127.130095] niks3-server[954]: 2026/09/20 10:53:29 INFO Received uploads request method=POST path=/api/pending_closures5384worker2 # [ 127.092887] nix-grpc-daemon[1464]: time=2026-09-20T10:53:29.728Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5385worker2 # [ 127.094402] nix-grpc-daemon[1464]: time=2026-09-20T10:53:29.728Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"5386lb # [ 127.157208] niks3-server[954]: 2026/09/20 10:53:29 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst5387worker2 # [ 127.131911] nix-grpc-daemon[1464]: time=2026-09-20T10:53:29.767Z level=INFO msg="Uploading 1 narinfos"5388lb # [ 127.173076] niks3-server[954]: 2026/09/20 10:53:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5389lb # [ 127.187058] niks3-server[954]: 2026/09/20 10:53:29 INFO Signed narinfos id=41 count=15390lb # [ 127.193254] niks3-server[954]: 2026/09/20 10:53:29 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls5391worker2 # [ 127.154653] nix-grpc-daemon[1464]: time=2026-09-20T10:53:29.790Z level=INFO msg="Upload complete. (485ms)"5392lb # [ 127.202223] niks3-server[954]: 2026/09/20 10:53:29 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5393lb # [ 127.207872] niks3-server[954]: 2026/09/20 10:53:29 INFO Completed upload id=415394lb # [ 127.211173] niks3-server[954]: 2026/09/20 10:53:29 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo5395worker2 # [ 127.164975] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40546 duration_s=0 paths=1 nar_bytes_in=6405396worker2 # [ 127.174484] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:405465397worker2 # [ 127.181582] nix-daemon[832]: accepted connection from pid 1390, user nix-grpc-daemon (trusted)5398worker2 # [ 127.186289] nix-daemon[832]: reaped child process 1573, status = succeeded5399client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...5400client # farm-b> worker2: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5401worker2 # [ 127.199027] nix-daemon[832]: accepted connection from pid 1390, user nix-grpc-daemon (trusted)5402worker2 # [ 128.420225] nix-daemon[832]: reaped child process 1587, status = succeeded5403client # farm-b> LOG-farm-b-during-drain5404worker2 # [ 128.580362] nix-daemon[832]: accepted connection from pid 1602, user nix-grpc-daemon (trusted)5405worker2 # [ 128.599584] nix-daemon[832]: reaped child process 1605, status = succeeded5406lb # [ 128.659819] niks3-server[954]: 2026/09/20 10:53:31 INFO Received uploads request method=POST path=/api/pending_closures5407worker2 # [ 128.625097] nix-grpc-daemon[1464]: time=2026-09-20T10:53:31.259Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5408worker2 # [ 128.626612] nix-grpc-daemon[1464]: time=2026-09-20T10:53:31.259Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"5409lb # [ 128.706560] niks3-server[954]: 2026/09/20 10:53:31 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst5410lb # [ 128.723004] niks3-server[954]: 2026/09/20 10:53:31 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5411lb # [ 128.732290] niks3-server[954]: 2026/09/20 10:53:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5412worker2 # [ 128.690650] nix-grpc-daemon[1464]: time=2026-09-20T10:53:31.325Z level=INFO msg="Uploading 1 narinfos"5413lb # [ 128.740453] niks3-server[954]: 2026/09/20 10:53:31 INFO Signed narinfos id=42 count=15414lb # [ 128.746599] niks3-server[954]: 2026/09/20 10:53:31 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls5415lb # [ 128.753664] niks3-server[954]: 2026/09/20 10:53:31 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5416lb # [ 128.760609] niks3-server[954]: 2026/09/20 10:53:31 INFO Completed upload id=425417worker2 # [ 128.712128] nix-grpc-daemon[1464]: time=2026-09-20T10:53:31.347Z level=INFO msg="Upload complete. (303ms)"5418lb # [ 128.763292] niks3-server[954]: 2026/09/20 10:53:31 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo5419worker2 # [ 128.729430] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40546 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=4 outputs=15420worker2 # [ 128.744372] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:31Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=05421worker2 # [ 128.747782] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:31Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.4:50051 clients=15422worker2 # [ 128.751968] nix-daemon[832]: reaped child process 1585, status = succeeded5423worker2 # [ 128.773508] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:405465424worker2 # [ 128.787665] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:405465425worker2 # [ 128.801587] nix-grpc-daemon[1464]: time=2026-09-20T10:53:31.437Z level=INFO msg="All 2 paths already cached"5426client # copying 1 paths to 'lb:50051'...5427client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...5428worker2 # [ 128.811981] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:405465429worker2 # [ 128.830120] nix-daemon[832]: accepted connection from pid 1390, user nix-grpc-daemon (trusted)5430worker2 # [ 129.040536] nix-daemon[832]: accepted connection from pid 1611, user nix-grpc-daemon (trusted)5431worker2 # [ 129.062381] nix-daemon[832]: reaped child process 1614, status = succeeded5432worker2 # [ 129.240762] nix-daemon[832]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5433worker2 # [ 129.263875] nix-daemon[832]: reaped child process 1619, status = succeeded5434lb # [ 129.322877] niks3-server[954]: 2026/09/20 10:53:31 INFO Received uploads request method=POST path=/api/pending_closures5435worker2 # [ 129.286951] nix-grpc-daemon[1464]: time=2026-09-20T10:53:31.922Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5436worker2 # [ 129.288620] nix-grpc-daemon[1464]: time=2026-09-20T10:53:31.922Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"5437lb # [ 129.353705] niks3-server[954]: 2026/09/20 10:53:31 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst5438worker2 # [ 129.316459] nix-grpc-daemon[1464]: time=2026-09-20T10:53:31.951Z level=INFO msg="Uploading 1 narinfos"5439lb # [ 129.363699] niks3-server[954]: 2026/09/20 10:53:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5440lb # [ 129.370876] niks3-server[954]: 2026/09/20 10:53:31 INFO Signed narinfos id=43 count=15441lb # [ 129.375211] niks3-server[954]: 2026/09/20 10:53:31 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls5442lb # [ 129.381163] niks3-server[954]: 2026/09/20 10:53:32 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5443worker2 # [ 129.337806] nix-grpc-daemon[1464]: time=2026-09-20T10:53:31.973Z level=INFO msg="Upload complete. (489ms)"5444lb # [ 129.387244] niks3-server[954]: 2026/09/20 10:53:32 INFO Completed upload id=435445lb # [ 129.392543] niks3-server[954]: 2026/09/20 10:53:32 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo5446worker2 # [ 129.344317] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40546 duration_s=0 paths=1 nar_bytes_in=7685447worker2 # [ 129.352818] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:405465448worker2 # [ 129.364193] nix-daemon[832]: accepted connection from pid 1390, user nix-grpc-daemon (trusted)5449worker2 # [ 129.367488] nix-daemon[832]: reaped child process 1609, status = succeeded5450client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...5451worker2 # [ 129.380949] nix-daemon[832]: accepted connection from pid 1390, user nix-grpc-daemon (trusted)5452client # farm-top> worker2: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5453client # farm-top> LOG-farm-top-during-drain5454worker2 # [ 130.426526] nix-daemon[832]: reaped child process 1623, status = succeeded5455worker2 # [ 130.598188] nix-daemon[832]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)5456worker2 # [ 130.618037] nix-daemon[832]: reaped child process 1641, status = succeeded5457lb # [ 130.679048] niks3-server[954]: 2026/09/20 10:53:33 INFO Received uploads request method=POST path=/api/pending_closures5458worker2 # [ 130.644486] nix-grpc-daemon[1464]: time=2026-09-20T10:53:33.279Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5459worker2 # [ 130.646023] nix-grpc-daemon[1464]: time=2026-09-20T10:53:33.279Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"5460lb # [ 130.725315] niks3-server[954]: 2026/09/20 10:53:33 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst5461lb # [ 130.743788] niks3-server[954]: 2026/09/20 10:53:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5462lb # [ 130.756410] niks3-server[954]: 2026/09/20 10:53:33 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5463lb # [ 130.762298] niks3-server[954]: 2026/09/20 10:53:33 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls5464lb # [ 130.769921] niks3-server[954]: 2026/09/20 10:53:33 INFO Signed narinfos id=44 count=15465worker2 # [ 130.723372] nix-grpc-daemon[1464]: time=2026-09-20T10:53:33.358Z level=INFO msg="Uploading 1 narinfos"5466lb # [ 130.778989] niks3-server[954]: 2026/09/20 10:53:33 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5467lb # [ 130.788437] niks3-server[954]: 2026/09/20 10:53:33 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo5468lb # [ 130.799998] niks3-server[954]: 2026/09/20 10:53:33 INFO Completed upload id=445469worker2 # [ 130.753166] nix-grpc-daemon[1464]: time=2026-09-20T10:53:33.388Z level=INFO msg="Upload complete. (361ms)"5470worker2 # [ 130.765537] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40546 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=5 outputs=15471worker2 # [ 130.786275] nix-daemon[832]: reaped child process 1621, status = succeeded5472client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 6.41 seconds)5473client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath5474client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.24 seconds)5475worker1: must succeed: pkill -f 'read -t [9]0 x'5476worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds)5477client: waiting for success: ! systemctl is-active sw5478worker1 # [ 131.138224] nix-daemon[833]: reaped child process 1518, status = succeeded5479worker1 # [ 131.304340] nix-daemon[833]: accepted connection from pid 1558, user nix-grpc-daemon (trusted)5480worker1 # [ 131.321484] nix-daemon[833]: reaped child process 1561, status = succeeded5481lb # [ 131.382112] niks3-server[954]: 2026/09/20 10:53:34 INFO Received uploads request method=POST path=/api/pending_closures5482worker1 # [ 131.347218] nix-grpc-daemon[1414]: time=2026-09-20T10:53:33.975Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5483worker1 # [ 131.349069] nix-grpc-daemon[1414]: time=2026-09-20T10:53:33.975Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"5484lb # [ 131.421828] niks3-server[954]: 2026/09/20 10:53:34 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5485worker1 # [ 131.388459] nix-grpc-daemon[1414]: time=2026-09-20T10:53:34.016Z level=INFO msg="Uploading 1 narinfos"5486lb # [ 131.439768] niks3-server[954]: 2026/09/20 10:53:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5487lb # [ 131.449697] niks3-server[954]: 2026/09/20 10:53:34 INFO Signed narinfos id=45 count=15488lb # [ 131.454681] niks3-server[954]: 2026/09/20 10:53:34 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls5489lb # [ 131.458285] niks3-server[954]: 2026/09/20 10:53:34 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5490lb # [ 131.465547] niks3-server[954]: 2026/09/20 10:53:34 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5491lb # [ 131.470533] niks3-server[954]: 2026/09/20 10:53:34 INFO Completed upload id=455492worker1 # [ 131.422866] nix-grpc-daemon[1414]: time=2026-09-20T10:53:34.051Z level=INFO msg="Upload complete. (294ms)"5493lb # [ 131.472870] niks3-server[954]: 2026/09/20 10:53:34 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo5494worker1 # [ 131.432821] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43678 duration_s=8 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=2 outputs=15495worker1 # [ 131.445187] nix-daemon[833]: reaped child process 1516, status = succeeded5496lb # [ 131.521266] envoy[924]: conn peer=[2001:db8:1::1]:57552 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9629 tx=3843 ms=61165497client # [ 131.529237] systemd[1]: sw.service: Deactivated successfully.5498lb # [ 131.527039] envoy[924]: conn peer=[2001:db8:1::1]:57536 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2922 tx=1309 ms=96075499client # [ 131.533913] systemd[1]: sw.service: Consumed 165ms CPU time over 9.888s wall clock time, 38.9M memory peak, 8.3K incoming IP traffic, 8.8K outgoing IP traffic.5500client: (finished: waiting for success: ! systemctl is-active sw, in 1.13 seconds)5501client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5502client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds)5503worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5504worker1 # [ 132.350786] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:34Z level=info event=signal_exit5505worker2 # [ 133.384711] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:36Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:405185506worker2 # [ 133.385007] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:36Z level=info event=worker_gone addr=192.168.1.3:500515507worker1 # [ 133.391513] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:36Z level=info event=scheduler_restarting5508worker1 # [ 133.407996] nix-grpc-daemon[1304]: ts=2026-09-20T10:53:36Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5509worker1 # [ 133.432689] nix-grpc-daemon[1304]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5510worker1 # [ 133.437522] nix-grpc-daemon[1304]: E0000 00:00:1789901616.060984 1347 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true5511worker1 # [ 133.443753] nix-grpc-daemon[1304]: E0000 00:00:1789901616.061205 1347 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5512worker1 # [ 133.450140] nix-daemon[833]: reaped child process 1407, status = succeeded5513worker1 # [ 134.809077] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5514worker1 # [ 134.814909] systemd[1]: nix-grpc-daemon.service: Consumed 1.107s CPU time over 40.699s wall clock time, 34M memory peak, 27.4K incoming IP traffic, 40.6K outgoing IP traffic.5515worker1 # [ 134.834428] systemd[1]: Starting Nix worker-protocol over gRPC...5516worker1 # [ 135.029818] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:37Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5517worker1 # [ 135.032272] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:37Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15518worker1 # [ 135.039949] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:37Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5519worker1 # [ 135.048088] systemd[1]: Started Nix worker-protocol over gRPC.5520worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.77 seconds)5521lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5522lb: must succeed: curl -sf localhost:9901/clusters5523worker1 # [ 135.086079] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:37Z level=info event=scheduler_connected addr=lb:500515524worker2 # [ 135.090172] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:37Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05525lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)5526lb: must succeed: curl -sf localhost:9901/clusters5527lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5528lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.17 seconds)5529lb: must succeed: curl -sf localhost:9901/clusters5530lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5531worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5532worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5533(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 14.85 seconds)5534subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5535client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15536worker1 # [ 136.646664] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:600185537worker1 # [ 136.661792] nix-daemon[833]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5538worker2 # [ 136.686314] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:405465539worker2 # [ 136.732174] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:39Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=05540worker2 # [ 136.738580] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:39Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=15541worker2 # [ 136.744869] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:39Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=05542worker2 # [ 136.750029] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:39Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=05543worker1 # [ 136.785891] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:600185544worker1 # [ 136.803633] nix-grpc-daemon[1575]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 38 ms (attempt 1/5)5545worker1 # [ 136.849444] nix-grpc-daemon[1575]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 7 ms (attempt 2/5)5546worker1 # [ 136.864391] nix-grpc-daemon[1575]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 293 ms (attempt 3/5)5547worker1 # [ 137.165158] nix-grpc-daemon[1575]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 100 ms (attempt 4/5)5548worker1 # [ 137.265954] nix-grpc-daemon[1575]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5549worker1 # [ 137.286637] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:600185550worker1 # [ 137.302501] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:600185551worker1 # [ 137.317404] nix-daemon[833]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5552worker1 # [ 137.346009] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:39Z level=info event=niks3_push_started pid=16315553worker1 # [ 137.731174] nix-daemon[833]: accepted connection from pid 1644, user nix-grpc-daemon (trusted)5554worker1 # [ 137.748169] nix-daemon[833]: reaped child process 1647, status = succeeded5555worker1 # [ 137.924857] nix-daemon[833]: accepted connection from pid 1649, user nix-grpc-daemon (trusted)5556worker1 # [ 137.940612] nix-daemon[833]: reaped child process 1652, status = succeeded5557lb # [ 138.002630] niks3-server[954]: 2026/09/20 10:53:40 INFO Received uploads request method=POST path=/api/pending_closures5558worker1 # [ 137.966835] nix-grpc-daemon[1631]: time=2026-09-20T10:53:40.593Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5559worker1 # [ 137.968497] nix-grpc-daemon[1631]: time=2026-09-20T10:53:40.594Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"5560lb # [ 138.039126] niks3-server[954]: 2026/09/20 10:53:40 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst5561worker1 # [ 138.005965] nix-grpc-daemon[1631]: time=2026-09-20T10:53:40.634Z level=INFO msg="Uploading 1 narinfos"5562lb # [ 138.054192] niks3-server[954]: 2026/09/20 10:53:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5563lb # [ 138.065121] niks3-server[954]: 2026/09/20 10:53:40 INFO Signed narinfos id=46 count=15564lb # [ 138.071950] niks3-server[954]: 2026/09/20 10:53:40 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls5565lb # [ 138.079017] niks3-server[954]: 2026/09/20 10:53:40 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5566lb # [ 138.087758] niks3-server[954]: 2026/09/20 10:53:40 INFO Completed upload id=465567lb # [ 138.091679] niks3-server[954]: 2026/09/20 10:53:40 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo5568worker1 # [ 138.038760] nix-grpc-daemon[1631]: time=2026-09-20T10:53:40.667Z level=INFO msg="Upload complete. (477ms)"5569worker1 # [ 138.048947] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60018 duration_s=0 paths=1 nar_bytes_in=5125570worker1 # [ 138.062450] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:600185571worker1 # [ 138.068725] nix-daemon[833]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5572worker1 # [ 138.074311] nix-daemon[833]: reaped child process 1629, status = succeeded5573worker1 # [ 138.087152] nix-daemon[833]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5574worker1 # [ 139.127800] nix-daemon[833]: reaped child process 1656, status = succeeded5575worker1 # [ 139.309203] nix-daemon[833]: accepted connection from pid 1671, user nix-grpc-daemon (trusted)5576worker1 # [ 139.328435] nix-daemon[833]: reaped child process 1674, status = succeeded5577lb # [ 139.391317] niks3-server[954]: 2026/09/20 10:53:42 INFO Received uploads request method=POST path=/api/pending_closures5578worker1 # [ 139.350587] nix-grpc-daemon[1631]: time=2026-09-20T10:53:41.978Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5579worker1 # [ 139.357148] nix-grpc-daemon[1631]: time=2026-09-20T10:53:41.981Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"5580lb # [ 139.421324] niks3-server[954]: 2026/09/20 10:53:42 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv5581lb # [ 139.444316] niks3-server[954]: 2026/09/20 10:53:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5582worker1 # [ 139.402169] nix-grpc-daemon[1631]: time=2026-09-20T10:53:42.030Z level=INFO msg="Uploading 1 narinfos"5583lb # [ 139.453016] niks3-server[954]: 2026/09/20 10:53:42 INFO Signed narinfos id=47 count=15584lb # [ 139.460309] niks3-server[954]: 2026/09/20 10:53:42 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5585lb # [ 139.470767] niks3-server[954]: 2026/09/20 10:53:42 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls5586lb # [ 139.479309] niks3-server[954]: 2026/09/20 10:53:42 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5587lb # [ 139.484340] niks3-server[954]: 2026/09/20 10:53:42 INFO Completed upload id=475588worker1 # [ 139.436492] nix-grpc-daemon[1631]: time=2026-09-20T10:53:42.065Z level=INFO msg="Upload complete. (338ms)"5589lb # [ 139.487101] niks3-server[954]: 2026/09/20 10:53:42 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo5590worker2 # [ 139.449118] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:42Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=15591worker1 # [ 139.450323] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60018 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=6 outputs=15592worker2 # [ 139.460843] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:42Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=05593worker1 # [ 139.468381] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:600185594worker1 # [ 139.479288] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:600185595worker1 # [ 139.485246] nix-daemon[833]: reaped child process 1654, status = succeeded5596worker1 # [ 139.492764] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:600185597worker1 # [ 139.503995] nix-daemon[833]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5598worker1 # [ 139.693478] nix-daemon[833]: accepted connection from pid 1678, user nix-grpc-daemon (trusted)5599worker1 # [ 139.710519] nix-daemon[833]: reaped child process 1681, status = succeeded5600worker1 # [ 139.882177] nix-daemon[833]: accepted connection from pid 1683, user nix-grpc-daemon (trusted)5601worker1 # [ 139.898746] nix-daemon[833]: reaped child process 1686, status = succeeded5602lb # [ 139.958538] niks3-server[954]: 2026/09/20 10:53:42 INFO Received uploads request method=POST path=/api/pending_closures5603worker1 # [ 139.919723] nix-grpc-daemon[1631]: time=2026-09-20T10:53:42.548Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5604worker1 # [ 139.921391] nix-grpc-daemon[1631]: time=2026-09-20T10:53:42.548Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"5605lb # [ 139.983883] niks3-server[954]: 2026/09/20 10:53:42 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst5606worker1 # [ 139.949539] nix-grpc-daemon[1631]: time=2026-09-20T10:53:42.578Z level=INFO msg="Uploading 1 narinfos"5607lb # [ 140.001197] niks3-server[954]: 2026/09/20 10:53:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5608lb # [ 140.010417] niks3-server[954]: 2026/09/20 10:53:42 INFO Signed narinfos id=48 count=15609lb # [ 140.014968] niks3-server[954]: 2026/09/20 10:53:42 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls5610lb # [ 140.022756] niks3-server[954]: 2026/09/20 10:53:42 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5611worker1 # [ 139.979795] nix-grpc-daemon[1631]: time=2026-09-20T10:53:42.608Z level=INFO msg="Upload complete. (464ms)"5612lb # [ 140.027386] niks3-server[954]: 2026/09/20 10:53:42 INFO Completed upload id=485613lb # [ 140.030498] niks3-server[954]: 2026/09/20 10:53:42 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo5614worker1 # [ 139.988214] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60018 duration_s=0 paths=1 nar_bytes_in=5125615worker1 # [ 139.998478] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:600185616worker1 # [ 140.004196] nix-daemon[833]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5617worker1 # [ 140.008781] nix-daemon[833]: reaped child process 1676, status = succeeded5618worker1 # [ 140.021067] nix-daemon[833]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5619worker1 # [ 141.250411] nix-daemon[833]: reaped child process 1690, status = succeeded5620worker1 # [ 141.412735] nix-daemon[833]: accepted connection from pid 1705, user nix-grpc-daemon (trusted)5621worker1 # [ 141.431538] nix-daemon[833]: reaped child process 1708, status = succeeded5622lb # [ 141.491308] niks3-server[954]: 2026/09/20 10:53:44 INFO Received uploads request method=POST path=/api/pending_closures5623worker1 # [ 141.453670] nix-grpc-daemon[1631]: time=2026-09-20T10:53:44.081Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5624worker1 # [ 141.455176] nix-grpc-daemon[1631]: time=2026-09-20T10:53:44.081Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"5625lb # [ 141.517981] envoy[924]: conn peer=[2001:db8:1::3]:60374 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3107 tx=906 ms=390215626lb # [ 141.534687] niks3-server[954]: 2026/09/20 10:53:44 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5627lb # [ 141.547143] niks3-server[954]: 2026/09/20 10:53:44 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv5628lb # [ 141.554533] niks3-server[954]: 2026/09/20 10:53:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5629worker1 # [ 141.512092] nix-grpc-daemon[1631]: time=2026-09-20T10:53:44.140Z level=INFO msg="Uploading 1 narinfos"5630lb # [ 141.563156] niks3-server[954]: 2026/09/20 10:53:44 INFO Signed narinfos id=49 count=15631lb # [ 141.569108] niks3-server[954]: 2026/09/20 10:53:44 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls5632lb # [ 141.577437] niks3-server[954]: 2026/09/20 10:53:44 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5633lb # [ 141.582884] niks3-server[954]: 2026/09/20 10:53:44 INFO Completed upload id=495634worker1 # [ 141.534923] nix-grpc-daemon[1631]: time=2026-09-20T10:53:44.163Z level=INFO msg="Upload complete. (304ms)"5635lb # [ 141.585734] niks3-server[954]: 2026/09/20 10:53:44 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo5636worker2 # [ 141.545225] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:44Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=15637worker1 # [ 141.548537] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60018 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=7 outputs=15638worker2 # [ 141.557365] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:44Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=05639worker1 # [ 141.564420] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:600185640worker1 # [ 141.570632] nix-daemon[833]: reaped child process 1688, status = succeeded5641worker1 # [ 141.578121] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:600185642worker1 # [ 141.590575] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:600185643worker1 # [ 141.602588] nix-daemon[833]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5644worker1 # [ 141.793232] nix-daemon[833]: accepted connection from pid 1712, user nix-grpc-daemon (trusted)5645worker1 # [ 141.813103] nix-daemon[833]: reaped child process 1715, status = succeeded5646worker1 # [ 141.988644] nix-daemon[833]: accepted connection from pid 1717, user nix-grpc-daemon (trusted)5647worker1 # [ 142.006085] nix-daemon[833]: reaped child process 1720, status = succeeded5648lb # [ 142.066165] niks3-server[954]: 2026/09/20 10:53:44 INFO Received uploads request method=POST path=/api/pending_closures5649worker1 # [ 142.027467] nix-grpc-daemon[1631]: time=2026-09-20T10:53:44.655Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5650worker1 # [ 142.029125] nix-grpc-daemon[1631]: time=2026-09-20T10:53:44.655Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"5651lb # [ 142.094637] niks3-server[954]: 2026/09/20 10:53:44 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst5652worker1 # [ 142.065178] nix-grpc-daemon[1631]: time=2026-09-20T10:53:44.693Z level=INFO msg="Uploading 1 narinfos"5653lb # [ 142.106102] niks3-server[954]: 2026/09/20 10:53:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5654lb # [ 142.121934] niks3-server[954]: 2026/09/20 10:53:44 INFO Signed narinfos id=50 count=15655lb # [ 142.127505] niks3-server[954]: 2026/09/20 10:53:44 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls5656lb # [ 142.135446] niks3-server[954]: 2026/09/20 10:53:44 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5657lb # [ 142.142499] niks3-server[954]: 2026/09/20 10:53:44 INFO Completed upload id=505658worker1 # [ 142.095161] nix-grpc-daemon[1631]: time=2026-09-20T10:53:44.723Z level=INFO msg="Upload complete. (479ms)"5659lb # [ 142.145210] niks3-server[954]: 2026/09/20 10:53:44 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo5660worker1 # [ 142.104791] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60018 duration_s=0 paths=1 nar_bytes_in=5125661worker1 # [ 142.115341] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:600185662worker1 # [ 142.122098] nix-daemon[833]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5663worker1 # [ 142.126906] nix-daemon[833]: reaped child process 1710, status = succeeded5664worker1 # [ 142.140248] nix-daemon[833]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5665worker1 # [ 143.561667] nix-daemon[833]: reaped child process 1724, status = succeeded5666worker1 # [ 143.767236] nix-daemon[833]: accepted connection from pid 1739, user nix-grpc-daemon (trusted)5667worker1 # [ 143.791510] nix-daemon[833]: reaped child process 1742, status = succeeded5668lb # [ 143.853692] niks3-server[954]: 2026/09/20 10:53:46 INFO Received uploads request method=POST path=/api/pending_closures5669worker1 # [ 143.818107] nix-grpc-daemon[1631]: time=2026-09-20T10:53:46.446Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5670worker1 # [ 143.821319] nix-grpc-daemon[1631]: time=2026-09-20T10:53:46.448Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"5671lb # [ 143.924882] niks3-server[954]: 2026/09/20 10:53:46 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv5672lb # [ 143.937998] niks3-server[954]: 2026/09/20 10:53:46 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst5673lb # [ 143.950600] niks3-server[954]: 2026/09/20 10:53:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign5674worker1 # [ 143.909005] nix-grpc-daemon[1631]: time=2026-09-20T10:53:46.537Z level=INFO msg="Uploading 1 narinfos"5675lb # [ 143.960970] niks3-server[954]: 2026/09/20 10:53:46 INFO Signed narinfos id=51 count=15676lb # [ 143.963522] niks3-server[954]: 2026/09/20 10:53:46 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls5677lb # [ 143.973843] niks3-server[954]: 2026/09/20 10:53:46 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete5678lb # [ 143.980305] niks3-server[954]: 2026/09/20 10:53:46 INFO Completed upload id=515679lb # [ 143.982696] niks3-server[954]: 2026/09/20 10:53:46 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo5680worker1 # [ 143.932520] nix-grpc-daemon[1631]: time=2026-09-20T10:53:46.561Z level=INFO msg="Upload complete. (381ms)"5681worker1 # [ 143.947026] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60018 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=8 outputs=15682worker2 # [ 143.953943] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:46Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=15683worker2 # [ 143.964924] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:46Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=05684worker1 # [ 143.972422] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:600185685worker1 # [ 143.982046] nix-daemon[833]: reaped child process 1722, status = succeeded5686worker1 # [ 143.987127] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:600185687worker1 # [ 144.004880] nix-grpc-daemon[1631]: time=2026-09-20T10:53:46.633Z level=INFO msg="All 1 paths already cached"5688worker1 # [ 144.015694] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:600185689worker1 # [ 144.038443] nix-daemon[833]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5690worker1 # [ 144.274801] nix-daemon[833]: accepted connection from pid 1746, user nix-grpc-daemon (trusted)5691worker1 # [ 144.294560] nix-daemon[833]: reaped child process 1749, status = succeeded5692worker1 # [ 144.522685] nix-daemon[833]: accepted connection from pid 1751, user nix-grpc-daemon (trusted)5693worker1 # [ 144.543315] nix-daemon[833]: reaped child process 1754, status = succeeded5694lb # [ 144.602852] niks3-server[954]: 2026/09/20 10:53:47 INFO Received uploads request method=POST path=/api/pending_closures5695worker1 # [ 144.565915] nix-grpc-daemon[1631]: time=2026-09-20T10:53:47.194Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5696worker1 # [ 144.567469] nix-grpc-daemon[1631]: time=2026-09-20T10:53:47.194Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"5697lb # [ 144.637750] niks3-server[954]: 2026/09/20 10:53:47 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst5698lb # [ 144.657991] niks3-server[954]: 2026/09/20 10:53:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign5699worker1 # [ 144.617488] nix-grpc-daemon[1631]: time=2026-09-20T10:53:47.245Z level=INFO msg="Uploading 1 narinfos"5700lb # [ 144.672778] niks3-server[954]: 2026/09/20 10:53:47 INFO Signed narinfos id=52 count=15701lb # [ 144.684665] niks3-server[954]: 2026/09/20 10:53:47 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls5702lb # [ 144.696728] niks3-server[954]: 2026/09/20 10:53:47 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete5703lb # [ 144.704590] niks3-server[954]: 2026/09/20 10:53:47 INFO Completed upload id=525704worker1 # [ 144.657609] nix-grpc-daemon[1631]: time=2026-09-20T10:53:47.286Z level=INFO msg="Upload complete. (595ms)"5705lb # [ 144.710516] niks3-server[954]: 2026/09/20 10:53:47 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo5706worker1 # [ 144.672447] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60018 duration_s=0 paths=1 nar_bytes_in=6245707worker1 # [ 144.689306] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:600185708worker1 # [ 144.713113] nix-daemon[833]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5709worker1 # [ 144.728283] nix-daemon[833]: reaped child process 1744, status = succeeded5710worker1 # [ 144.736118] nix-daemon[833]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5711worker1 # [ 145.960475] nix-daemon[833]: reaped child process 1758, status = succeeded5712worker1 # [ 146.131322] nix-daemon[833]: accepted connection from pid 1773, user nix-grpc-daemon (trusted)5713worker1 # [ 146.150187] nix-daemon[833]: reaped child process 1776, status = succeeded5714lb # [ 146.214071] niks3-server[954]: 2026/09/20 10:53:48 INFO Received uploads request method=POST path=/api/pending_closures5715worker1 # [ 146.178691] nix-grpc-daemon[1631]: time=2026-09-20T10:53:48.804Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5716worker1 # [ 146.180339] nix-grpc-daemon[1631]: time=2026-09-20T10:53:48.804Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"5717lb # [ 146.246152] niks3-server[954]: 2026/09/20 10:53:48 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv5718lb # [ 146.264595] niks3-server[954]: 2026/09/20 10:53:48 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst5719lb # [ 146.284129] niks3-server[954]: 2026/09/20 10:53:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign5720worker1 # [ 146.242279] nix-grpc-daemon[1631]: time=2026-09-20T10:53:48.870Z level=INFO msg="Uploading 1 narinfos"5721lb # [ 146.295777] niks3-server[954]: 2026/09/20 10:53:48 INFO Signed narinfos id=53 count=15722lb # [ 146.302233] niks3-server[954]: 2026/09/20 10:53:48 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls5723lb # [ 146.310716] niks3-server[954]: 2026/09/20 10:53:48 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete5724lb # [ 146.316183] niks3-server[954]: 2026/09/20 10:53:48 INFO Completed upload id=535725worker1 # [ 146.268285] nix-grpc-daemon[1631]: time=2026-09-20T10:53:48.896Z level=INFO msg="Upload complete. (318ms)"5726worker1 # [ 146.280363] nix-grpc-daemon[1631]: time=2026-09-20T10:53:48.901Z level=WARN msg="Failed to register uploaded object" key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo error="server returned 404: object is not pending upload\n"5727worker2 # [ 146.284600] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:48Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=15728worker2 # [ 146.292659] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:48Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=05729worker1 # [ 146.299387] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60018 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=9 outputs=15730worker1 # [ 146.315439] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:600185731worker1 # [ 146.321511] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:600185732worker1 # [ 146.327478] nix-daemon[833]: reaped child process 1756, status = succeeded5733worker1 # [ 146.331226] nix-grpc-daemon[1631]: time=2026-09-20T10:53:48.959Z level=INFO msg="All 1 paths already cached"5734worker1 # [ 146.339375] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:600185735worker1 # [ 146.350789] nix-daemon[833]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5736worker1 # [ 146.548773] nix-daemon[833]: accepted connection from pid 1780, user nix-grpc-daemon (trusted)5737worker1 # [ 146.567267] nix-daemon[833]: reaped child process 1783, status = succeeded5738worker1 # [ 146.752683] nix-daemon[833]: accepted connection from pid 1785, user nix-grpc-daemon (trusted)5739worker1 # [ 146.770529] nix-daemon[833]: reaped child process 1788, status = succeeded5740lb # [ 146.830749] niks3-server[954]: 2026/09/20 10:53:49 INFO Received uploads request method=POST path=/api/pending_closures5741worker1 # [ 146.792813] nix-grpc-daemon[1631]: time=2026-09-20T10:53:49.421Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5742worker1 # [ 146.794336] nix-grpc-daemon[1631]: time=2026-09-20T10:53:49.421Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"5743lb # [ 146.860115] niks3-server[954]: 2026/09/20 10:53:49 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst5744worker1 # [ 146.826981] nix-grpc-daemon[1631]: time=2026-09-20T10:53:49.455Z level=INFO msg="Uploading 1 narinfos"5745lb # [ 146.877074] niks3-server[954]: 2026/09/20 10:53:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign5746lb # [ 146.888856] niks3-server[954]: 2026/09/20 10:53:49 INFO Signed narinfos id=54 count=15747lb # [ 146.894836] niks3-server[954]: 2026/09/20 10:53:49 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls5748lb # [ 146.903894] niks3-server[954]: 2026/09/20 10:53:49 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete5749lb # [ 146.909433] niks3-server[954]: 2026/09/20 10:53:49 INFO Completed upload id=545750worker1 # [ 146.862047] nix-grpc-daemon[1631]: time=2026-09-20T10:53:49.490Z level=INFO msg="Upload complete. (497ms)"5751lb # [ 146.912644] niks3-server[954]: 2026/09/20 10:53:49 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo5752worker1 # [ 146.872422] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60018 duration_s=0 paths=1 nar_bytes_in=6245753worker1 # [ 146.883558] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:600185754worker1 # [ 146.891099] nix-daemon[833]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5755worker1 # [ 146.897219] nix-daemon[833]: reaped child process 1778, status = succeeded5756worker1 # [ 146.910945] nix-daemon[833]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5757worker1 # [ 148.359356] nix-daemon[833]: reaped child process 1792, status = succeeded5758worker1 # [ 148.552188] nix-daemon[833]: accepted connection from pid 1807, user nix-grpc-daemon (trusted)5759worker1 # [ 148.569838] nix-daemon[833]: reaped child process 1810, status = succeeded5760lb # [ 148.629758] niks3-server[954]: 2026/09/20 10:53:51 INFO Received uploads request method=POST path=/api/pending_closures5761worker1 # [ 148.592389] nix-grpc-daemon[1631]: time=2026-09-20T10:53:51.220Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5762worker1 # [ 148.593839] nix-grpc-daemon[1631]: time=2026-09-20T10:53:51.220Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"5763lb # [ 148.666300] niks3-server[954]: 2026/09/20 10:53:51 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst5764lb # [ 148.683691] niks3-server[954]: 2026/09/20 10:53:51 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv5765lb # [ 148.692214] niks3-server[954]: 2026/09/20 10:53:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign5766worker1 # [ 148.650248] nix-grpc-daemon[1631]: time=2026-09-20T10:53:51.278Z level=INFO msg="Uploading 1 narinfos"5767lb # [ 148.702540] niks3-server[954]: 2026/09/20 10:53:51 INFO Signed narinfos id=55 count=15768lb # [ 148.708004] niks3-server[954]: 2026/09/20 10:53:51 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls5769worker1 # [ 148.667844] nix-grpc-daemon[1631]: time=2026-09-20T10:53:51.296Z level=INFO msg="Upload complete. (343ms)"5770lb # [ 148.718541] niks3-server[954]: 2026/09/20 10:53:51 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete5771lb # [ 148.724191] niks3-server[954]: 2026/09/20 10:53:51 INFO Completed upload id=555772lb # [ 148.727428] niks3-server[954]: 2026/09/20 10:53:51 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo5773worker2 # [ 148.678939] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:51Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=15774worker1 # [ 148.678270] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60018 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=10 outputs=15775worker2 # [ 148.692978] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:51Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=05776worker1 # [ 148.696260] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:600185777worker1 # [ 148.706515] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:600185778worker1 # [ 148.711435] nix-daemon[833]: reaped child process 1790, status = succeeded5779worker1 # [ 148.723313] nix-grpc-daemon[1631]: time=2026-09-20T10:53:51.352Z level=INFO msg="All 1 paths already cached"5780worker1 # [ 148.732510] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:600185781worker1 # [ 148.743697] nix-daemon[833]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5782worker1 # [ 148.936194] nix-daemon[833]: accepted connection from pid 1814, user nix-grpc-daemon (trusted)5783worker1 # [ 148.953361] nix-daemon[833]: reaped child process 1817, status = succeeded5784worker1 # [ 149.127892] nix-daemon[833]: accepted connection from pid 1819, user nix-grpc-daemon (trusted)5785worker1 # [ 149.145119] nix-daemon[833]: reaped child process 1822, status = succeeded5786lb # [ 149.204072] niks3-server[954]: 2026/09/20 10:53:51 INFO Received uploads request method=POST path=/api/pending_closures5787worker1 # [ 149.165660] nix-grpc-daemon[1631]: time=2026-09-20T10:53:51.794Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5788worker1 # [ 149.167129] nix-grpc-daemon[1631]: time=2026-09-20T10:53:51.794Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"5789lb # [ 149.233727] niks3-server[954]: 2026/09/20 10:53:51 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst5790worker1 # [ 149.195566] nix-grpc-daemon[1631]: time=2026-09-20T10:53:51.824Z level=INFO msg="Uploading 1 narinfos"5791lb # [ 149.245365] niks3-server[954]: 2026/09/20 10:53:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign5792lb # [ 149.257737] niks3-server[954]: 2026/09/20 10:53:51 INFO Signed narinfos id=56 count=15793lb # [ 149.262212] niks3-server[954]: 2026/09/20 10:53:51 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls5794worker1 # [ 149.224798] nix-grpc-daemon[1631]: time=2026-09-20T10:53:51.853Z level=INFO msg="Upload complete. (468ms)"5795lb # [ 149.272485] niks3-server[954]: 2026/09/20 10:53:51 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete5796lb # [ 149.279269] niks3-server[954]: 2026/09/20 10:53:51 INFO Completed upload id=565797worker1 # [ 149.231503] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60018 duration_s=0 paths=1 nar_bytes_in=6245798lb # [ 149.282787] niks3-server[954]: 2026/09/20 10:53:51 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo5799worker1 # [ 149.243521] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:600185800worker1 # [ 149.249775] nix-daemon[833]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5801worker1 # [ 149.254587] nix-daemon[833]: reaped child process 1812, status = succeeded5802worker1 # [ 149.265099] nix-daemon[833]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5803worker1 # [ 150.287326] nix-daemon[833]: reaped child process 1826, status = succeeded5804worker1 # [ 150.444655] nix-daemon[833]: accepted connection from pid 1841, user nix-grpc-daemon (trusted)5805worker1 # [ 150.462896] nix-daemon[833]: reaped child process 1844, status = succeeded5806lb # [ 150.522879] niks3-server[954]: 2026/09/20 10:53:53 INFO Received uploads request method=POST path=/api/pending_closures5807worker1 # [ 150.485581] nix-grpc-daemon[1631]: time=2026-09-20T10:53:53.113Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5808worker1 # [ 150.487015] nix-grpc-daemon[1631]: time=2026-09-20T10:53:53.113Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"5809lb # [ 150.561641] niks3-server[954]: 2026/09/20 10:53:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign5810worker1 # [ 150.523859] nix-grpc-daemon[1631]: time=2026-09-20T10:53:53.152Z level=INFO msg="Uploading 1 narinfos"5811lb # [ 150.576972] niks3-server[954]: 2026/09/20 10:53:53 INFO Signed narinfos id=57 count=15812lb # [ 150.585652] niks3-server[954]: 2026/09/20 10:53:53 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv5813lb # [ 150.593711] niks3-server[954]: 2026/09/20 10:53:53 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst5814worker1 # [ 150.556510] nix-grpc-daemon[1631]: time=2026-09-20T10:53:53.185Z level=INFO msg="Upload complete. (280ms)"5815lb # [ 150.604456] niks3-server[954]: 2026/09/20 10:53:53 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls5816lb # [ 150.610011] niks3-server[954]: 2026/09/20 10:53:53 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete5817lb # [ 150.614962] niks3-server[954]: 2026/09/20 10:53:53 INFO Completed upload id=575818worker2 # [ 150.564842] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:53Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=15819lb # [ 150.617621] niks3-server[954]: 2026/09/20 10:53:53 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo5820worker1 # [ 150.564663] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60018 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=11 outputs=15821worker1 # [ 150.578554] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:600185822worker2 # [ 150.579477] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:53Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=05823worker1 # [ 150.583599] nix-daemon[833]: reaped child process 1824, status = succeeded5824worker1 # [ 150.590295] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:600185825worker1 # [ 150.602374] nix-grpc-daemon[1631]: time=2026-09-20T10:53:53.231Z level=INFO msg="All 2 paths already cached"5826worker1 # [ 150.609318] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:600185827worker1 # [ 150.619173] nix-daemon[833]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5828worker1 # [ 150.807918] nix-daemon[833]: accepted connection from pid 1848, user nix-grpc-daemon (trusted)5829worker1 # [ 150.824514] nix-daemon[833]: reaped child process 1851, status = succeeded5830worker1 # [ 151.006682] nix-daemon[833]: accepted connection from pid 1853, user nix-grpc-daemon (trusted)5831worker1 # [ 151.023664] nix-daemon[833]: reaped child process 1856, status = succeeded5832lb # [ 151.082775] niks3-server[954]: 2026/09/20 10:53:53 INFO Received uploads request method=POST path=/api/pending_closures5833worker1 # [ 151.044133] nix-grpc-daemon[1631]: time=2026-09-20T10:53:53.672Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5834worker1 # [ 151.045971] nix-grpc-daemon[1631]: time=2026-09-20T10:53:53.674Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"5835lb # [ 151.110654] niks3-server[954]: 2026/09/20 10:53:53 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst5836worker1 # [ 151.076869] nix-grpc-daemon[1631]: time=2026-09-20T10:53:53.705Z level=INFO msg="Uploading 1 narinfos"5837lb # [ 151.127932] niks3-server[954]: 2026/09/20 10:53:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign5838lb # [ 151.139513] niks3-server[954]: 2026/09/20 10:53:53 INFO Signed narinfos id=58 count=15839worker1 # [ 151.102589] nix-grpc-daemon[1631]: time=2026-09-20T10:53:53.731Z level=INFO msg="Upload complete. (472ms)"5840lb # [ 151.144285] niks3-server[954]: 2026/09/20 10:53:53 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls5841worker1 # [ 151.108166] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60018 duration_s=0 paths=1 nar_bytes_in=7525842lb # [ 151.156204] niks3-server[954]: 2026/09/20 10:53:53 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete5843lb # [ 151.161299] niks3-server[954]: 2026/09/20 10:53:53 INFO Completed upload id=585844lb # [ 151.163748] niks3-server[954]: 2026/09/20 10:53:53 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo5845worker1 # [ 151.118884] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:600185846worker1 # [ 151.125182] nix-daemon[833]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5847worker1 # [ 151.129680] nix-daemon[833]: reaped child process 1846, status = succeeded5848worker1 # [ 151.141944] nix-daemon[833]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5849worker1 # [ 151.967436] nix-daemon[833]: reaped child process 1860, status = succeeded5850worker1 # [ 152.135568] nix-daemon[833]: accepted connection from pid 1875, user nix-grpc-daemon (trusted)5851worker1 # [ 152.155285] nix-daemon[833]: reaped child process 1878, status = succeeded5852lb # [ 152.216941] niks3-server[954]: 2026/09/20 10:53:54 INFO Received uploads request method=POST path=/api/pending_closures5853worker1 # [ 152.180394] nix-grpc-daemon[1631]: time=2026-09-20T10:53:54.806Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5854worker1 # [ 152.181892] nix-grpc-daemon[1631]: time=2026-09-20T10:53:54.807Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"5855lb # [ 152.252391] niks3-server[954]: 2026/09/20 10:53:54 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst5856lb # [ 152.269372] niks3-server[954]: 2026/09/20 10:53:54 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv5857lb # [ 152.277783] niks3-server[954]: 2026/09/20 10:53:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign5858worker1 # [ 152.235434] nix-grpc-daemon[1631]: time=2026-09-20T10:53:54.863Z level=INFO msg="Uploading 1 narinfos"5859lb # [ 152.287714] niks3-server[954]: 2026/09/20 10:53:54 INFO Signed narinfos id=59 count=15860lb # [ 152.291950] niks3-server[954]: 2026/09/20 10:53:54 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls5861worker1 # [ 152.251172] nix-grpc-daemon[1631]: time=2026-09-20T10:53:54.879Z level=INFO msg="Upload complete. (300ms)"5862lb # [ 152.299538] niks3-server[954]: 2026/09/20 10:53:54 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete5863lb # [ 152.304255] niks3-server[954]: 2026/09/20 10:53:54 INFO Completed upload id=595864lb # [ 152.306505] niks3-server[954]: 2026/09/20 10:53:54 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo5865worker2 # [ 152.259016] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:54Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=15866worker1 # [ 152.260195] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60018 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=12 outputs=15867worker1 # [ 152.274025] nix-daemon[833]: reaped child process 1858, status = succeeded5868worker1 # [ 152.304422] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:600185869worker1 # [ 152.318982] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:600185870worker1 # [ 152.332648] nix-grpc-daemon[1631]: time=2026-09-20T10:53:54.961Z level=INFO msg="All 2 paths already cached"5871worker1 # [ 152.341091] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:600185872worker1 # [ 152.354700] nix-daemon[833]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5873worker1 # [ 152.554450] nix-daemon[833]: accepted connection from pid 1882, user nix-grpc-daemon (trusted)5874worker1 # [ 152.573420] nix-daemon[833]: reaped child process 1885, status = succeeded5875worker1 # [ 152.750620] nix-daemon[833]: accepted connection from pid 1887, user nix-grpc-daemon (trusted)5876worker1 # [ 152.769028] nix-daemon[833]: reaped child process 1890, status = succeeded5877lb # [ 152.829030] niks3-server[954]: 2026/09/20 10:53:55 INFO Received uploads request method=POST path=/api/pending_closures5878worker1 # [ 152.790050] nix-grpc-daemon[1631]: time=2026-09-20T10:53:55.418Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5879worker1 # [ 152.791550] nix-grpc-daemon[1631]: time=2026-09-20T10:53:55.418Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"5880lb # [ 152.855937] niks3-server[954]: 2026/09/20 10:53:55 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst5881worker1 # [ 152.820840] nix-grpc-daemon[1631]: time=2026-09-20T10:53:55.449Z level=INFO msg="Uploading 1 narinfos"5882lb # [ 152.870012] niks3-server[954]: 2026/09/20 10:53:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign5883lb # [ 152.880488] niks3-server[954]: 2026/09/20 10:53:55 INFO Signed narinfos id=60 count=15884lb # [ 152.883674] niks3-server[954]: 2026/09/20 10:53:55 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls5885lb # [ 152.894105] niks3-server[954]: 2026/09/20 10:53:55 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete5886worker1 # [ 152.853336] nix-grpc-daemon[1631]: time=2026-09-20T10:53:55.482Z level=INFO msg="Upload complete. (479ms)"5887lb # [ 152.901589] niks3-server[954]: 2026/09/20 10:53:55 INFO Completed upload id=605888lb # [ 152.903849] niks3-server[954]: 2026/09/20 10:53:55 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo5889worker1 # [ 152.861051] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60018 duration_s=0 paths=1 nar_bytes_in=7525890worker1 # [ 152.874484] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:600185891worker1 # [ 152.880735] nix-daemon[833]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5892worker1 # [ 152.885718] nix-daemon[833]: reaped child process 1880, status = succeeded5893worker1 # [ 152.899293] nix-daemon[833]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5894worker1 # [ 153.719346] nix-daemon[833]: reaped child process 1894, status = succeeded5895worker1 # [ 153.881959] nix-daemon[833]: accepted connection from pid 1909, user nix-grpc-daemon (trusted)5896worker1 # [ 153.900544] nix-daemon[833]: reaped child process 1912, status = succeeded5897lb # [ 153.963309] niks3-server[954]: 2026/09/20 10:53:56 INFO Received uploads request method=POST path=/api/pending_closures5898worker1 # [ 153.927162] nix-grpc-daemon[1631]: time=2026-09-20T10:53:56.554Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5899worker1 # [ 153.928746] nix-grpc-daemon[1631]: time=2026-09-20T10:53:56.554Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"5900lb # [ 153.993342] niks3-server[954]: 2026/09/20 10:53:56 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv5901lb # [ 154.006097] niks3-server[954]: 2026/09/20 10:53:56 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst5902lb # [ 154.025277] niks3-server[954]: 2026/09/20 10:53:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign5903worker1 # [ 153.982803] nix-grpc-daemon[1631]: time=2026-09-20T10:53:56.611Z level=INFO msg="Uploading 1 narinfos"5904lb # [ 154.032640] niks3-server[954]: 2026/09/20 10:53:56 INFO Signed narinfos id=61 count=15905lb # [ 154.035310] niks3-server[954]: 2026/09/20 10:53:56 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls5906lb # [ 154.045902] niks3-server[954]: 2026/09/20 10:53:56 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete5907lb # [ 154.053340] niks3-server[954]: 2026/09/20 10:53:56 INFO Completed upload id=615908worker1 # [ 154.005385] nix-grpc-daemon[1631]: time=2026-09-20T10:53:56.634Z level=INFO msg="Upload complete. (297ms)"5909lb # [ 154.056292] niks3-server[954]: 2026/09/20 10:53:56 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo5910worker2 # [ 154.015970] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:56Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=15911worker1 # [ 154.016502] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60018 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=13 outputs=15912worker1 # [ 154.030960] nix-daemon[833]: reaped child process 1892, status = succeeded5913worker1 # [ 154.063427] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:600185914worker1 # [ 154.079268] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:600185915worker1 # [ 154.095013] nix-grpc-daemon[1631]: time=2026-09-20T10:53:56.723Z level=INFO msg="All 2 paths already cached"5916worker1 # [ 154.104097] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:600185917worker1 # [ 154.117714] nix-daemon[833]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5918worker1 # [ 154.322470] nix-daemon[833]: accepted connection from pid 1916, user nix-grpc-daemon (trusted)5919worker1 # [ 154.343042] nix-daemon[833]: reaped child process 1919, status = succeeded5920worker1 # [ 154.515556] nix-daemon[833]: accepted connection from pid 1921, user nix-grpc-daemon (trusted)5921worker1 # [ 154.530982] nix-daemon[833]: reaped child process 1924, status = succeeded5922lb # [ 154.593816] niks3-server[954]: 2026/09/20 10:53:57 INFO Received uploads request method=POST path=/api/pending_closures5923worker1 # [ 154.555598] nix-grpc-daemon[1631]: time=2026-09-20T10:53:57.184Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5924worker1 # [ 154.557216] nix-grpc-daemon[1631]: time=2026-09-20T10:53:57.184Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"5925lb # [ 154.619537] niks3-server[954]: 2026/09/20 10:53:57 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst5926worker1 # [ 154.585286] nix-grpc-daemon[1631]: time=2026-09-20T10:53:57.213Z level=INFO msg="Uploading 1 narinfos"5927lb # [ 154.634060] niks3-server[954]: 2026/09/20 10:53:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign5928lb # [ 154.643280] niks3-server[954]: 2026/09/20 10:53:57 INFO Signed narinfos id=62 count=15929lb # [ 154.653377] niks3-server[954]: 2026/09/20 10:53:57 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete5930worker1 # [ 154.611217] nix-grpc-daemon[1631]: time=2026-09-20T10:53:57.239Z level=INFO msg="Upload complete. (476ms)"5931lb # [ 154.659659] niks3-server[954]: 2026/09/20 10:53:57 INFO Completed upload id=625932lb # [ 154.664101] niks3-server[954]: 2026/09/20 10:53:57 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo5933worker1 # [ 154.620202] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60018 duration_s=0 paths=1 nar_bytes_in=7525934lb # [ 154.668654] niks3-server[954]: 2026/09/20 10:53:57 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls5935worker1 # [ 154.629116] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:600185936worker1 # [ 154.635378] nix-daemon[833]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5937worker1 # [ 154.640391] nix-daemon[833]: reaped child process 1914, status = succeeded5938worker1 # [ 154.652740] nix-daemon[833]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5939worker1 # [ 155.899934] nix-daemon[833]: reaped child process 1928, status = succeeded5940worker1 # [ 156.081979] nix-daemon[833]: accepted connection from pid 1943, user nix-grpc-daemon (trusted)5941worker1 # [ 156.101409] nix-daemon[833]: reaped child process 1946, status = succeeded5942lb # [ 156.163904] niks3-server[954]: 2026/09/20 10:53:58 INFO Received uploads request method=POST path=/api/pending_closures5943worker1 # [ 156.128170] nix-grpc-daemon[1631]: time=2026-09-20T10:53:58.754Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5944worker1 # [ 156.129689] nix-grpc-daemon[1631]: time=2026-09-20T10:53:58.754Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"5945lb # [ 156.201651] niks3-server[954]: 2026/09/20 10:53:58 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst5946lb # [ 156.214453] niks3-server[954]: 2026/09/20 10:53:58 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv5947worker1 # [ 156.179431] nix-grpc-daemon[1631]: time=2026-09-20T10:53:58.807Z level=INFO msg="Uploading 1 narinfos"5948lb # [ 156.226698] niks3-server[954]: 2026/09/20 10:53:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign5949lb # [ 156.232113] niks3-server[954]: 2026/09/20 10:53:58 INFO Signed narinfos id=63 count=15950lb # [ 156.234720] niks3-server[954]: 2026/09/20 10:53:58 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls5951lb # [ 156.246703] niks3-server[954]: 2026/09/20 10:53:58 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete5952lb # [ 156.253798] niks3-server[954]: 2026/09/20 10:53:58 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo5953lb # [ 156.258233] niks3-server[954]: 2026/09/20 10:53:58 INFO Completed upload id=635954worker1 # [ 156.210966] nix-grpc-daemon[1631]: time=2026-09-20T10:53:58.839Z level=INFO msg="Upload complete. (347ms)"5955worker1 # [ 156.221311] nix-grpc-daemon[1575]: ts=2026-09-20T10:53:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60018 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=14 outputs=15956worker1 # [ 156.241307] nix-daemon[833]: reaped child process 1926, status = succeeded5957client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 19.93 seconds)5958worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5959worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5960client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&15961worker2 # [ 156.629805] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:59Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:405465962worker2 # [ 156.641404] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:405465963worker2 # [ 156.667409] nix-grpc-daemon[1390]: ts=2026-09-20T10:53:59Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=05964lb # [ 161.521367] envoy[924]: conn peer=[2001:db8:1::1]:60914 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27118 tx=10771 ms=196025965client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 30.34 seconds)5966(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 50.34 seconds)5967subtest: low disk drains a worker and builds go to the other5968worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill5969worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.11 seconds)5970worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'5971worker1 # [ 188.070868] nix-grpc-daemon[1575]: ts=2026-09-20T10:54:30Z level=info event=unhealthy reason=min_free5972worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.12 seconds)5973client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&25974worker2 # [ 189.198169] nix-grpc-daemon[1390]: ts=2026-09-20T10:54:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:405465975client # don't know how to build these paths:5976client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv5977worker1 # [ 189.213813] nix-grpc-daemon[1575]: ts=2026-09-20T10:54:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:600185978worker2 # [ 189.243513] nix-grpc-daemon[1390]: ts=2026-09-20T10:54:31Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=05979worker2 # [ 189.251159] nix-grpc-daemon[1390]: ts=2026-09-20T10:54:31Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=15980worker2 # [ 189.289477] nix-grpc-daemon[1390]: ts=2026-09-20T10:54:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:405465981worker2 # [ 189.306839] nix-grpc-daemon[1390]: ts=2026-09-20T10:54:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:405465982client # copying 1 paths to 'lb:50051'...5983client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...5984worker2 # [ 189.323012] nix-grpc-daemon[1390]: ts=2026-09-20T10:54:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:405465985worker2 # [ 189.342636] nix-daemon[832]: accepted connection from pid 1390, user nix-grpc-daemon (trusted)5986worker2 # [ 189.555185] nix-daemon[832]: accepted connection from pid 1666, user nix-grpc-daemon (trusted)5987worker2 # [ 189.575352] nix-daemon[832]: reaped child process 1669, status = succeeded5988worker2 # [ 189.743265] nix-daemon[832]: accepted connection from pid 1671, user nix-grpc-daemon (trusted)5989worker2 # [ 189.762832] nix-daemon[832]: reaped child process 1674, status = succeeded5990lb # [ 189.822060] niks3-server[954]: 2026/09/20 10:54:32 INFO Received uploads request method=POST path=/api/pending_closures5991worker2 # [ 189.789644] nix-grpc-daemon[1464]: time=2026-09-20T10:54:32.424Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5992worker2 # [ 189.791168] nix-grpc-daemon[1464]: time=2026-09-20T10:54:32.424Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"5993lb # [ 189.857843] niks3-server[954]: 2026/09/20 10:54:32 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst5994lb # [ 189.871459] niks3-server[954]: 2026/09/20 10:54:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign5995worker2 # [ 189.830909] nix-grpc-daemon[1464]: time=2026-09-20T10:54:32.466Z level=INFO msg="Uploading 1 narinfos"5996lb # [ 189.880751] niks3-server[954]: 2026/09/20 10:54:32 INFO Signed narinfos id=64 count=15997lb # [ 189.888069] niks3-server[954]: 2026/09/20 10:54:32 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls5998lb # [ 189.899015] niks3-server[954]: 2026/09/20 10:54:32 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete5999lb # [ 189.905699] niks3-server[954]: 2026/09/20 10:54:32 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6000lb # [ 189.911246] niks3-server[954]: 2026/09/20 10:54:32 INFO Completed upload id=646001worker2 # [ 189.864456] nix-grpc-daemon[1464]: time=2026-09-20T10:54:32.499Z level=INFO msg="Upload complete. (502ms)"6002worker2 # [ 189.873935] nix-grpc-daemon[1390]: ts=2026-09-20T10:54:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40546 duration_s=0 paths=1 nar_bytes_in=5126003worker2 # [ 189.889267] nix-grpc-daemon[1390]: ts=2026-09-20T10:54:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:405466004worker2 # [ 189.896375] nix-daemon[832]: accepted connection from pid 1390, user nix-grpc-daemon (trusted)6005worker2 # [ 189.901691] nix-daemon[832]: reaped child process 1664, status = succeeded6006client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6007client # farm-a> worker2: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6008worker2 # [ 189.915997] nix-daemon[832]: accepted connection from pid 1390, user nix-grpc-daemon (trusted)6009client # farm-a> LOG-farm-a-drain6010worker2 # [ 190.556689] nix-daemon[832]: reaped child process 1678, status = succeeded6011worker2 # [ 190.739744] nix-daemon[832]: accepted connection from pid 1693, user nix-grpc-daemon (trusted)6012worker2 # [ 190.757081] nix-daemon[832]: reaped child process 1696, status = succeeded6013lb # [ 190.816589] niks3-server[954]: 2026/09/20 10:54:33 INFO Received uploads request method=POST path=/api/pending_closures6014worker2 # [ 190.781833] nix-grpc-daemon[1464]: time=2026-09-20T10:54:33.416Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6015worker2 # [ 190.783495] nix-grpc-daemon[1464]: time=2026-09-20T10:54:33.416Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6016lb # [ 190.857140] niks3-server[954]: 2026/09/20 10:54:33 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6017lb # [ 190.872447] niks3-server[954]: 2026/09/20 10:54:33 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6018worker2 # [ 190.833633] nix-grpc-daemon[1464]: time=2026-09-20T10:54:33.468Z level=INFO msg="Uploading 1 narinfos"6019lb # [ 190.882757] niks3-server[954]: 2026/09/20 10:54:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6020lb # [ 190.890620] niks3-server[954]: 2026/09/20 10:54:33 INFO Signed narinfos id=65 count=16021worker2 # [ 190.852206] nix-grpc-daemon[1464]: time=2026-09-20T10:54:33.487Z level=INFO msg="Upload complete. (325ms)"6022lb # [ 190.899369] niks3-server[954]: 2026/09/20 10:54:33 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6023lb # [ 190.903429] niks3-server[954]: 2026/09/20 10:54:33 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6024lb # [ 190.908131] niks3-server[954]: 2026/09/20 10:54:33 INFO Completed upload id=656025lb # [ 190.910778] niks3-server[954]: 2026/09/20 10:54:33 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6026worker2 # [ 190.862040] nix-grpc-daemon[1390]: ts=2026-09-20T10:54:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40546 duration_s=0 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=15 outputs=16027worker2 # [ 190.877419] nix-daemon[832]: reaped child process 1676, status = succeeded6028worker2 # [ 190.910340] nix-grpc-daemon[1390]: ts=2026-09-20T10:54:33Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06029worker2 # [ 190.917567] nix-grpc-daemon[1390]: ts=2026-09-20T10:54:33Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16030worker2 # [ 190.927089] nix-grpc-daemon[1390]: ts=2026-09-20T10:54:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:405466031worker2 # [ 190.938486] nix-grpc-daemon[1390]: ts=2026-09-20T10:54:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:405466032worker2 # [ 190.952172] nix-grpc-daemon[1464]: time=2026-09-20T10:54:33.587Z level=INFO msg="All 1 paths already cached"6033client # copying 1 paths to 'lb:50051'...6034client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6035worker2 # [ 190.962149] nix-grpc-daemon[1390]: ts=2026-09-20T10:54:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:405466036worker2 # [ 190.975611] nix-daemon[832]: accepted connection from pid 1390, user nix-grpc-daemon (trusted)6037worker2 # [ 191.171497] nix-daemon[832]: accepted connection from pid 1702, user nix-grpc-daemon (trusted)6038worker2 # [ 191.191828] nix-daemon[832]: reaped child process 1705, status = succeeded6039worker2 # [ 191.361067] nix-daemon[832]: accepted connection from pid 1707, user nix-grpc-daemon (trusted)6040worker2 # [ 191.380253] nix-daemon[832]: reaped child process 1710, status = succeeded6041lb # [ 191.438322] niks3-server[954]: 2026/09/20 10:54:34 INFO Received uploads request method=POST path=/api/pending_closures6042worker2 # [ 191.400062] nix-grpc-daemon[1464]: time=2026-09-20T10:54:34.035Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6043worker2 # [ 191.401582] nix-grpc-daemon[1464]: time=2026-09-20T10:54:34.035Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6044lb # [ 191.466801] niks3-server[954]: 2026/09/20 10:54:34 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6045worker2 # [ 191.431928] nix-grpc-daemon[1464]: time=2026-09-20T10:54:34.067Z level=INFO msg="Uploading 1 narinfos"6046lb # [ 191.482955] niks3-server[954]: 2026/09/20 10:54:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6047lb # [ 191.493473] niks3-server[954]: 2026/09/20 10:54:34 INFO Signed narinfos id=66 count=16048worker2 # [ 191.455556] nix-grpc-daemon[1464]: time=2026-09-20T10:54:34.091Z level=INFO msg="Upload complete. (465ms)"6049lb # [ 191.502882] niks3-server[954]: 2026/09/20 10:54:34 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6050worker2 # [ 191.464285] nix-grpc-daemon[1390]: ts=2026-09-20T10:54:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40546 duration_s=0 paths=1 nar_bytes_in=6326051lb # [ 191.509798] niks3-server[954]: 2026/09/20 10:54:34 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6052lb # [ 191.516221] niks3-server[954]: 2026/09/20 10:54:34 INFO Completed upload id=666053worker2 # [ 191.469314] nix-grpc-daemon[1390]: ts=2026-09-20T10:54:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:405466054lb # [ 191.518972] niks3-server[954]: 2026/09/20 10:54:34 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6055worker2 # [ 191.479429] nix-daemon[832]: accepted connection from pid 1390, user nix-grpc-daemon (trusted)6056lb # [ 191.525953] envoy[924]: conn peer=[2001:db8:1::1]:39834 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=500 ms=300626057worker2 # [ 191.484153] nix-daemon[832]: reaped child process 1700, status = succeeded6058client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6059worker2 # [ 191.495546] nix-daemon[832]: accepted connection from pid 1390, user nix-grpc-daemon (trusted)6060client # farm-b> worker2: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6061worker2 # [ 192.915839] nix-daemon[832]: reaped child process 1714, status = succeeded6062client # farm-b> LOG-farm-b-drain6063worker2 # [ 193.073371] nix-daemon[832]: accepted connection from pid 1729, user nix-grpc-daemon (trusted)6064worker2 # [ 193.091839] nix-daemon[832]: reaped child process 1732, status = succeeded6065lb # [ 193.151120] niks3-server[954]: 2026/09/20 10:54:35 INFO Received uploads request method=POST path=/api/pending_closures6066worker2 # [ 193.115517] nix-grpc-daemon[1464]: time=2026-09-20T10:54:35.749Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6067worker2 # [ 193.119157] nix-grpc-daemon[1464]: time=2026-09-20T10:54:35.749Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6068lb # [ 193.188272] niks3-server[954]: 2026/09/20 10:54:35 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6069lb # [ 193.201107] niks3-server[954]: 2026/09/20 10:54:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6070worker2 # [ 193.159767] nix-grpc-daemon[1464]: time=2026-09-20T10:54:35.795Z level=INFO msg="Uploading 1 narinfos"6071lb # [ 193.210502] niks3-server[954]: 2026/09/20 10:54:35 INFO Signed narinfos id=67 count=16072lb # [ 193.217582] niks3-server[954]: 2026/09/20 10:54:35 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6073lb # [ 193.223899] niks3-server[954]: 2026/09/20 10:54:35 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6074worker2 # [ 193.183811] nix-grpc-daemon[1464]: time=2026-09-20T10:54:35.819Z level=INFO msg="Upload complete. (279ms)"6075lb # [ 193.230324] niks3-server[954]: 2026/09/20 10:54:35 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6076lb # [ 193.235762] niks3-server[954]: 2026/09/20 10:54:35 INFO Completed upload id=676077lb # [ 193.238265] niks3-server[954]: 2026/09/20 10:54:35 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6078worker2 # [ 193.195561] nix-grpc-daemon[1390]: ts=2026-09-20T10:54:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40546 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=16 outputs=16079worker2 # [ 193.211310] nix-grpc-daemon[1390]: ts=2026-09-20T10:54:35Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06080worker2 # [ 193.215158] nix-grpc-daemon[1390]: ts=2026-09-20T10:54:35Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16081worker2 # [ 193.219040] nix-daemon[832]: reaped child process 1712, status = succeeded6082worker2 # [ 193.249856] nix-grpc-daemon[1390]: ts=2026-09-20T10:54:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:405466083worker2 # [ 193.264223] nix-grpc-daemon[1390]: ts=2026-09-20T10:54:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:405466084worker2 # [ 193.276903] nix-grpc-daemon[1464]: time=2026-09-20T10:54:35.912Z level=INFO msg="All 2 paths already cached"6085client # copying 1 paths to 'lb:50051'...6086client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6087worker2 # [ 193.287070] nix-grpc-daemon[1390]: ts=2026-09-20T10:54:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:405466088worker2 # [ 193.301759] nix-daemon[832]: accepted connection from pid 1390, user nix-grpc-daemon (trusted)6089worker2 # [ 193.499081] nix-daemon[832]: accepted connection from pid 1738, user nix-grpc-daemon (trusted)6090worker2 # [ 193.517851] nix-daemon[832]: reaped child process 1741, status = succeeded6091worker2 # [ 193.690887] nix-daemon[832]: accepted connection from pid 1743, user nix-grpc-daemon (trusted)6092worker2 # [ 193.707071] nix-daemon[832]: reaped child process 1746, status = succeeded6093lb # [ 193.765197] niks3-server[954]: 2026/09/20 10:54:36 INFO Received uploads request method=POST path=/api/pending_closures6094worker2 # [ 193.726803] nix-grpc-daemon[1464]: time=2026-09-20T10:54:36.362Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6095worker2 # [ 193.728391] nix-grpc-daemon[1464]: time=2026-09-20T10:54:36.362Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6096lb # [ 193.791511] niks3-server[954]: 2026/09/20 10:54:36 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6097worker2 # [ 193.758170] nix-grpc-daemon[1464]: time=2026-09-20T10:54:36.393Z level=INFO msg="Uploading 1 narinfos"6098lb # [ 193.807557] niks3-server[954]: 2026/09/20 10:54:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6099lb # [ 193.820633] niks3-server[954]: 2026/09/20 10:54:36 INFO Signed narinfos id=68 count=16100lb # [ 193.823719] niks3-server[954]: 2026/09/20 10:54:36 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6101lb # [ 193.831957] niks3-server[954]: 2026/09/20 10:54:36 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6102lb # [ 193.839979] niks3-server[954]: 2026/09/20 10:54:36 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6103lb # [ 193.844074] niks3-server[954]: 2026/09/20 10:54:36 INFO Completed upload id=686104worker2 # [ 193.797412] nix-grpc-daemon[1464]: time=2026-09-20T10:54:36.432Z level=INFO msg="Upload complete. (481ms)"6105worker2 # [ 193.808303] nix-grpc-daemon[1390]: ts=2026-09-20T10:54:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40546 duration_s=0 paths=1 nar_bytes_in=7606106worker2 # [ 193.820327] nix-grpc-daemon[1390]: ts=2026-09-20T10:54:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:405466107worker2 # [ 193.826410] nix-daemon[832]: accepted connection from pid 1390, user nix-grpc-daemon (trusted)6108worker2 # [ 193.830788] nix-daemon[832]: reaped child process 1736, status = succeeded6109client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6110worker2 # [ 193.842041] nix-daemon[832]: accepted connection from pid 1390, user nix-grpc-daemon (trusted)6111client # farm-top> worker2: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6112client # farm-top> LOG-farm-top-drain6113worker2 # [ 195.290114] nix-daemon[832]: reaped child process 1750, status = succeeded6114worker2 # [ 195.475956] nix-daemon[832]: accepted connection from pid 1765, user nix-grpc-daemon (trusted)6115worker2 # [ 195.494351] nix-daemon[832]: reaped child process 1768, status = succeeded6116lb # [ 195.556681] niks3-server[954]: 2026/09/20 10:54:38 INFO Received uploads request method=POST path=/api/pending_closures6117worker2 # [ 195.519861] nix-grpc-daemon[1464]: time=2026-09-20T10:54:38.154Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6118worker2 # [ 195.521633] nix-grpc-daemon[1464]: time=2026-09-20T10:54:38.154Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6119lb # [ 195.599722] niks3-server[954]: 2026/09/20 10:54:38 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6120lb # [ 195.614763] niks3-server[954]: 2026/09/20 10:54:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6121worker2 # [ 195.572477] nix-grpc-daemon[1464]: time=2026-09-20T10:54:38.207Z level=INFO msg="Uploading 1 narinfos"6122lb # [ 195.619340] niks3-server[954]: 2026/09/20 10:54:38 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6123lb # [ 195.623989] niks3-server[954]: 2026/09/20 10:54:38 INFO Signed narinfos id=69 count=16124lb # [ 195.626219] niks3-server[954]: 2026/09/20 10:54:38 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6125lb # [ 195.635771] niks3-server[954]: 2026/09/20 10:54:38 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6126worker2 # [ 195.593880] nix-grpc-daemon[1464]: time=2026-09-20T10:54:38.229Z level=INFO msg="Upload complete. (337ms)"6127lb # [ 195.642820] niks3-server[954]: 2026/09/20 10:54:38 INFO Completed upload id=696128lb # [ 195.645567] niks3-server[954]: 2026/09/20 10:54:38 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6129worker2 # [ 195.605815] nix-grpc-daemon[1390]: ts=2026-09-20T10:54:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40546 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=17 outputs=16130worker2 # [ 195.625060] nix-daemon[832]: reaped child process 1748, status = succeeded6131client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 6.71 seconds)6132client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath6133client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.23 seconds)6134worker1: must succeed: rm /nix/.rw-store/fill6135worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.16 seconds)6136worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6137worker1 # [ 197.078784] nix-grpc-daemon[1575]: ts=2026-09-20T10:54:39Z level=info event=healthy reason=min_free6138worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds)6139(finished: subtest: low disk drains a worker and builds go to the other, in 10.55 seconds)6140(finished: run the VM test script, in 198.15 seconds)6141test script finished in 198.44s6142cleanup6143kill QemuMachine (pid 49)6144client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6145kill QemuMachine (pid 50)6146lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6147kill QemuMachine (pid 52)6148worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6149kill QemuMachine (pid 51)6150worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6151(finished: cleanup, in 1.02 seconds)6152additionally exposed symbols:6153 client, lb, worker1, worker2,6154 vlan1,6155 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh