vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #237
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12client # Disk image does not exist, creating the virtualisation disk image...13client # Formatting '/build/vm-state-client/tmp.8JZRon84fh', fmt=raw size=107374182414client # mke2fs 1.47.4 (6-Mar-2025)15client # Discarding device blocks: 0/262144 done16client # Creating filesystem with 262144 4k blocks and 65536 inodes17client # Filesystem UUID: 5c6c59d9-66d5-4d9a-aec2-94145266481f18client: QEMU running (pid 49)19client # Superblock backups stored on blocks:20lb # Disk image does not exist, creating the virtualisation disk image...21client # 32768, 98304, 163840, 22937622worker2 # Disk image does not exist, creating the virtualisation disk image...23worker1: QEMU running (pid 50)24worker1 # Disk image does not exist, creating the virtualisation disk image...25client # 26worker2 # Formatting '/build/vm-state-worker2/tmp.BEuae36LAt', fmt=raw size=107374182427lb: QEMU running (pid 51)28worker2: QEMU running (pid 52)29lb # Formatting '/build/vm-state-lb/tmp.6x6hnmu4CO', fmt=raw size=107374182430worker1 # Formatting '/build/vm-state-worker1/tmp.w1zvtnsmft', fmt=raw size=107374182431worker2 # mke2fs 1.47.4 (6-Mar-2025)32client # Allocating group tables: 0/8 done33lb # mke2fs 1.47.4 (6-Mar-2025)34(finished: start all VMs, in 0.51 seconds)35worker1 # mke2fs 1.47.4 (6-Mar-2025)36worker2 # Discarding device blocks: 0/262144 done37client # Writing inode tables: 0/8 done38lb # Discarding device blocks: 0/262144 done39client: waiting for unit network-addresses-eth1.service40client # Creating journal (8192 blocks): done41lb # Creating filesystem with 262144 4k blocks and 65536 inodes42client: waiting for the VM to finish booting43client # Writing superblocks and filesystem accounting information: 0/8 done44lb # Filesystem UUID: 3c657710-7f42-46bf-998e-877eb706c02045worker1 # Discarding device blocks: 0/262144 done46worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes47client # 48lb # Superblock backups stored on blocks:49worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes50worker2 # Filesystem UUID: 3d4bcb35-e471-481a-ae75-0338713edd1451client # Virtualisation disk image created.52lb # 32768, 98304, 163840, 22937653worker1 # Filesystem UUID: ebeabc69-007e-4336-a53a-3d6214bc09e954lb # 55worker1 # Superblock backups stored on blocks:56lb # Allocating group tables: 0/8 done57worker1 # 32768, 98304, 163840, 22937658lb # Writing inode tables: 0/8 done59worker1 # 60lb # Creating journal (8192 blocks): done61worker1 # Allocating group tables: 0/8 done62lb # Writing superblocks and filesystem accounting information: 0/8 done63worker1 # Writing inode tables: 0/8 done64lb # 65worker1 # Creating journal (8192 blocks): done66lb # Virtualisation disk image created.67worker1 # Writing superblocks and filesystem accounting information: 0/8 done68worker2 # Superblock backups stored on blocks:69worker1 # 70worker2 # 32768, 98304, 163840, 22937671worker1 # Virtualisation disk image created.72worker2 # 73worker2 # Allocating group tables: 0/8 done74worker2 # Writing inode tables: 0/8 done75worker2 # Creating journal (8192 blocks): done76worker2 # Writing superblocks and filesystem accounting information: 0/8 done77worker2 # 78worker2 # Virtualisation disk image created.79client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]80client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202681client # [ 0.000000] KASLR enabled82client # [ 0.000000] random: crng init done83client # [ 0.000000] Machine model: linux,dummy-virt84client # [ 0.000000] efi: UEFI not found.85client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT86client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]87client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]88client # [ 0.000000] Zone ranges:89client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]90client # [ 0.000000] DMA32 empty91client # [ 0.000000] Normal empty92client # [ 0.000000] Device empty93client # [ 0.000000] Movable zone start for each node94client # [ 0.000000] Early memory node ranges95client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]96client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]97client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c40000098client # [ 0.000000] psci: probing for conduit method from DT.99client # [ 0.000000] psci: PSCIv1.3 detected in firmware.100client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs101client # [ 0.000000] psci: Trusted OS migration not required102client # [ 0.000000] psci: SMC Calling Convention v1.1103client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)104client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296105client # [ 0.000000] Detected PIPT I-cache on CPU0106client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)107client # [ 0.000000] CPU features: detected: GICv3 CPU interface108client # [ 0.000000] CPU features: detected: Spectre-v4109client # [ 0.000000] CPU features: detected: Spectre-BHB110client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38111client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23112client # [ 0.000000] alternatives: applying boot alternatives113client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/knm2rnivax139w5fp50r3x29k5mj4l28-nixos-system-client-test/init regInfo=/nix/store/lcyxd7fx5gdnixf1ay086bcihx3jf2vi-closure-info/registration console=ttyAMA0,115200n8 console=tty0114client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/lcyxd7fx5gdnixf1ay086bcihx3jf2vi-closure-info/registration", will be passed to user space.115client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes116client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)117client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)118client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB119client # [ 0.000000] software IO TLB: area num 1.120client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB121client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)122client # [ 0.000000] Fallback order for Node 0: 0123client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216124client # [ 0.000000] Policy zone: DMA125client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off126client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1127client # [ 0.000000] allocated 3145728 bytes of page_ext128client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages129client # [ 0.000000] ftrace: allocated 294 pages with 4 groups130client # [ 0.000000] rcu: Hierarchical RCU implementation.131client # [ 0.000000] rcu: RCU event tracing is enabled.132client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.133client # [ 0.000000] Trampoline variant of Tasks RCU enabled.134client # [ 0.000000] Rude variant of Tasks RCU enabled.135client # [ 0.000000] Tracing variant of Tasks RCU enabled.136client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.137lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]138client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1139client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.140lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026141lb # [ 0.000000] KASLR enabled142client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.143lb # [ 0.000000] random: crng init done144lb # [ 0.000000] Machine model: linux,dummy-virt145lb # [ 0.000000] efi: UEFI not found.146client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.147client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0148lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT149client # [ 0.000000] GICv3: 256 SPIs implemented150lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]151client # [ 0.000000] GICv3: 0 Extended SPIs implemented152client # [ 0.000000] Root IRQ handler: gic_handle_irq153lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]154lb # [ 0.000000] Zone ranges:155worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]156client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI157lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]158client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0159lb # [ 0.000000] DMA32 empty160lb # [ 0.000000] Normal empty161client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000162worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026163lb # [ 0.000000] Device empty164worker2 # [ 0.000000] KASLR enabled165client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]166lb # [ 0.000000] Movable zone start for each node167worker2 # [ 0.000000] random: crng init done168lb # [ 0.000000] Early memory node ranges169worker2 # [ 0.000000] Machine model: linux,dummy-virt170client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)171worker2 # [ 0.000000] efi: UEFI not found.172lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]173worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT174lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]175client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)176lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000177client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000178worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]179lb # [ 0.000000] psci: probing for conduit method from DT.180worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]181client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000182worker2 # [ 0.000000] Zone ranges:183lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.184lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs185client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.186worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]187worker2 # [ 0.000000] DMA32 empty188lb # [ 0.000000] psci: Trusted OS migration not required189worker2 # [ 0.000000] Normal empty190lb # [ 0.000000] psci: SMC Calling Convention v1.1191client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns192worker2 # [ 0.000000] Device empty193worker2 # [ 0.000000] Movable zone start for each node194client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).195worker2 # [ 0.000000] Early memory node ranges196lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)197worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]198lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296199client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns200lb # [ 0.000000] Detected PIPT I-cache on CPU0201worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]202client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns203worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000204lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)205client # [ 0.000036] arm-pv: using stolen time PV206worker2 # [ 0.000000] psci: probing for conduit method from DT.207lb # [ 0.000000] CPU features: detected: GICv3 CPU interface208worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.209lb # [ 0.000000] CPU features: detected: Spectre-v4210client # [ 0.000726] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)211lb # [ 0.000000] CPU features: detected: Spectre-BHB212worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs213client # [ 0.000918] Console: colour dummy device 80x25214worker2 # [ 0.000000] psci: Trusted OS migration not required215lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38216client # [ 0.000925] printk: legacy console [tty0] enabled217worker2 # [ 0.000000] psci: SMC Calling Convention v1.1218lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23219lb # [ 0.000000] alternatives: applying boot alternatives220worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)221client # [ 0.001152] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)222worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]223client # [ 0.001159] pid_max: default: 32768 minimum: 301224worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296225client # [ 0.001229] LSM: initializing lsm=capability,landlock,yama,bpf,ima226worker2 # [ 0.000000] Detected PIPT I-cache on CPU0227client # [ 0.001413] landlock: Up and running.228worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026229client # [ 0.001416] Yama: becoming mindful.230worker1 # [ 0.000000] KASLR enabled231worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)232worker1 # [ 0.000000] random: crng init done233client # [ 0.002106] LSM support for eBPF active234worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface235worker1 # [ 0.000000] Machine model: linux,dummy-virt236worker2 # [ 0.000000] CPU features: detected: Spectre-v4237worker1 # [ 0.000000] efi: UEFI not found.238lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ynn2zqc2v8ljbhyrx04lvra7yrxsl31x-nixos-system-lb-test/init regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration console=ttyAMA0,115200n8 console=tty0239client # [ 0.002258] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)240worker2 # [ 0.000000] CPU features: detected: Spectre-BHB241worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT242client # [ 0.002291] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)243worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38244worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]245client # [ 0.003435] cacheinfo: Unable to detect cache hierarchy for CPU 0246worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23247client # [ 0.004252] rcu: Hierarchical SRCU implementation.248worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]249worker2 # [ 0.000000] alternatives: applying boot alternatives250lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration", will be passed to user space.251worker1 # [ 0.000000] Zone ranges:252client # [ 0.004256] rcu: Max phase no-delay instances is 1000.253worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]254client # [ 0.005468] fsl-mc MSI: its@8080000 domain created255lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes256worker1 # [ 0.000000] DMA32 empty257client # [ 0.005557] EFI services will not be available.258worker1 # [ 0.000000] Normal empty259lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)260client # [ 0.005620] smp: Bringing up secondary CPUs ...261worker1 # [ 0.000000] Device empty262client # [ 0.005628] smp: Brought up 1 node, 1 CPU263worker1 # [ 0.000000] Movable zone start for each node264lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)265worker1 # [ 0.000000] Early memory node ranges266client # [ 0.005632] SMP: Total of 1 processors activated.267client # [ 0.005637] CPU: All CPU(s) started at EL1268lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB269worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]270worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/q02yzyzp9sb5j0ly3mxmgq595b2igv75-nixos-system-worker2-test/init regInfo=/nix/store/nyfpjsca2rspcan1wrf2nqcdfkvabmfb-closure-info/registration console=ttyAMA0,115200n8 console=tty0271lb # [ 0.000000] software IO TLB: area num 1.272client # [ 0.005648] CPU features: detected: Branch Target Identification273worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]274lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB275client # [ 0.005653] CPU features: detected: ARMv8.4 Translation Table Level276worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000277worker1 # [ 0.000000] psci: probing for conduit method from DT.278lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)279client # [ 0.005656] CPU features: detected: Instruction cache invalidation not required for I/D coherence280lb # [ 0.000000] Fallback order for Node 0: 0281worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/nyfpjsca2rspcan1wrf2nqcdfkvabmfb-closure-info/registration", will be passed to user space.282worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.283worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs284lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216285worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes286client # [ 0.005660] CPU features: detected: Data cache clean to the PoU not required for I/D coherence287worker1 # [ 0.000000] psci: Trusted OS migration not required288lb # [ 0.000000] Policy zone: DMA289client # [ 0.005664] CPU features: detected: Common not Private translations290worker1 # [ 0.000000] psci: SMC Calling Convention v1.1291worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)292lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off293client # [ 0.005666] CPU features: detected: CRC32 instructions294lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1295worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)296worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)297client # [ 0.005669] CPU features: detected: Data cache clean to Point of Deep Persistence298lb # [ 0.000000] allocated 3145728 bytes of page_ext299worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB300worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296301client # [ 0.005673] CPU features: detected: Data cache clean to Point of Persistence302lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages303worker2 # [ 0.000000] software IO TLB: area num 1.304worker1 # [ 0.000000] Detected PIPT I-cache on CPU0305lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups306client # [ 0.005676] CPU features: detected: Data independent timing control (DIT)307worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB308worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)309client # [ 0.005679] CPU features: detected: E0PD310lb # [ 0.000000] rcu: Hierarchical RCU implementation.311worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface312worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)313client # [ 0.005681] CPU features: detected: Enhanced Counter Virtualization314lb # [ 0.000000] rcu: RCU event tracing is enabled.315worker2 # [ 0.000000] Fallback order for Node 0: 0316worker1 # [ 0.000000] CPU features: detected: Spectre-v4317lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.318client # [ 0.005684] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)319worker1 # [ 0.000000] CPU features: detected: Spectre-BHB320worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216321lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.322client # [ 0.005687] CPU features: detected: Enhanced Virtualization Traps323worker2 # [ 0.000000] Policy zone: DMA324worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38325lb # [ 0.000000] Rude variant of Tasks RCU enabled.326client # [ 0.005690] CPU features: detected: Fine Grained Traps327lb # [ 0.000000] Tracing variant of Tasks RCU enabled.328worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off329worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23330worker1 # [ 0.000000] alternatives: applying boot alternatives331worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1332client # [ 0.005694] CPU features: detected: Generic authentication (architected QARMA5 algorithm)333lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.334worker2 # [ 0.000000] allocated 3145728 bytes of page_ext335client # [ 0.005698] CPU features: detected: RCpc load-acquire (LDAPR)336lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1337worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages338client # [ 0.005700] CPU features: detected: LSE atomic instructions339worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups340lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.341worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.342client # [ 0.005703] CPU features: detected: Privileged Access Never343worker2 # [ 0.000000] rcu: RCU event tracing is enabled.344lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.345client # [ 0.005706] CPU features: detected: PMUv3346worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/d5qsspck7saaddsnmrm52mlyg18n2837-nixos-system-worker1-test/init regInfo=/nix/store/6si2ndxzha4yx1bqv0147p8ms3n57bj7-closure-info/registration console=ttyAMA0,115200n8 console=tty0347worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.348client # [ 0.005708] CPU features: detected: RAS Extension Support349lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.350worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.351client # [ 0.005711] CPU features: detected: RASv1p1 Extension Support352lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0353worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.354worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/6si2ndxzha4yx1bqv0147p8ms3n57bj7-closure-info/registration", will be passed to user space.355lb # [ 0.000000] GICv3: 256 SPIs implemented356worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.357client # [ 0.005714] CPU features: detected: Random Number Generator358lb # [ 0.000000] GICv3: 0 Extended SPIs implemented359client # [ 0.005716] CPU features: detected: Speculation barrier (SB)360lb # [ 0.000000] Root IRQ handler: gic_handle_irq361client # [ 0.005718] CPU features: detected: Stage-2 Force Write-Back362lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI363worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.364worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes365worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1366lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0367client # [ 0.005721] CPU features: detected: TLB range maintenance instructions368worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)369worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.370lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000371client # [ 0.005725] CPU features: detected: Speculative Store Bypassing Safe (SSBS)372worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)373lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]374client # [ 0.005781] alternatives: applying system-wide alternatives375worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.376worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB377client # [ 0.008791] CPU features: detected: BBM Level 2 without TLB conflict abort378lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)379worker1 # [ 0.000000] software IO TLB: area num 1.380worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.381worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB382worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0383lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)384worker2 # [ 0.000000] GICv3: 256 SPIs implemented385worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)386client # [ 0.008969] Memory: 1406516K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)387lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000388worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented389client # [ 0.009365] devtmpfs: initialized390worker1 # [ 0.000000] Fallback order for Node 0: 0391worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq392lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000393worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216394client # [ 0.011249] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)395worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI396worker1 # [ 0.000000] Policy zone: DMA397lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.398worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0399client # [ 0.011271] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).400worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off401worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000402lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns403client # [ 0.011446] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL404worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1405worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]406client # [ 0.011451] 0 pages in range for non-PLT usage407lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).408worker1 # [ 0.000000] allocated 3145728 bytes of page_ext409client # [ 0.011452] 508288 pages in range for PLT usage410worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages411worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)412client # [ 0.011565] pinctrl core: initialized pinctrl subsystem413worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups414lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns415client # [ 0.012341] DMI not present or invalid.416worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.417worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)418client # [ 0.016048] NET: Registered PF_NETLINK/PF_ROUTE protocol family419lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns420worker1 # [ 0.000000] rcu: RCU event tracing is enabled.421worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000422lb # [ 0.000032] arm-pv: using stolen time PV423client # [ 0.018419] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations424worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.425worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000426worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.427lb # [ 0.000447] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)428client # [ 0.018619] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations429worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.430worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.431lb # [ 0.000617] Console: colour dummy device 80x25432worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.433client # [ 0.018826] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations434lb # [ 0.000626] printk: legacy console [tty0] enabled435worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns436client # [ 0.018848] audit: initializing netlink subsys (disabled)437worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.438worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).439lb # [ 0.000817] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)440client # [ 0.019415] thermal_sys: Registered thermal governor 'fair_share'441worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1442lb # [ 0.000824] pid_max: default: 32768 minimum: 301443client # [ 0.019417] thermal_sys: Registered thermal governor 'bang_bang'444worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns445worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.446client # [ 0.019420] thermal_sys: Registered thermal governor 'step_wise'447lb # [ 0.001108] LSM: initializing lsm=capability,landlock,yama,bpf,ima448lb # [ 0.001267] landlock: Up and running.449lb # [ 0.001270] Yama: becoming mindful.450client # [ 0.019428] thermal_sys: Registered thermal governor 'user_space'451worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns452worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.453lb # [ 0.001765] LSM support for eBPF active454worker2 # [ 0.000034] arm-pv: using stolen time PV455client # [ 0.019430] thermal_sys: Registered thermal governor 'power_allocator'456lb # [ 0.001898] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)457worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.458worker2 # [ 0.000482] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)459client # [ 0.019456] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1460worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0461lb # [ 0.001935] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)462client # [ 0.019464] cpuidle: using governor ladder463worker2 # [ 0.000645] Console: colour dummy device 80x25464worker1 # [ 0.000000] GICv3: 256 SPIs implemented465client # [ 0.019470] cpuidle: using governor menu466worker2 # [ 0.000653] printk: legacy console [tty0] enabled467worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented468lb # [ 0.003014] cacheinfo: Unable to detect cache hierarchy for CPU 0469worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq470lb # [ 0.003789] rcu: Hierarchical SRCU implementation.471client # [ 0.019668] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.472worker2 # [ 0.000848] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)473worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI474lb # [ 0.003794] rcu: Max phase no-delay instances is 1000.475client # [ 0.019683] ASID allocator initialised with 65536 entries476worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0477worker2 # [ 0.000855] pid_max: default: 32768 minimum: 301478client # [ 0.020928] Serial: AMBA PL011 UART driver479lb # [ 0.005022] fsl-mc MSI: its@8080000 domain created480lb # [ 0.005122] EFI services will not be available.481worker2 # [ 0.000925] LSM: initializing lsm=capability,landlock,yama,bpf,ima482worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000483client # [ 0.026392] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1484lb # [ 0.005258] smp: Bringing up secondary CPUs ...485worker2 # [ 0.001067] landlock: Up and running.486worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]487worker2 # [ 0.001070] Yama: becoming mindful.488client # [ 0.026532] printk: console [ttyAMA0] enabled489lb # [ 0.005267] smp: Brought up 1 node, 1 CPU490worker2 # [ 0.001577] LSM support for eBPF active491lb # [ 0.005270] SMP: Total of 1 processors activated.492worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)493lb # [ 0.005276] CPU: All CPU(s) started at EL1494worker2 # [ 0.001728] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)495lb # [ 0.005288] CPU features: detected: Branch Target Identification496worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)497worker2 # [ 0.001763] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)498lb # [ 0.005293] CPU features: detected: ARMv8.4 Translation Table Level499worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000500worker2 # [ 0.003102] cacheinfo: Unable to detect cache hierarchy for CPU 0501worker2 # [ 0.003799] rcu: Hierarchical SRCU implementation.502worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000503lb # [ 0.005296] CPU features: detected: Instruction cache invalidation not required for I/D coherence504worker2 # [ 0.003804] rcu: Max phase no-delay instances is 1000.505worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.506lb # [ 0.005300] CPU features: detected: Data cache clean to the PoU not required for I/D coherence507worker2 # [ 0.004992] fsl-mc MSI: its@8080000 domain created508worker2 # [ 0.005084] EFI services will not be available.509lb # [ 0.005304] CPU features: detected: Common not Private translations510worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns511worker2 # [ 0.005170] smp: Bringing up secondary CPUs ...512lb # [ 0.005307] CPU features: detected: CRC32 instructions513worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).514worker2 # [ 0.005178] smp: Brought up 1 node, 1 CPU515worker2 # [ 0.005181] SMP: Total of 1 processors activated.516lb # [ 0.005310] CPU features: detected: Data cache clean to Point of Deep Persistence517worker2 # [ 0.005187] CPU: All CPU(s) started at EL1518worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns519lb # [ 0.005313] CPU features: detected: Data cache clean to Point of Persistence520worker2 # [ 0.005198] CPU features: detected: Branch Target Identification521worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns522lb # [ 0.005316] CPU features: detected: Data independent timing control (DIT)523worker2 # [ 0.005203] CPU features: detected: ARMv8.4 Translation Table Level524worker1 # [ 0.000031] arm-pv: using stolen time PV525lb # [ 0.005319] CPU features: detected: E0PD526lb # [ 0.005322] CPU features: detected: Enhanced Counter Virtualization527client # [ 0.149033] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages528worker2 # [ 0.005206] CPU features: detected: Instruction cache invalidation not required for I/D coherence529client # [ 0.149053] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page530worker1 # [ 0.000432] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)531lb # [ 0.005325] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)532worker1 # [ 0.000612] Console: colour dummy device 80x25533worker2 # [ 0.005210] CPU features: detected: Data cache clean to the PoU not required for I/D coherence534worker1 # [ 0.000620] printk: legacy console [tty0] enabled535client # [ 0.149058] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages536lb # [ 0.005328] CPU features: detected: Enhanced Virtualization Traps537worker2 # [ 0.005214] CPU features: detected: Common not Private translations538lb # [ 0.005331] CPU features: detected: Fine Grained Traps539client # [ 0.149063] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page540worker2 # [ 0.005217] CPU features: detected: CRC32 instructions541worker1 # [ 0.000806] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)542client # [ 0.149067] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages543lb # [ 0.005335] CPU features: detected: Generic authentication (architected QARMA5 algorithm)544worker1 # [ 0.000813] pid_max: default: 32768 minimum: 301545worker2 # [ 0.005220] CPU features: detected: Data cache clean to Point of Deep Persistence546client # [ 0.149072] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page547lb # [ 0.005340] CPU features: detected: RCpc load-acquire (LDAPR)548worker1 # [ 0.000907] LSM: initializing lsm=capability,landlock,yama,bpf,ima549worker2 # [ 0.005224] CPU features: detected: Data cache clean to Point of Persistence550worker1 # [ 0.001039] landlock: Up and running.551lb # [ 0.005343] CPU features: detected: LSE atomic instructions552client # [ 0.149076] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages553worker1 # [ 0.001042] Yama: becoming mindful.554worker2 # [ 0.005227] CPU features: detected: Data independent timing control (DIT)555lb # [ 0.005347] CPU features: detected: Privileged Access Never556worker1 # [ 0.001512] LSM support for eBPF active557client # [ 0.149080] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page558worker2 # [ 0.005230] CPU features: detected: E0PD559lb # [ 0.005349] CPU features: detected: PMUv3560worker1 # [ 0.001649] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)561worker2 # [ 0.005233] CPU features: detected: Enhanced Counter Virtualization562lb # [ 0.005352] CPU features: detected: RAS Extension Support563worker1 # [ 0.001686] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)564lb # [ 0.005355] CPU features: detected: RASv1p1 Extension Support565worker2 # [ 0.005236] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)566client # [ 0.156420] fbcon: Taking over console567worker1 # [ 0.002813] cacheinfo: Unable to detect cache hierarchy for CPU 0568lb # [ 0.005357] CPU features: detected: Random Number Generator569worker2 # [ 0.005239] CPU features: detected: Enhanced Virtualization Traps570client # [ 0.156437] ACPI: Interpreter disabled.571worker1 # [ 0.003566] rcu: Hierarchical SRCU implementation.572lb # [ 0.005360] CPU features: detected: Speculation barrier (SB)573worker2 # [ 0.005242] CPU features: detected: Fine Grained Traps574worker1 # [ 0.003570] rcu: Max phase no-delay instances is 1000.575lb # [ 0.005363] CPU features: detected: Stage-2 Force Write-Back576worker2 # [ 0.005246] CPU features: detected: Generic authentication (architected QARMA5 algorithm)577worker1 # [ 0.004793] fsl-mc MSI: its@8080000 domain created578lb # [ 0.005366] CPU features: detected: TLB range maintenance instructions579worker2 # [ 0.005252] CPU features: detected: RCpc load-acquire (LDAPR)580worker1 # [ 0.004882] EFI services will not be available.581worker1 # [ 0.004964] smp: Bringing up secondary CPUs ...582lb # [ 0.005371] CPU features: detected: Speculative Store Bypassing Safe (SSBS)583worker2 # [ 0.005255] CPU features: detected: LSE atomic instructions584worker1 # [ 0.004972] smp: Brought up 1 node, 1 CPU585lb # [ 0.005411] alternatives: applying system-wide alternatives586worker2 # [ 0.005257] CPU features: detected: Privileged Access Never587worker1 # [ 0.004975] SMP: Total of 1 processors activated.588worker2 # [ 0.005260] CPU features: detected: PMUv3589worker1 # [ 0.004980] CPU: All CPU(s) started at EL1590lb # [ 0.008420] CPU features: detected: BBM Level 2 without TLB conflict abort591worker2 # [ 0.005263] CPU features: detected: RAS Extension Support592worker1 # [ 0.004991] CPU features: detected: Branch Target Identification593worker2 # [ 0.005265] CPU features: detected: RASv1p1 Extension Support594worker1 # [ 0.004996] CPU features: detected: ARMv8.4 Translation Table Level595lb # [ 0.008605] Memory: 1406512K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)596worker2 # [ 0.005268] CPU features: detected: Random Number Generator597lb # [ 0.009002] devtmpfs: initialized598worker2 # [ 0.005271] CPU features: detected: Speculation barrier (SB)599worker1 # [ 0.004999] CPU features: detected: Instruction cache invalidation not required for I/D coherence600lb # [ 0.010842] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)601worker2 # [ 0.005274] CPU features: detected: Stage-2 Force Write-Back602worker1 # [ 0.005003] CPU features: detected: Data cache clean to the PoU not required for I/D coherence603worker2 # [ 0.005277] CPU features: detected: TLB range maintenance instructions604lb # [ 0.010864] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).605client # [ 0.165187] iommu: Default domain type: Translated606worker1 # [ 0.005007] CPU features: detected: Common not Private translations607worker2 # [ 0.005281] CPU features: detected: Speculative Store Bypassing Safe (SSBS)608lb # [ 0.011045] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL609worker1 # [ 0.005010] CPU features: detected: CRC32 instructions610client # [ 0.165197] iommu: DMA domain TLB invalidation policy: strict mode611lb # [ 0.011049] 0 pages in range for non-PLT usage612worker2 # [ 0.005319] alternatives: applying system-wide alternatives613client # [ 0.165548] SCSI subsystem initialized614worker1 # [ 0.005013] CPU features: detected: Data cache clean to Point of Deep Persistence615lb # [ 0.011050] 508288 pages in range for PLT usage616worker2 # [ 0.008253] CPU features: detected: BBM Level 2 without TLB conflict abort617lb # [ 0.011160] pinctrl core: initialized pinctrl subsystem618worker1 # [ 0.005017] CPU features: detected: Data cache clean to Point of Persistence619client # [ 0.167482] usbcore: registered new interface driver usbfs620lb # [ 0.011958] DMI not present or invalid.621worker1 # [ 0.005020] CPU features: detected: Data independent timing control (DIT)622client # [ 0.167513] usbcore: registered new interface driver hub623lb # [ 0.014993] NET: Registered PF_NETLINK/PF_ROUTE protocol family624worker2 # [ 0.008506] Memory: 1406556K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)625worker1 # [ 0.005023] CPU features: detected: E0PD626worker2 # [ 0.008883] devtmpfs: initialized627client # [ 0.167531] usbcore: registered new device driver usb628lb # [ 0.017274] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations629worker1 # [ 0.005025] CPU features: detected: Enhanced Counter Virtualization630client # [ 0.167812] pps_core: LinuxPPS API ver. 1 registered631worker2 # [ 0.010720] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)632lb # [ 0.017471] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations633worker1 # [ 0.005028] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)634client # [ 0.167817] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>635worker1 # [ 0.005031] CPU features: detected: Enhanced Virtualization Traps636worker2 # [ 0.010742] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).637client # [ 0.167827] PTP clock support registered638lb # [ 0.017669] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations639client # [ 0.167881] EDAC MC: Ver: 3.0.0640worker1 # [ 0.005035] CPU features: detected: Fine Grained Traps641worker2 # [ 0.010973] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL642lb # [ 0.017694] audit: initializing netlink subsys (disabled)643worker2 # [ 0.010978] 0 pages in range for non-PLT usage644client # [ 0.172349] scmi_core: SCMI protocol bus registered645lb # [ 0.018230] thermal_sys: Registered thermal governor 'fair_share'646worker1 # [ 0.005039] CPU features: detected: Generic authentication (architected QARMA5 algorithm)647worker2 # [ 0.010979] 508288 pages in range for PLT usage648lb # [ 0.018232] thermal_sys: Registered thermal governor 'bang_bang'649worker1 # [ 0.005044] CPU features: detected: RCpc load-acquire (LDAPR)650client # [ 0.173292] FPGA manager framework651worker2 # [ 0.011080] pinctrl core: initialized pinctrl subsystem652client # [ 0.174250] vgaarb: loaded653worker2 # [ 0.011791] DMI not present or invalid.654worker1 # [ 0.005047] CPU features: detected: LSE atomic instructions655lb # [ 0.018235] thermal_sys: Registered thermal governor 'step_wise'656worker1 # [ 0.005050] CPU features: detected: Privileged Access Never657worker2 # [ 0.014855] NET: Registered PF_NETLINK/PF_ROUTE protocol family658lb # [ 0.018240] thermal_sys: Registered thermal governor 'user_space'659client # [ 0.174883] clocksource: Switched to clocksource arch_sys_counter660worker1 # [ 0.005053] CPU features: detected: PMUv3661worker2 # [ 0.017065] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations662worker1 # [ 0.005055] CPU features: detected: RAS Extension Support663lb # [ 0.018242] thermal_sys: Registered thermal governor 'power_allocator'664worker1 # [ 0.005058] CPU features: detected: RASv1p1 Extension Support665worker2 # [ 0.017260] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations666client # [ 0.176554] VFS: Disk quotas dquot_6.6.0667lb # [ 0.018267] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1668worker1 # [ 0.005060] CPU features: detected: Random Number Generator669lb # [ 0.018275] cpuidle: using governor ladder670worker2 # [ 0.017454] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations671client # [ 0.176590] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)672lb # [ 0.018281] cpuidle: using governor menu673worker1 # [ 0.005063] CPU features: detected: Speculation barrier (SB)674worker2 # [ 0.017475] audit: initializing netlink subsys (disabled)675lb # [ 0.018468] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.676worker1 # [ 0.005066] CPU features: detected: Stage-2 Force Write-Back677worker2 # [ 0.018043] thermal_sys: Registered thermal governor 'fair_share'678lb # [ 0.018482] ASID allocator initialised with 65536 entries679worker1 # [ 0.005069] CPU features: detected: TLB range maintenance instructions680worker2 # [ 0.018044] thermal_sys: Registered thermal governor 'bang_bang'681lb # [ 0.019623] Serial: AMBA PL011 UART driver682worker1 # [ 0.005073] CPU features: detected: Speculative Store Bypassing Safe (SSBS)683client # [ 0.180182] netfs: FS-Cache loaded684lb # [ 0.024889] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1685client # [ 0.180301] pnp: PnP ACPI: disabled686worker1 # [ 0.005111] alternatives: applying system-wide alternatives687lb # [ 0.025040] printk: console [ttyAMA0] enabled688worker1 # [ 0.008039] CPU features: detected: BBM Level 2 without TLB conflict abort689worker1 # [ 0.008297] Memory: 1406576K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)690worker1 # [ 0.008673] devtmpfs: initialized691worker1 # [ 0.010407] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)692worker1 # [ 0.010428] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).693worker1 # [ 0.010610] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL694client # [ 0.184198] NET: Registered PF_INET protocol family695client # [ 0.184456] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)696worker2 # [ 0.018048] thermal_sys: Registered thermal governor 'step_wise'697worker2 # [ 0.018053] thermal_sys: Registered thermal governor 'user_space'698worker2 # [ 0.018056] thermal_sys: Registered thermal governor 'power_allocator'699worker2 # [ 0.018079] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1700lb # [ 0.145942] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages701worker2 # [ 0.018087] cpuidle: using governor ladder702worker2 # [ 0.018092] cpuidle: using governor menu703lb # [ 0.145962] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page704worker2 # [ 0.018270] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.705lb # [ 0.145967] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages706worker2 # [ 0.018283] ASID allocator initialised with 65536 entries707lb # [ 0.145972] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page708worker2 # [ 0.019473] Serial: AMBA PL011 UART driver709lb # [ 0.145976] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages710worker2 # [ 0.024635] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1711worker1 # [ 0.010615] 0 pages in range for non-PLT usage712lb # [ 0.145980] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page713worker2 # [ 0.024794] printk: console [ttyAMA0] enabled714worker1 # [ 0.010616] 508288 pages in range for PLT usage715lb # [ 0.145985] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages716worker1 # [ 0.010722] pinctrl core: initialized pinctrl subsystem717lb # [ 0.145989] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page718worker2 # [ 0.145109] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages719worker1 # [ 0.011475] DMI not present or invalid.720worker1 # [ 0.014754] NET: Registered PF_NETLINK/PF_ROUTE protocol family721worker2 # [ 0.145129] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page722worker1 # [ 0.017021] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations723worker2 # [ 0.145135] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages724worker2 # [ 0.145140] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page725lb # [ 0.153466] fbcon: Taking over console726worker1 # [ 0.017197] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations727lb # [ 0.153485] ACPI: Interpreter disabled.728worker2 # [ 0.145144] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages729worker1 # [ 0.017402] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations730lb # [ 0.155375] iommu: Default domain type: Translated731worker2 # [ 0.145148] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page732worker1 # [ 0.017425] audit: initializing netlink subsys (disabled)733lb # [ 0.155386] iommu: DMA domain TLB invalidation policy: strict mode734worker2 # [ 0.145153] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages735worker1 # [ 0.018079] thermal_sys: Registered thermal governor 'fair_share'736lb # [ 0.157023] SCSI subsystem initialized737worker2 # [ 0.145157] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page738worker1 # [ 0.018081] thermal_sys: Registered thermal governor 'bang_bang'739worker1 # [ 0.018085] thermal_sys: Registered thermal governor 'step_wise'740lb # [ 0.157732] usbcore: registered new interface driver usbfs741worker1 # [ 0.018090] thermal_sys: Registered thermal governor 'user_space'742lb # [ 0.157764] usbcore: registered new interface driver hub743lb # [ 0.157782] usbcore: registered new device driver usb744worker1 # [ 0.018093] thermal_sys: Registered thermal governor 'power_allocator'745worker2 # [ 0.152593] fbcon: Taking over console746lb # [ 0.158039] pps_core: LinuxPPS API ver. 1 registered747worker2 # [ 0.152610] ACPI: Interpreter disabled.748worker1 # [ 0.018120] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1749worker2 # [ 0.154537] iommu: Default domain type: Translated750worker1 # [ 0.018128] cpuidle: using governor ladder751lb # [ 0.158045] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>752worker1 # [ 0.018134] cpuidle: using governor menu753lb # [ 0.158056] PTP clock support registered754worker2 # [ 0.154546] iommu: DMA domain TLB invalidation policy: strict mode755lb # [ 0.158111] EDAC MC: Ver: 3.0.0756worker1 # [ 0.018332] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.757worker2 # [ 0.156203] SCSI subsystem initialized758worker1 # [ 0.018349] ASID allocator initialised with 65536 entries759lb # [ 0.162730] scmi_core: SCMI protocol bus registered760worker1 # [ 0.019568] Serial: AMBA PL011 UART driver761lb # [ 0.163686] FPGA manager framework762worker1 # [ 0.024810] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1763worker1 # [ 0.024935] printk: console [ttyAMA0] enabled764worker1 # [ 0.144901] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages765worker1 # [ 0.144924] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page766worker1 # [ 0.144930] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages767worker1 # [ 0.144934] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page768worker1 # [ 0.144938] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages769worker2 # [ 0.162696] usbcore: registered new interface driver usbfs770worker1 # [ 0.144943] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page771worker2 # [ 0.162730] usbcore: registered new interface driver hub772lb # [ 0.170911] vgaarb: loaded773worker2 # [ 0.162749] usbcore: registered new device driver usb774worker1 # [ 0.144947] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages775worker2 # [ 0.163046] pps_core: LinuxPPS API ver. 1 registered776worker1 # [ 0.144951] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page777worker2 # [ 0.163052] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>778lb # [ 0.171603] clocksource: Switched to clocksource arch_sys_counter779lb # [ 0.172437] VFS: Disk quotas dquot_6.6.0780worker2 # [ 0.163062] PTP clock support registered781worker2 # [ 0.163118] EDAC MC: Ver: 3.0.0782lb # [ 0.172476] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)783worker1 # [ 0.152488] fbcon: Taking over console784worker2 # [ 0.167833] scmi_core: SCMI protocol bus registered785lb # [ 0.174772] netfs: FS-Cache loaded786worker1 # [ 0.152504] ACPI: Interpreter disabled.787lb # [ 0.174871] pnp: PnP ACPI: disabled788worker1 # [ 0.154340] iommu: Default domain type: Translated789worker2 # [ 0.168788] FPGA manager framework790worker2 # [ 0.169759] vgaarb: loaded791worker1 # [ 0.154349] iommu: DMA domain TLB invalidation policy: strict mode792worker2 # [ 0.170424] clocksource: Switched to clocksource arch_sys_counter793worker1 # [ 0.156137] SCSI subsystem initialized794client # [ 0.214225] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)795worker2 # [ 0.173031] VFS: Disk quotas dquot_6.6.0796client # [ 0.214283] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)797worker2 # [ 0.173068] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)798client # [ 0.214316] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)799client # [ 0.214398] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)800client # [ 0.214543] TCP: Hash tables configured (established 16384 bind 16384)801client # [ 0.214627] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)802worker2 # [ 0.176929] netfs: FS-Cache loaded803lb # [ 0.180789] NET: Registered PF_INET protocol family804worker2 # [ 0.177075] pnp: PnP ACPI: disabled805client # [ 0.214664] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)806lb # [ 0.181066] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)807client # [ 0.214701] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)808worker1 # [ 0.163795] usbcore: registered new interface driver usbfs809client # [ 0.214792] NET: Registered PF_UNIX/PF_LOCAL protocol family810client # [ 0.214817] NET: Registered PF_XDP protocol family811worker1 # [ 0.163832] usbcore: registered new interface driver hub812client # [ 0.214835] PCI: CLS 0 bytes, default 64813worker1 # [ 0.163866] usbcore: registered new device driver usb814client # [ 0.214991] Trying to unpack rootfs image as initramfs...815worker1 # [ 0.164180] pps_core: LinuxPPS API ver. 1 registered816worker1 # [ 0.164186] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>817worker2 # [ 0.180973] NET: Registered PF_INET protocol family818worker1 # [ 0.164196] PTP clock support registered819worker1 # [ 0.164245] EDAC MC: Ver: 3.0.0820worker2 # [ 0.181243] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)821worker1 # [ 0.169006] scmi_core: SCMI protocol bus registered822worker1 # [ 0.169969] FPGA manager framework823worker1 # [ 0.170965] vgaarb: loaded824worker1 # [ 0.171626] clocksource: Switched to clocksource arch_sys_counter825worker1 # [ 0.173040] VFS: Disk quotas dquot_6.6.0826client # [ 0.232872] kvm [1]: HYP mode not available827worker1 # [ 0.173073] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)828worker1 # [ 0.174649] netfs: FS-Cache loaded829worker1 # [ 0.174775] pnp: PnP ACPI: disabled830worker1 # [ 0.180772] NET: Registered PF_INET protocol family831worker1 # [ 0.181067] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)832lb # [ 0.210976] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)833lb # [ 0.211036] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)834lb # [ 0.211070] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)835lb # [ 0.211159] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)836lb # [ 0.211305] TCP: Hash tables configured (established 16384 bind 16384)837lb # [ 0.211399] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)838lb # [ 0.211439] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)839lb # [ 0.211476] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)840lb # [ 0.211564] NET: Registered PF_UNIX/PF_LOCAL protocol family841lb # [ 0.211588] NET: Registered PF_XDP protocol family842lb # [ 0.220254] PCI: CLS 0 bytes, default 64843worker2 # [ 0.211981] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)844worker2 # [ 0.212040] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)845worker2 # [ 0.212074] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)846lb # [ 0.221023] Trying to unpack rootfs image as initramfs...847worker2 # [ 0.212166] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)848worker2 # [ 0.212309] TCP: Hash tables configured (established 16384 bind 16384)849worker2 # [ 0.212396] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)850worker2 # [ 0.212434] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)851worker2 # [ 0.212470] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)852worker2 # [ 0.212564] NET: Registered PF_UNIX/PF_LOCAL protocol family853worker2 # [ 0.212606] NET: Registered PF_XDP protocol family854worker1 # [ 0.211268] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)855worker2 # [ 0.212624] PCI: CLS 0 bytes, default 64856worker2 # [ 0.212876] Trying to unpack rootfs image as initramfs...857worker1 # [ 0.211318] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)858worker1 # [ 0.211351] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)859lb # [ 0.228343] kvm [1]: HYP mode not available860worker1 # [ 0.211435] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)861worker1 # [ 0.211578] TCP: Hash tables configured (established 16384 bind 16384)862worker2 # [ 0.228279] kvm [1]: HYP mode not available863worker1 # [ 0.216658] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)864worker1 # [ 0.216701] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)865worker1 # [ 0.216738] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)866worker1 # [ 0.216874] NET: Registered PF_UNIX/PF_LOCAL protocol family867worker1 # [ 0.216897] NET: Registered PF_XDP protocol family868worker1 # [ 0.216916] PCI: CLS 0 bytes, default 64869worker1 # [ 0.217174] Trying to unpack rootfs image as initramfs...870worker1 # [ 0.228653] kvm [1]: HYP mode not available871client # [ 0.339511] Initialise system trusted keyrings872client # [ 0.340241] workingset: timestamp_bits=42 max_order=19 bucket_order=0873client # [ 0.341529] squashfs: version 4.0 (2009/01/31) Phillip Lougher874client # [ 0.342315] 9p: Installing v9fs 9p2000 file system support875client # [ 0.370977] Key type asymmetric registered876client # [ 0.371009] Asymmetric key parser 'x509' registered877lb # [ 0.327282] Initialise system trusted keyrings878client # [ 0.371088] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)879lb # [ 0.328086] workingset: timestamp_bits=42 max_order=19 bucket_order=0880client # [ 0.373199] io scheduler mq-deadline registered881client # [ 0.373209] io scheduler kyber registered882lb # [ 0.329411] squashfs: version 4.0 (2009/01/31) Phillip Lougher883lb # [ 0.330183] 9p: Installing v9fs 9p2000 file system support884client # [ 0.383048] pl061_gpio 9030000.pl061: PL061 GPIO chip registered885worker2 # [ 0.335057] Initialise system trusted keyrings886client # [ 0.384458] ledtrig-cpu: registered to indicate activity on CPUs887worker2 # [ 0.335831] workingset: timestamp_bits=42 max_order=19 bucket_order=0888client # [ 0.384877] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:889worker2 # [ 0.337109] squashfs: version 4.0 (2009/01/31) Phillip Lougher890client # [ 0.384896] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000891worker2 # [ 0.337880] 9p: Installing v9fs 9p2000 file system support892client # [ 0.384908] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000893client # [ 0.384917] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000894client # [ 0.384937] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits895client # [ 0.384970] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]896client # [ 0.385051] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00897client # [ 0.385061] pci_bus 0000:00: root bus resource [bus 00-ff]898client # [ 0.385067] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]899client # [ 0.385073] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]900client # [ 0.385078] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]901client # [ 0.385173] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint902lb # [ 0.354148] Key type asymmetric registered903lb # [ 0.354179] Asymmetric key parser 'x509' registered904client # [ 0.385614] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint905client # [ 0.385827] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]906lb # [ 0.354262] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)907client # [ 0.385844] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]908client # [ 0.385874] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]909worker1 # [ 0.336292] Initialise system trusted keyrings910client # [ 0.385890] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]911worker1 # [ 0.337093] workingset: timestamp_bits=42 max_order=19 bucket_order=0912client # [ 0.386350] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint913client # [ 0.386536] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]914worker1 # [ 0.338417] squashfs: version 4.0 (2009/01/31) Phillip Lougher915client # [ 0.386552] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]916worker1 # [ 0.339210] 9p: Installing v9fs 9p2000 file system support917client # [ 0.386582] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]918client # [ 0.406529] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint919client # [ 0.406721] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]920lb # [ 0.359675] io scheduler mq-deadline registered921lb # [ 0.359695] io scheduler kyber registered922client # [ 0.406736] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]923client # [ 0.406766] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]924client # [ 0.410456] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint925client # [ 0.410638] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]926client # [ 0.410653] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]927client # [ 0.410687] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]928worker2 # [ 0.366629] Key type asymmetric registered929worker2 # [ 0.366657] Asymmetric key parser 'x509' registered930worker2 # [ 0.366736] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)931worker2 # [ 0.368879] io scheduler mq-deadline registered932worker2 # [ 0.368890] io scheduler kyber registered933client # [ 0.419202] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint934client # [ 0.419396] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]935lb # [ 0.371764] pl061_gpio 9030000.pl061: PL061 GPIO chip registered936client # [ 0.419412] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]937lb # [ 0.372417] ledtrig-cpu: registered to indicate activity on CPUs938client # [ 0.419442] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]939lb # [ 0.372790] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:940client # [ 0.419900] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint941lb # [ 0.372808] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000942client # [ 0.420082] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]943client # [ 0.420098] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]944lb # [ 0.372820] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000945client # [ 0.420127] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]946lb # [ 0.372829] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000947client # [ 0.420589] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint948lb # [ 0.372850] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits949client # [ 0.420775] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]950worker2 # [ 0.378570] pl061_gpio 9030000.pl061: PL061 GPIO chip registered951client # [ 0.420791] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]952lb # [ 0.372876] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]953client # [ 0.420821] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]954lb # [ 0.372967] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00955client # [ 0.420837] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]956lb # [ 0.372976] pci_bus 0000:00: root bus resource [bus 00-ff]957worker2 # [ 0.379969] ledtrig-cpu: registered to indicate activity on CPUs958lb # [ 0.372982] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]959client # [ 0.421330] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint960worker1 # [ 0.367893] Key type asymmetric registered961worker1 # [ 0.367923] Asymmetric key parser 'x509' registered962client # [ 0.421516] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]963worker2 # [ 0.380368] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:964lb # [ 0.372988] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]965worker1 # [ 0.367996] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)966client # [ 0.421546] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]967lb # [ 0.372993] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]968worker2 # [ 0.380385] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000969worker1 # [ 0.370068] io scheduler mq-deadline registered970client # [ 0.422020] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint971lb # [ 0.373079] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint972worker1 # [ 0.370078] io scheduler kyber registered973worker2 # [ 0.380398] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000974client # [ 0.422204] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]975lb # [ 0.373541] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint976client # [ 0.422233] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]977worker2 # [ 0.380406] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000978lb # [ 0.373733] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]979client # [ 0.422619] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint980lb # [ 0.373750] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]981worker2 # [ 0.380427] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits982client # [ 0.422803] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]983lb # [ 0.373780] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]984worker2 # [ 0.380450] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]985lb # [ 0.373796] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]986worker2 # [ 0.380526] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00987lb # [ 0.374248] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint988worker2 # [ 0.380535] pci_bus 0000:00: root bus resource [bus 00-ff]989lb # [ 0.374432] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]990worker2 # [ 0.380541] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]991lb # [ 0.374447] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]992worker2 # [ 0.380547] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]993client # [ 0.439885] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint994lb # [ 0.374477] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]995worker2 # [ 0.380552] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]996client # [ 0.440191] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]997lb # [ 0.374921] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint998client # [ 0.440209] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]999worker2 # [ 0.380609] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1000lb # [ 0.375104] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1001client # [ 0.440240] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1002lb # [ 0.375120] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1003worker2 # [ 0.381061] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1004worker1 # [ 0.379739] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1005worker2 # [ 0.381250] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1006client # [ 0.440738] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1007lb # [ 0.375150] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1008client # [ 0.440922] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1009worker2 # [ 0.381266] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1010lb # [ 0.375636] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1011client # [ 0.440938] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1012worker2 # [ 0.381296] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1013lb # [ 0.375817] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1014client # [ 0.440967] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1015worker2 # [ 0.381312] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1016lb # [ 0.375833] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1017client # [ 0.441555] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1018worker1 # [ 0.381060] ledtrig-cpu: registered to indicate activity on CPUs1019lb # [ 0.375866] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1020worker2 # [ 0.381769] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1021client # [ 0.441565] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1022worker2 # [ 0.381953] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1023worker1 # [ 0.381421] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1024lb # [ 0.376323] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1025worker2 # [ 0.381968] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1026lb # [ 0.376505] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1027client # [ 0.441571] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1028worker1 # [ 0.381438] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001029worker2 # [ 0.381998] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1030lb # [ 0.376521] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1031client # [ 0.441616] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1032worker1 # [ 0.381458] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001033lb # [ 0.376551] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1034client # [ 0.441664] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1035worker1 # [ 0.381467] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001036lb # [ 0.377038] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1037worker2 # [ 0.401266] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1038client # [ 0.441711] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1039lb # [ 0.377233] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1040worker1 # [ 0.381492] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1041worker2 # [ 0.401459] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1042lb # [ 0.377250] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1043client # [ 0.441775] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1044worker2 # [ 0.401475] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1045worker1 # [ 0.381514] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1046lb # [ 0.377279] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1047worker2 # [ 0.401505] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1048client # [ 0.441821] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1049worker1 # [ 0.381587] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001050lb # [ 0.377728] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1051worker2 # [ 0.401981] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1052worker1 # [ 0.381597] pci_bus 0000:00: root bus resource [bus 00-ff]1053client # [ 0.441868] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1054lb # [ 0.377910] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1055worker2 # [ 0.402164] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1056worker1 # [ 0.381603] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1057client # [ 0.441913] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1058lb # [ 0.377926] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1059worker2 # [ 0.402180] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1060worker1 # [ 0.381608] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1061lb # [ 0.377956] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1062client # [ 0.441960] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1063worker2 # [ 0.402212] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1064worker1 # [ 0.381613] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1065lb # [ 0.377972] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1066client # [ 0.442007] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1067worker1 # [ 0.381669] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1068lb # [ 0.378419] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1069client # [ 0.442087] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1070lb # [ 0.378610] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1071worker1 # [ 0.382098] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1072client # [ 0.442134] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1073worker1 # [ 0.382282] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1074lb # [ 0.378643] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1075client # [ 0.442155] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1076worker1 # [ 0.382299] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1077lb # [ 0.379093] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1078client # [ 0.442176] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1079worker1 # [ 0.382328] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1080lb # [ 0.379280] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1081client # [ 0.442198] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1082worker1 # [ 0.382344] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1083lb # [ 0.379309] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1084client # [ 0.442222] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1085worker1 # [ 0.382795] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1086client # [ 0.442243] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1087worker1 # [ 0.382977] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1088client # [ 0.442265] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1089worker1 # [ 0.382993] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1090client # [ 0.442286] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1091worker1 # [ 0.383022] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1092client # [ 0.442308] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1093worker1 # [ 0.383473] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1094client # [ 0.442330] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1095worker1 # [ 0.403128] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1096client # [ 0.442352] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1097worker1 # [ 0.403148] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1098client # [ 0.442374] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1099worker1 # [ 0.403177] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1100client # [ 0.442395] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1101client # [ 0.442417] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1102client # [ 0.442438] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1103client # [ 0.442459] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1104client # [ 0.442480] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1105worker2 # [ 0.414729] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1106client # [ 0.442501] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1107worker2 # [ 0.414933] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1108client # [ 0.442522] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1109worker2 # [ 0.414950] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1110client # [ 0.442544] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1111worker2 # [ 0.414979] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1112client # [ 0.442565] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1113worker2 # [ 0.415470] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1114client # [ 0.442592] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1115worker2 # [ 0.415653] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1116client # [ 0.442602] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1117lb # [ 0.427847] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1118worker2 # [ 0.415668] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1119client # [ 0.442606] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1120lb # [ 0.428057] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1121worker2 # [ 0.415698] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1122lb # [ 0.428319] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1123worker2 # [ 0.416150] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1124lb # [ 0.428593] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1125worker2 # [ 0.416335] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1126lb # [ 0.428611] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1127worker2 # [ 0.416351] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1128lb # [ 0.428641] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1129worker2 # [ 0.416381] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1130worker2 # [ 0.416397] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1131lb # [ 0.429102] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1132lb # [ 0.429297] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1133worker2 # [ 0.416853] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1134lb # [ 0.429317] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1135worker2 # [ 0.417039] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1136worker1 # [ 0.411696] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1137lb # [ 0.429349] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1138worker2 # [ 0.417068] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1139worker1 # [ 0.411898] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1140lb # [ 0.429957] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1141worker1 # [ 0.411914] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1142worker2 # [ 0.417527] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1143lb # [ 0.429970] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1144worker1 # [ 0.411948] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1145worker2 # [ 0.417715] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1146lb # [ 0.429975] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1147worker1 # [ 0.412451] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1148worker2 # [ 0.417744] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1149worker1 # [ 0.412637] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1150client # [ 0.487880] pci 0000:00:0a.0: enabling device (0000 -> 0002)1151lb # [ 0.430025] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1152worker2 # [ 0.418148] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1153worker1 # [ 0.412653] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1154worker2 # [ 0.418331] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1155lb # [ 0.430073] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1156worker1 # [ 0.412683] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1157worker2 # [ 0.418591] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1158lb # [ 0.430122] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1159worker1 # [ 0.413134] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1160worker2 # [ 0.418899] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1161worker1 # [ 0.413317] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1162lb # [ 0.430170] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1163worker2 # [ 0.418916] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1164worker1 # [ 0.413333] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1165lb # [ 0.430219] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1166worker2 # [ 0.418946] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1167worker1 # [ 0.413362] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1168lb # [ 0.430269] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1169worker2 # [ 0.419406] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1170worker1 # [ 0.413843] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1171worker2 # [ 0.419605] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1172lb # [ 0.430318] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1173worker1 # [ 0.414027] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1174worker2 # [ 0.419620] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1175worker1 # [ 0.414042] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1176lb # [ 0.430369] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1177worker2 # [ 0.419649] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1178worker1 # [ 0.414071] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1179lb # [ 0.430418] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1180worker2 # [ 0.420220] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1181worker1 # [ 0.414087] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1182lb # [ 0.430502] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1183worker2 # [ 0.420231] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1184worker1 # [ 0.414543] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1185lb # [ 0.430549] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1186worker2 # [ 0.420237] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1187worker1 # [ 0.414729] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1188lb # [ 0.430570] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1189worker2 # [ 0.420282] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1190worker1 # [ 0.414759] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1191lb # [ 0.430592] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1192worker2 # [ 0.420330] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1193worker1 # [ 0.415205] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1194lb # [ 0.430615] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1195worker1 # [ 0.415391] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1196worker2 # [ 0.420377] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1197lb # [ 0.430640] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1198worker1 # [ 0.415421] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1199lb # [ 0.430662] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1200worker2 # [ 0.420423] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1201worker1 # [ 0.415834] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1202lb # [ 0.430685] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1203worker2 # [ 0.420469] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1204worker1 # [ 0.416017] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1205lb # [ 0.430707] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1206worker2 # [ 0.420516] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1207worker1 # [ 0.416291] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1208lb # [ 0.430730] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1209worker2 # [ 0.420562] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1210worker1 # [ 0.416586] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1211lb # [ 0.430752] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1212worker1 # [ 0.416604] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1213worker2 # [ 0.420609] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1214lb # [ 0.430775] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1215worker1 # [ 0.416633] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1216worker2 # [ 0.420656] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1217lb # [ 0.430798] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1218worker1 # [ 0.417100] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1219lb # [ 0.430820] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1220worker2 # [ 0.420731] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1221worker1 # [ 0.417281] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1222lb # [ 0.430841] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1223worker2 # [ 0.420777] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1224worker1 # [ 0.417297] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1225lb # [ 0.430863] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1226worker2 # [ 0.420798] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1227worker1 # [ 0.417326] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1228lb # [ 0.430885] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1229worker2 # [ 0.420820] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1230worker1 # [ 0.417899] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1231lb # [ 0.430907] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1232client # [ 0.508305] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1233worker2 # [ 0.420841] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1234lb # [ 0.430929] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1235worker1 # [ 0.417910] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1236client # [ 0.510462] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1237worker2 # [ 0.420865] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1238lb # [ 0.430951] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1239worker1 # [ 0.417916] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1240worker2 # [ 0.420887] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1241lb # [ 0.430973] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1242worker1 # [ 0.417960] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1243lb # [ 0.430996] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1244worker2 # [ 0.420908] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1245worker1 # [ 0.418007] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1246lb # [ 0.431023] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1247worker2 # [ 0.420930] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1248lb # [ 0.431032] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1249worker1 # [ 0.418052] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1250worker2 # [ 0.420952] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1251lb # [ 0.431037] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1252worker2 # [ 0.420974] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1253worker1 # [ 0.418098] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1254lb # [ 0.432232] pci 0000:00:0a.0: enabling device (0000 -> 0002)1255worker2 # [ 0.420996] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1256worker1 # [ 0.418143] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1257worker2 # [ 0.421019] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1258worker1 # [ 0.418189] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1259worker2 # [ 0.421040] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1260worker1 # [ 0.418235] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1261worker2 # [ 0.421061] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1262worker2 # [ 0.421083] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1263worker1 # [ 0.418281] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1264worker2 # [ 0.421104] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1265worker1 # [ 0.418326] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1266worker2 # [ 0.421125] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1267worker1 # [ 0.418400] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1268worker2 # [ 0.421147] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1269client # [ 0.521619] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1270worker2 # [ 0.421168] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1271worker1 # [ 0.418446] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1272worker2 # [ 0.421190] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1273worker1 # [ 0.418467] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1274worker2 # [ 0.421211] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1275worker1 # [ 0.418488] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1276worker2 # [ 0.421237] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1277worker1 # [ 0.418510] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1278worker2 # [ 0.421247] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1279worker1 # [ 0.418534] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1280worker2 # [ 0.421251] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1281worker1 # [ 0.418556] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1282worker2 # [ 0.422408] pci 0000:00:0a.0: enabling device (0000 -> 0002)1283worker1 # [ 0.418577] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1284worker1 # [ 0.418598] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1285worker1 # [ 0.418622] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1286worker1 # [ 0.418644] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1287client # [ 0.527998] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1288worker1 # [ 0.418666] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1289worker1 # [ 0.418688] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1290client # [ 0.530019] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1291worker1 # [ 0.418709] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1292worker1 # [ 0.418730] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1293worker1 # [ 0.418752] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1294worker2 # [ 0.482565] pci 0000:00:0a.0: quirk_usb_early_handoff+0x0/0xa60 took 58750 usecs1295worker1 # [ 0.418773] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1296worker1 # [ 0.418795] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1297worker1 # [ 0.418816] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1298worker1 # [ 0.418837] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1299worker1 # [ 0.418859] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1300worker1 # [ 0.418880] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1301worker1 # [ 0.418907] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1302worker1 # [ 0.418916] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1303worker1 # [ 0.418921] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1304client # [ 0.540360] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1305lb # [ 0.498086] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1306client # [ 0.542499] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1307lb # [ 0.501091] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1308lb # [ 0.503213] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1309worker1 # [ 0.484203] pci 0000:00:0a.0: enabling device (0000 -> 0002)1310client # [ 0.553982] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1311worker2 # [ 0.503312] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1312worker2 # [ 0.505502] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1313client # [ 0.557061] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1314lb # [ 0.513056] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1315lb # [ 0.515139] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1316worker2 # [ 0.516586] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1317client # [ 0.567028] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1318client # [ 0.569583] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1319lb # [ 0.526775] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1320worker1 # [ 0.505301] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1321lb # [ 0.529953] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1322worker2 # [ 0.522636] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1323worker2 # [ 0.524715] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1324client # [ 0.580152] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1325worker1 # [ 0.516084] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1326lb # [ 0.535789] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1327worker1 # [ 0.518502] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1328lb # [ 0.539087] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1329client # [ 0.583019] msm_serial: driver initialized1330client # [ 0.583167] SuperH (H)SCI(F) driver initialized1331client # [ 0.583220] STM32 USART driver initialized1332worker1 # [ 0.522373] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1333worker2 # [ 0.535008] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1334worker2 # [ 0.537074] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1335lb # [ 0.549184] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1336worker1 # [ 0.528758] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1337worker2 # [ 0.547124] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1338worker1 # [ 0.535802] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1339worker2 # [ 0.550074] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1340worker1 # [ 0.537875] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1341worker2 # [ 0.552119] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1342lb # [ 0.559862] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1343worker2 # [ 0.554287] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1344worker1 # [ 0.547832] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1345worker1 # [ 0.550170] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1346lb # [ 0.575859] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1347client # [ 0.620006] loop: module loaded1348client # [ 0.620191] virtio_blk virtio5: 1/0/0 default/read/poll queues1349client # [ 0.620918] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1350lb # [ 0.578548] msm_serial: driver initialized1351lb # [ 0.578683] SuperH (H)SCI(F) driver initialized1352lb # [ 0.578739] STM32 USART driver initialized1353worker2 # [ 0.575699] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1354worker2 # [ 0.578327] msm_serial: driver initialized1355worker1 # [ 0.559815] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1356worker1 # [ 0.562540] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1357worker2 # [ 0.579070] SuperH (H)SCI(F) driver initialized1358worker2 # [ 0.579127] STM32 USART driver initialized1359client # [ 0.631573] megasas: 07.734.00.00-rc11360client # [ 0.632302] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1361client # [ 0.634169] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001362client # [ 0.634196] Intel/Sharp Extended Query Table at 0x00311363worker1 # [ 0.575786] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1364client # [ 0.639244] Using buffer write method1365client # [ 0.639324] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1366worker1 # [ 0.578352] msm_serial: driver initialized1367worker1 # [ 0.578507] SuperH (H)SCI(F) driver initialized1368client # [ 0.641107] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001369worker1 # [ 0.578561] STM32 USART driver initialized1370client # [ 0.641140] Intel/Sharp Extended Query Table at 0x00311371client # [ 0.650926] Using buffer write method1372client # [ 0.650956] Concatenating MTD devices:1373client # [ 0.650960] (0): "0.flash"1374client # [ 0.650964] (1): "0.flash"1375client # [ 0.650968] into device "0.flash"1376lb # [ 0.609393] loop: module loaded1377lb # [ 0.609605] virtio_blk virtio5: 1/0/0 default/read/poll queues1378lb # [ 0.610381] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1379lb # [ 0.616297] megasas: 07.734.00.00-rc11380lb # [ 0.616995] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1381worker2 # [ 0.613420] loop: module loaded1382worker2 # [ 0.613623] virtio_blk virtio5: 1/0/0 default/read/poll queues1383lb # [ 0.618961] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001384lb # [ 0.618986] Intel/Sharp Extended Query Table at 0x00311385worker2 # [ 0.615668] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1386worker2 # [ 0.619181] megasas: 07.734.00.00-rc11387worker2 # [ 0.619900] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1388lb # [ 0.628843] Using buffer write method1389lb # [ 0.628927] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1390lb # [ 0.630734] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001391lb # [ 0.630769] Intel/Sharp Extended Query Table at 0x00311392lb # [ 0.640548] Using buffer write method1393lb # [ 0.640599] Concatenating MTD devices:1394lb # [ 0.640604] (0): "0.flash"1395worker2 # [ 0.631958] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001396lb # [ 0.640608] (1): "0.flash"1397worker2 # [ 0.631996] Intel/Sharp Extended Query Table at 0x00311398lb # [ 0.640611] into device "0.flash"1399worker2 # [ 0.633627] Using buffer write method1400worker1 # [ 0.620351] loop: module loaded1401worker1 # [ 0.620570] virtio_blk virtio5: 1/0/0 default/read/poll queues1402worker2 # [ 0.633704] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1403worker1 # [ 0.621335] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1404worker2 # [ 0.647904] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001405worker2 # [ 0.647940] Intel/Sharp Extended Query Table at 0x00311406worker2 # [ 0.649612] Using buffer write method1407worker2 # [ 0.649640] Concatenating MTD devices:1408worker2 # [ 0.649644] (0): "0.flash"1409worker2 # [ 0.649648] (1): "0.flash"1410worker2 # [ 0.649652] into device "0.flash"1411worker1 # [ 0.632399] megasas: 07.734.00.00-rc11412worker1 # [ 0.633138] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1413worker1 # [ 0.635176] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001414worker1 # [ 0.635203] Intel/Sharp Extended Query Table at 0x00311415worker1 # [ 0.637013] Using buffer write method1416worker1 # [ 0.637083] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1417worker1 # [ 0.638883] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001418worker1 # [ 0.638914] Intel/Sharp Extended Query Table at 0x00311419worker1 # [ 0.659009] Using buffer write method1420worker1 # [ 0.659055] Concatenating MTD devices:1421worker1 # [ 0.659059] (0): "0.flash"1422worker1 # [ 0.659064] (1): "0.flash"1423worker1 # [ 0.659067] into device "0.flash"1424client # [ 0.908297] Freeing initrd memory: 26160K1425client # [ 0.914468] tun: Universal TUN/TAP device driver, 1.61426client # [ 0.918414] thunder_xcv, ver 1.01427client # [ 0.918464] thunder_bgx, ver 1.01428client # [ 0.918488] nicpf, ver 1.01429client # [ 0.920283] e1000: Intel(R) PRO/1000 Network Driver1430client # [ 0.920294] e1000: Copyright (c) 1999-2006 Intel Corporation.1431client # [ 0.920323] e1000e: Intel(R) PRO/1000 Network Driver1432client # [ 0.920333] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1433client # [ 0.920363] igb: Intel(R) Gigabit Ethernet Network Driver1434client # [ 0.920368] igb: Copyright (c) 2007-2014 Intel Corporation.1435client # [ 0.920398] igbvf: Intel(R) Gigabit Virtual Function Network Driver1436client # [ 0.920404] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1437client # [ 0.920539] sky2: driver version 1.301438client # [ 0.922159] usbcore: registered new interface driver usb-storage1439client # [ 0.922244] usbcore: registered new interface driver usbserial_generic1440client # [ 0.922260] usbserial: USB Serial support registered for generic1441client # [ 0.922850] hv_vmbus: registering driver hyperv_keyboard1442client # [ 0.923563] ehci-pci 0000:00:0a.0: EHCI Host Controller1443client # [ 0.923589] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11444client # [ 0.923803] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001445client # [ 0.935076] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001446client # [ 0.935428] hub 1-0:1.0: USB hub found1447client # [ 0.935442] hub 1-0:1.0: 6 ports detected1448client # [ 0.938551] rtc-pl031 9010000.pl031: registered as rtc01449client # [ 0.938588] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:16:54 UTC (1789892214)1450client # [ 0.940605] i2c_dev: i2c /dev entries driver1451lb # [ 0.897181] Freeing initrd memory: 26140K1452client # [ 0.943776] sdhci: Secure Digital Host Controller Interface driver1453client # [ 0.943785] sdhci: Copyright(c) Pierre Ossman1454lb # [ 0.903238] tun: Universal TUN/TAP device driver, 1.61455client # [ 0.944047] Synopsys Designware Multimedia Card Interface Driver1456client # [ 0.944413] sdhci-pltfm: SDHCI platform and OF driver helper1457client # [ 0.946088] hid: raw HID events driver (C) Jiri Kosina1458client # [ 0.946338] usbcore: registered new interface driver usbhid1459client # [ 0.946345] usbhid: USB HID core driver1460lb # [ 0.907126] thunder_xcv, ver 1.01461lb # [ 0.907172] thunder_bgx, ver 1.01462lb # [ 0.907194] nicpf, ver 1.01463client # [ 0.952001] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1464client # [ 0.953484] drop_monitor: Initializing network drop monitor service1465client # [ 0.953631] NET: Registered PF_INET6 protocol family1466client # [ 0.956717] Segment Routing with IPv61467worker2 # [ 0.905859] Freeing initrd memory: 26148K1468client # [ 0.956736] In-situ OAM (IOAM) with IPv61469lb # [ 0.909082] e1000: Intel(R) PRO/1000 Network Driver1470client # [ 0.956767] NET: Registered PF_PACKET protocol family1471lb # [ 0.909091] e1000: Copyright (c) 1999-2006 Intel Corporation.1472lb # [ 0.909117] e1000e: Intel(R) PRO/1000 Network Driver1473client # [ 0.958445] 9pnet: Installing 9P2000 support1474lb # [ 0.909127] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1475lb # [ 0.909178] igb: Intel(R) Gigabit Ethernet Network Driver1476lb # [ 0.909183] igb: Copyright (c) 2007-2014 Intel Corporation.1477lb # [ 0.909207] igbvf: Intel(R) Gigabit Virtual Function Network Driver1478lb # [ 0.909214] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1479lb # [ 0.909355] sky2: driver version 1.301480client # [ 0.961441] Key type dns_resolver registered1481worker2 # [ 0.911993] tun: Universal TUN/TAP device driver, 1.61482lb # [ 0.910973] usbcore: registered new interface driver usb-storage1483lb # [ 0.911021] usbcore: registered new interface driver usbserial_generic1484lb # [ 0.911035] usbserial: USB Serial support registered for generic1485lb # [ 0.912329] ehci-pci 0000:00:0a.0: EHCI Host Controller1486lb # [ 0.912353] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11487lb # [ 0.912648] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001488lb # [ 0.923441] hv_vmbus: registering driver hyperv_keyboard1489lb # [ 0.923662] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001490lb # [ 0.924063] hub 1-0:1.0: USB hub found1491worker2 # [ 0.915981] thunder_xcv, ver 1.01492worker2 # [ 0.916032] thunder_bgx, ver 1.01493lb # [ 0.924122] hub 1-0:1.0: 6 ports detected1494worker2 # [ 0.916056] nicpf, ver 1.01495client # [ 0.967898] registered taskstats version 11496worker1 # [ 0.903980] Freeing initrd memory: 26148K1497worker2 # [ 0.916615] e1000: Intel(R) PRO/1000 Network Driver1498client # [ 0.968061] Loading compiled-in X.509 certificates1499worker2 # [ 0.916623] e1000: Copyright (c) 1999-2006 Intel Corporation.1500worker2 # [ 0.916648] e1000e: Intel(R) PRO/1000 Network Driver1501lb # [ 0.927698] rtc-pl031 9010000.pl031: registered as rtc01502worker2 # [ 0.916659] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1503worker2 # [ 0.916688] igb: Intel(R) Gigabit Ethernet Network Driver1504lb # [ 0.927727] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:16:54 UTC (1789892214)1505lb # [ 0.928026] i2c_dev: i2c /dev entries driver1506worker2 # [ 0.916693] igb: Copyright (c) 2007-2014 Intel Corporation.1507worker2 # [ 0.916722] igbvf: Intel(R) Gigabit Virtual Function Network Driver1508worker1 # [ 0.910092] tun: Universal TUN/TAP device driver, 1.61509worker2 # [ 0.916728] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1510worker2 # [ 0.916862] sky2: driver version 1.301511client # [ 0.976793] Demotion targets for Node 0: null1512worker2 # [ 0.919246] ehci-pci 0000:00:0a.0: EHCI Host Controller1513client # [ 0.976916] Key type .fscrypt registered1514client # [ 0.976922] Key type fscrypt-provisioning registered1515worker2 # [ 0.919274] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11516client # [ 0.977020] ima: No TPM chip found, activating TPM-bypass!1517worker2 # [ 0.919509] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001518client # [ 0.977039] ima: Allocated hash algorithm: sha11519client # [ 0.977060] ima: No architecture policies found1520lb # [ 0.933041] sdhci: Secure Digital Host Controller Interface driver1521lb # [ 0.933051] sdhci: Copyright(c) Pierre Ossman1522worker1 # [ 0.913907] thunder_xcv, ver 1.01523worker1 # [ 0.913952] thunder_bgx, ver 1.01524client # [ 0.981290] input: gpio-keys as /devices/platform/gpio-keys/input/input01525lb # [ 0.933326] Synopsys Designware Multimedia Card Interface Driver1526worker2 # [ 0.929108] usbcore: registered new interface driver usb-storage1527worker1 # [ 0.913975] nicpf, ver 1.01528lb # [ 0.933692] sdhci-pltfm: SDHCI platform and OF driver helper1529worker2 # [ 0.929206] usbcore: registered new interface driver usbserial_generic1530worker1 # [ 0.914523] e1000: Intel(R) PRO/1000 Network Driver1531lb # [ 0.935351] hid: raw HID events driver (C) Jiri Kosina1532worker1 # [ 0.914530] e1000: Copyright (c) 1999-2006 Intel Corporation.1533worker2 # [ 0.929221] usbserial: USB Serial support registered for generic1534lb # [ 0.935580] usbcore: registered new interface driver usbhid1535worker1 # [ 0.914560] e1000e: Intel(R) PRO/1000 Network Driver1536worker2 # [ 0.929834] hv_vmbus: registering driver hyperv_keyboard1537lb # [ 0.935586] usbhid: USB HID core driver1538worker1 # [ 0.914568] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1539worker2 # [ 0.930493] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001540worker1 # [ 0.914598] igb: Intel(R) Gigabit Ethernet Network Driver1541worker2 # [ 0.934348] hub 1-0:1.0: USB hub found1542worker1 # [ 0.914603] igb: Copyright (c) 2007-2014 Intel Corporation.1543worker2 # [ 0.934887] hub 1-0:1.0: 6 ports detected1544worker1 # [ 0.914626] igbvf: Intel(R) Gigabit Virtual Function Network Driver1545worker1 # [ 0.914632] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1546worker1 # [ 0.914768] sky2: driver version 1.301547lb # [ 0.941082] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1548worker2 # [ 0.935973] rtc-pl031 9010000.pl031: registered as rtc01549lb # [ 0.942607] drop_monitor: Initializing network drop monitor service1550worker2 # [ 0.936000] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:16:54 UTC (1789892214)1551worker1 # [ 0.923352] usbcore: registered new interface driver usb-storage1552lb # [ 0.942813] NET: Registered PF_INET6 protocol family1553worker2 # [ 0.936364] i2c_dev: i2c /dev entries driver1554worker1 # [ 0.923470] usbcore: registered new interface driver usbserial_generic1555lb # [ 0.945917] Segment Routing with IPv61556worker1 # [ 0.923486] usbserial: USB Serial support registered for generic1557lb # [ 0.945937] In-situ OAM (IOAM) with IPv61558lb # [ 0.945980] NET: Registered PF_PACKET protocol family1559worker1 # [ 0.926405] hv_vmbus: registering driver hyperv_keyboard1560worker2 # [ 0.941319] sdhci: Secure Digital Host Controller Interface driver1561worker2 # [ 0.941329] sdhci: Copyright(c) Pierre Ossman1562worker1 # [ 0.928453] ehci-pci 0000:00:0a.0: EHCI Host Controller1563worker2 # [ 0.941597] Synopsys Designware Multimedia Card Interface Driver1564worker1 # [ 0.928483] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11565worker2 # [ 0.941968] sdhci-pltfm: SDHCI platform and OF driver helper1566lb # [ 0.947819] 9pnet: Installing 9P2000 support1567worker1 # [ 0.928772] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001568lb # [ 0.949987] Key type dns_resolver registered1569worker1 # [ 0.931440] rtc-pl031 9010000.pl031: registered as rtc01570worker2 # [ 0.946349] hid: raw HID events driver (C) Jiri Kosina1571worker1 # [ 0.931470] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:16:54 UTC (1789892214)1572worker2 # [ 0.947269] usbcore: registered new interface driver usbhid1573worker2 # [ 0.947279] usbhid: USB HID core driver1574worker1 # [ 0.933586] i2c_dev: i2c /dev entries driver1575client # [ 0.999391] clk: Disabling unused clocks1576worker2 # [ 0.949557] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1577client # [ 0.999421] PM: genpd: Disabling unused power domains1578worker2 # [ 0.952254] drop_monitor: Initializing network drop monitor service1579client # [ 1.003694] Freeing unused kernel memory: 4736K1580worker2 # [ 0.952435] NET: Registered PF_INET6 protocol family1581lb # [ 0.956704] registered taskstats version 11582client # [ 1.003907] Run /init as init process1583lb # [ 0.956864] Loading compiled-in X.509 certificates1584worker2 # [ 0.954365] Segment Routing with IPv61585worker2 # [ 0.954386] In-situ OAM (IOAM) with IPv61586worker1 # [ 0.936935] sdhci: Secure Digital Host Controller Interface driver1587worker2 # [ 0.954417] NET: Registered PF_PACKET protocol family1588worker1 # [ 0.936951] sdhci: Copyright(c) Pierre Ossman1589worker1 # [ 0.937217] Synopsys Designware Multimedia Card Interface Driver1590worker1 # [ 0.937597] sdhci-pltfm: SDHCI platform and OF driver helper1591worker1 # [ 0.939305] hid: raw HID events driver (C) Jiri Kosina1592worker1 # [ 0.939577] usbcore: registered new interface driver usbhid1593worker2 # [ 0.956106] 9pnet: Installing 9P2000 support1594worker1 # [ 0.939584] usbhid: USB HID core driver1595worker2 # [ 0.958221] Key type dns_resolver registered1596lb # [ 0.965483] Demotion targets for Node 0: null1597worker1 # [ 0.939671] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001598lb # [ 0.965595] Key type .fscrypt registered1599worker1 # [ 0.939992] hub 1-0:1.0: USB hub found1600lb # [ 0.965601] Key type fscrypt-provisioning registered1601worker1 # [ 0.940058] hub 1-0:1.0: 6 ports detected1602lb # [ 0.965701] ima: No TPM chip found, activating TPM-bypass!1603lb # [ 0.965721] ima: Allocated hash algorithm: sha11604lb # [ 0.965743] ima: No architecture policies found1605lb # [ 0.969829] input: gpio-keys as /devices/platform/gpio-keys/input/input01606worker1 # [ 0.947699] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1607worker1 # [ 0.949240] drop_monitor: Initializing network drop monitor service1608worker1 # [ 0.949416] NET: Registered PF_INET6 protocol family1609worker2 # [ 0.965167] registered taskstats version 11610worker2 # [ 0.965334] Loading compiled-in X.509 certificates1611worker1 # [ 0.952467] Segment Routing with IPv61612worker1 # [ 0.952486] In-situ OAM (IOAM) with IPv61613worker1 # [ 0.952516] NET: Registered PF_PACKET protocol family1614worker1 # [ 0.954185] 9pnet: Installing 9P2000 support1615client # [ 1.021211] systemd[1]: Successfully made /usr/ read-only.1616worker1 # [ 0.956980] Key type dns_resolver registered1617worker2 # [ 0.973913] Demotion targets for Node 0: null1618worker2 # [ 0.974023] Key type .fscrypt registered1619worker2 # [ 0.974029] Key type fscrypt-provisioning registered1620worker2 # [ 0.974127] ima: No TPM chip found, activating TPM-bypass!1621worker2 # [ 0.974146] ima: Allocated hash algorithm: sha11622worker2 # [ 0.974166] ima: No architecture policies found1623worker1 # [ 0.963270] registered taskstats version 11624worker2 # [ 0.978582] input: gpio-keys as /devices/platform/gpio-keys/input/input01625worker1 # [ 0.963416] Loading compiled-in X.509 certificates1626lb # [ 0.987578] clk: Disabling unused clocks1627lb # [ 0.988163] PM: genpd: Disabling unused power domains1628lb # [ 0.991940] Freeing unused kernel memory: 4736K1629lb # [ 0.992138] Run /init as init process1630worker1 # [ 0.972185] Demotion targets for Node 0: null1631worker1 # [ 0.972292] Key type .fscrypt registered1632worker1 # [ 0.972299] Key type fscrypt-provisioning registered1633worker1 # [ 0.972392] ima: No TPM chip found, activating TPM-bypass!1634worker1 # [ 0.972411] ima: Allocated hash algorithm: sha11635worker1 # [ 0.972432] ima: No architecture policies found1636worker1 # [ 0.976794] input: gpio-keys as /devices/platform/gpio-keys/input/input01637worker2 # [ 0.996492] clk: Disabling unused clocks1638worker2 # [ 0.996528] PM: genpd: Disabling unused power domains1639worker2 # [ 1.000801] Freeing unused kernel memory: 4736K1640worker2 # [ 1.001010] Run /init as init process1641lb # [ 1.009956] systemd[1]: Successfully made /usr/ read-only.1642worker1 # [ 0.995518] clk: Disabling unused clocks1643worker1 # [ 0.995555] PM: genpd: Disabling unused power domains1644worker1 # [ 0.999919] Freeing unused kernel memory: 4736K1645worker1 # [ 1.000145] Run /init as init process1646worker2 # [ 1.016752] systemd[1]: Successfully made /usr/ read-only.1647worker1 # [ 1.018030] systemd[1]: Successfully made /usr/ read-only.1648client # [ 1.182990] usb 1-1: new high-speed USB device number 2 using ehci-pci1649lb # [ 1.171687] usb 1-1: new high-speed USB device number 2 using ehci-pci1650worker2 # [ 1.182529] usb 1-1: new high-speed USB device number 2 using ehci-pci1651worker1 # [ 1.187706] usb 1-1: new high-speed USB device number 2 using ehci-pci1652client # [ 1.335582] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11653client # [ 1.355892] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1654client # [ 1.359743] systemd[1]: Detected virtualization qemu.1655client # [ 1.360430] systemd[1]: Detected architecture arm64.1656client # [ 1.361054] systemd[1]: Running in initrd.1657client # [ 1.362030] systemd[1]: Initializing machine ID from random generator.1658client # [ 1.363127] systemd[1]: Hostname set to <client>.1659lb # [ 1.321999] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11660worker2 # [ 1.334884] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11661lb # [ 1.344832] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1662lb # [ 1.357307] systemd[1]: Detected virtualization qemu.1663lb # [ 1.359413] systemd[1]: Detected architecture arm64.1664lb # [ 1.361505] systemd[1]: Running in initrd.1665lb # [ 1.364156] systemd[1]: Initializing machine ID from random generator.1666lb # [ 1.367008] systemd[1]: Hostname set to <lb>.1667worker1 # [ 1.342018] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11668worker2 # [ 1.351639] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1669worker2 # [ 1.364108] systemd[1]: Detected virtualization qemu.1670worker2 # [ 1.366120] systemd[1]: Detected architecture arm64.1671worker2 # [ 1.368145] systemd[1]: Running in initrd.1672client # [ 1.419139] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01673worker2 # [ 1.370926] systemd[1]: Initializing machine ID from random generator.1674worker2 # [ 1.373787] systemd[1]: Hostname set to <worker2>.1675worker1 # [ 1.352975] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1676worker1 # [ 1.365568] systemd[1]: Detected virtualization qemu.1677worker1 # [ 1.367715] systemd[1]: Detected architecture arm64.1678worker1 # [ 1.369701] systemd[1]: Running in initrd.1679worker1 # [ 1.372444] systemd[1]: Initializing machine ID from random generator.1680worker1 # [ 1.375357] systemd[1]: Hostname set to <worker1>.1681lb # [ 1.411923] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01682worker2 # [ 1.418814] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01683worker1 # [ 1.423947] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01684client # [ 1.538983] usb 1-2: new high-speed USB device number 3 using ehci-pci1685lb # [ 1.539695] usb 1-2: new high-speed USB device number 3 using ehci-pci1686worker2 # [ 1.546542] usb 1-2: new high-speed USB device number 3 using ehci-pci1687worker1 # [ 1.547675] usb 1-2: new high-speed USB device number 3 using ehci-pci1688client # [ 1.639185] systemd[1]: bpf-restrict-fs: LSM BPF program attached1689client # [ 1.702057] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21690client # [ 1.705027] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01691lb # [ 1.681609] systemd[1]: bpf-restrict-fs: LSM BPF program attached1692client # [ 1.732842] systemd[1]: Queued start job for default target Initrd Default Target.1693worker2 # [ 1.684293] systemd[1]: bpf-restrict-fs: LSM BPF program attached1694client # [ 1.741022] systemd[1]: Created slice Slice /system/modprobe.1695client # [ 1.742081] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1696client # [ 1.743182] systemd[1]: Expecting device /dev/disk/by-label/nixos...1697client # [ 1.744017] systemd[1]: Reached target Path Units.1698client # [ 1.744659] systemd[1]: Reached target Slice Units.1699lb # [ 1.695904] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21700client # [ 1.745307] systemd[1]: Reached target Swaps.1701client # [ 1.746045] systemd[1]: Reached target Timer Units.1702client # [ 1.746953] systemd[1]: Listening on D-Bus System Message Bus Socket.1703client # [ 1.748026] systemd[1]: Listening on Journal Socket (/dev/log).1704client # [ 1.748919] systemd[1]: Listening on Journal Sockets.1705client # [ 1.749700] systemd[1]: Listening on udev Control Socket.1706lb # [ 1.701603] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01707client # [ 1.750526] systemd[1]: Listening on udev Kernel Socket.1708client # [ 1.751282] systemd[1]: Reached target Socket Units.1709client # [ 1.753298] systemd[1]: Starting Create List of Static Device Nodes...1710worker2 # [ 1.709743] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21711worker1 # [ 1.698569] systemd[1]: bpf-restrict-fs: LSM BPF program attached1712worker2 # [ 1.715143] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01713client # [ 1.771471] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1714client # [ 1.771573] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1715worker1 # [ 1.711178] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21716worker1 # [ 1.716826] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01717client # [ 1.787212] systemd[1]: Mounting Kernel Configuration File System...1718client # [ 1.795149] systemd[1]: Starting Journal Service...1719client # [ 1.808638] systemd[1]: Starting Load Kernel Modules...1720client # [ 1.809487] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1721client # [ 1.828038] systemd[1]: Starting Coldplug All udev Devices...1722lb # [ 1.794709] systemd[1]: Queued start job for default target Initrd Default Target.1723lb # [ 1.806019] systemd[1]: Created slice Slice /system/modprobe.1724lb # [ 1.807210] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1725worker2 # [ 1.801427] systemd[1]: Queued start job for default target Initrd Default Target.1726lb # [ 1.808620] systemd[1]: Expecting device /dev/disk/by-label/nixos...1727client # [ 1.851107] systemd[1]: Finished Create List of Static Device Nodes.1728lb # [ 1.809692] systemd[1]: Reached target Path Units.1729lb # [ 1.810515] systemd[1]: Reached target Slice Units.1730client # [ 1.852378] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1731lb # [ 1.811345] systemd[1]: Reached target Swaps.1732client # [ 1.852700] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1733lb # [ 1.812161] systemd[1]: Reached target Timer Units.1734client # [ 1.852961] systemd[1]: Mounted Kernel Configuration File System.1735lb # [ 1.813211] systemd[1]: Listening on D-Bus System Message Bus Socket.1736lb # [ 1.814425] systemd[1]: Listening on Journal Socket (/dev/log).1737lb # [ 1.815543] systemd[1]: Listening on Journal Sockets.1738lb # [ 1.816617] systemd[1]: Listening on udev Control Socket.1739lb # [ 1.816749] systemd[1]: Listening on udev Kernel Socket.1740worker2 # [ 1.812766] systemd[1]: Created slice Slice /system/modprobe.1741lb # [ 1.816774] systemd[1]: Reached target Socket Units.1742worker2 # [ 1.813973] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1743worker2 # [ 1.815386] systemd[1]: Expecting device /dev/disk/by-label/nixos...1744lb # [ 1.820927] systemd[1]: Starting Create List of Static Device Nodes...1745worker2 # [ 1.816545] systemd[1]: Reached target Path Units.1746worker2 # [ 1.817373] systemd[1]: Reached target Slice Units.1747worker2 # [ 1.818212] systemd[1]: Reached target Swaps.1748worker2 # [ 1.819037] systemd[1]: Reached target Timer Units.1749client # [ 1.867407] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1750worker2 # [ 1.820053] systemd[1]: Listening on D-Bus System Message Bus Socket.1751worker2 # [ 1.821311] systemd[1]: Listening on Journal Socket (/dev/log).1752worker2 # [ 1.822471] systemd[1]: Listening on Journal Sockets.1753worker2 # [ 1.823483] systemd[1]: Listening on udev Control Socket.1754worker1 # [ 1.808272] systemd[1]: Queued start job for default target Initrd Default Target.1755worker2 # [ 1.824527] systemd[1]: Listening on udev Kernel Socket.1756lb # [ 1.831420] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1757worker2 # [ 1.825436] systemd[1]: Reached target Socket Units.1758lb # [ 1.832808] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1759worker2 # [ 1.828072] systemd[1]: Starting Create List of Static Device Nodes...1760client # [ 1.879146] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1761worker1 # [ 1.818097] systemd[1]: Created slice Slice /system/modprobe.1762worker1 # [ 1.819265] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1763client # [ 1.886252] systemd-journald[73]: Collecting audit messages is disabled.1764worker1 # [ 1.820641] systemd[1]: Expecting device /dev/disk/by-label/nixos...1765worker1 # [ 1.821687] systemd[1]: Reached target Path Units.1766worker1 # [ 1.822467] systemd[1]: Reached target Slice Units.1767worker1 # [ 1.823258] systemd[1]: Reached target Swaps.1768worker1 # [ 1.824066] systemd[1]: Reached target Timer Units.1769worker2 # [ 1.838676] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1770worker1 # [ 1.825107] systemd[1]: Listening on D-Bus System Message Bus Socket.1771worker2 # [ 1.839885] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1772worker1 # [ 1.826313] systemd[1]: Listening on Journal Socket (/dev/log).1773lb # [ 1.845277] systemd[1]: Mounting Kernel Configuration File System...1774worker1 # [ 1.827404] systemd[1]: Listening on Journal Sockets.1775worker2 # [ 1.843380] systemd[1]: Mounting Kernel Configuration File System...1776client # [ 1.895033] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1777worker1 # [ 1.828441] systemd[1]: Listening on udev Control Socket.1778worker1 # [ 1.828575] systemd[1]: Listening on udev Kernel Socket.1779worker1 # [ 1.828598] systemd[1]: Reached target Socket Units.1780worker1 # [ 1.832881] systemd[1]: Starting Create List of Static Device Nodes...1781client # [ 1.907120] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01782client # [ 1.907387] [drm] features: -virgl +edid -resource_blob -host_visible1783worker1 # [ 1.843493] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1784client # [ 1.907401] [drm] features: -context_init1785client # [ 1.908182] [drm] number of scanouts: 11786client # [ 1.908205] [drm] number of cap sets: 01787worker1 # [ 1.844833] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1788lb # [ 1.867906] systemd[1]: Starting Journal Service...1789lb # [ 1.871744] systemd[1]: Starting Load Kernel Modules...1790lb # [ 1.872706] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1791worker2 # [ 1.867044] systemd[1]: Starting Journal Service...1792worker1 # [ 1.853163] systemd[1]: Mounting Kernel Configuration File System...1793client # [ 1.927277] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1794client # [ 1.927307] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01795worker2 # [ 1.887021] systemd[1]: Starting Load Kernel Modules...1796lb # [ 1.892336] systemd[1]: Starting Coldplug All udev Devices...1797worker2 # [ 1.887993] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1798worker1 # [ 1.875060] systemd[1]: Starting Journal Service...1799worker2 # [ 1.894054] systemd[1]: Starting Coldplug All udev Devices...1800client # [ 1.947619] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1801worker1 # [ 1.884063] systemd[1]: Starting Load Kernel Modules...1802worker1 # [ 1.884201] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1803lb # [ 1.907814] systemd[1]: Finished Create List of Static Device Nodes.1804lb # [ 1.909806] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1805client # [ 1.955291] systemd[1]: Starting Create Static Device Nodes in /dev...1806lb # [ 1.915872] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1807lb # [ 1.920116] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1808worker1 # [ 1.899814] systemd[1]: Starting Coldplug All udev Devices...1809client # [ 1.959461] Console: switching to colour frame buffer device 160x501810client # [ 1.966065] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1811worker2 # [ 1.918774] systemd[1]: Finished Create List of Static Device Nodes.1812worker2 # [ 1.919898] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1813worker2 # [ 1.920198] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1814worker2 # [ 1.920430] systemd[1]: Mounted Kernel Configuration File System.1815lb # [ 1.931575] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1816lb # [ 1.936544] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01817lb # [ 1.936787] [drm] features: -virgl +edid -resource_blob -host_visible1818lb # [ 1.936795] [drm] features: -context_init1819lb # [ 1.937512] [drm] number of scanouts: 11820lb # [ 1.937532] [drm] number of cap sets: 01821worker1 # [ 1.925476] systemd-journald[73]: Collecting audit messages is disabled.1822client # [ 1.991923] systemd[1]: Finished Load Kernel Modules.1823worker2 # [ 1.939748] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1824worker2 # [ 1.944173] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1825worker1 # [ 1.928960] systemd[1]: Finished Create List of Static Device Nodes.1826worker1 # [ 1.929899] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1827worker1 # [ 1.930205] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1828lb # [ 1.953714] systemd-journald[73]: Collecting audit messages is disabled.1829lb # [ 1.953895] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1830client # [ 1.999582] systemd[1]: Starting Apply Kernel Variables...1831lb # [ 1.960312] systemd[1]: Mounted Kernel Configuration File System.1832worker2 # [ 1.954568] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1833worker2 # [ 1.959686] systemd-journald[73]: Collecting audit messages is disabled.1834worker1 # [ 1.951808] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1835worker2 # [ 1.968738] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01836worker2 # [ 1.968995] [drm] features: -virgl +edid -resource_blob -host_visible1837worker2 # [ 1.969004] [drm] features: -context_init1838worker2 # [ 1.969820] [drm] number of scanouts: 11839lb # [ 1.968028] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1840worker2 # [ 1.969838] [drm] number of cap sets: 01841lb # [ 1.968050] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01842worker1 # [ 1.964336] systemd[1]: Mounted Kernel Configuration File System.1843lb # [ 1.984276] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1844lb # [ 1.987980] systemd[1]: Starting Create Static Device Nodes in /dev...1845client # [ 2.031356] systemd[1]: Finished Create Static Device Nodes in /dev.1846client # [ 2.033774] systemd[1]: Reached target Preparation for Local File Systems.1847client # [ 2.033821] systemd[1]: Reached target Local File Systems.1848worker2 # [ 1.986820] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1849worker2 # [ 1.986846] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01850client # [ 2.047629] systemd[1]: Starting Rule-based Manager for Device Events and Files...1851lb # [ 2.001060] Console: switching to colour frame buffer device 160x501852worker2 # [ 2.007200] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1853worker1 # [ 1.994264] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1854worker2 # [ 2.010862] systemd[1]: Starting Create Static Device Nodes in /dev...1855client # [ 2.068357] systemd[1]: Finished Apply Kernel Variables.1856worker2 # [ 2.011998] Console: switching to colour frame buffer device 160x501857lb # [ 2.032373] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1858client # [ 2.064873] systemd-modules-load[74]: Inserted module 'dm_mod'1859client # [ 2.066017] systemd-modules-load[74]: Module 'virtio_balloon' is built in1860client # [ 2.067159] systemd-modules-load[74]: Module 'virtio_console' is built in1861worker1 # [ 2.016361] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1862worker1 # [ 2.019024] systemd[1]: Starting Create Static Device Nodes in /dev...1863client # [ 2.083086] systemd[1]: Started Journal Service.1864client # [ 2.076531] systemd-modules-load[74]: Inserted module 'virtio_gpu'1865lb # [ 2.046049] systemd[1]: Finished Load Kernel Modules.1866client # [ 2.077560] systemd-modules-load[74]: Module 'virtio_rng' is built in1867lb # [ 2.048602] systemd[1]: Starting Apply Kernel Variables...1868worker1 # [ 2.023761] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1869worker1 # [ 2.028638] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01870worker1 # [ 2.028877] [drm] features: -virgl +edid -resource_blob -host_visible1871worker1 # [ 2.028886] [drm] features: -context_init1872worker1 # [ 2.029629] [drm] number of scanouts: 11873worker1 # [ 2.029647] [drm] number of cap sets: 01874worker2 # [ 2.047126] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1875client # [ 2.092100] systemd[1]: Starting Create System Files and Directories...1876worker1 # [ 2.044422] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1877lb # [ 2.067853] systemd[1]: Finished Create Static Device Nodes in /dev.1878worker1 # [ 2.044445] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01879worker2 # [ 2.063998] systemd[1]: Finished Load Kernel Modules.1880lb # [ 2.070231] systemd[1]: Reached target Preparation for Local File Systems.1881lb # [ 2.070288] systemd[1]: Reached target Local File Systems.1882worker2 # [ 2.067511] systemd[1]: Starting Apply Kernel Variables...1883lb # [ 2.084159] systemd[1]: Starting Rule-based Manager for Device Events and Files...1884worker2 # [ 2.094848] systemd[1]: Finished Create Static Device Nodes in /dev.1885worker2 # [ 2.095104] systemd[1]: Reached target Preparation for Local File Systems.1886worker2 # [ 2.095139] systemd[1]: Reached target Local File Systems.1887client # [ 2.136444] systemd-udevd[80]: Using default interface naming scheme 'v261'.1888worker1 # [ 2.079945] Console: switching to colour frame buffer device 160x501889client # [ 2.139398] systemd[1]: Finished Create System Files and Directories.1890worker1 # [ 2.086726] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1891worker2 # [ 2.102961] systemd[1]: Starting Rule-based Manager for Device Events and Files...1892lb # [ 2.116010] systemd[1]: Finished Apply Kernel Variables.1893worker1 # [ 2.098258] systemd[1]: Started Journal Service.1894worker1 # [ 2.086820] systemd-modules-load[74]: Inserted module 'dm_mod'1895worker1 # [ 2.093122] systemd-modules-load[74]: Module 'virtio_balloon' is built in1896worker1 # [ 2.096502] systemd-modules-load[74]: Module 'virtio_console' is built in1897client # [ 2.164785] systemd[1]: Started Rule-based Manager for Device Events and Files.1898worker1 # [ 2.100318] systemd[1]: Finished Create Static Device Nodes in /dev.1899lb # [ 2.135811] systemd[1]: Started Journal Service.1900worker2 # [ 2.131105] systemd[1]: Finished Apply Kernel Variables.1901worker1 # [ 2.104418] systemd[1]: Reached target Preparation for Local File Systems.1902worker1 # [ 2.108275] systemd[1]: Reached target Local File Systems.1903worker2 # [ 2.124530] systemd-modules-load[74]: Inserted module 'dm_mod'1904worker1 # [ 2.109265] systemd[1]: Starting Create System Files and Directories...1905worker1 # [ 2.111311] systemd-modules-load[74]: Inserted module 'virtio_gpu'1906lb # [ 2.136390] systemd-modules-load[74]: Inserted module 'dm_mod'1907worker2 # [ 2.140049] systemd[1]: Started Journal Service.1908lb # [ 2.140285] systemd-modules-load[74]: Module 'virtio_balloon' is built in1909worker1 # [ 2.116244] systemd-modules-load[74]: Module 'virtio_rng' is built in1910lb # [ 2.141445] systemd-modules-load[74]: Module 'virtio_console' is built in1911worker2 # [ 2.132422] systemd-modules-load[74]: Module 'virtio_balloon' is built in1912lb # [ 2.142508] systemd-modules-load[74]: Inserted module 'virtio_gpu'1913worker2 # [ 2.133554] systemd-modules-load[74]: Module 'virtio_console' is built in1914lb # [ 2.143506] systemd-modules-load[74]: Module 'virtio_rng' is built in1915worker2 # [ 2.134741] systemd-modules-load[74]: Inserted module 'virtio_gpu'1916worker2 # [ 2.135733] systemd-modules-load[74]: Module 'virtio_rng' is built in1917worker1 # [ 2.120219] systemd[1]: Starting Rule-based Manager for Device Events and Files...1918worker1 # [ 2.122390] systemd[1]: Finished Load Kernel Modules.1919lb # [ 2.154239] systemd[1]: Starting Create System Files and Directories...1920worker2 # [ 2.148188] systemd[1]: Starting Create System Files and Directories...1921worker1 # [ 2.148205] systemd[1]: Starting Apply Kernel Variables...1922lb # [ 2.174319] systemd-udevd[81]: Using default interface naming scheme 'v261'.1923client # [ 2.223822] systemd[1]: Starting Virtual Console Setup...1924lb # [ 2.188142] systemd[1]: Finished Create System Files and Directories.1925worker2 # [ 2.181389] systemd[1]: Finished Create System Files and Directories.1926worker1 # [ 2.170845] systemd[1]: Finished Create System Files and Directories.1927worker2 # [ 2.197328] systemd-udevd[81]: Using default interface naming scheme 'v261'.1928lb # [ 2.212754] systemd[1]: Started Rule-based Manager for Device Events and Files.1929worker1 # [ 2.189037] systemd[1]: Finished Apply Kernel Variables.1930worker1 # [ 2.201602] systemd-udevd[81]: Using default interface naming scheme 'v261'.1931worker2 # [ 2.225073] systemd[1]: Started Rule-based Manager for Device Events and Files.1932client # [ 2.276835] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones.1933client # [ 2.279759] systemd[1]: Finished Virtual Console Setup.1934worker1 # [ 2.233352] systemd[1]: Started Rule-based Manager for Device Events and Files.1935lb # [ 2.269987] systemd[1]: Starting Virtual Console Setup...1936worker2 # [ 2.280672] systemd[1]: Starting Virtual Console Setup...1937worker1 # [ 2.286698] systemd[1]: Starting Virtual Console Setup...1938lb # [ 2.324551] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1939lb # [ 2.328161] systemd[1]: Finished Virtual Console Setup.1940worker2 # [ 2.332569] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1941worker2 # [ 2.336092] systemd[1]: Finished Virtual Console Setup.1942worker1 # [ 2.348545] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1943worker1 # [ 2.352192] systemd[1]: Finished Virtual Console Setup.1944client # [ 2.886357] systemd[1]: Finished Coldplug All udev Devices.1945client # [ 2.888868] systemd[1]: Reached target System Initialization.1946client # [ 2.892765] systemd[1]: Reached target Basic System.1947lb # [ 2.933365] systemd[1]: Finished Coldplug All udev Devices.1948lb # [ 2.934387] systemd[1]: Reached target System Initialization.1949lb # [ 2.935199] systemd[1]: Reached target Basic System.1950worker2 # [ 2.929346] systemd[1]: Finished Coldplug All udev Devices.1951worker2 # [ 2.930323] systemd[1]: Reached target System Initialization.1952worker2 # [ 2.931146] systemd[1]: Reached target Basic System.1953worker1 # [ 2.922318] systemd[1]: Finished Coldplug All udev Devices.1954worker1 # [ 2.928154] systemd[1]: Reached target System Initialization.1955worker1 # [ 2.929253] systemd[1]: Reached target Basic System.1956client # [ 3.040142] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line.1957client # [ 3.067060] (udev-worker)[91]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1958client # [ 3.081157] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line.1959worker1 # [ 3.051963] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line.1960lb # [ 3.090859] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line.1961worker2 # [ 3.095799] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line.1962client # [ 3.154790] systemd[1]: Found device /dev/disk/by-label/nixos.1963worker2 # [ 3.106343] (udev-worker)[98]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1964client # [ 3.159355] systemd[1]: Reached target Initrd Root Device.1965worker1 # [ 3.093003] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1966lb # [ 3.120297] (udev-worker)[106]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1967worker2 # [ 3.112263] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line.1968worker1 # [ 3.097408] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line.1969client # [ 3.165143] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1970lb # [ 3.128370] (udev-worker)[106]: Network interface NamePolicy= disabled on kernel command line.1971client # [ 3.214352] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks1972client # [ 3.223559] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1973worker2 # [ 3.173626] systemd[1]: Found device /dev/disk/by-label/nixos.1974client # [ 3.225683] systemd[1]: Mounting /sysroot...1975worker1 # [ 3.161995] systemd[1]: Found device /dev/disk/by-label/nixos.1976worker2 # [ 3.180358] systemd[1]: Reached target Initrd Root Device.1977worker1 # [ 3.164979] systemd[1]: Reached target Initrd Root Device.1978lb # [ 3.192233] systemd[1]: Found device /dev/disk/by-label/nixos.1979worker1 # [ 3.168169] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1980worker2 # [ 3.187916] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1981lb # [ 3.198505] systemd[1]: Reached target Initrd Root Device.1982lb # [ 3.203568] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1983client # [ 3.283519] EXT4-fs (vda): mounted filesystem 5c6c59d9-66d5-4d9a-aec2-94145266481f r/w with ordered data mode. Quota mode: none.1984client # [ 3.275996] systemd[1]: Mounted /sysroot.1985client # [ 3.278224] systemd[1]: Reached target Initrd Root File System.1986client # [ 3.284663] systemd[1]: Starting Mountpoints Configured in the Real Root...1987worker2 # [ 3.235333] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1988worker1 # [ 3.224326] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1989worker2 # [ 3.242963] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1990worker2 # [ 3.244538] systemd[1]: Mounting /sysroot...1991lb # [ 3.253929] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1992worker1 # [ 3.231351] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1993lb # [ 3.262139] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1994lb # [ 3.264204] systemd[1]: Mounting /sysroot...1995worker1 # [ 3.244984] systemd[1]: Mounting /sysroot...1996client # [ 3.312481] systemd-sysroot-fstab-check[119]: /sysroot should be mounted in the initrd, will request daemon-reload.1997client # [ 3.319853] systemd[1]: Reload requested from client PID 119 ('systemd-sysroot') (unit initrd-parse-etc.service)...1998client # [ 3.324711] systemd[1]: Reloading...1999worker2 # [ 3.293052] EXT4-fs (vda): mounted filesystem 3d4bcb35-e471-481a-ae75-0338713edd14 r/w with ordered data mode. Quota mode: none.2000worker2 # [ 3.284194] systemd[1]: Mounted /sysroot.
loading 1,363 hidden lines…
3364worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.11 seconds)3365worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3366worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.05 seconds)3367worker2: waiting for unit network-addresses-eth1.service3368worker2: waiting for the VM to finish booting3369worker2: Guest shell says: b'Spawning backdoor root shell...\n'3370worker2: connected to guest root shell3371worker2: (connecting took 0.00 seconds)3372worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3373worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.12 seconds)3374worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3375worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.05 seconds)3376lb: waiting for unit niks3.service3377worker1 # [ 15.407336] dhcpcd[645]: eth0: soliciting an IPv6 router3378worker1 # [ 15.410880] dhcpcd[645]: eth0: Router Advertisement from fe80::23379worker1 # [ 15.413689] dhcpcd[645]: eth0: adding address fec0::5054:ff:fe12:3456/643380worker1 # [ 15.416495] dhcpcd[645]: eth0: adding route to fec0::/643381worker1 # [ 15.418701] dhcpcd[645]: eth0: adding default route via fe80::23382lb # [ 15.606820] postgresql-pre-start[678]: selecting default time zone ... UTC3383lb # [ 15.614892] postgresql-pre-start[678]: creating configuration files ... ok3384lb # [ 15.871868] dhcpcd[655]: eth0: soliciting an IPv6 router3385lb # [ 15.873724] dhcpcd[655]: eth0: Router Advertisement from fe80::23386lb # [ 15.874562] dhcpcd[655]: eth0: adding address fec0::5054:ff:fe12:3456/643387lb # [ 15.875441] dhcpcd[655]: eth0: adding route to fec0::/643388lb # [ 15.883099] dhcpcd[655]: eth0: adding default route via fe80::23389lb # [ 16.147382] postgresql-pre-start[678]: running bootstrap script ... ok3390lb # [ 16.168324] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3391lb # [ 16.169400] systemd[1]: Stopped Virtual Console Setup.3392lb # [ 16.170133] systemd[1]: Stopping Virtual Console Setup...3393lb # [ 16.176397] systemd[1]: Starting Virtual Console Setup...3394lb # [ 16.230594] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3395lb # [ 16.243742] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3396lb # [ 16.248508] systemd[1]: Stopped Virtual Console Setup.3397lb # [ 16.264186] systemd[1]: Starting Virtual Console Setup...3398lb # [ 16.290805] systemd-logind[517]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3399lb # [ 16.683090] systemd-vconsole-setup[786]: Configuration of first virtual console was skipped, ignoring remaining ones.3400lb # [ 16.689873] systemd[1]: Finished Virtual Console Setup.3401lb # [ 16.971527] postgresql-pre-start[678]: performing post-bootstrap initialization ... ok3402lb # [ 17.119516] postgresql-pre-start[678]: syncing data to disk ... ok3403lb # [ 17.121612] postgresql-pre-start[678]: initdb: warning: enabling "trust" authentication for local connections3404lb # [ 17.126534] postgresql-pre-start[678]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3405lb # [ 17.129756] postgresql-pre-start[678]: Success. You can now start the database server using:3406lb # [ 17.130869] postgresql-pre-start[678]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3407lb # [ 17.271021] postgres[802]: [802] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit3408lb # [ 17.275389] postgres[802]: [802] LOG: listening on IPv6 address "::1", port 54323409lb # [ 17.276764] postgres[802]: [802] LOG: listening on IPv4 address "127.0.0.1", port 54323410lb # [ 17.278475] postgres[802]: [802] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3411lb # [ 17.292429] postgres[811]: [811] LOG: database system was shut down at 2026-09-20 08:17:10 GMT3412lb # [ 17.299434] postgres[802]: [802] LOG: database system is ready to accept connections3413lb # [ 17.305766] systemd[1]: Started PostgreSQL Server.3414lb # [ 17.313657] systemd[1]: Starting PostgreSQL Setup Scripts...3415lb # [ 17.540191] postgresql-setup-start[822]: CREATE DATABASE3416lb # [ 17.617067] postgresql-setup-start[830]: CREATE ROLE3417lb # [ 17.652411] postgresql-setup-start[838]: ALTER DATABASE3418lb # [ 17.662082] systemd[1]: Finished PostgreSQL Setup Scripts.3419lb # [ 17.664279] systemd[1]: Reached target PostgreSQL.3420lb # [ 19.080465] dhcpcd[655]: eth0: leased 10.0.2.15 for 86400 seconds3421lb # [ 19.083609] dhcpcd[655]: eth0: adding route to 10.0.2.0/243422lb # [ 19.086596] dhcpcd[655]: eth0: adding default route via 10.0.2.23423lb # [ 19.251283] systemd[1]: Started DHCP Client.3424lb # [ 19.254375] systemd[1]: Reached target Network is Online.3425lb # [ 19.260176] systemd[1]: Started Envoy reverse proxy.3426lb # [ 19.268545] systemd[1]: Started mock-oidc.service.3427lb # [ 19.370197] mock-oidc-server[911]: Mock OIDC Server running3428lb # [ 19.371355] mock-oidc-server[911]: OIDC Address: 192.168.1.2:80803429lb # [ 19.373791] mock-oidc-server[911]: Issue Address: 0.0.0.0:80813430lb # [ 19.375011] mock-oidc-server[911]: Issuer: http://192.168.1.2:8080/oidc3431lb # [ 19.376838] mock-oidc-server[911]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3432lb # [ 19.378168] mock-oidc-server[911]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3433lb # [ 19.379777] mock-oidc-server[911]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3434client # [ 19.535989] dhcpcd[526]: eth0: leased 10.0.2.15 for 86400 seconds3435client # [ 19.539482] dhcpcd[526]: eth0: adding route to 10.0.2.0/243436client # [ 19.542484] dhcpcd[526]: eth0: adding default route via 10.0.2.23437client # [ 19.704371] systemd[1]: Started DHCP Client.3438client # [ 19.707409] systemd[1]: Reached target Multi-User System.3439client # [ 19.709279] systemd[1]: Startup finished in 993ms (kernel) + 4.630s (initrd) + 14.084s (userspace) = 19.708s.3440worker2 # [ 19.661102] dhcpcd[644]: eth0: leased 10.0.2.15 for 86400 seconds3441worker2 # [ 19.664875] dhcpcd[644]: eth0: adding route to 10.0.2.0/243442worker2 # [ 19.668246] dhcpcd[644]: eth0: adding default route via 10.0.2.23443worker2 # [ 19.828258] systemd[1]: Started DHCP Client.3444worker2 # [ 19.830371] systemd[1]: Reached target Multi-User System.3445worker2 # [ 19.831238] systemd[1]: Startup finished in 991ms (kernel) + 5.467s (initrd) + 13.371s (userspace) = 19.829s.3446lb # [ 19.976449] envoy[910]: [2026-09-20 08:17:13.559][910][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120)3447lb # [ 19.979406] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:469] statically linked extensions:3448lb # [ 19.981357] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection3449lb # [ 19.986581] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3450lb # [ 19.989289] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3451lb # [ 19.991823] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3452lb # [ 19.994642] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3453lb # [ 19.997005] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3454lb # [ 20.000237] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case3455lb # [ 20.002733] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats3456lb # [ 20.005559] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator3457lb # [ 20.008037] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3458lb # [ 20.014121] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3459lb # [ 20.032541] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3460lb # [ 20.034347] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3461lb # [ 20.038906] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor3462lb # [ 20.041966] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple3463lb # [ 20.044429] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso3464lb # [ 20.048230] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3465lb # [ 20.051341] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3466lb # [ 20.058760] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3467lb # [ 20.067877] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3468lb # [ 20.070515] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3469lb # [ 20.072691] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic3470lb # [ 20.074626] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default3471lb # [ 20.076413] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3472lb # [ 20.078473] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3473lb # [ 20.084119] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3474lb # [ 20.087160] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default3475lb # [ 20.089031] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3476lb # [ 20.091016] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83477lb # [ 20.093756] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3478lb # [ 20.095898] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3479lb # [ 20.100154] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3480lb # [ 20.102010] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3481lb # [ 20.106841] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3482lb # [ 20.138738] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3483lb # [ 20.141750] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3484lb # [ 20.143609] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3485lb # [ 20.146209] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3486lb # [ 20.151252] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3487lb # [ 20.154551] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3488lb # [ 20.157827] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3489lb # [ 20.160656] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based3490worker1 # [ 20.138134] dhcpcd[645]: eth0: leased 10.0.2.15 for 86400 seconds3491lb # [ 20.165351] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift3492worker1 # [ 20.141703] dhcpcd[645]: eth0: adding route to 10.0.2.0/243493lb # [ 20.169050] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3494worker1 # [ 20.145160] dhcpcd[645]: eth0: adding default route via 10.0.2.23495lb # [ 20.170974] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3496lb # [ 20.172998] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3497lb # [ 20.180751] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3498lb # [ 20.182676] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3499lb # [ 20.184904] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3500lb # [ 20.187108] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3501lb # [ 20.190777] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default3502lb # [ 20.197141] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3503lb # [ 20.201568] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3504lb # [ 20.210033] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth23505lb # [ 20.212983] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3506lb # [ 20.215492] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection3507lb # [ 20.217889] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3508lb # [ 20.220470] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3509lb # [ 20.225094] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy3510lb # [ 20.227925] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua3511lb # [ 20.230570] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3512lb # [ 20.235283] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3513lb # [ 20.238143] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3514lb # [ 20.246840] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3515lb # [ 20.250522] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3516lb # [ 20.256919] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind3517lb # [ 20.258896] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13518lb # [ 20.263977] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid3519lb # [ 20.265859] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3520lb # [ 20.269301] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3521lb # [ 20.273194] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23522lb # [ 20.275081] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert3523lb # [ 20.277596] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3524lb # [ 20.283570] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3525lb # [ 20.287696] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3526lb # [ 20.293828] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3527lb # [ 20.296573] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3528lb # [ 20.301570] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3529lb # [ 20.304178] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3530lb # [ 20.306446] envoy[910]: [2026-09-20 08:17:13.562][910][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable3531lb # [ 20.309156] envoy[910]: [2026-09-20 08:17:13.563][910][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3532lb # [ 20.313794] envoy[910]: [2026-09-20 08:17:13.563][910][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3533lb # [ 20.318131] envoy[910]: [2026-09-20 08:17:13.563][910][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo3534lb # [ 20.322614] envoy[910]: [2026-09-20 08:17:13.563][910][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default3535worker1 # [ 20.307040] systemd[1]: Started DHCP Client.3536worker1 # [ 20.309332] systemd[1]: Reached target Multi-User System.3537worker1 # [ 20.310183] systemd[1]: Startup finished in 989ms (kernel) + 5.532s (initrd) + 13.787s (userspace) = 20.309s.3538lb # [ 20.325911] envoy[910]: [2026-09-20 08:17:13.563][910][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy3539lb # [ 20.343540] envoy[910]: [2026-09-20 08:17:13.563][910][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3540lb # [ 20.348301] envoy[910]: [2026-09-20 08:17:13.563][910][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction3541lb # [ 20.355803] envoy[910]: [2026-09-20 08:17:13.563][910][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3542lb # [ 20.361347] envoy[910]: [2026-09-20 08:17:13.563][910][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3543lb # [ 20.365337] envoy[910]: [2026-09-20 08:17:13.563][910][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3544lb # [ 20.373068] envoy[910]: [2026-09-20 08:17:13.563][910][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3545lb # [ 20.375030] envoy[910]: [2026-09-20 08:17:13.563][910][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3546lb # [ 20.377709] envoy[910]: [2026-09-20 08:17:13.563][910][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3547lb # [ 20.381200] envoy[910]: [2026-09-20 08:17:13.563][910][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override3548lb # [ 20.384179] envoy[910]: [2026-09-20 08:17:13.563][910][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default3549lb # [ 20.386465] envoy[910]: [2026-09-20 08:17:13.563][910][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter3550lb # [ 20.389508] envoy[910]: [2026-09-20 08:17:13.563][910][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23551lb # [ 20.391664] envoy[910]: [2026-09-20 08:17:13.563][910][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params3552worker1 # [ 20.376507] systemd[1]: Starting Nix worker-protocol over gRPC...3553lb # [ 20.403370] envoy[910]: [2026-09-20 08:17:13.563][910][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3554lb # [ 20.406039] envoy[910]: [2026-09-20 08:17:13.563][910][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3555lb # [ 20.408778] envoy[910]: [2026-09-20 08:17:13.563][910][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3556lb # [ 20.411046] envoy[910]: [2026-09-20 08:17:13.563][910][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy3557lb # [ 20.416280] envoy[910]: [2026-09-20 08:17:13.563][910][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3558lb # [ 20.419155] envoy[910]: [2026-09-20 08:17:13.563][910][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector3559lb # [ 20.426652] envoy[910]: [2026-09-20 08:17:13.597][910][info][main] [source/server/server.cc:531] HTTP header map info:3560worker2 # [ 20.419087] systemd[1]: Starting Nix worker-protocol over gRPC...3561lb # [ 20.428294] envoy[910]: [2026-09-20 08:17:13.607][910][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id3562lb # [ 20.444673] envoy[910]: [2026-09-20 08:17:13.607][910][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:3563lb # [ 20.446654] envoy[910]: [2026-09-20 08:17:13.607][910][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id3564lb # [ 20.456312] envoy[910]: [2026-09-20 08:17:13.607][910][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status3565lb # [ 20.458500] envoy[910]: [2026-09-20 08:17:13.792][910][info][main] [source/server/server.cc:968] runtime: {}3566lb # [ 20.459880] envoy[910]: [2026-09-20 08:17:13.805][910][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.3567lb # [ 20.463083] envoy[910]: [2026-09-20 08:17:13.805][910][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99013568lb # [ 20.466307] envoy[910]: [2026-09-20 08:17:13.805][910][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99013569lb # [ 20.468201] envoy[910]: [2026-09-20 08:17:13.814][910][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration3570lb # [ 20.469971] envoy[910]: [2026-09-20 08:17:13.814][910][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)3571lb # [ 20.471652] envoy[910]: [2026-09-20 08:17:13.814][910][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)3572lb # [ 20.474053] envoy[910]: [2026-09-20 08:17:13.999][910][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)3573lb # [ 20.478480] envoy[910]: [2026-09-20 08:17:14.062][910][info][config] [source/server/configuration_impl.cc:164] loading stats configuration3574lb # [ 20.481898] envoy[910]: [2026-09-20 08:17:14.064][910][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.3575lb # [ 20.485229] envoy[910]: [2026-09-20 08:17:14.064][910][info][main] [source/server/server.cc:1077] starting main dispatch loop3576worker1 # [ 20.618533] nix-grpc-daemon[774]: ts=2026-09-20T08:17:14Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3577worker1 # [ 20.630735] nix-grpc-daemon[774]: ts=2026-09-20T08:17:14Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=13578worker2 # [ 20.678248] nix-grpc-daemon[776]: ts=2026-09-20T08:17:14Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3579worker2 # [ 20.688976] nix-grpc-daemon[776]: ts=2026-09-20T08:17:14Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=13580worker1 # [ 20.675793] nix-grpc-daemon[774]: ts=2026-09-20T08:17:14Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3581worker1 # [ 20.680896] systemd[1]: Started Nix worker-protocol over gRPC.3582worker2 # [ 20.733621] nix-grpc-daemon[776]: ts=2026-09-20T08:17:14Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3583lb # [ 20.742622] envoy[910]: [2026-09-20 08:17:14.325][910][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization3584worker2 # [ 20.738576] systemd[1]: Started Nix worker-protocol over gRPC.3585lb # [ 20.749657] envoy[910]: [2026-09-20 08:17:14.325][910][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized3586lb # [ 20.762164] envoy[910]: [2026-09-20 08:17:14.325][910][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager3587lb # [ 20.774208] envoy[910]: [2026-09-20 08:17:14.325][910][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers3588worker1 # [ 20.759496] nix-grpc-daemon[774]: ts=2026-09-20T08:17:14Z level=info event=scheduler_connected addr=lb:500513589worker1 # [ 20.780327] nix-grpc-daemon[774]: ts=2026-09-20T08:17:14Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3590worker2 # [ 20.799352] nix-grpc-daemon[776]: ts=2026-09-20T08:17:14Z level=info event=scheduler_connected addr=lb:500513591worker2 # [ 20.810380] nix-grpc-daemon[776]: ts=2026-09-20T08:17:14Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3592worker1 # [ 20.982124] nix-grpc-daemon[774]: ts=2026-09-20T08:17:14Z level=info event=scheduler_connected addr=lb:500513593worker1 # [ 20.989965] nix-grpc-daemon[774]: ts=2026-09-20T08:17:14Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3594worker2 # [ 21.011977] nix-grpc-daemon[776]: ts=2026-09-20T08:17:14Z level=info event=scheduler_connected addr=lb:500513595worker2 # [ 21.018847] nix-grpc-daemon[776]: ts=2026-09-20T08:17:14Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3596worker1 # [ 21.191161] nix-grpc-daemon[774]: ts=2026-09-20T08:17:14Z level=info event=scheduler_connected addr=lb:500513597worker1 # [ 21.198499] nix-grpc-daemon[774]: ts=2026-09-20T08:17:14Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3598worker2 # [ 21.219451] nix-grpc-daemon[776]: ts=2026-09-20T08:17:14Z level=info event=scheduler_connected addr=lb:500513599worker2 # [ 21.224440] nix-grpc-daemon[776]: ts=2026-09-20T08:17:14Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3600worker1 # [ 21.399789] nix-grpc-daemon[774]: ts=2026-09-20T08:17:14Z level=info event=scheduler_connected addr=lb:500513601worker1 # [ 21.406561] nix-grpc-daemon[774]: ts=2026-09-20T08:17:14Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3602worker2 # [ 21.425682] nix-grpc-daemon[776]: ts=2026-09-20T08:17:15Z level=info event=scheduler_connected addr=lb:500513603worker2 # [ 21.433159] nix-grpc-daemon[776]: ts=2026-09-20T08:17:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3604worker1 # [ 21.607776] nix-grpc-daemon[774]: ts=2026-09-20T08:17:15Z level=info event=scheduler_connected addr=lb:500513605worker1 # [ 21.614484] nix-grpc-daemon[774]: ts=2026-09-20T08:17:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3606worker2 # [ 21.634505] nix-grpc-daemon[776]: ts=2026-09-20T08:17:15Z level=info event=scheduler_connected addr=lb:500513607worker2 # [ 21.641517] nix-grpc-daemon[776]: ts=2026-09-20T08:17:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3608worker1 # [ 21.819006] nix-grpc-daemon[774]: ts=2026-09-20T08:17:15Z level=info event=scheduler_connected addr=lb:500513609worker1 # [ 21.823476] nix-grpc-daemon[774]: ts=2026-09-20T08:17:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3610worker2 # [ 21.844865] nix-grpc-daemon[776]: ts=2026-09-20T08:17:15Z level=info event=scheduler_connected addr=lb:500513611worker2 # [ 21.847240] nix-grpc-daemon[776]: ts=2026-09-20T08:17:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3612worker1 # [ 22.019849] nix-grpc-daemon[774]: ts=2026-09-20T08:17:15Z level=info event=scheduler_connected addr=lb:500513613worker1 # [ 22.026812] nix-grpc-daemon[774]: ts=2026-09-20T08:17:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3614worker2 # [ 22.045929] nix-grpc-daemon[776]: ts=2026-09-20T08:17:15Z level=info event=scheduler_connected addr=lb:500513615worker2 # [ 22.053237] nix-grpc-daemon[776]: ts=2026-09-20T08:17:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3616worker1 # [ 22.228814] nix-grpc-daemon[774]: ts=2026-09-20T08:17:15Z level=info event=scheduler_connected addr=lb:500513617worker1 # [ 22.235568] nix-grpc-daemon[774]: ts=2026-09-20T08:17:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3618worker2 # [ 22.254802] nix-grpc-daemon[776]: ts=2026-09-20T08:17:15Z level=info event=scheduler_connected addr=lb:500513619worker2 # [ 22.261752] nix-grpc-daemon[776]: ts=2026-09-20T08:17:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3620worker1 # [ 22.436957] nix-grpc-daemon[774]: ts=2026-09-20T08:17:16Z level=info event=scheduler_connected addr=lb:500513621worker1 # [ 22.444236] nix-grpc-daemon[774]: ts=2026-09-20T08:17:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3622worker2 # [ 22.463061] nix-grpc-daemon[776]: ts=2026-09-20T08:17:16Z level=info event=scheduler_connected addr=lb:500513623worker2 # [ 22.470234] nix-grpc-daemon[776]: ts=2026-09-20T08:17:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3624worker1 # [ 22.645723] nix-grpc-daemon[774]: ts=2026-09-20T08:17:16Z level=info event=scheduler_connected addr=lb:500513625worker1 # [ 22.653013] nix-grpc-daemon[774]: ts=2026-09-20T08:17:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3626worker2 # [ 22.671377] nix-grpc-daemon[776]: ts=2026-09-20T08:17:16Z level=info event=scheduler_connected addr=lb:500513627worker2 # [ 22.678582] nix-grpc-daemon[776]: ts=2026-09-20T08:17:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3628worker1 # [ 22.855720] nix-grpc-daemon[774]: ts=2026-09-20T08:17:16Z level=info event=scheduler_connected addr=lb:500513629worker1 # [ 22.858844] nix-grpc-daemon[774]: ts=2026-09-20T08:17:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3630worker2 # [ 22.880000] nix-grpc-daemon[776]: ts=2026-09-20T08:17:16Z level=info event=scheduler_connected addr=lb:500513631worker2 # [ 22.883838] nix-grpc-daemon[776]: ts=2026-09-20T08:17:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3632worker1 # [ 23.060338] nix-grpc-daemon[774]: ts=2026-09-20T08:17:16Z level=info event=scheduler_connected addr=lb:500513633worker1 # [ 23.067950] nix-grpc-daemon[774]: ts=2026-09-20T08:17:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3634worker2 # [ 23.085153] nix-grpc-daemon[776]: ts=2026-09-20T08:17:16Z level=info event=scheduler_connected addr=lb:500513635worker2 # [ 23.092282] nix-grpc-daemon[776]: ts=2026-09-20T08:17:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3636worker1 # [ 23.269122] nix-grpc-daemon[774]: ts=2026-09-20T08:17:16Z level=info event=scheduler_connected addr=lb:500513637worker1 # [ 23.275863] nix-grpc-daemon[774]: ts=2026-09-20T08:17:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3638worker2 # [ 23.293610] nix-grpc-daemon[776]: ts=2026-09-20T08:17:16Z level=info event=scheduler_connected addr=lb:500513639worker2 # [ 23.300529] nix-grpc-daemon[776]: ts=2026-09-20T08:17:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3640worker1 # [ 23.477517] nix-grpc-daemon[774]: ts=2026-09-20T08:17:17Z level=info event=scheduler_connected addr=lb:500513641worker1 # [ 23.484680] nix-grpc-daemon[774]: ts=2026-09-20T08:17:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3642worker2 # [ 23.501997] nix-grpc-daemon[776]: ts=2026-09-20T08:17:17Z level=info event=scheduler_connected addr=lb:500513643worker2 # [ 23.509116] nix-grpc-daemon[776]: ts=2026-09-20T08:17:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3644worker1 # [ 23.685893] nix-grpc-daemon[774]: ts=2026-09-20T08:17:17Z level=info event=scheduler_connected addr=lb:500513645worker1 # [ 23.693073] nix-grpc-daemon[774]: ts=2026-09-20T08:17:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3646worker2 # [ 23.710515] nix-grpc-daemon[776]: ts=2026-09-20T08:17:17Z level=info event=scheduler_connected addr=lb:500513647worker2 # [ 23.717740] nix-grpc-daemon[776]: ts=2026-09-20T08:17:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3648worker1 # [ 23.894974] nix-grpc-daemon[774]: ts=2026-09-20T08:17:17Z level=info event=scheduler_connected addr=lb:500513649worker1 # [ 23.899591] nix-grpc-daemon[774]: ts=2026-09-20T08:17:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3650worker2 # [ 23.922405] nix-grpc-daemon[776]: ts=2026-09-20T08:17:17Z level=info event=scheduler_connected addr=lb:500513651worker2 # [ 23.926669] nix-grpc-daemon[776]: ts=2026-09-20T08:17:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3652worker1 # [ 24.100967] nix-grpc-daemon[774]: ts=2026-09-20T08:17:17Z level=info event=scheduler_connected addr=lb:500513653worker2 # [ 24.123409] nix-grpc-daemon[776]: ts=2026-09-20T08:17:17Z level=info event=scheduler_connected addr=lb:500513654worker1 # [ 24.109347] nix-grpc-daemon[774]: ts=2026-09-20T08:17:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3655worker2 # [ 24.130644] nix-grpc-daemon[776]: ts=2026-09-20T08:17:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3656worker1 # [ 24.310626] nix-grpc-daemon[774]: ts=2026-09-20T08:17:17Z level=info event=scheduler_connected addr=lb:500513657worker2 # [ 24.331850] nix-grpc-daemon[776]: ts=2026-09-20T08:17:17Z level=info event=scheduler_connected addr=lb:500513658worker1 # [ 24.318091] nix-grpc-daemon[774]: ts=2026-09-20T08:17:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3659worker2 # [ 24.339292] nix-grpc-daemon[776]: ts=2026-09-20T08:17:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3660worker1 # [ 24.519216] nix-grpc-daemon[774]: ts=2026-09-20T08:17:18Z level=info event=scheduler_connected addr=lb:500513661worker2 # [ 24.540592] nix-grpc-daemon[776]: ts=2026-09-20T08:17:18Z level=info event=scheduler_connected addr=lb:500513662worker1 # [ 24.526577] nix-grpc-daemon[774]: ts=2026-09-20T08:17:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3663worker2 # [ 24.548179] nix-grpc-daemon[776]: ts=2026-09-20T08:17:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3664worker1 # [ 24.727669] nix-grpc-daemon[774]: ts=2026-09-20T08:17:18Z level=info event=scheduler_connected addr=lb:500513665worker2 # [ 24.749357] nix-grpc-daemon[776]: ts=2026-09-20T08:17:18Z level=info event=scheduler_connected addr=lb:500513666worker1 # [ 24.734994] nix-grpc-daemon[774]: ts=2026-09-20T08:17:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3667worker2 # [ 24.756411] nix-grpc-daemon[776]: ts=2026-09-20T08:17:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3668worker1 # [ 24.938417] nix-grpc-daemon[774]: ts=2026-09-20T08:17:18Z level=info event=scheduler_connected addr=lb:500513669worker2 # [ 24.960624] nix-grpc-daemon[776]: ts=2026-09-20T08:17:18Z level=info event=scheduler_connected addr=lb:500513670worker1 # [ 24.943980] nix-grpc-daemon[774]: ts=2026-09-20T08:17:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3671worker2 # [ 24.964851] nix-grpc-daemon[776]: ts=2026-09-20T08:17:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3672worker1 # [ 25.144759] nix-grpc-daemon[774]: ts=2026-09-20T08:17:18Z level=info event=scheduler_connected addr=lb:500513673worker2 # [ 25.161787] nix-grpc-daemon[776]: ts=2026-09-20T08:17:18Z level=info event=scheduler_connected addr=lb:500513674worker1 # [ 25.151891] nix-grpc-daemon[774]: ts=2026-09-20T08:17:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3675worker2 # [ 25.168900] nix-grpc-daemon[776]: ts=2026-09-20T08:17:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3676worker1 # [ 25.352672] nix-grpc-daemon[774]: ts=2026-09-20T08:17:18Z level=info event=scheduler_connected addr=lb:500513677worker1 # [ 25.356755] nix-grpc-daemon[774]: ts=2026-09-20T08:17:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3678worker2 # [ 25.370057] nix-grpc-daemon[776]: ts=2026-09-20T08:17:18Z level=info event=scheduler_connected addr=lb:500513679worker2 # [ 25.376756] nix-grpc-daemon[776]: ts=2026-09-20T08:17:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3680worker1 # [ 25.558084] nix-grpc-daemon[774]: ts=2026-09-20T08:17:19Z level=info event=scheduler_connected addr=lb:500513681worker2 # [ 25.577671] nix-grpc-daemon[776]: ts=2026-09-20T08:17:19Z level=info event=scheduler_connected addr=lb:500513682worker1 # [ 25.565269] nix-grpc-daemon[774]: ts=2026-09-20T08:17:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3683worker2 # [ 25.584851] nix-grpc-daemon[776]: ts=2026-09-20T08:17:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3684worker1 # [ 25.766342] nix-grpc-daemon[774]: ts=2026-09-20T08:17:19Z level=info event=scheduler_connected addr=lb:500513685worker2 # [ 25.785949] nix-grpc-daemon[776]: ts=2026-09-20T08:17:19Z level=info event=scheduler_connected addr=lb:500513686worker1 # [ 25.773340] nix-grpc-daemon[774]: ts=2026-09-20T08:17:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3687worker2 # [ 25.792883] nix-grpc-daemon[776]: ts=2026-09-20T08:17:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3688worker1 # [ 25.975208] nix-grpc-daemon[774]: ts=2026-09-20T08:17:19Z level=info event=scheduler_connected addr=lb:500513689worker1 # [ 25.979842] nix-grpc-daemon[774]: ts=2026-09-20T08:17:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3690worker2 # [ 25.997180] nix-grpc-daemon[776]: ts=2026-09-20T08:17:19Z level=info event=scheduler_connected addr=lb:500513691worker2 # [ 26.001410] nix-grpc-daemon[776]: ts=2026-09-20T08:17:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3692worker2 # [ 26.197758] nix-grpc-daemon[776]: ts=2026-09-20T08:17:19Z level=info event=scheduler_connected addr=lb:500513693worker1 # [ 26.180950] nix-grpc-daemon[774]: ts=2026-09-20T08:17:19Z level=info event=scheduler_connected addr=lb:500513694worker2 # [ 26.202065] nix-grpc-daemon[776]: ts=2026-09-20T08:17:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3695worker1 # [ 26.186484] nix-grpc-daemon[774]: ts=2026-09-20T08:17:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3696worker2 # [ 26.403202] nix-grpc-daemon[776]: ts=2026-09-20T08:17:19Z level=info event=scheduler_connected addr=lb:500513697worker1 # [ 26.387735] nix-grpc-daemon[774]: ts=2026-09-20T08:17:19Z level=info event=scheduler_connected addr=lb:500513698worker1 # [ 26.394529] nix-grpc-daemon[774]: ts=2026-09-20T08:17:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3699worker2 # [ 26.410486] nix-grpc-daemon[776]: ts=2026-09-20T08:17:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3700worker1 # [ 26.595631] nix-grpc-daemon[774]: ts=2026-09-20T08:17:20Z level=info event=scheduler_connected addr=lb:500513701worker2 # [ 26.611851] nix-grpc-daemon[776]: ts=2026-09-20T08:17:20Z level=info event=scheduler_connected addr=lb:500513702worker2 # [ 26.618696] nix-grpc-daemon[776]: ts=2026-09-20T08:17:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3703worker1 # [ 26.602860] nix-grpc-daemon[774]: ts=2026-09-20T08:17:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3704worker1 # [ 26.804639] nix-grpc-daemon[774]: ts=2026-09-20T08:17:20Z level=info event=scheduler_connected addr=lb:500513705worker2 # [ 26.820454] nix-grpc-daemon[776]: ts=2026-09-20T08:17:20Z level=info event=scheduler_connected addr=lb:500513706worker1 # [ 26.812349] nix-grpc-daemon[774]: ts=2026-09-20T08:17:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3707worker2 # [ 26.828297] nix-grpc-daemon[776]: ts=2026-09-20T08:17:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3708worker2 # [ 27.031452] nix-grpc-daemon[776]: ts=2026-09-20T08:17:20Z level=info event=scheduler_connected addr=lb:500513709worker1 # [ 27.015733] nix-grpc-daemon[774]: ts=2026-09-20T08:17:20Z level=info event=scheduler_connected addr=lb:500513710worker2 # [ 27.039397] nix-grpc-daemon[776]: ts=2026-09-20T08:17:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3711worker1 # [ 27.023906] nix-grpc-daemon[774]: ts=2026-09-20T08:17:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3712worker1 # [ 27.225474] nix-grpc-daemon[774]: ts=2026-09-20T08:17:20Z level=info event=scheduler_connected addr=lb:500513713worker2 # [ 27.241571] nix-grpc-daemon[776]: ts=2026-09-20T08:17:20Z level=info event=scheduler_connected addr=lb:500513714worker2 # [ 27.249527] nix-grpc-daemon[776]: ts=2026-09-20T08:17:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3715worker1 # [ 27.233592] nix-grpc-daemon[774]: ts=2026-09-20T08:17:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3716worker2 # [ 27.450621] nix-grpc-daemon[776]: ts=2026-09-20T08:17:21Z level=info event=scheduler_connected addr=lb:500513717worker1 # [ 27.435613] nix-grpc-daemon[774]: ts=2026-09-20T08:17:21Z level=info event=scheduler_connected addr=lb:500513718worker2 # [ 27.458838] nix-grpc-daemon[776]: ts=2026-09-20T08:17:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3719worker1 # [ 27.443048] nix-grpc-daemon[774]: ts=2026-09-20T08:17:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3720worker1 # [ 27.643842] nix-grpc-daemon[774]: ts=2026-09-20T08:17:21Z level=info event=scheduler_connected addr=lb:500513721worker2 # [ 27.660553] nix-grpc-daemon[776]: ts=2026-09-20T08:17:21Z level=info event=scheduler_connected addr=lb:500513722worker1 # [ 27.649824] nix-grpc-daemon[774]: ts=2026-09-20T08:17:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3723worker2 # [ 27.670485] nix-grpc-daemon[776]: ts=2026-09-20T08:17:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3724worker1 # [ 27.851449] nix-grpc-daemon[774]: ts=2026-09-20T08:17:21Z level=info event=scheduler_connected addr=lb:500513725worker2 # [ 27.871627] nix-grpc-daemon[776]: ts=2026-09-20T08:17:21Z level=info event=scheduler_connected addr=lb:500513726worker1 # [ 27.860294] nix-grpc-daemon[774]: ts=2026-09-20T08:17:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3727worker2 # [ 27.879336] nix-grpc-daemon[776]: ts=2026-09-20T08:17:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3728worker1 # [ 28.066517] nix-grpc-daemon[774]: ts=2026-09-20T08:17:21Z level=info event=scheduler_connected addr=lb:500513729worker2 # [ 28.084863] nix-grpc-daemon[776]: ts=2026-09-20T08:17:21Z level=info event=scheduler_connected addr=lb:500513730worker1 # [ 28.071332] nix-grpc-daemon[774]: ts=2026-09-20T08:17:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3731worker2 # [ 28.089251] nix-grpc-daemon[776]: ts=2026-09-20T08:17:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3732worker1 # [ 28.267225] nix-grpc-daemon[774]: ts=2026-09-20T08:17:21Z level=info event=scheduler_connected addr=lb:500513733worker2 # [ 28.285509] nix-grpc-daemon[776]: ts=2026-09-20T08:17:21Z level=info event=scheduler_connected addr=lb:500513734worker1 # [ 28.275279] nix-grpc-daemon[774]: ts=2026-09-20T08:17:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3735worker2 # [ 28.293484] nix-grpc-daemon[776]: ts=2026-09-20T08:17:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3736worker2 # [ 28.490615] nix-grpc-daemon[776]: ts=2026-09-20T08:17:22Z level=info event=scheduler_connected addr=lb:500513737worker1 # [ 28.476824] nix-grpc-daemon[774]: ts=2026-09-20T08:17:22Z level=info event=scheduler_connected addr=lb:500513738worker1 # [ 28.483274] nix-grpc-daemon[774]: ts=2026-09-20T08:17:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3739worker2 # [ 28.500857] nix-grpc-daemon[776]: ts=2026-09-20T08:17:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3740worker1 # [ 28.684157] nix-grpc-daemon[774]: ts=2026-09-20T08:17:22Z level=info event=scheduler_connected addr=lb:500513741worker2 # [ 28.702487] nix-grpc-daemon[776]: ts=2026-09-20T08:17:22Z level=info event=scheduler_connected addr=lb:500513742worker1 # [ 28.693205] nix-grpc-daemon[774]: ts=2026-09-20T08:17:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3743worker2 # [ 28.711400] nix-grpc-daemon[776]: ts=2026-09-20T08:17:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3744worker1 # [ 28.895285] nix-grpc-daemon[774]: ts=2026-09-20T08:17:22Z level=info event=scheduler_connected addr=lb:500513745worker2 # [ 28.913248] nix-grpc-daemon[776]: ts=2026-09-20T08:17:22Z level=info event=scheduler_connected addr=lb:500513746worker1 # [ 28.902796] nix-grpc-daemon[774]: ts=2026-09-20T08:17:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3747worker2 # [ 28.921817] nix-grpc-daemon[776]: ts=2026-09-20T08:17:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3748worker1 # [ 29.107486] nix-grpc-daemon[774]: ts=2026-09-20T08:17:22Z level=info event=scheduler_connected addr=lb:500513749worker2 # [ 29.127273] nix-grpc-daemon[776]: ts=2026-09-20T08:17:22Z level=info event=scheduler_connected addr=lb:500513750worker1 # [ 29.115110] nix-grpc-daemon[774]: ts=2026-09-20T08:17:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3751worker2 # [ 29.137648] nix-grpc-daemon[776]: ts=2026-09-20T08:17:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3752worker1 # [ 29.317236] nix-grpc-daemon[774]: ts=2026-09-20T08:17:22Z level=info event=scheduler_connected addr=lb:500513753worker2 # [ 29.339222] nix-grpc-daemon[776]: ts=2026-09-20T08:17:22Z level=info event=scheduler_connected addr=lb:500513754worker1 # [ 29.328280] nix-grpc-daemon[774]: ts=2026-09-20T08:17:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3755worker2 # [ 29.347847] nix-grpc-daemon[776]: ts=2026-09-20T08:17:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3756worker1 # [ 29.529561] nix-grpc-daemon[774]: ts=2026-09-20T08:17:23Z level=info event=scheduler_connected addr=lb:500513757worker2 # [ 29.549015] nix-grpc-daemon[776]: ts=2026-09-20T08:17:23Z level=info event=scheduler_connected addr=lb:500513758worker1 # [ 29.535775] nix-grpc-daemon[774]: ts=2026-09-20T08:17:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3759worker2 # [ 29.554144] nix-grpc-daemon[776]: ts=2026-09-20T08:17:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3760worker1 # [ 29.736918] nix-grpc-daemon[774]: ts=2026-09-20T08:17:23Z level=info event=scheduler_connected addr=lb:500513761worker2 # [ 29.755903] nix-grpc-daemon[776]: ts=2026-09-20T08:17:23Z level=info event=scheduler_connected addr=lb:500513762worker1 # [ 29.744618] nix-grpc-daemon[774]: ts=2026-09-20T08:17:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3763worker2 # [ 29.763761] nix-grpc-daemon[776]: ts=2026-09-20T08:17:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3764worker1 # [ 29.946079] nix-grpc-daemon[774]: ts=2026-09-20T08:17:23Z level=info event=scheduler_connected addr=lb:500513765worker2 # [ 29.965671] nix-grpc-daemon[776]: ts=2026-09-20T08:17:23Z level=info event=scheduler_connected addr=lb:500513766worker1 # [ 29.954410] nix-grpc-daemon[774]: ts=2026-09-20T08:17:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3767worker2 # [ 29.975484] nix-grpc-daemon[776]: ts=2026-09-20T08:17:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3768worker1 # [ 30.157414] nix-grpc-daemon[774]: ts=2026-09-20T08:17:23Z level=info event=scheduler_connected addr=lb:500513769worker2 # [ 30.181588] nix-grpc-daemon[776]: ts=2026-09-20T08:17:23Z level=info event=scheduler_connected addr=lb:500513770worker1 # [ 30.165048] nix-grpc-daemon[774]: ts=2026-09-20T08:17:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3771worker2 # [ 30.186014] nix-grpc-daemon[776]: ts=2026-09-20T08:17:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3772worker1 # [ 30.366578] nix-grpc-daemon[774]: ts=2026-09-20T08:17:23Z level=info event=scheduler_connected addr=lb:500513773worker2 # [ 30.382820] nix-grpc-daemon[776]: ts=2026-09-20T08:17:23Z level=info event=scheduler_connected addr=lb:500513774worker1 # [ 30.374840] nix-grpc-daemon[774]: ts=2026-09-20T08:17:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3775worker2 # [ 30.391257] nix-grpc-daemon[776]: ts=2026-09-20T08:17:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3776worker1 # [ 30.576631] nix-grpc-daemon[774]: ts=2026-09-20T08:17:24Z level=info event=scheduler_connected addr=lb:500513777worker2 # [ 30.593224] nix-grpc-daemon[776]: ts=2026-09-20T08:17:24Z level=info event=scheduler_connected addr=lb:500513778worker1 # [ 30.584244] nix-grpc-daemon[774]: ts=2026-09-20T08:17:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3779worker2 # [ 30.601744] nix-grpc-daemon[776]: ts=2026-09-20T08:17:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3780worker1 # [ 30.785549] nix-grpc-daemon[774]: ts=2026-09-20T08:17:24Z level=info event=scheduler_connected addr=lb:500513781worker2 # [ 30.803469] nix-grpc-daemon[776]: ts=2026-09-20T08:17:24Z level=info event=scheduler_connected addr=lb:500513782worker1 # [ 30.793395] nix-grpc-daemon[774]: ts=2026-09-20T08:17:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3783worker2 # [ 30.814064] nix-grpc-daemon[776]: ts=2026-09-20T08:17:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3784worker1 # [ 30.994983] nix-grpc-daemon[774]: ts=2026-09-20T08:17:24Z level=info event=scheduler_connected addr=lb:500513785worker2 # [ 31.014698] nix-grpc-daemon[776]: ts=2026-09-20T08:17:24Z level=info event=scheduler_connected addr=lb:500513786worker1 # [ 31.003298] nix-grpc-daemon[774]: ts=2026-09-20T08:17:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3787worker2 # [ 31.022845] nix-grpc-daemon[776]: ts=2026-09-20T08:17:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3788worker1 # [ 31.209250] nix-grpc-daemon[774]: ts=2026-09-20T08:17:24Z level=info event=scheduler_connected addr=lb:500513789worker2 # [ 31.228237] nix-grpc-daemon[776]: ts=2026-09-20T08:17:24Z level=info event=scheduler_connected addr=lb:500513790worker1 # [ 31.213891] nix-grpc-daemon[774]: ts=2026-09-20T08:17:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3791worker2 # [ 31.232621] nix-grpc-daemon[776]: ts=2026-09-20T08:17:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3792worker1 # [ 31.410577] nix-grpc-daemon[774]: ts=2026-09-20T08:17:24Z level=info event=scheduler_connected addr=lb:500513793worker2 # [ 31.429442] nix-grpc-daemon[776]: ts=2026-09-20T08:17:25Z level=info event=scheduler_connected addr=lb:500513794worker1 # [ 31.418950] nix-grpc-daemon[774]: ts=2026-09-20T08:17:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3795worker2 # [ 31.436989] nix-grpc-daemon[776]: ts=2026-09-20T08:17:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3796worker1 # [ 31.620567] nix-grpc-daemon[774]: ts=2026-09-20T08:17:25Z level=info event=scheduler_connected addr=lb:500513797worker2 # [ 31.638300] nix-grpc-daemon[776]: ts=2026-09-20T08:17:25Z level=info event=scheduler_connected addr=lb:500513798worker1 # [ 31.629008] nix-grpc-daemon[774]: ts=2026-09-20T08:17:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3799worker2 # [ 31.646423] nix-grpc-daemon[776]: ts=2026-09-20T08:17:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3800worker1 # [ 31.830409] nix-grpc-daemon[774]: ts=2026-09-20T08:17:25Z level=info event=scheduler_connected addr=lb:500513801worker2 # [ 31.847275] nix-grpc-daemon[776]: ts=2026-09-20T08:17:25Z level=info event=scheduler_connected addr=lb:500513802worker1 # [ 31.838348] nix-grpc-daemon[774]: ts=2026-09-20T08:17:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3803worker2 # [ 31.855447] nix-grpc-daemon[776]: ts=2026-09-20T08:17:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3804worker1 # [ 32.039811] nix-grpc-daemon[774]: ts=2026-09-20T08:17:25Z level=info event=scheduler_connected addr=lb:500513805worker2 # [ 32.057125] nix-grpc-daemon[776]: ts=2026-09-20T08:17:25Z level=info event=scheduler_connected addr=lb:500513806worker1 # [ 32.047039] nix-grpc-daemon[774]: ts=2026-09-20T08:17:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3807worker2 # [ 32.064614] nix-grpc-daemon[776]: ts=2026-09-20T08:17:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3808lb # [ 32.081898] rustfs-bucket-start[1030]: mb s3://farm3809lb # [ 32.090964] systemd[1]: Finished rustfs-bucket.service.3810lb # [ 32.102097] systemd[1]: Starting niks3 server...3811worker2 # [ 32.269698] nix-grpc-daemon[776]: ts=2026-09-20T08:17:25Z level=info event=scheduler_connected addr=lb:500513812worker1 # [ 32.254010] nix-grpc-daemon[774]: ts=2026-09-20T08:17:25Z level=info event=scheduler_connected addr=lb:500513813worker2 # [ 32.274231] nix-grpc-daemon[776]: ts=2026-09-20T08:17:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3814worker1 # [ 32.258547] nix-grpc-daemon[774]: ts=2026-09-20T08:17:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3815lb # [ 32.353843] postgres[1049]: [1049] ERROR: relation "goose_db_version" does not exist at character 363816lb # [ 32.355156] postgres[1049]: [1049] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC3817lb # [ 32.391746] niks3-server[1040]: 2026/09/20 08:17:25 OK 20241026095416_initial_model.sql (22.05ms)3818lb # [ 32.395619] niks3-server[1040]: 2026/09/20 08:17:25 OK 20251210153512_drop_unused_gin_index.sql (4.2ms)3819lb # [ 32.402075] niks3-server[1040]: 2026/09/20 08:17:25 OK 20251218171726_add_pins.sql (6.37ms)3820lb # [ 32.407712] niks3-server[1040]: 2026/09/20 08:17:25 OK 20260628120000_add_object_size_and_stats.sql (5.62ms)3821lb # [ 32.413563] niks3-server[1040]: 2026/09/20 08:17:25 OK 20260905000000_add_claims.sql (5.81ms)3822lb # [ 32.419036] niks3-server[1040]: 2026/09/20 08:17:26 OK 20260920000000_drop_claims.sql (5.33ms)3823lb # [ 32.421188] niks3-server[1040]: 2026/09/20 08:17:26 goose: successfully migrated database to version: 202609200000003824lb # [ 32.426390] niks3-server[1040]: 2026/09/20 08:17:26 OK 1_commit_pending_closure.sql (7.32ms)3825lb # [ 32.429831] niks3-server[1040]: 2026/09/20 08:17:26 OK 2_object_stats_trigger.sql (3.23ms)3826lb # [ 32.431018] niks3-server[1040]: 2026/09/20 08:17:26 goose: up to current file version: 23827lb # [ 32.435355] niks3-server[1040]: 2026/09/20 08:17:26 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key3828worker1 # [ 32.454035] nix-grpc-daemon[774]: ts=2026-09-20T08:17:26Z level=info event=scheduler_connected addr=lb:500513829worker2 # [ 32.470334] nix-grpc-daemon[776]: ts=2026-09-20T08:17:26Z level=info event=scheduler_connected addr=lb:500513830lb # [ 32.489502] niks3-server[1040]: 2026/09/20 08:17:26 INFO Read proxy enabled — serving cache objects from S33831worker2 # [ 32.477642] nix-grpc-daemon[776]: ts=2026-09-20T08:17:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3832worker1 # [ 32.461848] nix-grpc-daemon[774]: ts=2026-09-20T08:17:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3833lb # [ 32.493297] niks3-server[1040]: 2026/09/20 08:17:26 INFO Using socket-activated listener address=0.0.0.0:57513834lb # [ 32.498012] systemd[1]: Started niks3 server.3835lb # [ 32.498804] niks3-server[1040]: 2026/09/20 08:17:26 INFO systemd watchdog enabled interval=15s3836lb # [ 32.502815] niks3-server[1040]: 2026/09/20 08:17:26 INFO Starting HTTP server address=0.0.0.0:57513837lb # [ 32.507905] systemd[1]: Reached target Multi-User System.3838lb # [ 32.510272] systemd[1]: Startup finished in 985ms (kernel) + 4.689s (initrd) + 26.826s (userspace) = 32.501s.3839lb # [ 32.514427] niks3-server[1040]: 2026/09/20 08:17:26 INFO lead: acquired remote=192.168.1.4:426923840worker2 # [ 32.507001] nix-grpc-daemon[776]: ts=2026-09-20T08:17:26Z level=info event=scheduler_take_over3841worker1 # [ 32.663111] nix-grpc-daemon[774]: ts=2026-09-20T08:17:26Z level=info event=scheduler_connected addr=lb:500513842worker2 # [ 32.679110] nix-grpc-daemon[776]: ts=2026-09-20T08:17:26Z level=info event=scheduler_connected addr=lb:500513843worker2 # [ 32.687569] nix-grpc-daemon[776]: ts=2026-09-20T08:17:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3844worker2 # [ 32.694152] nix-grpc-daemon[776]: ts=2026-09-20T08:17:26Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=03845worker2 # [ 32.888380] nix-grpc-daemon[776]: ts=2026-09-20T08:17:26Z level=info event=scheduler_connected addr=lb:500513846worker2 # [ 32.891205] nix-grpc-daemon[776]: ts=2026-09-20T08:17:26Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=03847lb: (finished: waiting for unit niks3.service, in 18.13 seconds)3848lb: waiting for TCP port 5751 on localhost3849lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!3850lb: (finished: waiting for TCP port 5751 on localhost, in 0.11 seconds)3851lb: waiting for unit envoy.service3852lb: (finished: waiting for unit envoy.service, in 0.10 seconds)3853lb: waiting for TCP port 50051 on localhost3854lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!3855lb # [ 33.675196] envoy[910]: conn peer=[::1]:40216 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=103856lb: (finished: waiting for TCP port 50051 on localhost, in 0.06 seconds)3857lb: waiting until exactly no endpoints of aarch64-linux are unhealthy3858lb: must succeed: curl -sf localhost:9901/clusters3859lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)3860lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.11 seconds)3861subtest: one node schedules and both builders hold a WorkerSession on it3862lb: must succeed: curl -sf localhost:9901/clusters3863lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)3864worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true3865worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.10 seconds)3866lb: must succeed: curl -sf localhost:9901/clusters3867lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)3868lb: must succeed: curl -sf localhost:9901/clusters3869lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)3870worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="leader"} ' || true3871worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="leader"} ' || true, in 0.10 seconds)3872lb: must succeed: curl -sf localhost:9901/clusters3873lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)3874lb: must succeed: curl -sf localhost:9901/clusters3875lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)3876worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="leader"} ' || true3877worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="leader"} ' || true, in 0.11 seconds)3878worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="slots"' || true3879worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="slots"' || true, in 0.10 seconds)3880worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="free"' || true3881worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="free"' || true, in 0.07 seconds)3882worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="queued"' || true3883worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="queued"' || true, in 0.05 seconds)3884(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.90 seconds)3885subtest: balancer auth: client cert, bearer token, nothing, unknown CN3886worker1 # [ 35.279852] nix-grpc-daemon[774]: ts=2026-09-20T08:17:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:365783887worker1 # [ 35.301975] systemd[1]: Started Nix Daemon.3888worker1 # [ 35.648585] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3889worker1 # [ 35.701398] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 37 ms (attempt 1/5)3890worker1 # [ 35.744725] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 27 ms (attempt 2/5)3891worker1 # [ 35.780222] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 151 ms (attempt 3/5)3892worker1 # [ 35.939300] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 354 ms (attempt 4/5)3893worker1 # [ 36.305734] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3894worker2 # [ 36.377488] nix-grpc-daemon[776]: ts=2026-09-20T08:17:29Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:455243895worker2 # [ 36.395550] systemd[1]: Started Nix Daemon.3896worker2 # [ 36.712306] nix-daemon[863]: accepted connection from pid 776, user nix-grpc-daemon (trusted)3897worker2 # [ 36.743826] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 7 ms (attempt 1/5)3898worker2 # [ 36.753594] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 68 ms (attempt 2/5)3899worker2 # [ 36.824763] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 50 ms (attempt 3/5)3900worker2 # [ 36.879137] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 249 ms (attempt 4/5)3901worker2 # [ 37.138959] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3902worker2 # [ 37.157513] nix-grpc-daemon[776]: ts=2026-09-20T08:17:30Z level=debug event=path_info_miss path=knm2rnivax139w5fp50r3x29k5mj4l28-nixos-system-client-test error="error: path '/nix/store/knm2rnivax139w5fp50r3x29k5mj4l28-nixos-system-client-test' is required, but there is no substituter that can build it"3903worker1 # [ 37.151643] nix-grpc-daemon[774]: ts=2026-09-20T08:17:30Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:365783904worker1 # [ 37.170608] nix-grpc-daemon[774]: ts=2026-09-20T08:17:30Z level=debug event=path_info_miss path=knm2rnivax139w5fp50r3x29k5mj4l28-nixos-system-client-test error="error: path '/nix/store/knm2rnivax139w5fp50r3x29k5mj4l28-nixos-system-client-test' is required, but there is no substituter that can build it"3905client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt3906client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.13 seconds)3907client: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key3908client: (finished: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds)3909worker2 # [ 37.704262] nix-grpc-daemon[776]: ts=2026-09-20T08:17:31Z level=info event=oidc_jwks provider=mock keys=13910worker2 # [ 37.710283] nix-grpc-daemon[776]: ts=2026-09-20T08:17:31Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:455243911worker1 # [ 37.729665] nix-grpc-daemon[774]: ts=2026-09-20T08:17:31Z level=info event=oidc_jwks provider=mock keys=13912worker1 # [ 37.737775] nix-grpc-daemon[774]: ts=2026-09-20T08:17:31Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:365783913worker1 # [ 37.746839] nix-grpc-daemon[774]: ts=2026-09-20T08:17:31Z level=debug event=path_info_miss path=knm2rnivax139w5fp50r3x29k5mj4l28-nixos-system-client-test error="error: path '/nix/store/knm2rnivax139w5fp50r3x29k5mj4l28-nixos-system-client-test' is required, but there is no substituter that can build it"3914worker2 # [ 37.769790] nix-grpc-daemon[776]: ts=2026-09-20T08:17:31Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:455243915worker2 # [ 37.784401] nix-grpc-daemon[776]: ts=2026-09-20T08:17:31Z level=debug event=path_info_miss path=knm2rnivax139w5fp50r3x29k5mj4l28-nixos-system-client-test error="error: path '/nix/store/knm2rnivax139w5fp50r3x29k5mj4l28-nixos-system-client-test' is required, but there is no substituter that can build it"3916client: must succeed: rm -r /var/lib/nix-grpc-store3917client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.05 seconds)3918worker2 # [ 38.116061] nix-grpc-daemon[776]: ts=2026-09-20T08:17:31Z level=info event=denied method=QueryMissing cn=- role=none3919worker1 # [ 38.359801] nix-grpc-daemon[774]: ts=2026-09-20T08:17:31Z level=info event=denied method=QueryMissing cn=stranger role=none3920(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.50 seconds)3921subtest: DAG build is scheduled across workers and lands in the cache3922client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&23923worker1 # [ 38.607274] nix-grpc-daemon[774]: ts=2026-09-20T08:17:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:365783924client # don't know how to build these paths:3925client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3926worker2 # [ 38.655372] nix-grpc-daemon[776]: ts=2026-09-20T08:17:32Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=03927worker2 # [ 38.661840] nix-grpc-daemon[776]: ts=2026-09-20T08:17:32Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.3:50051 clients=13928worker1 # [ 38.699703] nix-grpc-daemon[774]: ts=2026-09-20T08:17:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365783929worker1 # [ 38.721042] nix-grpc-daemon[774]: ts=2026-09-20T08:17:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:365783930client # copying 1 paths to 'lb:50051'...3931worker1 # [ 38.739593] nix-grpc-daemon[774]: ts=2026-09-20T08:17:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:365783932client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...3933worker1 # [ 38.773350] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3934worker1 # [ 38.809194] nix-grpc-daemon[774]: ts=2026-09-20T08:17:32Z level=info event=niks3_push_started pid=8473935worker1 # [ 39.280113] nix-daemon[837]: accepted connection from pid 860, user nix-grpc-daemon (trusted)3936worker1 # [ 39.300743] nix-daemon[837]: reaped child process 863, status = succeeded3937worker1 # [ 39.496346] nix-daemon[837]: accepted connection from pid 865, user nix-grpc-daemon (trusted)3938worker1 # [ 39.520519] nix-daemon[837]: reaped child process 868, status = succeeded3939lb # [ 39.559140] niks3-server[1040]: 2026/09/20 08:17:33 INFO Received uploads request method=POST path=/api/pending_closures3940worker1 # [ 39.562948] nix-grpc-daemon[847]: time=2026-09-20T08:17:33.144Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3941worker1 # [ 39.564845] nix-grpc-daemon[847]: time=2026-09-20T08:17:33.144Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"3942lb # [ 39.639365] niks3-server[1040]: 2026/09/20 08:17:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign3943lb # [ 39.646703] niks3-server[1040]: 2026/09/20 08:17:33 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst3944lb # [ 39.691522] niks3-server[1040]: 2026/09/20 08:17:33 INFO Signed narinfos id=1 count=13945worker1 # [ 39.667827] nix-grpc-daemon[847]: time=2026-09-20T08:17:33.250Z level=INFO msg="Uploading 1 narinfos"3946lb # [ 39.711037] niks3-server[1040]: 2026/09/20 08:17:33 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete3947lb # [ 39.726802] niks3-server[1040]: 2026/09/20 08:17:33 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo3948lb # [ 39.733617] niks3-server[1040]: 2026/09/20 08:17:33 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls3949lb # [ 39.741566] niks3-server[1040]: 2026/09/20 08:17:33 INFO Completed upload id=13950worker1 # [ 39.717074] nix-grpc-daemon[847]: time=2026-09-20T08:17:33.301Z level=INFO msg="Upload complete. (625ms)"3951worker1 # [ 39.732392] nix-grpc-daemon[774]: ts=2026-09-20T08:17:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36578 duration_s=0 paths=1 nar_bytes_in=5043952worker1 # [ 39.745662] nix-grpc-daemon[774]: ts=2026-09-20T08:17:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365783953worker1 # [ 39.760851] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3954worker1 # [ 39.766861] nix-daemon[837]: reaped child process 845, status = succeeded3955client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...3956client # farm-a> node-a: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3957worker1 # [ 39.782184] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3958lb # [ 40.421980] envoy[910]: conn peer=[2001:db8:1::1]:57308 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=406 ms=19583959lb # [ 40.427163] envoy[910]: conn peer=[2001:db8:1::1]:57312 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=1223960lb # [ 40.431794] envoy[910]: conn peer=[2001:db8:1::1]:57324 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=183961lb # [ 40.436341] envoy[910]: conn peer=[2001:db8:1::1]:57336 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=133962client # farm-a> LOG-farm-a-t13963worker1 # [ 41.034012] nix-daemon[837]: reaped child process 873, status = succeeded3964worker1 # [ 41.213165] nix-daemon[837]: accepted connection from pid 888, user nix-grpc-daemon (trusted)3965worker1 # [ 41.232860] nix-daemon[837]: reaped child process 891, status = succeeded3966lb # [ 41.271219] niks3-server[1040]: 2026/09/20 08:17:34 INFO Received uploads request method=POST path=/api/pending_closures3967worker1 # [ 41.263230] nix-grpc-daemon[847]: time=2026-09-20T08:17:34.845Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3968worker1 # [ 41.266143] nix-grpc-daemon[847]: time=2026-09-20T08:17:34.845Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"3969lb # [ 41.338944] niks3-server[1040]: 2026/09/20 08:17:34 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3970lb # [ 41.348868] niks3-server[1040]: 2026/09/20 08:17:34 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst3971lb # [ 41.357635] niks3-server[1040]: 2026/09/20 08:17:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign3972lb # [ 41.363607] niks3-server[1040]: 2026/09/20 08:17:34 INFO Signed narinfos id=2 count=13973worker1 # [ 41.340264] nix-grpc-daemon[847]: time=2026-09-20T08:17:34.922Z level=INFO msg="Uploading 1 narinfos"3974lb # [ 41.367494] niks3-server[1040]: 2026/09/20 08:17:34 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls3975lb # [ 41.377785] niks3-server[1040]: 2026/09/20 08:17:34 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete3976lb # [ 41.387862] niks3-server[1040]: 2026/09/20 08:17:34 INFO Completed upload id=23977lb # [ 41.391914] niks3-server[1040]: 2026/09/20 08:17:34 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo3978worker1 # [ 41.363190] nix-grpc-daemon[847]: time=2026-09-20T08:17:34.947Z level=INFO msg="Upload complete. (363ms)"3979worker1 # [ 41.377530] nix-grpc-daemon[774]: ts=2026-09-20T08:17:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36578 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=13980worker2 # [ 41.405286] nix-grpc-daemon[776]: ts=2026-09-20T08:17:34Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=03981worker1 # [ 41.395292] nix-daemon[837]: reaped child process 871, status = succeeded3982worker2 # [ 41.411980] nix-grpc-daemon[776]: ts=2026-09-20T08:17:34Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.3:50051 clients=13983worker1 # [ 41.443878] nix-grpc-daemon[774]: ts=2026-09-20T08:17:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365783984worker1 # [ 41.459563] nix-grpc-daemon[774]: ts=2026-09-20T08:17:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:365783985worker1 # [ 41.475147] nix-grpc-daemon[847]: time=2026-09-20T08:17:35.059Z level=INFO msg="All 1 paths already cached"3986client # copying 1 paths to 'lb:50051'...3987worker1 # [ 41.485485] nix-grpc-daemon[774]: ts=2026-09-20T08:17:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:365783988client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...3989worker1 # [ 41.508488] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3990worker1 # [ 41.723915] nix-daemon[837]: accepted connection from pid 895, user nix-grpc-daemon (trusted)3991worker1 # [ 41.742731] nix-daemon[837]: reaped child process 898, status = succeeded3992worker1 # [ 41.923724] nix-daemon[837]: accepted connection from pid 900, user nix-grpc-daemon (trusted)3993worker1 # [ 41.944555] nix-daemon[837]: reaped child process 903, status = succeeded3994lb # [ 41.980300] niks3-server[1040]: 2026/09/20 08:17:35 INFO Received uploads request method=POST path=/api/pending_closures3995worker1 # [ 41.969514] nix-grpc-daemon[847]: time=2026-09-20T08:17:35.553Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3996worker1 # [ 41.971720] nix-grpc-daemon[847]: time=2026-09-20T08:17:35.555Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"3997lb # [ 42.021478] niks3-server[1040]: 2026/09/20 08:17:35 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst3998lb # [ 42.032530] niks3-server[1040]: 2026/09/20 08:17:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign3999worker1 # [ 42.015794] nix-grpc-daemon[847]: time=2026-09-20T08:17:35.599Z level=INFO msg="Uploading 1 narinfos"4000lb # [ 42.043554] niks3-server[1040]: 2026/09/20 08:17:35 INFO Signed narinfos id=3 count=14001lb # [ 42.050136] niks3-server[1040]: 2026/09/20 08:17:35 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls4002lb # [ 42.059872] niks3-server[1040]: 2026/09/20 08:17:35 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4003lb # [ 42.067880] niks3-server[1040]: 2026/09/20 08:17:35 INFO Completed upload id=34004lb # [ 42.071095] niks3-server[1040]: 2026/09/20 08:17:35 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo4005worker1 # [ 42.043062] nix-grpc-daemon[847]: time=2026-09-20T08:17:35.627Z level=INFO msg="Upload complete. (516ms)"4006worker1 # [ 42.052573] nix-grpc-daemon[774]: ts=2026-09-20T08:17:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36578 duration_s=0 paths=1 nar_bytes_in=6244007worker1 # [ 42.062218] nix-grpc-daemon[774]: ts=2026-09-20T08:17:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365784008worker1 # [ 42.074695] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4009worker1 # [ 42.081748] nix-daemon[837]: reaped child process 893, status = succeeded4010client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...4011client # farm-b> node-a: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv4012worker1 # [ 42.095151] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4013client # farm-b> LOG-farm-b-t14014worker1 # [ 43.145041] nix-daemon[837]: reaped child process 907, status = succeeded4015worker1 # [ 43.327916] nix-daemon[837]: accepted connection from pid 923, user nix-grpc-daemon (trusted)4016worker1 # [ 43.348554] nix-daemon[837]: reaped child process 926, status = succeeded4017lb # [ 43.385158] niks3-server[1040]: 2026/09/20 08:17:36 INFO Received uploads request method=POST path=/api/pending_closures4018worker1 # [ 43.371171] nix-grpc-daemon[847]: time=2026-09-20T08:17:36.954Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4019worker1 # [ 43.372840] nix-grpc-daemon[847]: time=2026-09-20T08:17:36.954Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"4020lb # [ 43.424574] niks3-server[1040]: 2026/09/20 08:17:37 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv4021lb # [ 43.436968] niks3-server[1040]: 2026/09/20 08:17:37 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst4022worker1 # [ 43.420060] nix-grpc-daemon[847]: time=2026-09-20T08:17:37.003Z level=INFO msg="Uploading 1 narinfos"4023lb # [ 43.449072] niks3-server[1040]: 2026/09/20 08:17:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4024lb # [ 43.456238] niks3-server[1040]: 2026/09/20 08:17:37 INFO Signed narinfos id=4 count=14025lb # [ 43.458299] niks3-server[1040]: 2026/09/20 08:17:37 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls4026lb # [ 43.463583] niks3-server[1040]: 2026/09/20 08:17:37 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4027lb # [ 43.469668] niks3-server[1040]: 2026/09/20 08:17:37 INFO Completed upload id=44028worker1 # [ 43.443748] nix-grpc-daemon[847]: time=2026-09-20T08:17:37.027Z level=INFO msg="Upload complete. (336ms)"4029lb # [ 43.471837] niks3-server[1040]: 2026/09/20 08:17:37 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo4030worker1 # [ 43.457139] nix-grpc-daemon[774]: ts=2026-09-20T08:17:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36578 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=14031worker2 # [ 43.477400] nix-grpc-daemon[776]: ts=2026-09-20T08:17:37Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=04032worker2 # [ 43.483830] nix-grpc-daemon[776]: ts=2026-09-20T08:17:37Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.3:50051 clients=14033worker1 # [ 43.473624] nix-daemon[837]: reaped child process 905, status = succeeded4034worker1 # [ 43.515635] nix-grpc-daemon[774]: ts=2026-09-20T08:17:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365784035worker1 # [ 43.529264] nix-grpc-daemon[774]: ts=2026-09-20T08:17:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:365784036worker1 # [ 43.542716] nix-grpc-daemon[847]: time=2026-09-20T08:17:37.126Z level=INFO msg="All 2 paths already cached"4037client # copying 1 paths to 'lb:50051'...4038client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...4039worker1 # [ 43.551096] nix-grpc-daemon[774]: ts=2026-09-20T08:17:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:365784040worker1 # [ 43.568559] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4041worker1 # [ 43.765450] nix-daemon[837]: accepted connection from pid 930, user nix-grpc-daemon (trusted)4042worker1 # [ 43.787979] nix-daemon[837]: reaped child process 933, status = succeeded4043worker1 # [ 43.964984] nix-daemon[837]: accepted connection from pid 935, user nix-grpc-daemon (trusted)4044worker1 # [ 43.987382] nix-daemon[837]: reaped child process 938, status = succeeded4045lb # [ 44.024685] niks3-server[1040]: 2026/09/20 08:17:37 INFO Received uploads request method=POST path=/api/pending_closures4046worker1 # [ 44.010111] nix-grpc-daemon[847]: time=2026-09-20T08:17:37.593Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4047worker1 # [ 44.011642] nix-grpc-daemon[847]: time=2026-09-20T08:17:37.593Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"4048lb # [ 44.055876] niks3-server[1040]: 2026/09/20 08:17:37 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst4049worker1 # [ 44.043138] nix-grpc-daemon[847]: time=2026-09-20T08:17:37.626Z level=INFO msg="Uploading 1 narinfos"4050lb # [ 44.070949] niks3-server[1040]: 2026/09/20 08:17:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4051lb # [ 44.080829] niks3-server[1040]: 2026/09/20 08:17:37 INFO Signed narinfos id=5 count=14052lb # [ 44.086518] niks3-server[1040]: 2026/09/20 08:17:37 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls4053lb # [ 44.097324] niks3-server[1040]: 2026/09/20 08:17:37 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4054lb # [ 44.101991] niks3-server[1040]: 2026/09/20 08:17:37 INFO Completed upload id=54055worker1 # [ 44.077116] nix-grpc-daemon[847]: time=2026-09-20T08:17:37.661Z level=INFO msg="Upload complete. (494ms)"4056lb # [ 44.104684] niks3-server[1040]: 2026/09/20 08:17:37 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo4057worker1 # [ 44.084395] nix-grpc-daemon[774]: ts=2026-09-20T08:17:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36578 duration_s=0 paths=1 nar_bytes_in=7524058worker1 # [ 44.096612] nix-grpc-daemon[774]: ts=2026-09-20T08:17:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365784059worker1 # [ 44.105810] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4060worker1 # [ 44.115838] nix-daemon[837]: reaped child process 928, status = succeeded4061client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...4062worker1 # [ 44.123800] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4063client # farm-top> node-a: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4064client # farm-top> LOG-farm-top-t14065worker1 # [ 45.575426] nix-daemon[837]: reaped child process 942, status = succeeded4066worker1 # [ 45.755635] nix-daemon[837]: accepted connection from pid 957, user nix-grpc-daemon (trusted)4067worker1 # [ 45.774986] nix-daemon[837]: reaped child process 960, status = succeeded4068lb # [ 45.813936] niks3-server[1040]: 2026/09/20 08:17:39 INFO Received uploads request method=POST path=/api/pending_closures4069worker1 # [ 45.800485] nix-grpc-daemon[847]: time=2026-09-20T08:17:39.383Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4070worker1 # [ 45.802024] nix-grpc-daemon[847]: time=2026-09-20T08:17:39.383Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"4071lb # [ 45.864195] niks3-server[1040]: 2026/09/20 08:17:39 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst4072lb # [ 45.876792] niks3-server[1040]: 2026/09/20 08:17:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4073worker1 # [ 45.856689] nix-grpc-daemon[847]: time=2026-09-20T08:17:39.440Z level=INFO msg="Uploading 1 narinfos"4074lb # [ 45.884431] niks3-server[1040]: 2026/09/20 08:17:39 INFO Signed narinfos id=6 count=14075lb # [ 45.891400] niks3-server[1040]: 2026/09/20 08:17:39 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4076lb # [ 45.898771] niks3-server[1040]: 2026/09/20 08:17:39 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls4077lb # [ 45.908101] niks3-server[1040]: 2026/09/20 08:17:39 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4078lb # [ 45.912053] niks3-server[1040]: 2026/09/20 08:17:39 INFO Completed upload id=64079worker1 # [ 45.887143] nix-grpc-daemon[847]: time=2026-09-20T08:17:39.471Z level=INFO msg="Upload complete. (349ms)"4080lb # [ 45.914744] niks3-server[1040]: 2026/09/20 08:17:39 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo4081worker1 # [ 45.896916] nix-grpc-daemon[774]: ts=2026-09-20T08:17:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36578 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=14082worker1 # [ 45.909054] nix-daemon[837]: reaped child process 940, status = succeeded4083client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&2, in 7.57 seconds)4084client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath4085client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath, in 0.23 seconds)4086client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4087client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.04 seconds)4088client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4089client # copying 3 paths...4090client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...4091client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...4092client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...4093client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.31 seconds)4094(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 8.24 seconds)4095subtest: repeat is answered Cached by the scheduler without building4096worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4097worker1 # finding garbage collector roots...4098worker1 # deleting specified paths...4099worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4100worker1 # deleting unused links...4101worker1 # note: hard linking is currently saving 0.0 KiB4102worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.29 seconds)4103worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4104worker2 # finding garbage collector roots...4105worker2 # deleting specified paths...4106worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4107worker2 # deleting unused links...4108worker2 # note: hard linking is currently saving 0.0 KiB4109worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.30 seconds)4110client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&24111worker1 # [ 47.467677] nix-grpc-daemon[774]: ts=2026-09-20T08:17:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:365784112client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):4113client # /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4114worker2 # [ 47.517348] nix-grpc-daemon[776]: ts=2026-09-20T08:17:41Z level=debug event=want client=2 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=14115worker2 # [ 47.725840] nix-grpc-daemon[776]: ts=2026-09-20T08:17:41Z level=debug event=want client=2 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=14116worker2 # [ 47.743491] nix-grpc-daemon[776]: ts=2026-09-20T08:17:41Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=14117client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&2, in 0.56 seconds)4118client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath4119client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath, in 0.23 seconds)4120lb: must succeed: curl -sf localhost:9901/clusters4121lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4122lb: must succeed: curl -sf localhost:9901/clusters4123lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4124worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true4125worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.09 seconds)4126(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.69 seconds)4127subtest: two clients wanting the same drv build it once4128client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4129client # [ 48.461131] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4130client # Running as unit: dedup1.service; invocation ID: e635c2649bba4c068edc0df3be58958e4131client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.10 seconds)4132client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4133worker2 # [ 48.654593] nix-grpc-daemon[776]: ts=2026-09-20T08:17:42Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:455244134client # [ 48.713150] nix[858]: don't know how to build these paths:4135client # [ 48.714299] nix[858]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4136worker2 # [ 48.674970] nix-grpc-daemon[776]: ts=2026-09-20T08:17:42Z level=debug event=want client=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04137worker2 # [ 48.682474] nix-grpc-daemon[776]: ts=2026-09-20T08:17:42Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=14138worker2 # [ 48.724239] nix-grpc-daemon[776]: ts=2026-09-20T08:17:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:455244139worker2 # [ 48.744073] nix-grpc-daemon[776]: ts=2026-09-20T08:17:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:455244140client # [ 48.808243] nix[858]: copying 1 paths to 'lb:50051'...4141worker2 # [ 48.759770] nix-grpc-daemon[776]: ts=2026-09-20T08:17:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:455244142client # [ 48.813432] nix[858]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4143worker2 # [ 48.776002] nix-daemon[863]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4144worker2 # [ 48.803226] nix-grpc-daemon[776]: ts=2026-09-20T08:17:42Z level=info event=niks3_push_started pid=9074145worker2 # [ 49.252818] nix-daemon[863]: accepted connection from pid 920, user nix-grpc-daemon (trusted)4146worker2 # [ 49.271894] nix-daemon[863]: reaped child process 923, status = succeeded4147worker2 # [ 49.446457] nix-daemon[863]: accepted connection from pid 925, user nix-grpc-daemon (trusted)4148worker2 # [ 49.466411] nix-daemon[863]: reaped child process 928, status = succeeded4149lb # [ 49.488713] niks3-server[1040]: 2026/09/20 08:17:43 INFO Received uploads request method=POST path=/api/pending_closures4150worker2 # [ 49.494840] nix-grpc-daemon[907]: time=2026-09-20T08:17:43.070Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4151worker2 # [ 49.496686] nix-grpc-daemon[907]: time=2026-09-20T08:17:43.071Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4152lb # [ 49.533880] niks3-server[1040]: 2026/09/20 08:17:43 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4153lb # [ 49.546275] niks3-server[1040]: 2026/09/20 08:17:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4154client # [ 49.580483] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4155worker2 # [ 49.545002] nix-grpc-daemon[907]: time=2026-09-20T08:17:43.122Z level=INFO msg="Uploading 1 narinfos"4156lb # [ 49.556437] niks3-server[1040]: 2026/09/20 08:17:43 INFO Signed narinfos id=7 count=14157client # Running as unit: dedup2.service; invocation ID: 9142f775dd20489ab16cf1c937e2c6d04158lb # [ 49.565554] niks3-server[1040]: 2026/09/20 08:17:43 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4159client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.13 seconds)4160lb # [ 49.577526] niks3-server[1040]: 2026/09/20 08:17:43 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4161lb # [ 49.585250] niks3-server[1040]: 2026/09/20 08:17:43 INFO Completed upload id=74162worker2 # [ 49.575777] nix-grpc-daemon[907]: time=2026-09-20T08:17:43.154Z level=INFO msg="Upload complete. (509ms)"4163lb # [ 49.587926] niks3-server[1040]: 2026/09/20 08:17:43 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4164worker2 # [ 49.584316] nix-grpc-daemon[776]: ts=2026-09-20T08:17:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45524 duration_s=0 paths=1 nar_bytes_in=4324165worker2 # [ 49.592704] nix-grpc-daemon[776]: ts=2026-09-20T08:17:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:455244166worker2 # [ 49.603431] nix-daemon[863]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4167worker2 # [ 49.608922] nix-daemon[863]: reaped child process 905, status = succeeded4168client # [ 49.669412] nix[858]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4169worker2 # [ 49.620190] nix-daemon[863]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4170worker2 # [ 49.871636] nix-grpc-daemon[776]: ts=2026-09-20T08:17:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:455244171client # [ 49.937001] nix[874]: this derivation will be built:4172worker1 # [ 49.873680] nix-grpc-daemon[774]: ts=2026-09-20T08:17:43Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:365784173worker1 # [ 49.891297] nix-grpc-daemon[774]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' from 'http://lb:5751'...4174client # [ 49.981993] nix[874]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4175worker2 # [ 49.946448] nix-grpc-daemon[776]: ts=2026-09-20T08:17:43Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04176worker2 # [ 49.957288] nix-grpc-daemon[776]: ts=2026-09-20T08:17:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:455244177client # [ 50.015593] nix[874]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4178lb # [ 50.418489] envoy[910]: conn peer=[2001:db8:1::1]:57338 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9440 tx=3809 ms=73234179lb # [ 50.423618] envoy[910]: conn peer=[2001:db8:1::1]:60438 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1205 tx=521 ms=2844180client: must succeed: sleep 24181client: (finished: must succeed: sleep 2, in 2.06 seconds)4182client: waiting for success: ! systemctl is-active dedup1 dedup24183worker2 # [ 53.266600] nix-daemon[863]: reaped child process 932, status = succeeded4184worker2 # [ 53.439738] nix-daemon[863]: accepted connection from pid 963, user nix-grpc-daemon (trusted)4185worker2 # [ 53.457897] nix-daemon[863]: reaped child process 966, status = succeeded4186lb # [ 53.481484] niks3-server[1040]: 2026/09/20 08:17:47 INFO Received uploads request method=POST path=/api/pending_closures4187worker2 # [ 53.484840] nix-grpc-daemon[907]: time=2026-09-20T08:17:47.061Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4188worker2 # [ 53.486938] nix-grpc-daemon[907]: time=2026-09-20T08:17:47.061Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4189lb # [ 53.532914] niks3-server[1040]: 2026/09/20 08:17:47 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4190lb # [ 53.545312] niks3-server[1040]: 2026/09/20 08:17:47 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4191lb # [ 53.555691] niks3-server[1040]: 2026/09/20 08:17:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4192lb # [ 53.561692] niks3-server[1040]: 2026/09/20 08:17:47 INFO Signed narinfos id=8 count=14193worker2 # [ 53.553701] nix-grpc-daemon[907]: time=2026-09-20T08:17:47.130Z level=INFO msg="Uploading 1 narinfos"4194lb # [ 53.565172] niks3-server[1040]: 2026/09/20 08:17:47 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4195lb # [ 53.578310] niks3-server[1040]: 2026/09/20 08:17:47 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4196worker2 # [ 53.574837] nix-grpc-daemon[907]: time=2026-09-20T08:17:47.153Z level=INFO msg="Upload complete. (339ms)"4197lb # [ 53.586250] niks3-server[1040]: 2026/09/20 08:17:47 INFO Completed upload id=84198lb # [ 53.590822] niks3-server[1040]: 2026/09/20 08:17:47 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4199worker2 # [ 53.589267] nix-grpc-daemon[776]: ts=2026-09-20T08:17:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45524 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=4 outputs=14200worker2 # [ 53.608540] nix-grpc-daemon[776]: ts=2026-09-20T08:17:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45524 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=4 outputs=14201worker2 # [ 53.617273] nix-daemon[863]: reaped child process 930, status = succeeded4202client # [ 53.698938] systemd[1]: dedup1.service: Deactivated successfully.4203client # [ 53.703891] systemd[1]: dedup1.service: Consumed 158ms CPU time over 5.242s wall clock time, 37.2M memory peak, 8.5K incoming IP traffic, 9.1K outgoing IP traffic.4204client # [ 53.715420] systemd[1]: dedup2.service: Deactivated successfully.4205client # [ 53.718551] systemd[1]: dedup2.service: Consumed 203ms CPU time over 4.131s wall clock time, 31M memory peak, 8.1K incoming IP traffic, 6.7K outgoing IP traffic.4206client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.14 seconds)4207client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4208client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds)4209worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4210worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4211worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4212worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds)4213worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4214worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.08 seconds)4215worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4216worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.09 seconds)4217(finished: subtest: two clients wanting the same drv build it once, in 6.32 seconds)4218subtest: build hook: nix-daemon with builders = grpc://lb4219client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag hook 2>/tmp/hook.log4220client # [ 54.940643] systemd[1]: Started Nix Daemon.4221client # [ 55.136884] nix-daemon[916]: accepted connection from pid 913, user root (trusted)4222worker1 # [ 55.278953] nix-grpc-daemon[774]: ts=2026-09-20T08:17:48Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:365784223worker2 # [ 55.300918] nix-grpc-daemon[776]: ts=2026-09-20T08:17:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:455244224worker2 # [ 55.314930] nix-grpc-daemon[776]: ts=2026-09-20T08:17:48Z level=debug event=want client=5 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04225worker2 # [ 55.321131] nix-grpc-daemon[776]: ts=2026-09-20T08:17:48Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.3:50051 clients=14226worker1 # [ 55.347789] nix-grpc-daemon[774]: ts=2026-09-20T08:17:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365784227worker1 # [ 55.364803] nix-grpc-daemon[774]: ts=2026-09-20T08:17:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:365784228worker1 # [ 55.380848] nix-grpc-daemon[774]: ts=2026-09-20T08:17:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:365784229worker1 # [ 55.397343] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4230worker1 # [ 55.606412] nix-daemon[837]: accepted connection from pid 1002, user nix-grpc-daemon (trusted)4231worker1 # [ 55.626755] nix-daemon[837]: reaped child process 1005, status = succeeded4232worker1 # [ 55.803827] nix-daemon[837]: accepted connection from pid 1007, user nix-grpc-daemon (trusted)4233worker1 # [ 55.821900] nix-daemon[837]: reaped child process 1010, status = succeeded4234lb # [ 55.861536] niks3-server[1040]: 2026/09/20 08:17:49 INFO Received uploads request method=POST path=/api/pending_closures4235worker1 # [ 55.845989] nix-grpc-daemon[847]: time=2026-09-20T08:17:49.429Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4236worker1 # [ 55.847469] nix-grpc-daemon[847]: time=2026-09-20T08:17:49.429Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4237lb # [ 55.890784] niks3-server[1040]: 2026/09/20 08:17:49 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4238lb # [ 55.904166] niks3-server[1040]: 2026/09/20 08:17:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4239worker1 # [ 55.886280] nix-grpc-daemon[847]: time=2026-09-20T08:17:49.470Z level=INFO msg="Uploading 1 narinfos"4240lb # [ 55.915375] niks3-server[1040]: 2026/09/20 08:17:49 INFO Signed narinfos id=9 count=14241lb # [ 55.923408] niks3-server[1040]: 2026/09/20 08:17:49 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4242lb # [ 55.936310] niks3-server[1040]: 2026/09/20 08:17:49 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4243lb # [ 55.942494] niks3-server[1040]: 2026/09/20 08:17:49 INFO Completed upload id=94244worker1 # [ 55.917755] nix-grpc-daemon[847]: time=2026-09-20T08:17:49.501Z level=INFO msg="Upload complete. (502ms)"4245lb # [ 55.945950] niks3-server[1040]: 2026/09/20 08:17:49 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4246worker1 # [ 55.928392] nix-grpc-daemon[774]: ts=2026-09-20T08:17:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36578 duration_s=0 paths=1 nar_bytes_in=5124247worker1 # [ 55.940665] nix-grpc-daemon[774]: ts=2026-09-20T08:17:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365784248worker1 # [ 55.950219] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4249worker1 # [ 55.955646] nix-daemon[837]: reaped child process 1000, status = succeeded4250worker1 # [ 55.970065] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4251worker1 # [ 57.017911] nix-daemon[837]: reaped child process 1014, status = succeeded4252worker1 # [ 57.183565] nix-daemon[837]: accepted connection from pid 1029, user nix-grpc-daemon (trusted)4253worker1 # [ 57.201849] nix-daemon[837]: reaped child process 1032, status = succeeded4254lb # [ 57.239106] niks3-server[1040]: 2026/09/20 08:17:50 INFO Received uploads request method=POST path=/api/pending_closures4255worker1 # [ 57.226813] nix-grpc-daemon[847]: time=2026-09-20T08:17:50.808Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4256worker1 # [ 57.228376] nix-grpc-daemon[847]: time=2026-09-20T08:17:50.808Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4257lb # [ 57.274205] niks3-server[1040]: 2026/09/20 08:17:50 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4258lb # [ 57.290387] niks3-server[1040]: 2026/09/20 08:17:50 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4259lb # [ 57.300172] niks3-server[1040]: 2026/09/20 08:17:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4260worker1 # [ 57.280749] nix-grpc-daemon[847]: time=2026-09-20T08:17:50.864Z level=INFO msg="Uploading 1 narinfos"4261lb # [ 57.309212] niks3-server[1040]: 2026/09/20 08:17:50 INFO Signed narinfos id=10 count=14262lb # [ 57.311764] niks3-server[1040]: 2026/09/20 08:17:50 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4263lb # [ 57.323850] niks3-server[1040]: 2026/09/20 08:17:50 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4264lb # [ 57.331127] niks3-server[1040]: 2026/09/20 08:17:50 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4265lb # [ 57.337419] niks3-server[1040]: 2026/09/20 08:17:50 INFO Completed upload id=104266worker1 # [ 57.312714] nix-grpc-daemon[847]: time=2026-09-20T08:17:50.896Z level=INFO msg="Upload complete. (328ms)"4267worker1 # [ 57.326465] nix-grpc-daemon[774]: ts=2026-09-20T08:17:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36578 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=5 outputs=14268worker1 # [ 57.343322] nix-grpc-daemon[774]: ts=2026-09-20T08:17:50Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:365784269worker1 # [ 57.347938] nix-daemon[837]: reaped child process 1012, status = succeeded4270worker2 # [ 57.369878] nix-grpc-daemon[776]: ts=2026-09-20T08:17:50Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:455244271worker2 # [ 57.380355] nix-grpc-daemon[776]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4272worker2 # [ 57.401644] nix-grpc-daemon[776]: ts=2026-09-20T08:17:50Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:45524 duration_s=0 paths=1 nar_bytes_out=1284273worker1 # [ 57.688926] nix-grpc-daemon[774]: ts=2026-09-20T08:17:51Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:365784274worker1 # [ 57.696751] nix-grpc-daemon[774]: ts=2026-09-20T08:17:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:365784275worker1 # [ 57.703442] nix-grpc-daemon[847]: time=2026-09-20T08:17:51.286Z level=INFO msg="All 1 paths already cached"4276worker2 # [ 57.732408] nix-grpc-daemon[776]: ts=2026-09-20T08:17:51Z level=debug event=want client=6 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04277worker2 # [ 57.738666] nix-grpc-daemon[776]: ts=2026-09-20T08:17:51Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.3:50051 clients=14278worker1 # [ 57.726061] nix-grpc-daemon[774]: ts=2026-09-20T08:17:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365784279worker1 # [ 57.742577] nix-grpc-daemon[774]: ts=2026-09-20T08:17:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:365784280worker1 # [ 57.757671] nix-grpc-daemon[847]: time=2026-09-20T08:17:51.341Z level=INFO msg="All 1 paths already cached"4281worker1 # [ 57.767364] nix-grpc-daemon[774]: ts=2026-09-20T08:17:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:365784282worker1 # [ 57.781719] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4283worker1 # [ 58.000080] nix-daemon[837]: accepted connection from pid 1036, user nix-grpc-daemon (trusted)4284worker1 # [ 58.022554] nix-daemon[837]: reaped child process 1039, status = succeeded4285worker1 # [ 58.192570] nix-daemon[837]: accepted connection from pid 1041, user nix-grpc-daemon (trusted)4286worker1 # [ 58.215347] nix-daemon[837]: reaped child process 1044, status = succeeded4287lb # [ 58.251840] niks3-server[1040]: 2026/09/20 08:17:51 INFO Received uploads request method=POST path=/api/pending_closures4288worker1 # [ 58.237324] nix-grpc-daemon[847]: time=2026-09-20T08:17:51.820Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4289worker1 # [ 58.238850] nix-grpc-daemon[847]: time=2026-09-20T08:17:51.820Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4290worker1 # [ 58.269984] nix-grpc-daemon[847]: time=2026-09-20T08:17:51.853Z level=INFO msg="Uploading 1 narinfos"4291lb # [ 58.285587] niks3-server[1040]: 2026/09/20 08:17:51 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4292lb # [ 58.298056] niks3-server[1040]: 2026/09/20 08:17:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4293lb # [ 58.309701] niks3-server[1040]: 2026/09/20 08:17:51 INFO Signed narinfos id=11 count=14294lb # [ 58.314510] niks3-server[1040]: 2026/09/20 08:17:51 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4295lb # [ 58.322562] niks3-server[1040]: 2026/09/20 08:17:51 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4296worker1 # [ 58.302476] nix-grpc-daemon[847]: time=2026-09-20T08:17:51.886Z level=INFO msg="Upload complete. (503ms)"4297lb # [ 58.328344] niks3-server[1040]: 2026/09/20 08:17:51 INFO Completed upload id=114298lb # [ 58.332369] niks3-server[1040]: 2026/09/20 08:17:51 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4299worker1 # [ 58.308477] nix-grpc-daemon[774]: ts=2026-09-20T08:17:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36578 duration_s=0 paths=1 nar_bytes_in=6244300worker1 # [ 58.322601] nix-grpc-daemon[774]: ts=2026-09-20T08:17:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365784301worker1 # [ 58.329394] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4302worker1 # [ 58.334248] nix-daemon[837]: reaped child process 1034, status = succeeded4303worker1 # [ 58.348151] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4304worker1 # [ 59.399664] nix-daemon[837]: reaped child process 1048, status = succeeded4305worker1 # [ 59.582480] nix-daemon[837]: accepted connection from pid 1063, user nix-grpc-daemon (trusted)4306worker1 # [ 59.601475] nix-daemon[837]: reaped child process 1066, status = succeeded4307lb # [ 59.639063] niks3-server[1040]: 2026/09/20 08:17:53 INFO Received uploads request method=POST path=/api/pending_closures4308worker1 # [ 59.627655] nix-grpc-daemon[847]: time=2026-09-20T08:17:53.207Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4309worker1 # [ 59.629502] nix-grpc-daemon[847]: time=2026-09-20T08:17:53.207Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4310lb # [ 59.682632] niks3-server[1040]: 2026/09/20 08:17:53 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4311lb # [ 59.694499] niks3-server[1040]: 2026/09/20 08:17:53 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4312lb # [ 59.707745] niks3-server[1040]: 2026/09/20 08:17:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4313worker1 # [ 59.687789] nix-grpc-daemon[847]: time=2026-09-20T08:17:53.271Z level=INFO msg="Uploading 1 narinfos"4314lb # [ 59.715755] niks3-server[1040]: 2026/09/20 08:17:53 INFO Signed narinfos id=12 count=14315lb # [ 59.721080] niks3-server[1040]: 2026/09/20 08:17:53 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4316lb # [ 59.728222] niks3-server[1040]: 2026/09/20 08:17:53 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4317lb # [ 59.734467] niks3-server[1040]: 2026/09/20 08:17:53 INFO Completed upload id=124318lb # [ 59.737672] niks3-server[1040]: 2026/09/20 08:17:53 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4319worker1 # [ 59.708745] nix-grpc-daemon[847]: time=2026-09-20T08:17:53.292Z level=INFO msg="Upload complete. (349ms)"4320worker1 # [ 59.721387] nix-grpc-daemon[774]: ts=2026-09-20T08:17:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36578 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=6 outputs=14321worker1 # [ 59.740427] nix-grpc-daemon[774]: ts=2026-09-20T08:17:53Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:365784322worker1 # [ 59.747109] nix-daemon[837]: reaped child process 1046, status = succeeded4323worker2 # [ 59.775796] nix-grpc-daemon[776]: ts=2026-09-20T08:17:53Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:455244324worker2 # [ 59.789639] nix-grpc-daemon[776]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4325worker2 # [ 59.807041] nix-grpc-daemon[776]: ts=2026-09-20T08:17:53Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:45524 duration_s=0 paths=1 nar_bytes_out=1764326worker1 # [ 60.094082] nix-grpc-daemon[774]: ts=2026-09-20T08:17:53Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:365784327worker2 # [ 60.115401] nix-grpc-daemon[776]: ts=2026-09-20T08:17:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:455244328worker2 # [ 60.127051] nix-grpc-daemon[907]: time=2026-09-20T08:17:53.704Z level=INFO msg="All 2 paths already cached"4329worker2 # [ 60.148156] nix-grpc-daemon[776]: ts=2026-09-20T08:17:53Z level=debug event=want client=7 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04330worker2 # [ 60.154227] nix-grpc-daemon[776]: ts=2026-09-20T08:17:53Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.3:50051 clients=14331worker1 # [ 60.179679] nix-grpc-daemon[774]: ts=2026-09-20T08:17:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365784332worker1 # [ 60.196742] nix-grpc-daemon[774]: ts=2026-09-20T08:17:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:365784333worker1 # [ 60.211623] nix-grpc-daemon[847]: time=2026-09-20T08:17:53.795Z level=INFO msg="All 2 paths already cached"4334worker1 # [ 60.222612] nix-grpc-daemon[774]: ts=2026-09-20T08:17:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:365784335worker1 # [ 60.237132] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4336lb # [ 60.422891] envoy[910]: conn peer=[2001:db8:1::1]:60444 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2979 tx=1375 ms=49504337lb # [ 60.427987] envoy[910]: conn peer=[2001:db8:1::1]:60448 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1592 tx=1487 ms=37384338lb # [ 60.432811] envoy[910]: conn peer=[2001:db8:1::1]:55868 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3401 tx=1660 ms=21664339lb # [ 60.437582] envoy[910]: conn peer=[2001:db8:1::1]:55878 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=334 ms=984340lb # [ 60.442273] envoy[910]: conn peer=[2001:db8:1::1]:55880 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3901 tx=1853 ms=21604341lb # [ 60.447020] envoy[910]: conn peer=[2001:db8:1::1]:55890 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=376 ms=944342worker1 # [ 60.449940] nix-daemon[837]: accepted connection from pid 1070, user nix-grpc-daemon (trusted)4343worker1 # [ 60.469489] nix-daemon[837]: reaped child process 1073, status = succeeded4344worker1 # [ 60.646664] nix-daemon[837]: accepted connection from pid 1075, user nix-grpc-daemon (trusted)4345worker1 # [ 60.665144] nix-daemon[837]: reaped child process 1078, status = succeeded4346lb # [ 60.701844] niks3-server[1040]: 2026/09/20 08:17:54 INFO Received uploads request method=POST path=/api/pending_closures4347worker1 # [ 60.686699] nix-grpc-daemon[847]: time=2026-09-20T08:17:54.270Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4348worker1 # [ 60.688321] nix-grpc-daemon[847]: time=2026-09-20T08:17:54.270Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4349lb # [ 60.732200] niks3-server[1040]: 2026/09/20 08:17:54 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4350lb # [ 60.743916] niks3-server[1040]: 2026/09/20 08:17:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4351worker1 # [ 60.725356] nix-grpc-daemon[847]: time=2026-09-20T08:17:54.309Z level=INFO msg="Uploading 1 narinfos"4352lb # [ 60.755806] niks3-server[1040]: 2026/09/20 08:17:54 INFO Signed narinfos id=13 count=14353lb # [ 60.761948] niks3-server[1040]: 2026/09/20 08:17:54 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4354lb # [ 60.769717] niks3-server[1040]: 2026/09/20 08:17:54 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4355lb # [ 60.776080] niks3-server[1040]: 2026/09/20 08:17:54 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4356lb # [ 60.781244] niks3-server[1040]: 2026/09/20 08:17:54 INFO Completed upload id=134357worker1 # [ 60.756463] nix-grpc-daemon[847]: time=2026-09-20T08:17:54.340Z level=INFO msg="Upload complete. (500ms)"4358worker1 # [ 60.765826] nix-grpc-daemon[774]: ts=2026-09-20T08:17:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36578 duration_s=0 paths=1 nar_bytes_in=7524359worker1 # [ 60.779129] nix-grpc-daemon[774]: ts=2026-09-20T08:17:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365784360worker1 # [ 60.785616] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4361worker1 # [ 60.790540] nix-daemon[837]: reaped child process 1068, status = succeeded4362worker1 # [ 60.802601] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4363worker1 # [ 61.858910] nix-daemon[837]: reaped child process 1082, status = succeeded4364worker1 # [ 62.040109] nix-daemon[837]: accepted connection from pid 1097, user nix-grpc-daemon (trusted)4365worker1 # [ 62.058167] nix-daemon[837]: reaped child process 1100, status = succeeded4366lb # [ 62.097119] niks3-server[1040]: 2026/09/20 08:17:55 INFO Received uploads request method=POST path=/api/pending_closures4367worker1 # [ 62.082818] nix-grpc-daemon[847]: time=2026-09-20T08:17:55.665Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4368worker1 # [ 62.084492] nix-grpc-daemon[847]: time=2026-09-20T08:17:55.665Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4369lb # [ 62.134993] niks3-server[1040]: 2026/09/20 08:17:55 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4370lb # [ 62.145338] niks3-server[1040]: 2026/09/20 08:17:55 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4371worker1 # [ 62.131201] nix-grpc-daemon[847]: time=2026-09-20T08:17:55.715Z level=INFO msg="Uploading 1 narinfos"4372lb # [ 62.160837] niks3-server[1040]: 2026/09/20 08:17:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4373lb # [ 62.167796] niks3-server[1040]: 2026/09/20 08:17:55 INFO Signed narinfos id=14 count=14374lb # [ 62.170555] niks3-server[1040]: 2026/09/20 08:17:55 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4375worker1 # [ 62.152778] nix-grpc-daemon[847]: time=2026-09-20T08:17:55.736Z level=INFO msg="Upload complete. (330ms)"4376lb # [ 62.178310] niks3-server[1040]: 2026/09/20 08:17:55 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4377lb # [ 62.182917] niks3-server[1040]: 2026/09/20 08:17:55 INFO Completed upload id=144378lb # [ 62.186319] niks3-server[1040]: 2026/09/20 08:17:55 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4379worker1 # [ 62.165282] nix-grpc-daemon[774]: ts=2026-09-20T08:17:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36578 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=7 outputs=14380worker2 # [ 62.187620] nix-grpc-daemon[776]: ts=2026-09-20T08:17:55Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:455244381worker1 # [ 62.182175] nix-daemon[837]: reaped child process 1080, status = succeeded4382worker2 # [ 62.201076] nix-grpc-daemon[776]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...4383worker1 # [ 62.227779] nix-grpc-daemon[774]: ts=2026-09-20T08:17:55Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:365784384worker1 # [ 62.234805] nix-grpc-daemon[774]: ts=2026-09-20T08:17:55Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36578 duration_s=0 paths=1 nar_bytes_out=2324385client # [ 62.394112] nix-daemon[916]: reaped child process 918, status = succeeded4386client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.71 seconds)4387client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4388client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds)4389client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4390client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds)4391client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4392client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4393(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.83 seconds)4394subtest: an input only one worker has still reaches the builder4395client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4396client # this derivation will be built:4397client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4398client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4399client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.44 seconds)4400client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4401client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.21 seconds)4402worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4403worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.25 seconds)4404worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4405worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds)4406client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24407client # [ 63.687757] nix-daemon[916]: accepted connection from pid 999, user root (trusted)4408client # this derivation will be built:4409client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4410worker1 # [ 63.822311] nix-grpc-daemon[774]: ts=2026-09-20T08:17:57Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:365784411client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4412worker1 # [ 63.830124] nix-grpc-daemon[774]: ts=2026-09-20T08:17:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:365784413worker1 # [ 64.041505] nix-daemon[837]: accepted connection from pid 1107, user nix-grpc-daemon (trusted)4414worker1 # [ 64.059894] nix-daemon[837]: reaped child process 1110, status = succeeded4415lb # [ 64.096806] niks3-server[1040]: 2026/09/20 08:17:57 INFO Received uploads request method=POST path=/api/pending_closures4416worker1 # [ 64.081539] nix-grpc-daemon[847]: time=2026-09-20T08:17:57.665Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4417worker1 # [ 64.083998] nix-grpc-daemon[847]: time=2026-09-20T08:17:57.667Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4418lb # [ 64.131120] niks3-server[1040]: 2026/09/20 08:17:57 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4419lb # [ 64.142157] niks3-server[1040]: 2026/09/20 08:17:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4420worker1 # [ 64.124194] nix-grpc-daemon[847]: time=2026-09-20T08:17:57.707Z level=INFO msg="Uploading 1 narinfos"4421lb # [ 64.153388] niks3-server[1040]: 2026/09/20 08:17:57 INFO Signed narinfos id=15 count=14422lb # [ 64.159473] niks3-server[1040]: 2026/09/20 08:17:57 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4423lb # [ 64.167877] niks3-server[1040]: 2026/09/20 08:17:57 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4424lb # [ 64.175243] niks3-server[1040]: 2026/09/20 08:17:57 INFO Completed upload id=154425worker1 # [ 64.150580] nix-grpc-daemon[847]: time=2026-09-20T08:17:57.734Z level=INFO msg="Upload complete. (321ms)"4426lb # [ 64.178597] niks3-server[1040]: 2026/09/20 08:17:57 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4427worker2 # [ 64.194723] nix-grpc-daemon[776]: ts=2026-09-20T08:17:57Z level=debug event=want client=8 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04428worker2 # [ 64.195050] nix-grpc-daemon[776]: ts=2026-09-20T08:17:57Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=14429worker2 # [ 64.240571] nix-grpc-daemon[776]: ts=2026-09-20T08:17:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:455244430worker2 # [ 64.256307] nix-grpc-daemon[776]: ts=2026-09-20T08:17:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:455244431client # copying 2 paths to 'lb:50051'...4432client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4433worker2 # [ 64.276071] nix-grpc-daemon[776]: ts=2026-09-20T08:17:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:455244434client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4435worker2 # [ 64.291001] nix-daemon[863]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4436worker2 # [ 64.501615] nix-daemon[863]: accepted connection from pid 995, user nix-grpc-daemon (trusted)4437worker2 # [ 64.522271] nix-daemon[863]: reaped child process 998, status = succeeded4438worker2 # [ 64.696765] nix-daemon[863]: accepted connection from pid 1000, user nix-grpc-daemon (trusted)4439worker2 # [ 64.714187] nix-daemon[863]: reaped child process 1003, status = succeeded4440lb # [ 64.735637] niks3-server[1040]: 2026/09/20 08:17:58 INFO Received uploads request method=POST path=/api/pending_closures4441lb # [ 64.745261] niks3-server[1040]: 2026/09/20 08:17:58 INFO Received uploads request method=POST path=/api/pending_closures4442worker2 # [ 64.745610] nix-grpc-daemon[907]: time=2026-09-20T08:17:58.322Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4443worker2 # [ 64.747128] nix-grpc-daemon[907]: time=2026-09-20T08:17:58.323Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4444worker2 # [ 64.748979] nix-grpc-daemon[907]: time=2026-09-20T08:17:58.323Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4445lb # [ 64.782236] niks3-server[1040]: 2026/09/20 08:17:58 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4446lb # [ 64.801305] niks3-server[1040]: 2026/09/20 08:17:58 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4447lb # [ 64.809704] niks3-server[1040]: 2026/09/20 08:17:58 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4448lb # [ 64.818235] niks3-server[1040]: 2026/09/20 08:17:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4449lb # [ 64.826141] niks3-server[1040]: 2026/09/20 08:17:58 INFO Signed narinfos id=16 count=14450worker2 # [ 64.816104] nix-grpc-daemon[907]: time=2026-09-20T08:17:58.393Z level=INFO msg="Uploading 3 narinfos"4451lb # [ 64.830107] niks3-server[1040]: 2026/09/20 08:17:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4452lb # [ 64.835639] niks3-server[1040]: 2026/09/20 08:17:58 INFO Signed narinfos id=17 count=24453lb # [ 64.838974] niks3-server[1040]: 2026/09/20 08:17:58 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4454lb # [ 64.848868] niks3-server[1040]: 2026/09/20 08:17:58 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4455lb # [ 64.854483] niks3-server[1040]: 2026/09/20 08:17:58 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4456lb # [ 64.862387] niks3-server[1040]: 2026/09/20 08:17:58 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4457lb # [ 64.868564] niks3-server[1040]: 2026/09/20 08:17:58 INFO Completed upload id=164458lb # [ 64.870983] niks3-server[1040]: 2026/09/20 08:17:58 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4459lb # [ 64.873970] niks3-server[1040]: 2026/09/20 08:17:58 INFO Completed upload id=174460lb # [ 64.875327] niks3-server[1040]: 2026/09/20 08:17:58 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4461worker2 # [ 64.861403] nix-grpc-daemon[907]: time=2026-09-20T08:17:58.439Z level=INFO msg="Upload complete. (550ms)"4462worker2 # [ 64.873567] nix-grpc-daemon[776]: ts=2026-09-20T08:17:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45524 duration_s=0 paths=2 nar_bytes_in=9844463worker2 # [ 64.891232] nix-grpc-daemon[776]: ts=2026-09-20T08:17:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:455244464worker2 # [ 64.905674] nix-daemon[863]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4465worker2 # [ 64.909962] nix-daemon[863]: reaped child process 993, status = succeeded4466worker2 # [ 64.928694] nix-grpc-daemon[776]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...4467client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4468worker2 # [ 64.947363] nix-daemon[863]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4469client # uses-input-w1onlya> worker2: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4470worker2 # [ 65.978582] nix-daemon[863]: reaped child process 1008, status = succeeded4471worker2 # [ 66.142816] nix-daemon[863]: accepted connection from pid 1023, user nix-grpc-daemon (trusted)4472worker2 # [ 66.160891] nix-daemon[863]: reaped child process 1026, status = succeeded4473lb # [ 66.181436] niks3-server[1040]: 2026/09/20 08:17:59 INFO Received uploads request method=POST path=/api/pending_closures4474worker2 # [ 66.182923] nix-grpc-daemon[907]: time=2026-09-20T08:17:59.760Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4475lb # [ 66.212718] niks3-server[1040]: 2026/09/20 08:17:59 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4476worker2 # [ 66.212068] nix-grpc-daemon[907]: time=2026-09-20T08:17:59.790Z level=INFO msg="Uploading 1 narinfos"4477lb # [ 66.224299] niks3-server[1040]: 2026/09/20 08:17:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4478lb # [ 66.235849] niks3-server[1040]: 2026/09/20 08:17:59 INFO Signed narinfos id=18 count=14479lb # [ 66.240844] niks3-server[1040]: 2026/09/20 08:17:59 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4480lb # [ 66.249825] niks3-server[1040]: 2026/09/20 08:17:59 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4481worker2 # [ 66.245347] nix-grpc-daemon[907]: time=2026-09-20T08:17:59.823Z level=INFO msg="Upload complete. (281ms)"4482lb # [ 66.254771] niks3-server[1040]: 2026/09/20 08:17:59 INFO Completed upload id=184483lb # [ 66.257766] niks3-server[1040]: 2026/09/20 08:17:59 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4484worker2 # [ 66.254995] nix-grpc-daemon[776]: ts=2026-09-20T08:17:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45524 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=8 outputs=14485worker2 # [ 66.267845] nix-daemon[863]: reaped child process 1005, status = succeeded4486client # copying 1 paths...4487worker1 # [ 66.290267] nix-grpc-daemon[774]: ts=2026-09-20T08:17:59Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:365784488worker1 # [ 66.306932] nix-grpc-daemon[774]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'...4489client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4490worker1 # [ 66.354151] nix-grpc-daemon[774]: ts=2026-09-20T08:17:59Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:365784491worker1 # [ 66.359459] nix-grpc-daemon[774]: ts=2026-09-20T08:17:59Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36578 duration_s=0 paths=1 nar_bytes_out=1204492client # [ 66.547247] nix-daemon[916]: reaped child process 1002, status = succeeded4493client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.09 seconds)4494client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24495client # [ 66.768508] nix-daemon[916]: accepted connection from pid 1021, user root (trusted)4496client # this derivation will be built:4497client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4498worker2 # [ 66.919390] nix-grpc-daemon[776]: ts=2026-09-20T08:18:00Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:455244499client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4500worker2 # [ 66.927126] nix-grpc-daemon[776]: ts=2026-09-20T08:18:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:455244501worker2 # [ 66.934310] nix-grpc-daemon[907]: time=2026-09-20T08:18:00.511Z level=INFO msg="All 1 paths already cached"4502worker2 # [ 66.947469] nix-grpc-daemon[776]: ts=2026-09-20T08:18:00Z level=debug event=want client=9 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04503worker1 # [ 66.934643] nix-grpc-daemon[774]: ts=2026-09-20T08:18:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365784504worker2 # [ 66.954006] nix-grpc-daemon[776]: ts=2026-09-20T08:18:00Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=14505worker1 # [ 66.951358] nix-grpc-daemon[774]: ts=2026-09-20T08:18:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:365784506client # copying 1 paths to 'lb:50051'...4507client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4508worker1 # [ 66.974304] nix-grpc-daemon[774]: ts=2026-09-20T08:18:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:365784509worker1 # [ 66.990197] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4510worker1 # [ 67.013786] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 61 ms (attempt 1/5)4511worker1 # [ 67.081338] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 185 ms (attempt 2/5)4512worker1 # [ 67.274091] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 317 ms (attempt 3/5)4513worker1 # [ 67.600339] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 188 ms (attempt 4/5)4514worker1 # [ 67.789876] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4515worker1 # [ 67.799042] nix-grpc-daemon[774]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4516worker1 # [ 68.025451] nix-daemon[837]: accepted connection from pid 1119, user nix-grpc-daemon (trusted)4517worker1 # [ 68.046675] nix-daemon[837]: reaped child process 1122, status = succeeded4518worker1 # [ 68.222050] nix-daemon[837]: accepted connection from pid 1124, user nix-grpc-daemon (trusted)4519worker1 # [ 68.240503] nix-daemon[837]: reaped child process 1127, status = succeeded4520lb # [ 68.277133] niks3-server[1040]: 2026/09/20 08:18:01 INFO Received uploads request method=POST path=/api/pending_closures4521worker1 # [ 68.262215] nix-grpc-daemon[847]: time=2026-09-20T08:18:01.845Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4522worker1 # [ 68.263726] nix-grpc-daemon[847]: time=2026-09-20T08:18:01.845Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4523lb # [ 68.308403] niks3-server[1040]: 2026/09/20 08:18:01 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4524worker1 # [ 68.295892] nix-grpc-daemon[847]: time=2026-09-20T08:18:01.879Z level=INFO msg="Uploading 1 narinfos"4525lb # [ 68.324675] niks3-server[1040]: 2026/09/20 08:18:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4526lb # [ 68.333752] niks3-server[1040]: 2026/09/20 08:18:01 INFO Signed narinfos id=19 count=14527lb # [ 68.337799] niks3-server[1040]: 2026/09/20 08:18:01 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4528worker1 # [ 68.320559] nix-grpc-daemon[847]: time=2026-09-20T08:18:01.904Z level=INFO msg="Upload complete. (498ms)"4529lb # [ 68.347424] niks3-server[1040]: 2026/09/20 08:18:01 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4530lb # [ 68.353298] niks3-server[1040]: 2026/09/20 08:18:01 INFO Completed upload id=194531worker1 # [ 68.328188] nix-grpc-daemon[774]: ts=2026-09-20T08:18:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36578 duration_s=1 paths=1 nar_bytes_in=5684532lb # [ 68.356883] niks3-server[1040]: 2026/09/20 08:18:01 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4533worker1 # [ 68.338931] nix-grpc-daemon[774]: ts=2026-09-20T08:18:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:365784534worker1 # [ 68.350105] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4535worker1 # [ 68.354893] nix-daemon[837]: reaped child process 1113, status = succeeded4536client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4537worker1 # [ 68.367526] nix-daemon[837]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4538client # uses-input-w1onlyb> node-a: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4539worker1 # [ 69.212511] nix-daemon[837]: reaped child process 1131, status = succeeded4540worker1 # [ 69.396940] nix-daemon[837]: accepted connection from pid 1146, user nix-grpc-daemon (trusted)4541worker1 # [ 69.417600] nix-daemon[837]: reaped child process 1149, status = succeeded4542lb # [ 69.454118] niks3-server[1040]: 2026/09/20 08:18:03 INFO Received uploads request method=POST path=/api/pending_closures4543worker1 # [ 69.440477] nix-grpc-daemon[847]: time=2026-09-20T08:18:03.022Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4544lb # [ 69.488244] niks3-server[1040]: 2026/09/20 08:18:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4545worker1 # [ 69.471074] nix-grpc-daemon[847]: time=2026-09-20T08:18:03.054Z level=INFO msg="Uploading 1 narinfos"4546lb # [ 69.499255] niks3-server[1040]: 2026/09/20 08:18:03 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4547lb # [ 69.509954] niks3-server[1040]: 2026/09/20 08:18:03 INFO Signed narinfos id=20 count=14548lb # [ 69.514473] niks3-server[1040]: 2026/09/20 08:18:03 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4549worker1 # [ 69.500346] nix-grpc-daemon[847]: time=2026-09-20T08:18:03.084Z level=INFO msg="Upload complete. (322ms)"4550lb # [ 69.525727] niks3-server[1040]: 2026/09/20 08:18:03 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4551lb # [ 69.532657] niks3-server[1040]: 2026/09/20 08:18:03 INFO Completed upload id=204552lb # [ 69.535485] niks3-server[1040]: 2026/09/20 08:18:03 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4553worker1 # [ 69.512866] nix-grpc-daemon[774]: ts=2026-09-20T08:18:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36578 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=9 outputs=14554client # copying 1 paths...4555worker1 # [ 69.523505] nix-daemon[837]: reaped child process 1129, status = succeeded4556worker2 # [ 69.538191] nix-grpc-daemon[776]: ts=2026-09-20T08:18:03Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:455244557worker2 # [ 69.552449] nix-grpc-daemon[776]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'...4558client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4559worker1 # [ 69.582248] nix-grpc-daemon[774]: ts=2026-09-20T08:18:03Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:365784560worker1 # [ 69.587705] nix-grpc-daemon[774]: ts=2026-09-20T08:18:03Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36578 duration_s=0 paths=1 nar_bytes_out=1204561client # [ 69.734806] nix-daemon[916]: reaped child process 1024, status = succeeded4562client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.19 seconds)4563client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24564client # [ 69.954439] nix-daemon[916]: accepted connection from pid 1043, user root (trusted)4565client # this derivation will be built:4566client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4567worker2 # [ 70.102928] nix-grpc-daemon[776]: ts=2026-09-20T08:18:03Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:455244568client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4569worker1 # [ 70.092080] nix-grpc-daemon[774]: ts=2026-09-20T08:18:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:365784570worker1 # [ 70.113003] nix-grpc-daemon[847]: time=2026-09-20T08:18:03.696Z level=INFO msg="All 1 paths already cached"4571worker2 # [ 70.146062] nix-grpc-daemon[776]: ts=2026-09-20T08:18:03Z level=debug event=want client=10 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04572worker2 # [ 70.153294] nix-grpc-daemon[776]: ts=2026-09-20T08:18:03Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=14573worker2 # [ 70.191184] nix-grpc-daemon[776]: ts=2026-09-20T08:18:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:455244574worker2 # [ 70.206361] nix-grpc-daemon[776]: ts=2026-09-20T08:18:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:455244575worker2 # [ 70.222745] nix-grpc-daemon[907]: time=2026-09-20T08:18:03.800Z level=INFO msg="All 1 paths already cached"4576client # copying 1 paths to 'lb:50051'...4577client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4578worker2 # [ 70.233499] nix-grpc-daemon[776]: ts=2026-09-20T08:18:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:455244579worker2 # [ 70.249138] nix-daemon[863]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4580lb # [ 70.426610] envoy[910]: conn peer=[2001:db8:1::1]:35746 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=412 tx=406 ms=294581lb # [ 70.431866] envoy[910]: conn peer=[2001:db8:1::1]:55906 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4369 tx=2240 ms=21584582lb # [ 70.436828] envoy[910]: conn peer=[2001:db8:1::1]:35754 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3849 tx=1880 ms=25914583lb # [ 70.441596] envoy[910]: conn peer=[2001:db8:1::1]:35758 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=634584lb # [ 70.446285] envoy[910]: conn peer=[2001:db8:1::1]:35770 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3710 tx=1917 ms=26954585lb # [ 70.451073] envoy[910]: conn peer=[2001:db8:1::1]:35778 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=214586worker2 # [ 70.445587] nix-daemon[863]: accepted connection from pid 1035, user nix-grpc-daemon (trusted)4587worker2 # [ 70.466696] nix-daemon[863]: reaped child process 1038, status = succeeded4588worker2 # [ 70.641187] nix-daemon[863]: accepted connection from pid 1040, user nix-grpc-daemon (trusted)4589worker2 # [ 70.660299] nix-daemon[863]: reaped child process 1043, status = succeeded4590lb # [ 70.684799] niks3-server[1040]: 2026/09/20 08:18:04 INFO Received uploads request method=POST path=/api/pending_closures4591worker2 # [ 70.684569] nix-grpc-daemon[907]: time=2026-09-20T08:18:04.262Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4592worker2 # [ 70.686071] nix-grpc-daemon[907]: time=2026-09-20T08:18:04.262Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4593lb # [ 70.713549] niks3-server[1040]: 2026/09/20 08:18:04 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4594lb # [ 70.725908] niks3-server[1040]: 2026/09/20 08:18:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4595worker2 # [ 70.723633] nix-grpc-daemon[907]: time=2026-09-20T08:18:04.301Z level=INFO msg="Uploading 1 narinfos"4596lb # [ 70.737960] niks3-server[1040]: 2026/09/20 08:18:04 INFO Signed narinfos id=21 count=14597lb # [ 70.744328] niks3-server[1040]: 2026/09/20 08:18:04 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4598lb # [ 70.752121] niks3-server[1040]: 2026/09/20 08:18:04 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4599lb # [ 70.758289] niks3-server[1040]: 2026/09/20 08:18:04 INFO Completed upload id=214600worker2 # [ 70.749747] nix-grpc-daemon[907]: time=2026-09-20T08:18:04.328Z level=INFO msg="Upload complete. (484ms)"4601lb # [ 70.761392] niks3-server[1040]: 2026/09/20 08:18:04 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4602worker2 # [ 70.760996] nix-grpc-daemon[776]: ts=2026-09-20T08:18:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45524 duration_s=0 paths=1 nar_bytes_in=5684603worker2 # [ 70.771754] nix-daemon[863]: reaped child process 1033, status = succeeded4604worker2 # [ 70.781294] nix-grpc-daemon[776]: ts=2026-09-20T08:18:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:455244605worker2 # [ 70.792272] nix-daemon[863]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4606client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4607worker2 # [ 70.807944] nix-daemon[863]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4608client # uses-input-w1onlyc> worker2: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4609worker2 # [ 71.631297] nix-daemon[863]: reaped child process 1047, status = succeeded4610worker2 # [ 71.789388] nix-daemon[863]: accepted connection from pid 1062, user nix-grpc-daemon (trusted)4611worker2 # [ 71.808891] nix-daemon[863]: reaped child process 1065, status = succeeded4612lb # [ 71.832936] niks3-server[1040]: 2026/09/20 08:18:05 INFO Received uploads request method=POST path=/api/pending_closures4613worker2 # [ 71.834955] nix-grpc-daemon[907]: time=2026-09-20T08:18:05.411Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4614lb # [ 71.865551] niks3-server[1040]: 2026/09/20 08:18:05 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4615lb # [ 71.880354] niks3-server[1040]: 2026/09/20 08:18:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4616worker2 # [ 71.877138] nix-grpc-daemon[907]: time=2026-09-20T08:18:05.455Z level=INFO msg="Uploading 1 narinfos"4617lb # [ 71.893419] niks3-server[1040]: 2026/09/20 08:18:05 INFO Signed narinfos id=22 count=14618lb # [ 71.901168] niks3-server[1040]: 2026/09/20 08:18:05 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4619lb # [ 71.910679] niks3-server[1040]: 2026/09/20 08:18:05 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4620lb # [ 71.919086] niks3-server[1040]: 2026/09/20 08:18:05 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4621lb # [ 71.923976] niks3-server[1040]: 2026/09/20 08:18:05 INFO Completed upload id=224622worker2 # [ 71.915257] nix-grpc-daemon[907]: time=2026-09-20T08:18:05.493Z level=INFO msg="Upload complete. (296ms)"4623worker2 # [ 71.929136] nix-grpc-daemon[776]: ts=2026-09-20T08:18:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45524 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=10 outputs=14624worker2 # [ 71.943721] nix-daemon[863]: reaped child process 1045, status = succeeded4625client # copying 1 paths...4626worker2 # [ 71.975307] nix-grpc-daemon[776]: ts=2026-09-20T08:18:05Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:455244627client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4628worker1 # [ 71.997637] nix-grpc-daemon[774]: ts=2026-09-20T08:18:05Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:365784629worker1 # [ 72.012918] nix-grpc-daemon[774]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'...4630worker1 # [ 72.033210] nix-grpc-daemon[774]: ts=2026-09-20T08:18:05Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36578 duration_s=0 paths=1 nar_bytes_out=1204631client # [ 72.234552] nix-daemon[916]: reaped child process 1046, status = succeeded4632client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.50 seconds)4633(finished: subtest: an input only one worker has still reaches the builder, in 9.71 seconds)4634subtest: upload whose reference the worker lacks is completed from the cache4635client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4636client # this derivation will be built:4637client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4638client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4639client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.49 seconds)4640client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4641client # this derivation will be built:4642client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4643client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4644client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.56 seconds)4645client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4646client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.22 seconds)4647worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4648worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.27 seconds)4649worker2 # [ 73.814099] systemd[1]: Stopping Nix worker-protocol over gRPC...4650worker2 # [ 74.769956] nix-grpc-daemon[776]: ts=2026-09-20T08:18:08Z level=info event=signal_exit4651worker2 # [ 75.014637] nix-grpc-daemon[776]: ts=2026-09-20T08:18:08Z level=info event=scheduler_yield4652worker2 # [ 75.020626] nix-grpc-daemon[776]: ts=2026-09-20T08:18:08Z level=info event=scheduler_restarting addr=lb:500514653lb # [ 75.030331] niks3-server[1040]: 2026/09/20 08:18:08 INFO lead: released remote=192.168.1.4:426924654worker2 # [ 75.026679] nix-grpc-daemon[776]: ts=2026-09-20T08:18:08Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:385124655worker1 # [ 75.019963] nix-grpc-daemon[774]: ts=2026-09-20T08:18:08Z level=info event=scheduler_restarting addr=lb:500514656worker2 # [ 75.031477] nix-grpc-daemon[776]: ts=2026-09-20T08:18:08Z level=info event=worker_gone addr=192.168.1.4:500514657worker2 # [ 75.040401] nix-grpc-daemon[776]: ts=2026-09-20T08:18:08Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:385124658worker2 # [ 75.044981] nix-grpc-daemon[776]: ts=2026-09-20T08:18:08Z level=info event=worker_gone addr=192.168.1.3:500514659worker2 # [ 75.222083] nix-grpc-daemon[776]: ts=2026-09-20T08:18:08Z level=info event=scheduler_connected addr=lb:500514660worker2 # [ 75.227988] nix-grpc-daemon[776]: ts=2026-09-20T08:18:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4661worker1 # [ 75.219587] nix-grpc-daemon[774]: ts=2026-09-20T08:18:08Z level=info event=scheduler_connected addr=lb:500514662worker1 # [ 75.231231] nix-grpc-daemon[774]: ts=2026-09-20T08:18:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4663worker2 # [ 75.428877] nix-grpc-daemon[776]: ts=2026-09-20T08:18:09Z level=info event=scheduler_connected addr=lb:500514664worker2 # [ 75.434622] nix-grpc-daemon[776]: ts=2026-09-20T08:18:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4665worker1 # [ 75.432237] nix-grpc-daemon[774]: ts=2026-09-20T08:18:09Z level=info event=scheduler_connected addr=lb:500514666worker1 # [ 75.438304] nix-grpc-daemon[774]: ts=2026-09-20T08:18:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4667worker2 # [ 75.635442] nix-grpc-daemon[776]: ts=2026-09-20T08:18:09Z level=info event=scheduler_connected addr=lb:500514668worker2 # [ 75.641470] nix-grpc-daemon[776]: ts=2026-09-20T08:18:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4669worker1 # [ 75.640238] nix-grpc-daemon[774]: ts=2026-09-20T08:18:09Z level=info event=scheduler_connected addr=lb:500514670worker1 # [ 75.647938] nix-grpc-daemon[774]: ts=2026-09-20T08:18:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4671worker2 # [ 75.844120] nix-grpc-daemon[776]: ts=2026-09-20T08:18:09Z level=info event=scheduler_connected addr=lb:500514672worker2 # [ 75.849962] nix-grpc-daemon[776]: ts=2026-09-20T08:18:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4673worker1 # [ 75.848622] nix-grpc-daemon[774]: ts=2026-09-20T08:18:09Z level=info event=scheduler_connected addr=lb:500514674worker1 # [ 75.853685] nix-grpc-daemon[774]: ts=2026-09-20T08:18:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4675worker2 # [ 76.021378] nix-grpc-daemon[776]: ts=2026-09-20T08:18:09Z level=info event=scheduler_restarting4676worker1 # [ 76.056778] nix-grpc-daemon[774]: ts=2026-09-20T08:18:09Z level=info event=scheduler_connected addr=lb:500514677worker2 # [ 76.075678] nix-grpc-daemon[776]: ts=2026-09-20T08:18:09Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4678worker1 # [ 76.062390] nix-grpc-daemon[774]: ts=2026-09-20T08:18:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4679worker2 # [ 76.092906] nix-daemon[863]: reaped child process 865, status = succeeded4680worker1 # [ 76.263071] nix-grpc-daemon[774]: ts=2026-09-20T08:18:09Z level=info event=scheduler_connected addr=lb:500514681worker2 # [ 76.281656] nix-grpc-daemon[776]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4682worker2 # [ 76.286237] nix-grpc-daemon[776]: E0000 00:00:1789892289.859568 819 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true4683worker1 # [ 76.684570] nix-grpc-daemon[774]: ts=2026-09-20T08:18:10Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4684worker2 # [ 76.718335] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4685worker2 # [ 76.727973] systemd[1]: Stopped Nix worker-protocol over gRPC.4686worker2 # [ 76.730866] systemd[1]: nix-grpc-daemon.service: Consumed 1.952s CPU time over 56.298s wall clock time, 55M memory peak, 58.9K incoming IP traffic, 120.8K outgoing IP traffic.4687worker2 # [ 76.744948] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4688worker2 # [ 76.747031] systemd[1]: Closed Nix worker-protocol over gRPC.4689worker2 # [ 76.752546] systemd[1]: nix-grpc-daemon.socket: Consumed 588us CPU time over 1min 5.096s wall clock time, 256K memory peak, 97K incoming IP traffic, 83.2K outgoing IP traffic.4690lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4691lb: must succeed: curl -sf localhost:9901/clusters4692lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4693lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4694client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24695worker1 # [ 76.885569] nix-grpc-daemon[774]: ts=2026-09-20T08:18:10Z level=info event=scheduler_connected addr=lb:500514696worker1 # [ 76.892337] nix-grpc-daemon[774]: ts=2026-09-20T08:18:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4697worker1 # [ 77.081956] nix-grpc-daemon[774]: ts=2026-09-20T08:18:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:365784698worker1 # [ 77.090903] nix-grpc-daemon[774]: ts=2026-09-20T08:18:10Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:365784699client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4700worker1 # [ 77.098091] nix-grpc-daemon[774]: ts=2026-09-20T08:18:10Z level=info event=scheduler_connected addr=lb:500514701worker1 # [ 77.103282] nix-grpc-daemon[774]: ts=2026-09-20T08:18:10Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4702client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.29 seconds)4703worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4704worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)4705worker2 # [ 77.249866] systemd[1]: Listening on Nix worker-protocol over gRPC.4706worker1 # [ 77.307699] nix-grpc-daemon[774]: ts=2026-09-20T08:18:10Z level=info event=scheduler_connected addr=lb:500514707worker1 # [ 77.320409] nix-grpc-daemon[774]: ts=2026-09-20T08:18:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4708worker1 # [ 77.332496] systemd[1]: Stopping Nix worker-protocol over gRPC...4709lb # [ 77.505610] niks3-server[1040]: 2026/09/20 08:18:11 INFO lead: acquired remote=192.168.1.3:470244710worker1 # [ 77.480624] nix-grpc-daemon[774]: ts=2026-09-20T08:18:11Z level=info event=scheduler_take_over4711worker1 # [ 77.515134] nix-grpc-daemon[774]: ts=2026-09-20T08:18:11Z level=info event=scheduler_connected addr=lb:500514712worker2 # [ 77.545583] systemd[1]: Starting Nix worker-protocol over gRPC...4713worker1 # [ 77.724728] nix-grpc-daemon[774]: ts=2026-09-20T08:18:11Z level=info event=signal_exit4714worker2 # [ 77.765206] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:11Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4715worker2 # [ 77.768603] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:11Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14716worker2 # [ 77.777396] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:11Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4717worker2 # [ 77.779473] systemd[1]: Started Nix worker-protocol over gRPC.4718worker1 # [ 77.782964] nix-grpc-daemon[774]: ts=2026-09-20T08:18:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4719worker2 # [ 77.820358] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:11Z level=info event=scheduler_connected addr=lb:500514720worker1 # [ 77.806753] nix-grpc-daemon[774]: ts=2026-09-20T08:18:11Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04721worker1 # [ 77.970285] nix-grpc-daemon[774]: ts=2026-09-20T08:18:11Z level=info event=scheduler_yield4722lb # [ 77.995159] niks3-server[1040]: 2026/09/20 08:18:11 INFO lead: released remote=192.168.1.3:470244723worker2 # [ 77.994254] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:11Z level=info event=scheduler_restarting addr=lb:500514724worker1 # [ 77.979639] nix-grpc-daemon[774]: ts=2026-09-20T08:18:11Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:455744725worker1 # [ 77.985458] nix-grpc-daemon[774]: ts=2026-09-20T08:18:11Z level=info event=worker_gone addr=192.168.1.4:500514726worker1 # [ 77.990592] nix-grpc-daemon[774]: ts=2026-09-20T08:18:11Z level=info event=scheduler_connected addr=lb:500514727worker1 # [ 77.994595] nix-grpc-daemon[774]: ts=2026-09-20T08:18:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4728worker2 # [ 78.195588] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:11Z level=info event=scheduler_connected addr=lb:500514729worker2 # [ 78.200993] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4730worker1 # [ 78.192500] nix-grpc-daemon[774]: ts=2026-09-20T08:18:11Z level=info event=scheduler_connected addr=lb:500514731worker1 # [ 78.197516] nix-grpc-daemon[774]: ts=2026-09-20T08:18:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4732worker2 # [ 78.401744] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:11Z level=info event=scheduler_connected addr=lb:500514733worker2 # [ 78.407188] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4734worker1 # [ 78.398147] nix-grpc-daemon[774]: ts=2026-09-20T08:18:11Z level=info event=scheduler_connected addr=lb:500514735worker1 # [ 78.403381] nix-grpc-daemon[774]: ts=2026-09-20T08:18:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4736worker2 # [ 78.607945] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:12Z level=info event=scheduler_connected addr=lb:500514737worker2 # [ 78.613374] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4738worker1 # [ 78.604256] nix-grpc-daemon[774]: ts=2026-09-20T08:18:12Z level=info event=scheduler_connected addr=lb:500514739worker1 # [ 78.609346] nix-grpc-daemon[774]: ts=2026-09-20T08:18:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4740worker2 # [ 78.815489] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:12Z level=info event=scheduler_connected addr=lb:500514741worker2 # [ 78.821076] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4742worker1 # [ 78.809854] nix-grpc-daemon[774]: ts=2026-09-20T08:18:12Z level=info event=scheduler_connected addr=lb:500514743worker1 # [ 78.814994] nix-grpc-daemon[774]: ts=2026-09-20T08:18:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4744worker1 # [ 78.975248] nix-grpc-daemon[774]: ts=2026-09-20T08:18:12Z level=info event=scheduler_restarting4745worker2 # [ 79.022061] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:12Z level=info event=scheduler_connected addr=lb:500514746worker1 # [ 79.008543] nix-grpc-daemon[774]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4747worker1 # [ 79.040528] nix-grpc-daemon[774]: E0000 00:00:1789892292.592284 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true4748worker1 # [ 79.049829] nix-grpc-daemon[774]: ts=2026-09-20T08:18:12Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4749worker1 # [ 79.054136] nix-daemon[837]: reaped child process 839, status = succeeded4750worker1 # [ 79.854647] nix-grpc-daemon[774]: E0000 00:00:1789892293.437289 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true4751worker1 # [ 79.861288] nix-grpc-daemon[774]: E0000 00:00:1789892293.437622 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4752lb # [ 80.429231] envoy[910]: conn peer=[2001:db8:1::1]:35794 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3728 tx=1819 ms=20054753lb # [ 80.434215] envoy[910]: conn peer=[2001:db8:1::1]:56664 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=1024754lb # [ 80.439003] envoy[910]: conn peer=[2001:db8:1::4]:48430 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=9171 tx=2582 ms=552614755lb # [ 80.444087] envoy[910]: conn peer=[2001:db8:1::1]:56676 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=314756lb # [ 80.448624] envoy[910]: conn peer=[2001:db8:1::3]:37860 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=11577 tx=3317 ms=582854757worker2 # [ 80.614590] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:14Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4758worker1 # [ 80.618849] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4759worker1 # [ 80.627828] systemd[1]: Stopped Nix worker-protocol over gRPC.4760worker1 # [ 80.631641] systemd[1]: nix-grpc-daemon.service: Consumed 3.577s CPU time over 1min 241ms wall clock time, 59.3M memory peak, 84K incoming IP traffic, 152.2K outgoing IP traffic.4761worker1 # [ 80.647307] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4762worker1 # [ 80.650506] systemd[1]: Closed Nix worker-protocol over gRPC.4763worker1 # [ 80.653746] systemd[1]: nix-grpc-daemon.socket: Consumed 564us CPU time over 1min 8.907s wall clock time, 256K memory peak, 105.5K incoming IP traffic, 86.9K outgoing IP traffic.4764lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4765lb: must succeed: curl -sf localhost:9901/clusters4766lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4767lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4768client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24769worker2 # [ 80.814616] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:14Z level=info event=scheduler_connected addr=lb:500514770worker2 # [ 80.821990] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:14Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4771worker2 # [ 81.023161] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:14Z level=info event=scheduler_connected addr=lb:500514772worker2 # [ 81.033947] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:14Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4773worker2 # [ 81.045732] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:458184774worker2 # [ 81.065801] nix-daemon[863]: accepted connection from pid 1086, user nix-grpc-daemon (trusted)4775worker2 # [ 81.086062] nix-grpc-daemon[1086]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 56 ms (attempt 1/5)4776worker2 # [ 81.149057] nix-grpc-daemon[1086]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 156 ms (attempt 2/5)4777worker2 # [ 81.231566] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:14Z level=info event=scheduler_connected addr=lb:500514778worker2 # [ 81.238608] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:14Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4779worker2 # [ 81.305614] nix-grpc-daemon[1086]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 24 ms (attempt 3/5)4780worker2 # [ 81.337195] nix-grpc-daemon[1086]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 739 ms (attempt 4/5)4781worker2 # [ 81.439631] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:15Z level=info event=scheduler_connected addr=lb:500514782worker2 # [ 81.445009] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:15Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4783worker2 # [ 81.648215] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:15Z level=info event=scheduler_connected addr=lb:500514784worker2 # [ 81.653405] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4785worker2 # [ 81.854260] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:15Z level=info event=scheduler_connected addr=lb:500514786worker2 # [ 81.859611] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:15Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4787worker2 # [ 82.060918] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:15Z level=info event=scheduler_connected addr=lb:500514788worker2 # [ 82.067914] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4789worker2 # [ 82.077072] nix-grpc-daemon[1086]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4790client # copying 2 paths...4791client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...4792worker2 # [ 82.105980] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:458184793client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...4794worker2 # [ 82.127276] nix-daemon[863]: accepted connection from pid 1086, user nix-grpc-daemon (trusted)4795worker2 # [ 82.168721] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:15Z level=info event=niks3_push_started pid=11424796worker2 # [ 82.268885] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:15Z level=info event=scheduler_connected addr=lb:500514797worker2 # [ 82.273060] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:15Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4798worker2 # [ 82.472910] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:16Z level=info event=scheduler_connected addr=lb:500514799worker2 # [ 82.478265] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4800worker2 # [ 82.574839] nix-daemon[863]: accepted connection from pid 1155, user nix-grpc-daemon (trusted)4801worker2 # [ 82.592815] nix-daemon[863]: reaped child process 1158, status = succeeded4802lb # [ 82.618458] niks3-server[1040]: 2026/09/20 08:18:16 INFO Received uploads request method=POST path=/api/pending_closures4803lb # [ 82.627398] niks3-server[1040]: 2026/09/20 08:18:16 INFO Received uploads request method=POST path=/api/pending_closures4804worker2 # [ 82.628433] nix-grpc-daemon[1142]: time=2026-09-20T08:18:16.204Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4805worker2 # [ 82.629945] nix-grpc-daemon[1142]: time=2026-09-20T08:18:16.204Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"4806worker2 # [ 82.631639] nix-grpc-daemon[1142]: time=2026-09-20T08:18:16.205Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"4807lb # [ 82.679383] niks3-server[1040]: 2026/09/20 08:18:16 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst4808worker2 # [ 82.679016] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:16Z level=info event=scheduler_connected addr=lb:500514809worker2 # [ 82.682077] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:16Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4810lb # [ 82.692635] niks3-server[1040]: 2026/09/20 08:18:16 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst4811lb # [ 82.705705] niks3-server[1040]: 2026/09/20 08:18:16 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls4812lb # [ 82.715868] niks3-server[1040]: 2026/09/20 08:18:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4813lb # [ 82.719919] niks3-server[1040]: 2026/09/20 08:18:16 INFO Signed narinfos id=24 count=24814worker2 # [ 82.712115] nix-grpc-daemon[1142]: time=2026-09-20T08:18:16.289Z level=INFO msg="Uploading 3 narinfos"4815lb # [ 82.722351] niks3-server[1040]: 2026/09/20 08:18:16 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls4816lb # [ 82.729015] niks3-server[1040]: 2026/09/20 08:18:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4817lb # [ 82.735004] niks3-server[1040]: 2026/09/20 08:18:16 INFO Signed narinfos id=23 count=14818lb # [ 82.751899] niks3-server[1040]: 2026/09/20 08:18:16 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo4819lb # [ 82.761175] niks3-server[1040]: 2026/09/20 08:18:16 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4820lb # [ 82.763561] niks3-server[1040]: 2026/09/20 08:18:16 INFO Completed upload id=234821worker2 # [ 82.758246] nix-grpc-daemon[1142]: time=2026-09-20T08:18:16.336Z level=INFO msg="Upload complete. (359ms)"4822lb # [ 82.767877] niks3-server[1040]: 2026/09/20 08:18:16 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4823lb # [ 82.776874] niks3-server[1040]: 2026/09/20 08:18:16 INFO Completed upload id=244824lb # [ 82.778926] niks3-server[1040]: 2026/09/20 08:18:16 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4825worker2 # [ 82.772251] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45818 duration_s=0 paths=2 nar_bytes_in=3124826lb # [ 82.798698] niks3-server[1040]: 2026/09/20 08:18:16 INFO lead: acquired remote=192.168.1.4:332784827worker2 # [ 82.789147] nix-grpc-daemon[1142]: time=2026-09-20T08:18:16.346Z level=WARN msg="Failed to register uploaded object" key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo error="server returned 404: object is not pending upload\n"4828worker2 # [ 82.796617] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:16Z level=info event=scheduler_take_over4829worker2 # [ 82.799544] nix-daemon[863]: reaped child process 1140, status = succeeded4830client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 2.05 seconds)4831worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache4832worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.03 seconds)4833worker2 # [ 82.883306] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:16Z level=info event=scheduler_connected addr=lb:500514834worker2 # [ 82.889089] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:16Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04835worker1 # [ 82.918765] systemd[1]: Listening on Nix worker-protocol over gRPC.4836worker1 # [ 82.928607] systemd[1]: Starting Nix worker-protocol over gRPC...4837worker1 # [ 83.129460] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:16Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4838worker1 # [ 83.132141] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:16Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14839worker1 # [ 83.140064] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:16Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4840worker1 # [ 83.148377] systemd[1]: Started Nix worker-protocol over gRPC.4841lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4842lb: must succeed: curl -sf localhost:9901/clusters4843worker1 # [ 83.183900] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:16Z level=info event=scheduler_connected addr=lb:500514844worker2 # [ 83.202245] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:16Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04845lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)4846lb: must succeed: curl -sf localhost:9901/clusters4847lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4848lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.19 seconds)4849(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 12.17 seconds)4850subtest: scheduler down: the other node takes the lock and keeps it4851lb: must succeed: curl -sf localhost:9901/clusters4852lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4853lb: must succeed: curl -sf localhost:9901/clusters4854lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4855lb: must succeed: curl -sf localhost:9901/clusters4856lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4857lb: must succeed: curl -sf localhost:9901/clusters4858lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4859worker2 # [ 84.645406] systemd[1]: Stopping Nix worker-protocol over gRPC...4860worker2 # [ 84.791238] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:18Z level=info event=signal_exit4861worker2 # [ 84.996806] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:18Z level=info event=scheduler_yield4862lb # [ 85.009465] niks3-server[1040]: 2026/09/20 08:18:18 INFO lead: released remote=192.168.1.4:332784863worker1 # [ 84.987907] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:18Z level=info event=scheduler_restarting addr=lb:500514864worker2 # [ 85.006531] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:18Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:388124865worker2 # [ 85.014192] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:18Z level=info event=worker_gone addr=192.168.1.3:500514866worker2 # [ 85.018360] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:18Z level=info event=scheduler_restarting addr=lb:500514867worker2 # [ 85.022442] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:18Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:388124868worker2 # [ 85.026924] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:18Z level=info event=worker_gone addr=192.168.1.4:500514869worker1 # [ 85.187978] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:18Z level=info event=scheduler_connected addr=lb:500514870worker2 # [ 85.213573] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:18Z level=info event=scheduler_connected addr=lb:500514871worker1 # [ 85.199505] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4872worker2 # [ 85.232894] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4873worker1 # [ 85.400620] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:18Z level=info event=scheduler_connected addr=lb:500514874worker1 # [ 85.407711] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4875worker2 # [ 85.433918] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:19Z level=info event=scheduler_connected addr=lb:500514876worker2 # [ 85.441072] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4877worker1 # [ 85.608794] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:19Z level=info event=scheduler_connected addr=lb:500514878worker1 # [ 85.615586] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4879worker2 # [ 85.642156] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:19Z level=info event=scheduler_connected addr=lb:500514880worker2 # [ 85.649985] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4881worker1 # [ 85.816785] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:19Z level=info event=scheduler_connected addr=lb:500514882worker1 # [ 85.823530] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4883worker2 # [ 85.852860] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:19Z level=info event=scheduler_connected addr=lb:500514884worker2 # [ 85.857942] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4885worker2 # [ 86.002046] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:19Z level=info event=scheduler_restarting4886worker2 # [ 86.033157] nix-daemon[863]: reaped child process 1135, status = succeeded4887worker1 # [ 86.025020] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:19Z level=info event=scheduler_connected addr=lb:500514888worker1 # [ 86.031596] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4889worker2 # [ 86.078627] nix-grpc-daemon[1086]: ts=2026-09-20T08:18:19Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4890worker1 # [ 86.232803] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:19Z level=info event=scheduler_connected addr=lb:500514891worker2 # [ 86.251249] nix-grpc-daemon[1086]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4892worker2 # [ 86.255845] nix-grpc-daemon[1086]: E0000 00:00:1789892299.829245 1129 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true4893worker2 # [ 86.943518] nix-grpc-daemon[1086]: E0000 00:00:1789892300.520501 1129 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4894worker2 # [ 86.963608] nix-grpc-daemon[1086]: E0000 00:00:1789892300.541817 1129 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true4895worker1 # [ 87.783984] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:21Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4896worker2 # [ 87.822526] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4897worker2 # [ 87.829262] systemd[1]: Stopped Nix worker-protocol over gRPC.4898worker2 # [ 87.831750] systemd[1]: nix-grpc-daemon.service: Consumed 564ms CPU time over 10.274s wall clock time, 33M memory peak, 20.8K incoming IP traffic, 28K outgoing IP traffic.4899worker2 # [ 87.845202] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4900worker2 # [ 87.847414] systemd[1]: Closed Nix worker-protocol over gRPC.4901worker2 # [ 87.849670] systemd[1]: nix-grpc-daemon.socket: Consumed 801us CPU time over 10.602s wall clock time, 256K memory peak, 31.1K incoming IP traffic, 25.1K outgoing IP traffic.4902worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over4903worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.09 seconds)4904worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4905worker1 # [ 87.983474] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:21Z level=info event=scheduler_connected addr=lb:500514906worker1 # [ 87.988335] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4907worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds)4908lb # [ 88.176474] niks3-server[1040]: 2026/09/20 08:18:21 INFO lead: acquired remote=192.168.1.3:415904909worker1 # [ 88.151874] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:21Z level=info event=scheduler_take_over4910worker1 # [ 88.189464] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:21Z level=info event=scheduler_connected addr=lb:500514911worker1 # [ 88.194783] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:21Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4912worker1 # [ 88.395656] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:21Z level=info event=scheduler_connected addr=lb:500514913worker1 # [ 88.401495] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:21Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04914worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4915worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)4916client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby >&24917worker1 # [ 89.335766] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:555404918worker1 # [ 89.350986] nix-daemon[837]: accepted connection from pid 1173, user nix-grpc-daemon (trusted)4919client # don't know how to build these paths:4920client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4921worker1 # [ 89.380213] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:22Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=04922worker1 # [ 89.386818] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:22Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=14923worker1 # [ 89.432466] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:555404924worker1 # [ 89.454612] nix-grpc-daemon[1173]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 28 ms (attempt 1/5)4925worker1 # [ 89.490269] nix-grpc-daemon[1173]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 163 ms (attempt 2/5)4926worker1 # [ 89.660835] nix-grpc-daemon[1173]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 153 ms (attempt 3/5)4927worker1 # [ 89.821345] nix-grpc-daemon[1173]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 243 ms (attempt 4/5)4928worker1 # [ 90.065391] nix-grpc-daemon[1173]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4929worker1 # [ 90.087452] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:555404930client # copying 1 paths to 'lb:50051'...4931worker1 # [ 90.103401] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:555404932client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...4933worker1 # [ 90.123140] nix-daemon[837]: accepted connection from pid 1173, user nix-grpc-daemon (trusted)4934worker1 # [ 90.152952] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:23Z level=info event=niks3_push_started pid=12474935lb # [ 90.432550] envoy[910]: conn peer=[2001:db8:1::1]:56596 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1006 tx=305 ms=17534936lb # [ 90.432883] envoy[910]: conn peer=[2001:db8:1::4]:56780 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3139 tx=1039 ms=82474937worker1 # [ 90.555600] nix-daemon[837]: accepted connection from pid 1260, user nix-grpc-daemon (trusted)4938worker1 # [ 90.573054] nix-daemon[837]: reaped child process 1263, status = succeeded4939worker1 # [ 90.752570] nix-daemon[837]: accepted connection from pid 1265, user nix-grpc-daemon (trusted)4940worker1 # [ 90.769166] nix-daemon[837]: reaped child process 1268, status = succeeded4941lb # [ 90.810675] niks3-server[1040]: 2026/09/20 08:18:24 INFO Received uploads request method=POST path=/api/pending_closures4942worker1 # [ 90.794263] nix-grpc-daemon[1247]: time=2026-09-20T08:18:24.376Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4943worker1 # [ 90.795767] nix-grpc-daemon[1247]: time=2026-09-20T08:18:24.376Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"4944lb # [ 90.844563] niks3-server[1040]: 2026/09/20 08:18:24 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst4945worker1 # [ 90.840812] nix-grpc-daemon[1247]: time=2026-09-20T08:18:24.424Z level=INFO msg="Uploading 1 narinfos"4946lb # [ 90.858213] niks3-server[1040]: 2026/09/20 08:18:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4947lb # [ 90.873248] niks3-server[1040]: 2026/09/20 08:18:24 INFO Signed narinfos id=25 count=14948lb # [ 90.885983] niks3-server[1040]: 2026/09/20 08:18:24 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4949worker1 # [ 90.871868] nix-grpc-daemon[1247]: time=2026-09-20T08:18:24.455Z level=INFO msg="Upload complete. (493ms)"4950lb # [ 90.900339] niks3-server[1040]: 2026/09/20 08:18:24 INFO Completed upload id=254951worker1 # [ 90.880915] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55540 duration_s=0 paths=1 nar_bytes_in=5204952worker1 # [ 90.898259] nix-grpc-daemon[1247]: time=2026-09-20T08:18:24.470Z level=WARN msg="Failed to register uploaded object" key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls error="server returned 404: object is not pending upload\n"4953worker1 # [ 90.904399] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:555404954worker1 # [ 90.907257] nix-daemon[837]: accepted connection from pid 1173, user nix-grpc-daemon (trusted)4955client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...4956worker1 # [ 90.917249] nix-grpc-daemon[1247]: time=2026-09-20T08:18:24.475Z level=WARN msg="Failed to register uploaded object" key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo error="server returned 404: object is not pending upload\n"4957client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4958worker1 # [ 90.925216] nix-daemon[837]: reaped child process 1245, status = succeeded4959worker1 # [ 90.926646] nix-daemon[837]: accepted connection from pid 1173, user nix-grpc-daemon (trusted)4960client # farm-a> LOG-farm-a-on-standby4961worker1 # [ 91.765104] nix-daemon[837]: reaped child process 1272, status = succeeded4962worker1 # [ 91.956255] nix-daemon[837]: accepted connection from pid 1287, user nix-grpc-daemon (trusted)4963worker1 # [ 91.974213] nix-daemon[837]: reaped child process 1290, status = succeeded4964lb # [ 92.013876] niks3-server[1040]: 2026/09/20 08:18:25 INFO Received uploads request method=POST path=/api/pending_closures4965worker1 # [ 92.004544] nix-grpc-daemon[1247]: time=2026-09-20T08:18:25.586Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4966worker1 # [ 92.006182] nix-grpc-daemon[1247]: time=2026-09-20T08:18:25.586Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"4967lb # [ 92.084324] niks3-server[1040]: 2026/09/20 08:18:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4968worker1 # [ 92.068357] nix-grpc-daemon[1247]: time=2026-09-20T08:18:25.652Z level=INFO msg="Uploading 1 narinfos"4969lb # [ 92.094907] niks3-server[1040]: 2026/09/20 08:18:25 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst4970lb # [ 92.103311] niks3-server[1040]: 2026/09/20 08:18:25 INFO Signed narinfos id=26 count=14971lb # [ 92.108091] niks3-server[1040]: 2026/09/20 08:18:25 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4972lb # [ 92.117336] niks3-server[1040]: 2026/09/20 08:18:25 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls4973worker1 # [ 92.092582] nix-grpc-daemon[1247]: time=2026-09-20T08:18:25.676Z level=INFO msg="Upload complete. (356ms)"4974lb # [ 92.121378] niks3-server[1040]: 2026/09/20 08:18:25 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4975lb # [ 92.126074] niks3-server[1040]: 2026/09/20 08:18:25 INFO Completed upload id=264976lb # [ 92.128939] niks3-server[1040]: 2026/09/20 08:18:25 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo4977worker1 # [ 92.120348] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55540 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=14978worker1 # [ 92.131760] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:25Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=04979worker1 # [ 92.135748] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:25Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=14980worker1 # [ 92.140146] nix-daemon[837]: reaped child process 1270, status = succeeded4981worker1 # [ 92.165391] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:555404982worker1 # [ 92.181281] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:555404983worker1 # [ 92.196989] nix-grpc-daemon[1247]: time=2026-09-20T08:18:25.780Z level=INFO msg="All 1 paths already cached"4984client # copying 1 paths to 'lb:50051'...4985client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...4986worker1 # [ 92.206070] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:555404987worker1 # [ 92.224253] nix-daemon[837]: accepted connection from pid 1173, user nix-grpc-daemon (trusted)4988worker1 # [ 92.431201] nix-daemon[837]: accepted connection from pid 1296, user nix-grpc-daemon (trusted)4989worker1 # [ 92.449053] nix-daemon[837]: reaped child process 1299, status = succeeded4990worker1 # [ 92.628042] nix-daemon[837]: accepted connection from pid 1301, user nix-grpc-daemon (trusted)4991worker1 # [ 92.645808] nix-daemon[837]: reaped child process 1304, status = succeeded4992lb # [ 92.684451] niks3-server[1040]: 2026/09/20 08:18:26 INFO Received uploads request method=POST path=/api/pending_closures4993worker1 # [ 92.669580] nix-grpc-daemon[1247]: time=2026-09-20T08:18:26.253Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4994worker1 # [ 92.671078] nix-grpc-daemon[1247]: time=2026-09-20T08:18:26.253Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"4995lb # [ 92.718646] niks3-server[1040]: 2026/09/20 08:18:26 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst4996worker1 # [ 92.707006] nix-grpc-daemon[1247]: time=2026-09-20T08:18:26.290Z level=INFO msg="Uploading 1 narinfos"4997lb # [ 92.733178] niks3-server[1040]: 2026/09/20 08:18:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign4998lb # [ 92.742192] niks3-server[1040]: 2026/09/20 08:18:26 INFO Signed narinfos id=27 count=14999worker1 # [ 92.725808] nix-grpc-daemon[1247]: time=2026-09-20T08:18:26.309Z level=INFO msg="Upload complete. (484ms)"5000lb # [ 92.751343] niks3-server[1040]: 2026/09/20 08:18:26 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls5001lb # [ 92.755895] niks3-server[1040]: 2026/09/20 08:18:26 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5002worker1 # [ 92.732186] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55540 duration_s=0 paths=1 nar_bytes_in=6405003lb # [ 92.760001] niks3-server[1040]: 2026/09/20 08:18:26 INFO Completed upload id=275004lb # [ 92.761967] niks3-server[1040]: 2026/09/20 08:18:26 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo5005worker1 # [ 92.740627] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:555405006worker1 # [ 92.750835] nix-daemon[837]: accepted connection from pid 1173, user nix-grpc-daemon (trusted)5007worker1 # [ 92.755222] nix-daemon[837]: reaped child process 1294, status = succeeded5008client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...5009worker1 # [ 92.766137] nix-daemon[837]: accepted connection from pid 1173, user nix-grpc-daemon (trusted)5010client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5011client # farm-b> LOG-farm-b-on-standby5012worker1 # [ 93.609308] nix-daemon[837]: reaped child process 1308, status = succeeded5013worker1 # [ 93.795002] nix-daemon[837]: accepted connection from pid 1323, user nix-grpc-daemon (trusted)5014worker1 # [ 93.814629] nix-daemon[837]: reaped child process 1326, status = succeeded5015lb # [ 93.852683] niks3-server[1040]: 2026/09/20 08:18:27 INFO Received uploads request method=POST path=/api/pending_closures5016worker1 # [ 93.843426] nix-grpc-daemon[1247]: time=2026-09-20T08:18:27.426Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5017worker1 # [ 93.845241] nix-grpc-daemon[1247]: time=2026-09-20T08:18:27.426Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"5018lb # [ 93.888531] niks3-server[1040]: 2026/09/20 08:18:27 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5019lb # [ 93.901076] niks3-server[1040]: 2026/09/20 08:18:27 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst5020lb # [ 93.915041] niks3-server[1040]: 2026/09/20 08:18:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5021worker1 # [ 93.895647] nix-grpc-daemon[1247]: time=2026-09-20T08:18:27.479Z level=INFO msg="Uploading 1 narinfos"5022lb # [ 93.926009] niks3-server[1040]: 2026/09/20 08:18:27 INFO Signed narinfos id=28 count=15023lb # [ 93.931548] niks3-server[1040]: 2026/09/20 08:18:27 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls5024lb # [ 93.939550] niks3-server[1040]: 2026/09/20 08:18:27 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5025lb # [ 93.950046] niks3-server[1040]: 2026/09/20 08:18:27 INFO Completed upload id=285026worker1 # [ 93.925343] nix-grpc-daemon[1247]: time=2026-09-20T08:18:27.509Z level=INFO msg="Upload complete. (346ms)"5027lb # [ 93.952849] niks3-server[1040]: 2026/09/20 08:18:27 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo5028worker1 # [ 93.944971] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55540 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=15029worker1 # [ 93.960273] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:27Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=05030worker1 # [ 93.963937] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:27Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=15031worker1 # [ 93.968754] nix-daemon[837]: reaped child process 1306, status = succeeded5032worker1 # [ 93.988966] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:555405033worker1 # [ 94.004720] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:555405034worker1 # [ 94.018796] nix-grpc-daemon[1247]: time=2026-09-20T08:18:27.602Z level=INFO msg="All 2 paths already cached"5035client # copying 1 paths to 'lb:50051'...5036client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...5037worker1 # [ 94.029619] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:555405038worker1 # [ 94.045454] nix-daemon[837]: accepted connection from pid 1173, user nix-grpc-daemon (trusted)5039worker1 # [ 94.249265] nix-daemon[837]: accepted connection from pid 1332, user nix-grpc-daemon (trusted)5040worker1 # [ 94.268227] nix-daemon[837]: reaped child process 1335, status = succeeded5041worker1 # [ 94.441562] nix-daemon[837]: accepted connection from pid 1337, user nix-grpc-daemon (trusted)5042worker1 # [ 94.460111] nix-daemon[837]: reaped child process 1340, status = succeeded5043lb # [ 94.499234] niks3-server[1040]: 2026/09/20 08:18:28 INFO Received uploads request method=POST path=/api/pending_closures5044worker1 # [ 94.483411] nix-grpc-daemon[1247]: time=2026-09-20T08:18:28.067Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5045worker1 # [ 94.485029] nix-grpc-daemon[1247]: time=2026-09-20T08:18:28.067Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"5046lb # [ 94.531023] niks3-server[1040]: 2026/09/20 08:18:28 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst5047lb # [ 94.544742] niks3-server[1040]: 2026/09/20 08:18:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5048worker1 # [ 94.528453] nix-grpc-daemon[1247]: time=2026-09-20T08:18:28.112Z level=INFO msg="Uploading 1 narinfos"5049lb # [ 94.553233] niks3-server[1040]: 2026/09/20 08:18:28 INFO Signed narinfos id=29 count=15050lb # [ 94.563443] niks3-server[1040]: 2026/09/20 08:18:28 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls5051lb # [ 94.572621] niks3-server[1040]: 2026/09/20 08:18:28 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5052lb # [ 94.580818] niks3-server[1040]: 2026/09/20 08:18:28 INFO Completed upload id=295053worker1 # [ 94.555952] nix-grpc-daemon[1247]: time=2026-09-20T08:18:28.140Z level=INFO msg="Upload complete. (493ms)"5054lb # [ 94.584043] niks3-server[1040]: 2026/09/20 08:18:28 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo5055worker1 # [ 94.564156] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55540 duration_s=0 paths=1 nar_bytes_in=7685056worker1 # [ 94.579642] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:555405057worker1 # [ 94.586448] nix-daemon[837]: accepted connection from pid 1173, user nix-grpc-daemon (trusted)5058worker1 # [ 94.591234] nix-daemon[837]: reaped child process 1330, status = succeeded5059client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...5060client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5061worker1 # [ 94.605444] nix-daemon[837]: accepted connection from pid 1173, user nix-grpc-daemon (trusted)5062client # farm-top> LOG-farm-top-on-standby5063worker1 # [ 95.656444] nix-daemon[837]: reaped child process 1344, status = succeeded5064worker1 # [ 95.837504] nix-daemon[837]: accepted connection from pid 1359, user nix-grpc-daemon (trusted)5065worker1 # [ 95.857273] nix-daemon[837]: reaped child process 1362, status = succeeded5066lb # [ 95.897513] niks3-server[1040]: 2026/09/20 08:18:29 INFO Received uploads request method=POST path=/api/pending_closures5067worker1 # [ 95.883987] nix-grpc-daemon[1247]: time=2026-09-20T08:18:29.466Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5068worker1 # [ 95.885655] nix-grpc-daemon[1247]: time=2026-09-20T08:18:29.466Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"5069lb # [ 95.930438] niks3-server[1040]: 2026/09/20 08:18:29 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5070lb # [ 95.943445] niks3-server[1040]: 2026/09/20 08:18:29 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst5071lb # [ 95.957984] niks3-server[1040]: 2026/09/20 08:18:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5072worker1 # [ 95.938573] nix-grpc-daemon[1247]: time=2026-09-20T08:18:29.522Z level=INFO msg="Uploading 1 narinfos"5073lb # [ 95.969122] niks3-server[1040]: 2026/09/20 08:18:29 INFO Signed narinfos id=30 count=15074lb # [ 95.974746] niks3-server[1040]: 2026/09/20 08:18:29 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls5075lb # [ 95.983270] niks3-server[1040]: 2026/09/20 08:18:29 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5076lb # [ 95.989854] niks3-server[1040]: 2026/09/20 08:18:29 INFO Completed upload id=305077worker1 # [ 95.964475] nix-grpc-daemon[1247]: time=2026-09-20T08:18:29.548Z level=INFO msg="Upload complete. (347ms)"5078lb # [ 95.992950] niks3-server[1040]: 2026/09/20 08:18:29 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo5079worker1 # [ 95.975950] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55540 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=15080worker1 # [ 95.994669] nix-daemon[837]: reaped child process 1342, status = succeeded5081client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby >&2, in 6.95 seconds)5082client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby outPath5083client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby outPath, in 0.24 seconds)5084worker2 # [ 96.368950] systemd[1]: Listening on Nix worker-protocol over gRPC.5085worker2 # [ 96.377038] systemd[1]: Starting Nix worker-protocol over gRPC...5086worker2 # [ 96.579710] nix-grpc-daemon[1179]: ts=2026-09-20T08:18:30Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5087worker2 # [ 96.582297] nix-grpc-daemon[1179]: ts=2026-09-20T08:18:30Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15088worker2 # [ 96.590003] nix-grpc-daemon[1179]: ts=2026-09-20T08:18:30Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5089worker2 # [ 96.591788] systemd[1]: Started Nix worker-protocol over gRPC.5090lb: must succeed: curl -sf localhost:9901/clusters5091worker2 # [ 96.636408] nix-grpc-daemon[1179]: ts=2026-09-20T08:18:30Z level=info event=scheduler_connected addr=lb:500515092worker1 # [ 96.622764] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:30Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05093lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)5094worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5095worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5096lb: must succeed: curl -sf localhost:9901/clusters5097lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5098lb: must succeed: curl -sf localhost:9901/clusters5099lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5100worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5101worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5102(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.67 seconds)5103subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5104client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs5105client # [ 97.155165] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.5106client # Running as unit: rs.service; invocation ID: d300c133fddd4c38beae19d21650313e5107client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.09 seconds)5108worker1 # [ 97.334229] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:555405109client # [ 97.408457] nix[1147]: don't know how to build these paths:5110client # [ 97.410124] nix[1147]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5111worker1 # [ 97.351970] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:30Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=05112worker1 # [ 97.358993] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:30Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=15113worker1 # [ 97.400175] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:555405114worker1 # [ 97.416806] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:555405115client # [ 97.496165] nix[1147]: copying 1 paths to 'lb:50051'...5116worker1 # [ 97.431064] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:555405117client # [ 97.500853] nix[1147]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...5118worker1 # [ 97.449623] nix-daemon[837]: accepted connection from pid 1173, user nix-grpc-daemon (trusted)5119worker1 # [ 97.656265] nix-daemon[837]: accepted connection from pid 1377, user nix-grpc-daemon (trusted)5120worker1 # [ 97.676557] nix-daemon[837]: reaped child process 1380, status = succeeded5121worker1 # [ 97.852105] nix-daemon[837]: accepted connection from pid 1382, user nix-grpc-daemon (trusted)5122worker1 # [ 97.869032] nix-daemon[837]: reaped child process 1385, status = succeeded5123lb # [ 97.908792] niks3-server[1040]: 2026/09/20 08:18:31 INFO Received uploads request method=POST path=/api/pending_closures5124worker1 # [ 97.896156] nix-grpc-daemon[1247]: time=2026-09-20T08:18:31.479Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5125worker1 # [ 97.897620] nix-grpc-daemon[1247]: time=2026-09-20T08:18:31.479Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"5126lb # [ 97.942287] niks3-server[1040]: 2026/09/20 08:18:31 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst5127lb # [ 97.957847] niks3-server[1040]: 2026/09/20 08:18:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5128worker1 # [ 97.938467] nix-grpc-daemon[1247]: time=2026-09-20T08:18:31.522Z level=INFO msg="Uploading 1 narinfos"5129lb # [ 97.969814] niks3-server[1040]: 2026/09/20 08:18:31 INFO Signed narinfos id=31 count=15130lb # [ 97.977220] niks3-server[1040]: 2026/09/20 08:18:31 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls5131lb # [ 97.989993] niks3-server[1040]: 2026/09/20 08:18:31 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5132lb # [ 97.996069] niks3-server[1040]: 2026/09/20 08:18:31 INFO Completed upload id=315133worker1 # [ 97.970613] nix-grpc-daemon[1247]: time=2026-09-20T08:18:31.554Z level=INFO msg="Upload complete. (504ms)"5134lb # [ 98.000395] niks3-server[1040]: 2026/09/20 08:18:31 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5135worker1 # [ 97.981088] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55540 duration_s=0 paths=1 nar_bytes_in=4165136worker1 # [ 97.994036] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:555405137worker1 # [ 98.000537] nix-daemon[837]: accepted connection from pid 1173, user nix-grpc-daemon (trusted)5138worker1 # [ 98.005895] nix-daemon[837]: reaped child process 1375, status = succeeded5139client # [ 98.082898] nix[1147]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5140worker1 # [ 98.019948] nix-daemon[837]: accepted connection from pid 1173, user nix-grpc-daemon (trusted)5141lb: must succeed: curl -sf localhost:9901/clusters5142lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5143lb: must succeed: curl -sf localhost:9901/clusters5144lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5145lb: must succeed: curl -sf localhost:9901/clusters5146lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5147lb: must succeed: curl -sf localhost:9901/clusters5148lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5149worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5150worker2 # [ 100.077316] systemd-journald[277]: Received client request to rotate journal, rotating.5151worker2 # [ 100.096584] systemd-journald[277]: Vacuuming done, freed 0B of archived journals from /var/log/journal/8b4b6710d4a84363a81b2ac520d3ead3.5152worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.09 seconds)5153worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5154worker1 # [ 100.134246] systemd[1]: Stopping Nix worker-protocol over gRPC...5155worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds)5156client: must succeed: sleep 5.05157worker1 # [ 100.159680] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:33Z level=info event=draining5158lb # [ 100.429060] envoy[910]: conn peer=[2001:db8:1::1]:56606 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9467 tx=3825 ms=66615159client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5160worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5161worker1 # [ 105.682406] nix-daemon[837]: reaped child process 1389, status = succeeded5162worker1 # [ 105.860603] nix-daemon[837]: accepted connection from pid 1429, user nix-grpc-daemon (trusted)5163worker1 # [ 105.881385] nix-daemon[837]: reaped child process 1432, status = succeeded5164lb # [ 105.918615] niks3-server[1040]: 2026/09/20 08:18:39 INFO Received uploads request method=POST path=/api/pending_closures5165worker1 # [ 105.904456] nix-grpc-daemon[1247]: time=2026-09-20T08:18:39.487Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5166worker1 # [ 105.906041] nix-grpc-daemon[1247]: time=2026-09-20T08:18:39.487Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5167lb # [ 105.964302] niks3-server[1040]: 2026/09/20 08:18:39 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5168lb # [ 105.976816] niks3-server[1040]: 2026/09/20 08:18:39 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5169worker1 # [ 105.960937] nix-grpc-daemon[1247]: time=2026-09-20T08:18:39.544Z level=INFO msg="Uploading 1 narinfos"5170lb # [ 105.988474] niks3-server[1040]: 2026/09/20 08:18:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5171lb # [ 105.991720] niks3-server[1040]: 2026/09/20 08:18:39 INFO Signed narinfos id=32 count=15172lb # [ 106.001398] niks3-server[1040]: 2026/09/20 08:18:39 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5173lb # [ 106.009353] niks3-server[1040]: 2026/09/20 08:18:39 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5174worker1 # [ 105.984487] nix-grpc-daemon[1247]: time=2026-09-20T08:18:39.568Z level=INFO msg="Upload complete. (347ms)"5175lb # [ 106.012780] niks3-server[1040]: 2026/09/20 08:18:39 INFO Completed upload id=325176lb # [ 106.014451] niks3-server[1040]: 2026/09/20 08:18:39 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5177worker1 # [ 106.001230] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55540 duration_s=8 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15178worker1 # [ 106.016352] nix-daemon[837]: reaped child process 1387, status = succeeded5179client # [ 106.107882] systemd[1]: rs.service: Deactivated successfully.5180client # [ 106.113344] systemd[1]: rs.service: Consumed 165ms CPU time over 8.956s wall clock time, 37M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.5181worker1 # [ 106.161450] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:39Z level=info event=signal_exit5182worker1 # [ 106.373980] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:39Z level=info event=scheduler_yield5183lb # [ 106.406652] niks3-server[1040]: 2026/09/20 08:18:39 INFO lead: released remote=192.168.1.3:415905184worker1 # [ 106.387275] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:39Z level=info event=scheduler_restarting addr=lb:500515185worker2 # [ 106.404920] nix-grpc-daemon[1179]: ts=2026-09-20T08:18:39Z level=info event=scheduler_restarting addr=lb:500515186worker1 # [ 106.392967] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:39Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:555305187worker1 # [ 106.397495] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:39Z level=info event=worker_gone addr=192.168.1.4:500515188worker1 # [ 106.401464] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:39Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:555305189worker1 # [ 106.405894] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:39Z level=info event=worker_gone addr=192.168.1.3:500515190lb # [ 106.610331] niks3-server[1040]: 2026/09/20 08:18:40 INFO lead: acquired remote=192.168.1.4:497185191worker1 # [ 106.588500] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:40Z level=info event=scheduler_connected addr=lb:500515192worker2 # [ 106.606323] nix-grpc-daemon[1179]: ts=2026-09-20T08:18:40Z level=info event=scheduler_connected addr=lb:500515193worker2 # [ 106.613381] nix-grpc-daemon[1179]: ts=2026-09-20T08:18:40Z level=info event=scheduler_take_over5194worker1 # [ 106.596556] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5195worker2 # [ 106.617825] nix-grpc-daemon[1179]: ts=2026-09-20T08:18:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5196worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 1.14 seconds)5197client: waiting for success: ! systemctl is-active rs5198client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds)5199client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5200client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds)5201client: must fail: journalctl -u rs | grep -q 'reconnecting'5202client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5203lb: must succeed: curl -sf localhost:9901/clusters5204worker1 # [ 106.797783] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:40Z level=info event=scheduler_connected addr=lb:500515205worker2 # [ 106.813851] nix-grpc-daemon[1179]: ts=2026-09-20T08:18:40Z level=info event=scheduler_connected addr=lb:500515206worker2 # [ 106.824175] nix-grpc-daemon[1179]: ts=2026-09-20T08:18:40Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=0 running=05207worker2 # [ 106.837091] nix-grpc-daemon[1179]: ts=2026-09-20T08:18:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5208lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5209worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5210worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5211worker2 # [ 107.038277] nix-grpc-daemon[1179]: ts=2026-09-20T08:18:40Z level=info event=scheduler_connected addr=lb:500515212worker2 # [ 107.044643] nix-grpc-daemon[1179]: ts=2026-09-20T08:18:40Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05213worker2 # [ 107.401219] nix-grpc-daemon[1179]: ts=2026-09-20T08:18:40Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:564905214worker2 # [ 107.407164] nix-grpc-daemon[1179]: ts=2026-09-20T08:18:40Z level=info event=worker_gone addr=192.168.1.3:500515215worker1 # [ 107.399069] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:40Z level=info event=scheduler_restarting5216worker1 # [ 107.415776] nix-grpc-daemon[1173]: ts=2026-09-20T08:18:40Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5217worker1 # [ 107.443244] nix-daemon[837]: reaped child process 1238, status = succeeded5218worker1 # [ 107.655672] nix-grpc-daemon[1173]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5219worker1 # [ 107.660775] nix-grpc-daemon[1173]: E0000 00:00:1789892321.239343 1216 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5220worker1 # [ 107.685254] nix-grpc-daemon[1173]: E0000 00:00:1789892321.269086 1216 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5221lb: must succeed: curl -sf localhost:9901/clusters5222lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5223worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5224worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5225worker1 # [ 108.834206] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5226worker1 # [ 108.840475] systemd[1]: Stopped Nix worker-protocol over gRPC.5227worker1 # [ 108.843130] systemd[1]: nix-grpc-daemon.service: Consumed 1.900s CPU time over 25.910s wall clock time, 36.8M memory peak, 45.7K incoming IP traffic, 87.3K outgoing IP traffic.5228worker1 # [ 108.865691] systemd[1]: Starting Nix worker-protocol over gRPC...5229worker1 # [ 109.066117] nix-grpc-daemon[1439]: ts=2026-09-20T08:18:42Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5230worker1 # [ 109.069314] nix-grpc-daemon[1439]: ts=2026-09-20T08:18:42Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15231worker1 # [ 109.078192] nix-grpc-daemon[1439]: ts=2026-09-20T08:18:42Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5232worker1 # [ 109.079990] systemd[1]: Started Nix worker-protocol over gRPC.5233worker1 # [ 109.114272] nix-grpc-daemon[1439]: ts=2026-09-20T08:18:42Z level=info event=scheduler_connected addr=lb:500515234worker2 # [ 109.133465] nix-grpc-daemon[1179]: ts=2026-09-20T08:18:42Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05235lb: must succeed: curl -sf localhost:9901/clusters5236lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5237worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5238worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5239(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.30 seconds)5240subtest: scheduler restart mid-build: build finishes, no double build5241client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5242client # [ 109.449962] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5243client # Running as unit: mid.service; invocation ID: cd9f5cf697c142b28c201b558cc98dda5244client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.10 seconds)5245worker2 # [ 109.640126] nix-grpc-daemon[1179]: ts=2026-09-20T08:18:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:564945246worker2 # [ 109.655582] nix-daemon[863]: accepted connection from pid 1179, user nix-grpc-daemon (trusted)5247client # [ 109.723827] nix[1183]: don't know how to build these paths:5248client # [ 109.725088] nix[1183]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5249worker2 # [ 109.685972] nix-grpc-daemon[1179]: ts=2026-09-20T08:18:43Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05250worker2 # [ 109.692793] nix-grpc-daemon[1179]: ts=2026-09-20T08:18:43Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=15251worker2 # [ 109.740120] nix-grpc-daemon[1179]: ts=2026-09-20T08:18:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:564945252worker2 # [ 109.757401] nix-grpc-daemon[1179]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 81 ms (attempt 1/5)5253worker2 # [ 109.846251] nix-grpc-daemon[1179]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 103 ms (attempt 2/5)5254worker2 # [ 109.949973] nix-grpc-daemon[1179]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 256 ms (attempt 3/5)5255worker2 # [ 110.215588] nix-grpc-daemon[1179]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 448 ms (attempt 4/5)5256lb # [ 110.434507] envoy[910]: conn peer=[2001:db8:1::1]:48788 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2966 tx=1349 ms=86795257lb # [ 110.439699] envoy[910]: conn peer=[2001:db8:1::3]:57312 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2827 tx=1021 ms=242135258worker2 # [ 110.663090] nix-grpc-daemon[1179]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5259worker2 # [ 110.691305] nix-grpc-daemon[1179]: ts=2026-09-20T08:18:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:564945260client # [ 110.758902] nix[1183]: copying 1 paths to 'lb:50051'...5261client # [ 110.766391] nix[1183]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5262worker2 # [ 110.715449] nix-grpc-daemon[1179]: ts=2026-09-20T08:18:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:564945263worker2 # [ 110.734987] nix-daemon[863]: accepted connection from pid 1179, user nix-grpc-daemon (trusted)5264worker2 # [ 110.776123] nix-grpc-daemon[1179]: ts=2026-09-20T08:18:44Z level=info event=niks3_push_started pid=13055265worker2 # [ 111.245913] nix-daemon[863]: accepted connection from pid 1319, user nix-grpc-daemon (trusted)5266worker2 # [ 111.266505] nix-daemon[863]: reaped child process 1322, status = succeeded5267worker2 # [ 111.475561] nix-daemon[863]: accepted connection from pid 1324, user nix-grpc-daemon (trusted)5268worker2 # [ 111.495438] nix-daemon[863]: reaped child process 1327, status = succeeded5269lb # [ 111.522210] niks3-server[1040]: 2026/09/20 08:18:45 INFO Received uploads request method=POST path=/api/pending_closures5270worker2 # [ 111.529271] nix-grpc-daemon[1305]: time=2026-09-20T08:18:45.104Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5271worker2 # [ 111.530767] nix-grpc-daemon[1305]: time=2026-09-20T08:18:45.104Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5272lb # [ 111.579161] niks3-server[1040]: 2026/09/20 08:18:45 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5273worker2 # [ 111.583750] nix-grpc-daemon[1305]: time=2026-09-20T08:18:45.161Z level=INFO msg="Uploading 1 narinfos"5274lb # [ 111.597598] niks3-server[1040]: 2026/09/20 08:18:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5275lb # [ 111.606758] niks3-server[1040]: 2026/09/20 08:18:45 INFO Signed narinfos id=33 count=15276lb # [ 111.613911] niks3-server[1040]: 2026/09/20 08:18:45 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5277lb # [ 111.623488] niks3-server[1040]: 2026/09/20 08:18:45 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5278lb # [ 111.630942] niks3-server[1040]: 2026/09/20 08:18:45 INFO Completed upload id=335279worker2 # [ 111.621486] nix-grpc-daemon[1305]: time=2026-09-20T08:18:45.199Z level=INFO msg="Upload complete. (581ms)"5280lb # [ 111.633712] niks3-server[1040]: 2026/09/20 08:18:45 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo5281worker2 # [ 111.635409] nix-grpc-daemon[1179]: ts=2026-09-20T08:18:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56494 duration_s=0 paths=1 nar_bytes_in=4245282worker2 # [ 111.652805] nix-grpc-daemon[1179]: ts=2026-09-20T08:18:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:564945283worker2 # [ 111.668749] nix-daemon[863]: accepted connection from pid 1179, user nix-grpc-daemon (trusted)5284worker2 # [ 111.675793] nix-daemon[863]: reaped child process 1303, status = succeeded5285worker2 # [ 111.691600] nix-daemon[863]: accepted connection from pid 1179, user nix-grpc-daemon (trusted)5286client # [ 111.741553] nix[1183]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5287lb: must succeed: curl -sf localhost:9901/clusters5288lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)5289lb: must succeed: curl -sf localhost:9901/clusters5290lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5291worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5292worker2 # [ 113.702169] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1179 (nix-grpc-daemon) on client request.5293worker2 # [ 113.703823] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5294worker1 # [ 113.705167] nix-grpc-daemon[1439]: ts=2026-09-20T08:18:47Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5295client # [ 113.774408] nix[1183]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5296worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.09 seconds)5297client: must succeed: sleep 5.05298client # [ 113.780820] nix[1183]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5299worker2 # [ 113.749199] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5300worker2 # [ 113.750740] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5301worker2 # [ 113.758483] systemd[1]: nix-grpc-daemon.service: Consumed 655ms CPU time over 17.367s wall clock time, 33.8M memory peak, 13.8K incoming IP traffic, 25.5K outgoing IP traffic.5302worker2 # [ 113.766856] nix-daemon[863]: reaped child process 1293, status = succeeded5303worker2 # [ 113.768112] nix-daemon[863]: reaped child process 1329, status = succeeded5304worker2 # [ 113.776671] nix-daemon[1331]: unexpected Nix daemon error: error: interrupted by the user5305worker2 # [ 113.782845] nix-daemon[863]: reaped child process 1331, status = failed with exit code 15306worker2 # [ 113.901494] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5307worker2 # [ 113.913343] systemd[1]: Starting Nix worker-protocol over gRPC...5308worker1 # [ 113.904911] nix-grpc-daemon[1439]: ts=2026-09-20T08:18:47Z level=info event=scheduler_connected addr=lb:500515309lb # [ 113.727871] niks3-server[1040]: 2026/09/20 08:18:47 INFO lead: released remote=192.168.1.4:497185310lb # [ 114.116821] niks3-server[1040]: 2026/09/20 08:18:47 INFO lead: acquired remote=192.168.1.3:441905311worker1 # [ 114.096561] nix-grpc-daemon[1439]: ts=2026-09-20T08:18:47Z level=info event=scheduler_take_over5312worker2 # [ 114.122934] nix-grpc-daemon[1367]: ts=2026-09-20T08:18:47Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5313worker2 # [ 114.125413] nix-grpc-daemon[1367]: ts=2026-09-20T08:18:47Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15314worker2 # [ 114.132926] nix-grpc-daemon[1367]: ts=2026-09-20T08:18:47Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5315worker2 # [ 114.134633] systemd[1]: Started Nix worker-protocol over gRPC.5316worker1 # [ 114.143884] nix-grpc-daemon[1439]: ts=2026-09-20T08:18:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5317worker2 # [ 114.178425] nix-grpc-daemon[1367]: ts=2026-09-20T08:18:47Z level=info event=scheduler_connected addr=lb:500515318worker1 # [ 114.178084] nix-grpc-daemon[1439]: ts=2026-09-20T08:18:47Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05319client # [ 114.278091] nix[1183]: scheduler at lb:50051: scheduler passive, another node serves, reconnecting5320worker1 # [ 114.344936] nix-grpc-daemon[1439]: ts=2026-09-20T08:18:47Z level=info event=scheduler_connected addr=lb:500515321worker1 # [ 114.351048] nix-grpc-daemon[1439]: ts=2026-09-20T08:18:47Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05322client # [ 115.284383] nix[1183]: scheduler at lb:50051: scheduler passive, another node serves, reconnecting5323worker1 # [ 117.230525] nix-grpc-daemon[1439]: ts=2026-09-20T08:18:50Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05324worker1 # [ 117.236655] nix-grpc-daemon[1439]: ts=2026-09-20T08:18:50Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=15325worker2 # [ 117.297247] nix-grpc-daemon[1367]: ts=2026-09-20T08:18:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:351025326worker2 # [ 117.313627] nix-daemon[863]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)5327worker2 # [ 117.336935] nix-daemon[863]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)5328client # [ 117.405129] nix[1183]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5329worker2 # [ 117.355790] nix-daemon[863]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)5330client: (finished: must succeed: sleep 5.0, in 5.08 seconds)5331client: waiting for success: ! systemctl is-active mid5332worker2 # [ 119.179284] nix-grpc-daemon[1367]: ts=2026-09-20T08:18:52Z level=info event=niks3_push_started pid=14445333worker2 # [ 119.201264] nix-daemon[863]: reaped child process 1420, status = succeeded5334worker2 # [ 119.553544] nix-daemon[863]: accepted connection from pid 1457, user nix-grpc-daemon (trusted)5335worker2 # [ 119.571195] nix-daemon[863]: reaped child process 1460, status = succeeded5336lb # [ 119.593714] niks3-server[1040]: 2026/09/20 08:18:53 INFO Received uploads request method=POST path=/api/pending_closures5337worker2 # [ 119.596391] nix-grpc-daemon[1444]: time=2026-09-20T08:18:53.172Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5338worker2 # [ 119.597846] nix-grpc-daemon[1444]: time=2026-09-20T08:18:53.172Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5339lb # [ 119.644164] niks3-server[1040]: 2026/09/20 08:18:53 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5340lb # [ 119.655863] niks3-server[1040]: 2026/09/20 08:18:53 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5341lb # [ 119.664641] niks3-server[1040]: 2026/09/20 08:18:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5342worker2 # [ 119.662836] nix-grpc-daemon[1444]: time=2026-09-20T08:18:53.239Z level=INFO msg="Uploading 1 narinfos"5343lb # [ 119.676077] niks3-server[1040]: 2026/09/20 08:18:53 INFO Signed narinfos id=34 count=15344lb # [ 119.694229] niks3-server[1040]: 2026/09/20 08:18:53 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5345worker2 # [ 119.693171] nix-grpc-daemon[1444]: time=2026-09-20T08:18:53.271Z level=INFO msg="Upload complete. (311ms)"5346lb # [ 119.704948] niks3-server[1040]: 2026/09/20 08:18:53 INFO Completed upload id=345347worker2 # [ 119.704361] nix-grpc-daemon[1367]: ts=2026-09-20T08:18:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35102 duration_s=2 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15348lb # [ 119.725478] niks3-server[1040]: 2026/09/20 08:18:53 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls5349worker2 # [ 119.720351] nix-grpc-daemon[1444]: time=2026-09-20T08:18:53.294Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo error="server returned 404: object is not pending upload\n"5350worker2 # [ 119.729597] nix-daemon[863]: reaped child process 1418, status = succeeded5351client # [ 119.804886] systemd[1]: mid.service: Deactivated successfully.5352client # [ 119.809392] systemd[1]: mid.service: Consumed 180ms CPU time over 10.358s wall clock time, 39.2M memory peak, 10.1K incoming IP traffic, 11.4K outgoing IP traffic.5353client: (finished: waiting for success: ! systemctl is-active mid, in 1.15 seconds)5354client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5355client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds)5356(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 11.00 seconds)5357subtest: interrupting the client stops the build on the worker5358client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5359client # [ 120.420545] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5360client # Running as unit: intr.service; invocation ID: c744a813508c4040bfa71225ee95d4eb5361client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds)5362lb # [ 120.431062] envoy[910]: conn peer=[2001:db8:1::4]:42710 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=916 tx=440 ms=170965363worker2 # [ 120.601080] nix-grpc-daemon[1367]: ts=2026-09-20T08:18:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:351025364client # [ 120.659327] nix[1218]: don't know how to build these paths:5365client # [ 120.661121] nix[1218]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5366worker1 # [ 120.609604] nix-grpc-daemon[1439]: ts=2026-09-20T08:18:54Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05367worker1 # [ 120.615185] nix-grpc-daemon[1439]: ts=2026-09-20T08:18:54Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.3:50051 clients=15368worker1 # [ 120.671456] nix-grpc-daemon[1439]: ts=2026-09-20T08:18:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540825369worker1 # [ 120.687109] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5370worker1 # [ 120.712503] nix-grpc-daemon[1439]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 59 ms (attempt 1/5)5371worker1 # [ 120.777997] nix-grpc-daemon[1439]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 24 ms (attempt 2/5)5372worker1 # [ 120.809554] nix-grpc-daemon[1439]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 327 ms (attempt 3/5)5373lb # [ 120.436372] envoy[910]: conn peer=[2001:db8:1::1]:45626 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4202 tx=1820 ms=100875374worker1 # [ 121.144219] nix-grpc-daemon[1439]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 305 ms (attempt 4/5)5375worker1 # [ 121.457665] nix-grpc-daemon[1439]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5376worker1 # [ 121.480132] nix-grpc-daemon[1439]: ts=2026-09-20T08:18:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540825377client # [ 121.563652] nix[1218]: copying 1 paths to 'lb:50051'...5378worker1 # [ 121.496647] nix-grpc-daemon[1439]: ts=2026-09-20T08:18:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:540825379client # [ 121.564118] nix[1218]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5380worker1 # [ 121.512191] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5381worker1 # [ 121.543646] nix-grpc-daemon[1439]: ts=2026-09-20T08:18:55Z level=info event=niks3_push_started pid=15315382worker1 # [ 121.949278] nix-daemon[837]: accepted connection from pid 1548, user nix-grpc-daemon (trusted)5383worker1 # [ 121.967407] nix-daemon[837]: reaped child process 1551, status = succeeded5384worker1 # [ 122.145678] nix-daemon[837]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)5385worker1 # [ 122.163811] nix-daemon[837]: reaped child process 1556, status = succeeded5386lb # [ 122.201048] niks3-server[1040]: 2026/09/20 08:18:55 INFO Received uploads request method=POST path=/api/pending_closures5387worker1 # [ 122.191635] nix-grpc-daemon[1531]: time=2026-09-20T08:18:55.773Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5388worker1 # [ 122.193595] nix-grpc-daemon[1531]: time=2026-09-20T08:18:55.774Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5389lb # [ 122.244574] niks3-server[1040]: 2026/09/20 08:18:55 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5390lb # [ 122.255512] niks3-server[1040]: 2026/09/20 08:18:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5391worker1 # [ 122.238037] nix-grpc-daemon[1531]: time=2026-09-20T08:18:55.821Z level=INFO msg="Uploading 1 narinfos"5392lb # [ 122.268486] niks3-server[1040]: 2026/09/20 08:18:55 INFO Signed narinfos id=35 count=15393lb # [ 122.287384] niks3-server[1040]: 2026/09/20 08:18:55 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5394lb # [ 122.298959] niks3-server[1040]: 2026/09/20 08:18:55 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5395lb # [ 122.305337] niks3-server[1040]: 2026/09/20 08:18:55 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5396lb # [ 122.309587] niks3-server[1040]: 2026/09/20 08:18:55 INFO Completed upload id=355397worker1 # [ 122.284745] nix-grpc-daemon[1531]: time=2026-09-20T08:18:55.868Z level=INFO msg="Upload complete. (510ms)"5398worker1 # [ 122.295991] nix-grpc-daemon[1439]: ts=2026-09-20T08:18:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54082 duration_s=0 paths=1 nar_bytes_in=4245399worker1 # [ 122.312942] nix-grpc-daemon[1439]: ts=2026-09-20T08:18:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540825400worker1 # [ 122.323836] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5401worker1 # [ 122.326355] nix-daemon[837]: reaped child process 1529, status = succeeded5402client # [ 122.405086] nix[1218]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5403worker1 # [ 122.340214] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5404client: must succeed: systemctl kill -s INT intr5405client # [ 124.194444] systemd[1]: intr.service: Sent signal SIGINT to main process 1218 (nix) on client request.5406worker1 # [ 124.137316] nix-grpc-daemon[1439]: ts=2026-09-20T08:18:57Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5407client # [ 124.205499] nix[1218]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5408client # [ 124.215537] nix[1218]: error: interrupted by the user5409client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds)5410worker1 # [ 124.181673] nix-daemon[837]: reaped child process 1558, status = succeeded5411client # [ 124.249155] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5412worker1 # [ 124.185261] nix-daemon[1560]: unexpected Nix daemon error: error: interrupted by the user5413client # [ 124.253636] systemd[1]: intr.service: Failed with result 'exit-code'.5414client # [ 124.255556] systemd[1]: intr.service: Consumed 150ms CPU time over 3.831s wall clock time, 39.2M memory peak, 7.8K incoming IP traffic, 8.7K outgoing IP traffic.5415worker1 # [ 124.196402] nix-daemon[837]: reaped child process 1560, status = failed with exit code 15416(finished: subtest: interrupting the client stops the build on the worker, in 3.99 seconds)5417subtest: a deploy mid-build drains: the build finishes, the new generation takes over5418client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5419client # [ 124.431555] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5420client # Running as unit: sw.service; invocation ID: ea7315ca252a45168fc281093d0dca535421client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.09 seconds)5422client # [ 124.665325] nix[1239]: don't know how to build these paths:5423client # [ 124.666395] nix[1239]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5424worker1 # [ 124.596847] nix-grpc-daemon[1439]: ts=2026-09-20T08:18:58Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:540825425worker1 # [ 124.611629] nix-grpc-daemon[1439]: ts=2026-09-20T08:18:58Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05426worker1 # [ 124.617791] nix-grpc-daemon[1439]: ts=2026-09-20T08:18:58Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.4:50051 clients=15427worker2 # [ 124.676697] nix-grpc-daemon[1367]: ts=2026-09-20T08:18:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:351025428worker2 # [ 124.693126] nix-grpc-daemon[1367]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 15 ms (attempt 1/5)5429worker2 # [ 124.715651] nix-grpc-daemon[1367]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 82 ms (attempt 2/5)5430worker2 # [ 124.805445] nix-grpc-daemon[1367]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 58 ms (attempt 3/5)5431worker2 # [ 124.870912] nix-grpc-daemon[1367]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 741 ms (attempt 4/5)5432worker2 # [ 125.620238] nix-grpc-daemon[1367]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5433worker2 # [ 125.643239] nix-grpc-daemon[1367]: ts=2026-09-20T08:18:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:351025434client # [ 125.708672] nix[1239]: copying 1 paths to 'lb:50051'...5435client # [ 125.714630] nix[1239]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5436worker2 # [ 125.663436] nix-grpc-daemon[1367]: ts=2026-09-20T08:18:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:351025437worker2 # [ 125.684909] nix-daemon[863]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)5438worker2 # [ 125.893010] nix-daemon[863]: accepted connection from pid 1495, user nix-grpc-daemon (trusted)5439worker2 # [ 125.912547] nix-daemon[863]: reaped child process 1498, status = succeeded5440worker2 # [ 126.086092] nix-daemon[863]: accepted connection from pid 1500, user nix-grpc-daemon (trusted)5441worker2 # [ 126.105303] nix-daemon[863]: reaped child process 1503, status = succeeded5442lb # [ 126.126916] niks3-server[1040]: 2026/09/20 08:18:59 INFO Received uploads request method=POST path=/api/pending_closures5443worker2 # [ 126.130310] nix-grpc-daemon[1444]: time=2026-09-20T08:18:59.707Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5444worker2 # [ 126.131813] nix-grpc-daemon[1444]: time=2026-09-20T08:18:59.707Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5445lb # [ 126.165860] niks3-server[1040]: 2026/09/20 08:18:59 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5446worker2 # [ 126.169613] nix-grpc-daemon[1444]: time=2026-09-20T08:18:59.747Z level=INFO msg="Uploading 1 narinfos"5447lb # [ 126.178966] niks3-server[1040]: 2026/09/20 08:18:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5448lb # [ 126.190032] niks3-server[1040]: 2026/09/20 08:18:59 INFO Signed narinfos id=36 count=15449lb # [ 126.195003] niks3-server[1040]: 2026/09/20 08:18:59 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5450lb # [ 126.205455] niks3-server[1040]: 2026/09/20 08:18:59 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5451lb # [ 126.210745] niks3-server[1040]: 2026/09/20 08:18:59 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5452worker2 # [ 126.201883] nix-grpc-daemon[1444]: time=2026-09-20T08:18:59.780Z level=INFO msg="Upload complete. (494ms)"5453lb # [ 126.213443] niks3-server[1040]: 2026/09/20 08:18:59 INFO Completed upload id=365454worker2 # [ 126.210908] nix-grpc-daemon[1367]: ts=2026-09-20T08:18:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35102 duration_s=0 paths=1 nar_bytes_in=4165455worker2 # [ 126.225399] nix-grpc-daemon[1367]: ts=2026-09-20T08:18:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:351025456worker2 # [ 126.231161] nix-daemon[863]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)5457worker2 # [ 126.235966] nix-daemon[863]: reaped child process 1492, status = succeeded5458worker2 # [ 126.247800] nix-daemon[863]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)5459client # [ 126.297513] nix[1239]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5460worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&25461worker2 # Checking switch inhibitors... done5462worker2 # [ 129.073898] nixos[1538]: switching to system configuration /nix/store/6pgq6s0rn5hjx49346ij0spiidlzcph7-nixos-system-worker2-test5463worker2 # [ 129.076690] systemd[1]: Stopped target Remote File Systems.5464worker2 # [ 129.078453] systemd[1]: Stopped target Local File Systems.5465worker2 # activating the configuration...5466worker2 # setting up /etc...5467worker2 # [ 129.853160] systemd[1]: Reload requested from client PID 1538 ('.switch-to-conf') (unit backdoor.service)...5468worker2 # [ 129.855728] systemd[1]: Reloading...5469lb # [ 130.433314] envoy[910]: conn peer=[2001:db8:1::1]:53690 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2931 tx=753 ms=35765470worker2 # [ 130.757365] systemd[1]: Reloading finished in 899 ms.5471worker2 # restarting sysinit-reactivation.target5472worker2 # [ 130.841682] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....5473worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service5474worker2 # [ 131.002464] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..5475worker2 # [ 131.009175] systemd[1]: Reached target Reactivate sysinit units.5476worker2 # [ 131.010305] systemd[1]: Reloading D-Bus System Message Bus...5477worker2 # [ 131.013017] dbus-broker-launch[503]: Caught SIGHUP, trigger reload.5478worker2 # [ 131.014423] systemd[1]: Reloading Nix worker-protocol over gRPC...5479worker2 # [ 131.040525] dbus-broker-launch[503]: Looking up NSS user entry for 'systemd-timesync'...5480worker2 # [ 131.042923] dbus-broker-launch[503]: NSS returned no entry for 'systemd-timesync'5481worker2 # [ 131.046795] dbus-broker-launch[503]: Invalid user-name in /nix/store/c8a4kacp5lnfwrcxrjmwczbl8ba32m4a-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"5482worker2 # [ 131.070928] systemd[1]: Reloaded Nix worker-protocol over gRPC.5483worker2 # [ 131.093860] systemd[1]: Reloaded D-Bus System Message Bus.5484worker2 # [ 131.104445] systemd[1]: Reached target Local File Systems.5485worker2 # [ 131.108090] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore5486worker2 # [ 131.113607] systemd[1]: Starting Create SUID/SGID Wrappers...5487worker2 # [ 131.114451] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.5488worker2 # [ 131.115659] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc675489worker2 # [ 131.132179] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore5490worker2 # [ 131.133760] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5491worker2 # [ 131.134952] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5492worker2 # [ 131.141226] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os5493worker2 # [ 131.142481] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki5494worker2 # [ 131.143694] systemd[1]: Reached target Remote File Systems.5495worker2 # [ 131.150011] nix-grpc-daemon[1367]: ts=2026-09-20T08:19:04Z level=info event=draining5496worker2 # [ 131.620385] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.5497worker2 # [ 131.621501] systemd[1]: Finished Create SUID/SGID Wrappers.5498worker2 # [ 131.624330] systemd[1]: Starting linger-users.service...5499worker2 # [ 131.675826] systemd[1]: linger-users.service: Deactivated successfully.5500worker2 # [ 131.680183] systemd[1]: Finished linger-users.service.5501worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service5502worker2 # [ 131.933218] nixos[1538]: finished switching to system configuration /nix/store/6pgq6s0rn5hjx49346ij0spiidlzcph7-nixos-system-worker2-test5503worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 3.68 seconds)5504worker2: must succeed: pgrep -f 'read -t [9]0 x'5505worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds)5506client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain >&25507client # don't know how to build these paths:5508client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5509worker1 # [ 132.250838] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:540825510worker1 # [ 132.267992] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:05Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05511worker1 # [ 132.275015] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:05Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.3:50051 clients=15512worker1 # [ 132.323084] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540825513worker1 # [ 132.339045] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540825514client # copying 1 paths to 'lb:50051'...5515worker1 # [ 132.356417] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:540825516client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5517worker1 # [ 132.380148] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5518worker1 # [ 132.597099] nix-daemon[837]: accepted connection from pid 1614, user nix-grpc-daemon (trusted)5519worker1 # [ 132.617311] nix-daemon[837]: reaped child process 1617, status = succeeded5520worker1 # [ 132.793886] nix-daemon[837]: accepted connection from pid 1619, user nix-grpc-daemon (trusted)5521worker1 # [ 132.811678] nix-daemon[837]: reaped child process 1622, status = succeeded5522lb # [ 132.848998] niks3-server[1040]: 2026/09/20 08:19:06 INFO Received uploads request method=POST path=/api/pending_closures5523worker1 # [ 132.834807] nix-grpc-daemon[1531]: time=2026-09-20T08:19:06.418Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5524worker1 # [ 132.836511] nix-grpc-daemon[1531]: time=2026-09-20T08:19:06.418Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5525lb # [ 132.882446] niks3-server[1040]: 2026/09/20 08:19:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5526worker1 # [ 132.866823] nix-grpc-daemon[1531]: time=2026-09-20T08:19:06.450Z level=INFO msg="Uploading 1 narinfos"5527lb # [ 132.898066] niks3-server[1040]: 2026/09/20 08:19:06 INFO Signed narinfos id=37 count=15528lb # [ 132.906459] niks3-server[1040]: 2026/09/20 08:19:06 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5529lb # [ 132.917949] niks3-server[1040]: 2026/09/20 08:19:06 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5530lb # [ 132.927783] niks3-server[1040]: 2026/09/20 08:19:06 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5531lb # [ 132.933799] niks3-server[1040]: 2026/09/20 08:19:06 INFO Completed upload id=375532worker1 # [ 132.908945] nix-grpc-daemon[1531]: time=2026-09-20T08:19:06.492Z level=INFO msg="Upload complete. (511ms)"5533lb # [ 132.937113] niks3-server[1040]: 2026/09/20 08:19:06 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5534worker1 # [ 132.916311] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54082 duration_s=0 paths=1 nar_bytes_in=5285535worker1 # [ 132.930875] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540825536worker1 # [ 132.939070] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5537worker1 # [ 132.944714] nix-daemon[837]: reaped child process 1612, status = succeeded5538client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5539worker1 # [ 132.956539] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5540client # farm-a> node-a: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5541client # farm-a> LOG-farm-a-during-drain5542worker1 # [ 134.197585] nix-daemon[837]: reaped child process 1626, status = succeeded5543worker1 # [ 134.372595] nix-daemon[837]: accepted connection from pid 1641, user nix-grpc-daemon (trusted)5544worker1 # [ 134.392433] nix-daemon[837]: reaped child process 1644, status = succeeded5545lb # [ 134.429594] niks3-server[1040]: 2026/09/20 08:19:08 INFO Received uploads request method=POST path=/api/pending_closures5546worker1 # [ 134.416427] nix-grpc-daemon[1531]: time=2026-09-20T08:19:07.998Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5547worker1 # [ 134.417925] nix-grpc-daemon[1531]: time=2026-09-20T08:19:07.998Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5548lb # [ 134.470923] niks3-server[1040]: 2026/09/20 08:19:08 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5549lb # [ 134.483685] niks3-server[1040]: 2026/09/20 08:19:08 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5550lb # [ 134.493425] niks3-server[1040]: 2026/09/20 08:19:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5551lb # [ 134.500958] niks3-server[1040]: 2026/09/20 08:19:08 INFO Signed narinfos id=38 count=15552worker1 # [ 134.476136] nix-grpc-daemon[1531]: time=2026-09-20T08:19:08.059Z level=INFO msg="Uploading 1 narinfos"5553lb # [ 134.503486] niks3-server[1040]: 2026/09/20 08:19:08 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5554lb # [ 134.517923] niks3-server[1040]: 2026/09/20 08:19:08 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5555lb # [ 134.524171] niks3-server[1040]: 2026/09/20 08:19:08 INFO Completed upload id=385556worker1 # [ 134.498798] nix-grpc-daemon[1531]: time=2026-09-20T08:19:08.082Z level=INFO msg="Upload complete. (328ms)"5557lb # [ 134.527137] niks3-server[1040]: 2026/09/20 08:19:08 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo5558worker1 # [ 134.516430] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54082 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=15559worker1 # [ 134.531597] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:08Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05560worker1 # [ 134.536281] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:08Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.3:50051 clients=15561worker1 # [ 134.540602] nix-daemon[837]: reaped child process 1624, status = succeeded5562worker1 # [ 134.559262] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540825563worker1 # [ 134.572607] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540825564worker1 # [ 134.586775] nix-grpc-daemon[1531]: time=2026-09-20T08:19:08.170Z level=INFO msg="All 1 paths already cached"5565client # copying 1 paths to 'lb:50051'...5566worker1 # [ 134.597016] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:540825567client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5568worker1 # [ 134.625734] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5569worker1 # [ 134.833686] nix-daemon[837]: accepted connection from pid 1650, user nix-grpc-daemon (trusted)5570worker1 # [ 134.852717] nix-daemon[837]: reaped child process 1653, status = succeeded5571worker1 # [ 135.032559] nix-daemon[837]: accepted connection from pid 1655, user nix-grpc-daemon (trusted)5572worker1 # [ 135.052336] nix-daemon[837]: reaped child process 1658, status = succeeded5573lb # [ 135.088442] niks3-server[1040]: 2026/09/20 08:19:08 INFO Received uploads request method=POST path=/api/pending_closures5574worker1 # [ 135.073294] nix-grpc-daemon[1531]: time=2026-09-20T08:19:08.656Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5575worker1 # [ 135.074811] nix-grpc-daemon[1531]: time=2026-09-20T08:19:08.656Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"5576lb # [ 135.118950] niks3-server[1040]: 2026/09/20 08:19:08 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst5577worker1 # [ 135.103425] nix-grpc-daemon[1531]: time=2026-09-20T08:19:08.687Z level=INFO msg="Uploading 1 narinfos"5578lb # [ 135.131689] niks3-server[1040]: 2026/09/20 08:19:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5579lb # [ 135.143280] niks3-server[1040]: 2026/09/20 08:19:08 INFO Signed narinfos id=39 count=15580worker1 # [ 135.128915] nix-grpc-daemon[1531]: time=2026-09-20T08:19:08.712Z level=INFO msg="Upload complete. (485ms)"5581lb # [ 135.153866] niks3-server[1040]: 2026/09/20 08:19:08 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls5582lb # [ 135.158877] niks3-server[1040]: 2026/09/20 08:19:08 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5583worker1 # [ 135.136126] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54082 duration_s=0 paths=1 nar_bytes_in=6405584lb # [ 135.163399] niks3-server[1040]: 2026/09/20 08:19:08 INFO Completed upload id=395585lb # [ 135.165700] niks3-server[1040]: 2026/09/20 08:19:08 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo5586worker1 # [ 135.149281] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540825587worker1 # [ 135.154914] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5588worker1 # [ 135.159512] nix-daemon[837]: reaped child process 1648, status = succeeded5589client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...5590client # farm-b> node-a: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5591worker1 # [ 135.172944] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5592client # farm-b> LOG-farm-b-during-drain5593worker1 # [ 136.019938] nix-daemon[837]: reaped child process 1662, status = succeeded5594worker1 # [ 136.201033] nix-daemon[837]: accepted connection from pid 1677, user nix-grpc-daemon (trusted)5595worker1 # [ 136.219339] nix-daemon[837]: reaped child process 1680, status = succeeded5596lb # [ 136.256690] niks3-server[1040]: 2026/09/20 08:19:09 INFO Received uploads request method=POST path=/api/pending_closures5597worker1 # [ 136.242883] nix-grpc-daemon[1531]: time=2026-09-20T08:19:09.825Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5598worker1 # [ 136.244582] nix-grpc-daemon[1531]: time=2026-09-20T08:19:09.826Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"5599lb # [ 136.292707] niks3-server[1040]: 2026/09/20 08:19:09 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst5600lb # [ 136.305099] niks3-server[1040]: 2026/09/20 08:19:09 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5601worker1 # [ 136.288982] nix-grpc-daemon[1531]: time=2026-09-20T08:19:09.872Z level=INFO msg="Uploading 1 narinfos"5602lb # [ 136.318609] niks3-server[1040]: 2026/09/20 08:19:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5603lb # [ 136.325544] niks3-server[1040]: 2026/09/20 08:19:09 INFO Signed narinfos id=40 count=15604lb # [ 136.330546] niks3-server[1040]: 2026/09/20 08:19:09 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls5605worker1 # [ 136.311899] nix-grpc-daemon[1531]: time=2026-09-20T08:19:09.895Z level=INFO msg="Upload complete. (329ms)"5606lb # [ 136.337453] niks3-server[1040]: 2026/09/20 08:19:09 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5607lb # [ 136.345493] niks3-server[1040]: 2026/09/20 08:19:09 INFO Completed upload id=405608lb # [ 136.347384] niks3-server[1040]: 2026/09/20 08:19:09 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo5609worker1 # [ 136.327287] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54082 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=15610worker1 # [ 136.344514] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:09Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=05611worker1 # [ 136.348925] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:09Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.3:50051 clients=15612worker1 # [ 136.353265] nix-daemon[837]: reaped child process 1660, status = succeeded5613worker1 # [ 136.383394] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540825614worker1 # [ 136.398486] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540825615worker1 # [ 136.413056] nix-grpc-daemon[1531]: time=2026-09-20T08:19:09.997Z level=INFO msg="All 2 paths already cached"5616client # copying 1 paths to 'lb:50051'...5617worker1 # [ 136.425933] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:540825618client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...5619worker1 # [ 136.444148] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5620worker1 # [ 136.644753] nix-daemon[837]: accepted connection from pid 1686, user nix-grpc-daemon (trusted)5621worker1 # [ 136.664942] nix-daemon[837]: reaped child process 1689, status = succeeded5622worker1 # [ 136.841948] nix-daemon[837]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)5623worker1 # [ 136.861755] nix-daemon[837]: reaped child process 1694, status = succeeded5624lb # [ 136.898556] niks3-server[1040]: 2026/09/20 08:19:10 INFO Received uploads request method=POST path=/api/pending_closures5625worker1 # [ 136.885151] nix-grpc-daemon[1531]: time=2026-09-20T08:19:10.468Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5626worker1 # [ 136.886696] nix-grpc-daemon[1531]: time=2026-09-20T08:19:10.468Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"5627lb # [ 136.927812] niks3-server[1040]: 2026/09/20 08:19:10 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst5628lb # [ 136.945203] niks3-server[1040]: 2026/09/20 08:19:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5629worker1 # [ 136.926327] nix-grpc-daemon[1531]: time=2026-09-20T08:19:10.510Z level=INFO msg="Uploading 1 narinfos"5630lb # [ 136.957808] niks3-server[1040]: 2026/09/20 08:19:10 INFO Signed narinfos id=41 count=15631lb # [ 136.964586] niks3-server[1040]: 2026/09/20 08:19:10 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls5632lb # [ 136.971856] niks3-server[1040]: 2026/09/20 08:19:10 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5633lb # [ 136.978685] niks3-server[1040]: 2026/09/20 08:19:10 INFO Completed upload id=415634worker1 # [ 136.953198] nix-grpc-daemon[1531]: time=2026-09-20T08:19:10.537Z level=INFO msg="Upload complete. (492ms)"5635lb # [ 136.981383] niks3-server[1040]: 2026/09/20 08:19:10 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo5636worker1 # [ 136.960139] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54082 duration_s=0 paths=1 nar_bytes_in=7685637worker1 # [ 136.974620] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540825638worker1 # [ 136.982244] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5639worker1 # [ 136.987184] nix-daemon[837]: reaped child process 1684, status = succeeded5640client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...5641client # farm-top> node-a: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5642worker1 # [ 137.001245] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5643client # farm-top> LOG-farm-top-during-drain5644worker1 # [ 138.246207] nix-daemon[837]: reaped child process 1698, status = succeeded5645worker1 # [ 138.435687] nix-daemon[837]: accepted connection from pid 1713, user nix-grpc-daemon (trusted)5646worker1 # [ 138.454339] nix-daemon[837]: reaped child process 1716, status = succeeded5647lb # [ 138.494177] niks3-server[1040]: 2026/09/20 08:19:12 INFO Received uploads request method=POST path=/api/pending_closures5648worker1 # [ 138.482582] nix-grpc-daemon[1531]: time=2026-09-20T08:19:12.064Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5649worker1 # [ 138.484446] nix-grpc-daemon[1531]: time=2026-09-20T08:19:12.064Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"5650lb # [ 138.539402] niks3-server[1040]: 2026/09/20 08:19:12 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5651lb # [ 138.549756] niks3-server[1040]: 2026/09/20 08:19:12 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst5652lb # [ 138.560076] niks3-server[1040]: 2026/09/20 08:19:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5653worker1 # [ 138.539444] nix-grpc-daemon[1531]: time=2026-09-20T08:19:12.123Z level=INFO msg="Uploading 1 narinfos"5654lb # [ 138.568463] niks3-server[1040]: 2026/09/20 08:19:12 INFO Signed narinfos id=42 count=15655lb # [ 138.570647] niks3-server[1040]: 2026/09/20 08:19:12 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls5656lb # [ 138.580967] niks3-server[1040]: 2026/09/20 08:19:12 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5657lb # [ 138.588141] niks3-server[1040]: 2026/09/20 08:19:12 INFO Completed upload id=425658worker1 # [ 138.563673] nix-grpc-daemon[1531]: time=2026-09-20T08:19:12.147Z level=INFO msg="Upload complete. (351ms)"5659lb # [ 138.591258] niks3-server[1040]: 2026/09/20 08:19:12 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo5660worker1 # [ 138.577520] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54082 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=15661worker1 # [ 138.593931] nix-daemon[837]: reaped child process 1696, status = succeeded5662client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain >&2, in 6.64 seconds)5663client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain outPath5664client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain outPath, in 0.23 seconds)5665worker2: must succeed: pkill -f 'read -t [9]0 x'5666worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds)5667client: waiting for success: ! systemctl is-active sw5668worker2 # [ 139.093131] nix-daemon[863]: reaped child process 1507, status = succeeded5669worker2 # [ 139.265322] nix-daemon[863]: accepted connection from pid 1678, user nix-grpc-daemon (trusted)5670worker2 # [ 139.283096] nix-daemon[863]: reaped child process 1681, status = succeeded5671lb # [ 139.303924] niks3-server[1040]: 2026/09/20 08:19:12 INFO Received uploads request method=POST path=/api/pending_closures5672worker2 # [ 139.309724] nix-grpc-daemon[1444]: time=2026-09-20T08:19:12.886Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5673worker2 # [ 139.311764] nix-grpc-daemon[1444]: time=2026-09-20T08:19:12.886Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"5674lb # [ 139.344480] niks3-server[1040]: 2026/09/20 08:19:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5675worker2 # [ 139.341001] nix-grpc-daemon[1444]: time=2026-09-20T08:19:12.918Z level=INFO msg="Uploading 1 narinfos"5676lb # [ 139.354880] niks3-server[1040]: 2026/09/20 08:19:12 INFO Signed narinfos id=43 count=15677lb # [ 139.359864] niks3-server[1040]: 2026/09/20 08:19:12 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5678lb # [ 139.366926] niks3-server[1040]: 2026/09/20 08:19:12 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5679lb # [ 139.375040] niks3-server[1040]: 2026/09/20 08:19:12 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls5680worker2 # [ 139.371020] nix-grpc-daemon[1444]: time=2026-09-20T08:19:12.949Z level=INFO msg="Upload complete. (299ms)"5681lb # [ 139.381761] niks3-server[1040]: 2026/09/20 08:19:12 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5682lb # [ 139.384579] niks3-server[1040]: 2026/09/20 08:19:12 INFO Completed upload id=435683lb # [ 139.387565] niks3-server[1040]: 2026/09/20 08:19:12 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo5684worker2 # [ 139.384980] nix-grpc-daemon[1367]: ts=2026-09-20T08:19:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35102 duration_s=13 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=15685worker2 # [ 139.397572] nix-daemon[863]: reaped child process 1505, status = succeeded5686client # [ 139.477640] systemd[1]: sw.service: Deactivated successfully.5687client # [ 139.482030] systemd[1]: sw.service: Consumed 155ms CPU time over 15.049s wall clock time, 39.2M memory peak, 8.6K incoming IP traffic, 9K outgoing IP traffic.5688client: (finished: waiting for success: ! systemctl is-active sw, in 1.12 seconds)5689client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5690client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.05 seconds)5691worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5692worker2 # [ 140.153771] nix-grpc-daemon[1367]: ts=2026-09-20T08:19:13Z level=info event=signal_exit5693lb # [ 140.432745] envoy[910]: conn peer=[2001:db8:1::1]:52952 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9456 tx=3827 ms=63485694lb # [ 140.437410] envoy[910]: conn peer=[2001:db8:1::1]:41578 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2952 tx=1377 ms=147855695worker1 # [ 141.361821] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:14Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:540685696worker2 # [ 141.378613] nix-grpc-daemon[1367]: ts=2026-09-20T08:19:14Z level=info event=scheduler_restarting5697worker1 # [ 141.366653] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:14Z level=info event=worker_gone addr=192.168.1.4:500515698worker2 # [ 141.402321] nix-grpc-daemon[1367]: ts=2026-09-20T08:19:14Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5699worker2 # [ 141.426327] nix-daemon[863]: reaped child process 1416, status = succeeded5700worker2 # [ 142.196801] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5701worker2 # [ 142.200549] systemd[1]: nix-grpc-daemon.service: Consumed 836ms CPU time over 28.449s wall clock time, 33.4M memory peak, 20.9K incoming IP traffic, 27.1K outgoing IP traffic.5702worker2 # [ 142.223664] systemd[1]: Starting Nix worker-protocol over gRPC...5703worker2 # [ 142.421914] nix-grpc-daemon[1695]: ts=2026-09-20T08:19:15Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5704worker2 # [ 142.424381] nix-grpc-daemon[1695]: ts=2026-09-20T08:19:16Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15705worker2 # [ 142.431826] nix-grpc-daemon[1695]: ts=2026-09-20T08:19:16Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5706worker2 # [ 142.456513] systemd[1]: Started Nix worker-protocol over gRPC.5707worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.35 seconds)5708lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5709lb: must succeed: curl -sf localhost:9901/clusters5710worker2 # [ 142.482030] nix-grpc-daemon[1695]: ts=2026-09-20T08:19:16Z level=info event=scheduler_connected addr=lb:500515711worker1 # [ 142.471733] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:16Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05712lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5713lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.09 seconds)5714lb: must succeed: curl -sf localhost:9901/clusters5715lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5716worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5717worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5718(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 18.39 seconds)5719subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5720client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15721worker1 # [ 142.926527] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:16Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:540825722worker1 # [ 142.943818] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:16Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=05723worker1 # [ 142.951039] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:16Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=15724worker1 # [ 142.957236] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:16Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=05725worker1 # [ 142.963294] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:16Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=05726worker1 # [ 142.991326] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540825727worker1 # [ 143.007285] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540825728worker1 # [ 143.022364] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:540825729worker1 # [ 143.037433] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5730worker1 # [ 143.248419] nix-daemon[837]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)5731worker1 # [ 143.268962] nix-daemon[837]: reaped child process 1730, status = succeeded5732worker1 # [ 143.445304] nix-daemon[837]: accepted connection from pid 1732, user nix-grpc-daemon (trusted)5733worker1 # [ 143.462927] nix-daemon[837]: reaped child process 1735, status = succeeded5734lb # [ 143.501400] niks3-server[1040]: 2026/09/20 08:19:17 INFO Received uploads request method=POST path=/api/pending_closures5735worker1 # [ 143.486905] nix-grpc-daemon[1531]: time=2026-09-20T08:19:17.070Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5736worker1 # [ 143.488501] nix-grpc-daemon[1531]: time=2026-09-20T08:19:17.070Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"5737lb # [ 143.530071] niks3-server[1040]: 2026/09/20 08:19:17 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst5738worker1 # [ 143.517985] nix-grpc-daemon[1531]: time=2026-09-20T08:19:17.101Z level=INFO msg="Uploading 1 narinfos"5739lb # [ 143.543882] niks3-server[1040]: 2026/09/20 08:19:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5740lb # [ 143.555249] niks3-server[1040]: 2026/09/20 08:19:17 INFO Signed narinfos id=44 count=15741lb # [ 143.564270] niks3-server[1040]: 2026/09/20 08:19:17 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls5742lb # [ 143.567600] niks3-server[1040]: 2026/09/20 08:19:17 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5743lb # [ 143.573729] niks3-server[1040]: 2026/09/20 08:19:17 INFO Completed upload id=445744worker1 # [ 143.548847] nix-grpc-daemon[1531]: time=2026-09-20T08:19:17.132Z level=INFO msg="Upload complete. (495ms)"5745lb # [ 143.576253] niks3-server[1040]: 2026/09/20 08:19:17 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo5746worker1 # [ 143.556686] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54082 duration_s=0 paths=1 nar_bytes_in=5125747worker1 # [ 143.569379] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540825748worker1 # [ 143.575425] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5749worker1 # [ 143.580186] nix-daemon[837]: reaped child process 1725, status = succeeded5750worker1 # [ 143.593876] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5751worker1 # [ 145.035817] nix-daemon[837]: reaped child process 1739, status = succeeded5752worker1 # [ 145.213299] nix-daemon[837]: accepted connection from pid 1754, user nix-grpc-daemon (trusted)5753worker1 # [ 145.231788] nix-daemon[837]: reaped child process 1757, status = succeeded5754lb # [ 145.269355] niks3-server[1040]: 2026/09/20 08:19:18 INFO Received uploads request method=POST path=/api/pending_closures5755worker1 # [ 145.256417] nix-grpc-daemon[1531]: time=2026-09-20T08:19:18.837Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5756worker1 # [ 145.257945] nix-grpc-daemon[1531]: time=2026-09-20T08:19:18.837Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"5757lb # [ 145.300414] niks3-server[1040]: 2026/09/20 08:19:18 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv5758lb # [ 145.314760] niks3-server[1040]: 2026/09/20 08:19:18 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5759lb # [ 145.328838] niks3-server[1040]: 2026/09/20 08:19:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5760worker1 # [ 145.308208] nix-grpc-daemon[1531]: time=2026-09-20T08:19:18.892Z level=INFO msg="Uploading 1 narinfos"5761lb # [ 145.334899] niks3-server[1040]: 2026/09/20 08:19:18 INFO Signed narinfos id=45 count=15762lb # [ 145.341084] niks3-server[1040]: 2026/09/20 08:19:18 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls5763lb # [ 145.351851] niks3-server[1040]: 2026/09/20 08:19:18 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5764lb # [ 145.359255] niks3-server[1040]: 2026/09/20 08:19:18 INFO Completed upload id=455765worker1 # [ 145.334513] nix-grpc-daemon[1531]: time=2026-09-20T08:19:18.918Z level=INFO msg="Upload complete. (330ms)"5766lb # [ 145.362455] niks3-server[1040]: 2026/09/20 08:19:18 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo5767worker1 # [ 145.351513] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54082 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=7 outputs=15768worker1 # [ 145.367491] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:18Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=15769worker1 # [ 145.375829] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540825770worker1 # [ 145.380311] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:18Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=05771worker1 # [ 145.384574] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540825772worker1 # [ 145.388479] nix-daemon[837]: reaped child process 1737, status = succeeded5773worker1 # [ 145.391421] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:540825774worker1 # [ 145.403905] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5775worker1 # [ 145.581441] nix-daemon[837]: accepted connection from pid 1763, user nix-grpc-daemon (trusted)5776worker1 # [ 145.598954] nix-daemon[837]: reaped child process 1766, status = succeeded5777worker1 # [ 145.773432] nix-daemon[837]: accepted connection from pid 1768, user nix-grpc-daemon (trusted)5778worker1 # [ 145.790791] nix-daemon[837]: reaped child process 1771, status = succeeded5779lb # [ 145.827532] niks3-server[1040]: 2026/09/20 08:19:19 INFO Received uploads request method=POST path=/api/pending_closures5780worker1 # [ 145.812213] nix-grpc-daemon[1531]: time=2026-09-20T08:19:19.396Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5781worker1 # [ 145.814150] nix-grpc-daemon[1531]: time=2026-09-20T08:19:19.397Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"5782lb # [ 145.856114] niks3-server[1040]: 2026/09/20 08:19:19 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst5783worker1 # [ 145.844059] nix-grpc-daemon[1531]: time=2026-09-20T08:19:19.427Z level=INFO msg="Uploading 1 narinfos"5784lb # [ 145.871442] niks3-server[1040]: 2026/09/20 08:19:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5785lb # [ 145.882999] niks3-server[1040]: 2026/09/20 08:19:19 INFO Signed narinfos id=46 count=15786lb # [ 145.891338] niks3-server[1040]: 2026/09/20 08:19:19 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls5787lb # [ 145.895454] niks3-server[1040]: 2026/09/20 08:19:19 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5788lb # [ 145.900672] niks3-server[1040]: 2026/09/20 08:19:19 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo5789lb # [ 145.905195] niks3-server[1040]: 2026/09/20 08:19:19 INFO Completed upload id=465790worker1 # [ 145.880080] nix-grpc-daemon[1531]: time=2026-09-20T08:19:19.464Z level=INFO msg="Upload complete. (471ms)"5791worker1 # [ 145.889234] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54082 duration_s=0 paths=1 nar_bytes_in=5125792worker1 # [ 145.902184] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540825793worker1 # [ 145.908174] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5794worker1 # [ 145.912906] nix-daemon[837]: reaped child process 1761, status = succeeded5795worker1 # [ 145.927107] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5796worker1 # [ 147.153146] nix-daemon[837]: reaped child process 1775, status = succeeded5797worker1 # [ 147.317017] nix-daemon[837]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)5798worker1 # [ 147.336742] nix-daemon[837]: reaped child process 1793, status = succeeded5799lb # [ 147.373841] niks3-server[1040]: 2026/09/20 08:19:20 INFO Received uploads request method=POST path=/api/pending_closures5800worker1 # [ 147.360394] nix-grpc-daemon[1531]: time=2026-09-20T08:19:20.941Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5801worker1 # [ 147.361864] nix-grpc-daemon[1531]: time=2026-09-20T08:19:20.942Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"5802lb # [ 147.414134] niks3-server[1040]: 2026/09/20 08:19:20 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5803lb # [ 147.427685] niks3-server[1040]: 2026/09/20 08:19:21 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv5804lb # [ 147.436712] niks3-server[1040]: 2026/09/20 08:19:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5805worker1 # [ 147.417344] nix-grpc-daemon[1531]: time=2026-09-20T08:19:21.001Z level=INFO msg="Uploading 1 narinfos"5806lb # [ 147.445329] niks3-server[1040]: 2026/09/20 08:19:21 INFO Signed narinfos id=47 count=15807lb # [ 147.451136] niks3-server[1040]: 2026/09/20 08:19:21 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls5808lb # [ 147.461455] niks3-server[1040]: 2026/09/20 08:19:21 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5809worker1 # [ 147.442526] nix-grpc-daemon[1531]: time=2026-09-20T08:19:21.026Z level=INFO msg="Upload complete. (305ms)"5810lb # [ 147.469870] niks3-server[1040]: 2026/09/20 08:19:21 INFO Completed upload id=475811lb # [ 147.473439] niks3-server[1040]: 2026/09/20 08:19:21 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo5812worker1 # [ 147.458688] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54082 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=8 outputs=15813worker1 # [ 147.476860] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:21Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=15814worker1 # [ 147.485317] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540825815worker1 # [ 147.490164] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:21Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=05816worker1 # [ 147.494727] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540825817worker1 # [ 147.499551] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:540825818worker1 # [ 147.512223] nix-daemon[837]: reaped child process 1773, status = succeeded5819worker1 # [ 147.515480] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5820worker1 # [ 147.703743] nix-daemon[837]: accepted connection from pid 1799, user nix-grpc-daemon (trusted)5821worker1 # [ 147.722092] nix-daemon[837]: reaped child process 1802, status = succeeded5822worker1 # [ 147.903539] nix-daemon[837]: accepted connection from pid 1804, user nix-grpc-daemon (trusted)5823worker1 # [ 147.922300] nix-daemon[837]: reaped child process 1807, status = succeeded5824lb # [ 147.960661] niks3-server[1040]: 2026/09/20 08:19:21 INFO Received uploads request method=POST path=/api/pending_closures5825worker1 # [ 147.944743] nix-grpc-daemon[1531]: time=2026-09-20T08:19:21.528Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5826worker1 # [ 147.946250] nix-grpc-daemon[1531]: time=2026-09-20T08:19:21.528Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"5827lb # [ 147.986571] niks3-server[1040]: 2026/09/20 08:19:21 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst5828worker1 # [ 147.974702] nix-grpc-daemon[1531]: time=2026-09-20T08:19:21.558Z level=INFO msg="Uploading 1 narinfos"5829lb # [ 148.002082] niks3-server[1040]: 2026/09/20 08:19:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5830lb # [ 148.013267] niks3-server[1040]: 2026/09/20 08:19:21 INFO Signed narinfos id=48 count=15831lb # [ 148.019068] niks3-server[1040]: 2026/09/20 08:19:21 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls5832lb # [ 148.028437] niks3-server[1040]: 2026/09/20 08:19:21 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5833worker1 # [ 148.003334] nix-grpc-daemon[1531]: time=2026-09-20T08:19:21.587Z level=INFO msg="Upload complete. (482ms)"5834lb # [ 148.033970] niks3-server[1040]: 2026/09/20 08:19:21 INFO Completed upload id=485835worker1 # [ 148.009646] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54082 duration_s=0 paths=1 nar_bytes_in=5125836lb # [ 148.037551] niks3-server[1040]: 2026/09/20 08:19:21 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo5837worker1 # [ 148.022817] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540825838worker1 # [ 148.028518] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5839worker1 # [ 148.033220] nix-daemon[837]: reaped child process 1797, status = succeeded5840worker1 # [ 148.043323] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5841worker1 # [ 149.075187] nix-daemon[837]: reaped child process 1811, status = succeeded5842worker1 # [ 149.255657] nix-daemon[837]: accepted connection from pid 1826, user nix-grpc-daemon (trusted)5843worker1 # [ 149.279027] nix-daemon[837]: reaped child process 1829, status = succeeded5844lb # [ 149.319632] niks3-server[1040]: 2026/09/20 08:19:22 INFO Received uploads request method=POST path=/api/pending_closures5845worker1 # [ 149.307551] nix-grpc-daemon[1531]: time=2026-09-20T08:19:22.890Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5846worker1 # [ 149.309248] nix-grpc-daemon[1531]: time=2026-09-20T08:19:22.890Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"5847lb # [ 149.374145] niks3-server[1040]: 2026/09/20 08:19:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5848worker1 # [ 149.356642] nix-grpc-daemon[1531]: time=2026-09-20T08:19:22.940Z level=INFO msg="Uploading 1 narinfos"5849lb # [ 149.388388] niks3-server[1040]: 2026/09/20 08:19:22 INFO Signed narinfos id=49 count=15850lb # [ 149.391194] niks3-server[1040]: 2026/09/20 08:19:22 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst5851lb # [ 149.408780] niks3-server[1040]: 2026/09/20 08:19:22 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv5852lb # [ 149.421278] niks3-server[1040]: 2026/09/20 08:19:23 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5853lb # [ 149.427545] niks3-server[1040]: 2026/09/20 08:19:23 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls5854worker1 # [ 149.401906] nix-grpc-daemon[1531]: time=2026-09-20T08:19:22.985Z level=INFO msg="Upload complete. (345ms)"5855lb # [ 149.433022] niks3-server[1040]: 2026/09/20 08:19:23 INFO Completed upload id=495856lb # [ 149.435808] niks3-server[1040]: 2026/09/20 08:19:23 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo5857worker1 # [ 149.433354] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54082 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=9 outputs=15858worker1 # [ 149.444541] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:22Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=15859worker1 # [ 149.456881] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540825860worker1 # [ 149.465137] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:23Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=05861worker1 # [ 149.470812] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540825862worker1 # [ 149.475894] nix-daemon[837]: reaped child process 1809, status = succeeded5863worker1 # [ 149.478165] nix-grpc-daemon[1531]: time=2026-09-20T08:19:23.059Z level=INFO msg="All 1 paths already cached"5864worker1 # [ 149.482125] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:540825865worker1 # [ 149.493185] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5866worker1 # [ 149.710867] nix-daemon[837]: accepted connection from pid 1835, user nix-grpc-daemon (trusted)5867worker1 # [ 149.730443] nix-daemon[837]: reaped child process 1838, status = succeeded5868worker1 # [ 149.949380] nix-daemon[837]: accepted connection from pid 1840, user nix-grpc-daemon (trusted)5869worker1 # [ 149.971180] nix-daemon[837]: reaped child process 1843, status = succeeded5870lb # [ 150.008167] niks3-server[1040]: 2026/09/20 08:19:23 INFO Received uploads request method=POST path=/api/pending_closures5871worker1 # [ 149.996079] nix-grpc-daemon[1531]: time=2026-09-20T08:19:23.579Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5872worker1 # [ 149.997685] nix-grpc-daemon[1531]: time=2026-09-20T08:19:23.579Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"5873lb # [ 150.056653] niks3-server[1040]: 2026/09/20 08:19:23 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst5874worker1 # [ 150.041702] nix-grpc-daemon[1531]: time=2026-09-20T08:19:23.625Z level=INFO msg="Uploading 1 narinfos"5875lb # [ 150.071346] niks3-server[1040]: 2026/09/20 08:19:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5876lb # [ 150.083707] niks3-server[1040]: 2026/09/20 08:19:23 INFO Signed narinfos id=50 count=15877lb # [ 150.090559] niks3-server[1040]: 2026/09/20 08:19:23 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls5878lb # [ 150.099286] niks3-server[1040]: 2026/09/20 08:19:23 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5879lb # [ 150.108168] niks3-server[1040]: 2026/09/20 08:19:23 INFO Completed upload id=505880worker1 # [ 150.083311] nix-grpc-daemon[1531]: time=2026-09-20T08:19:23.667Z level=INFO msg="Upload complete. (576ms)"5881lb # [ 150.112788] niks3-server[1040]: 2026/09/20 08:19:23 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo5882worker1 # [ 150.097743] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54082 duration_s=0 paths=1 nar_bytes_in=6245883worker1 # [ 150.116853] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540825884worker1 # [ 150.128422] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5885worker1 # [ 150.136425] nix-daemon[837]: reaped child process 1833, status = succeeded5886worker1 # [ 150.156585] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5887lb # [ 150.434264] envoy[910]: conn peer=[2001:db8:1::4]:54080 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=846 tx=309 ms=272155888worker1 # [ 151.804609] nix-daemon[837]: reaped child process 1847, status = succeeded5889worker1 # [ 152.057711] nix-daemon[837]: accepted connection from pid 1862, user nix-grpc-daemon (trusted)5890worker1 # [ 152.088467] nix-daemon[837]: reaped child process 1865, status = succeeded5891lb # [ 152.127657] niks3-server[1040]: 2026/09/20 08:19:25 INFO Received uploads request method=POST path=/api/pending_closures5892worker1 # [ 152.116716] nix-grpc-daemon[1531]: time=2026-09-20T08:19:25.698Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5893worker1 # [ 152.118223] nix-grpc-daemon[1531]: time=2026-09-20T08:19:25.698Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"5894lb # [ 152.206058] niks3-server[1040]: 2026/09/20 08:19:25 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst5895lb # [ 152.220363] niks3-server[1040]: 2026/09/20 08:19:25 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv5896worker1 # [ 152.205321] nix-grpc-daemon[1531]: time=2026-09-20T08:19:25.788Z level=INFO msg="Uploading 1 narinfos"5897lb # [ 152.235134] niks3-server[1040]: 2026/09/20 08:19:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign5898lb # [ 152.245459] niks3-server[1040]: 2026/09/20 08:19:25 INFO Signed narinfos id=51 count=15899lb # [ 152.250157] niks3-server[1040]: 2026/09/20 08:19:25 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls5900lb # [ 152.258979] niks3-server[1040]: 2026/09/20 08:19:25 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete5901lb # [ 152.268318] niks3-server[1040]: 2026/09/20 08:19:25 INFO Completed upload id=515902worker1 # [ 152.242415] nix-grpc-daemon[1531]: time=2026-09-20T08:19:25.826Z level=INFO msg="Upload complete. (470ms)"5903lb # [ 152.271343] niks3-server[1040]: 2026/09/20 08:19:25 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo5904worker1 # [ 152.267156] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54082 duration_s=2 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=10 outputs=15905worker1 # [ 152.287657] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:25Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=15906worker1 # [ 152.304410] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540825907worker1 # [ 152.310801] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:25Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=05908worker1 # [ 152.318966] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540825909worker1 # [ 152.324199] nix-daemon[837]: reaped child process 1845, status = succeeded5910worker1 # [ 152.326374] nix-grpc-daemon[1531]: time=2026-09-20T08:19:25.907Z level=INFO msg="All 1 paths already cached"5911worker1 # [ 152.330634] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:540825912worker1 # [ 152.342533] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5913worker1 # [ 152.578530] nix-daemon[837]: accepted connection from pid 1871, user nix-grpc-daemon (trusted)5914worker1 # [ 152.603778] nix-daemon[837]: reaped child process 1874, status = succeeded5915worker1 # [ 152.804174] nix-daemon[837]: accepted connection from pid 1876, user nix-grpc-daemon (trusted)5916worker1 # [ 152.823400] nix-daemon[837]: reaped child process 1879, status = succeeded5917lb # [ 152.861450] niks3-server[1040]: 2026/09/20 08:19:26 INFO Received uploads request method=POST path=/api/pending_closures5918worker1 # [ 152.847698] nix-grpc-daemon[1531]: time=2026-09-20T08:19:26.431Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5919worker1 # [ 152.849396] nix-grpc-daemon[1531]: time=2026-09-20T08:19:26.431Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"5920lb # [ 152.896295] niks3-server[1040]: 2026/09/20 08:19:26 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst5921lb # [ 152.915540] niks3-server[1040]: 2026/09/20 08:19:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign5922worker1 # [ 152.900432] nix-grpc-daemon[1531]: time=2026-09-20T08:19:26.484Z level=INFO msg="Uploading 1 narinfos"5923lb # [ 152.928302] niks3-server[1040]: 2026/09/20 08:19:26 INFO Signed narinfos id=52 count=15924lb # [ 152.931603] niks3-server[1040]: 2026/09/20 08:19:26 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls5925lb # [ 152.950813] niks3-server[1040]: 2026/09/20 08:19:26 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete5926lb # [ 152.961778] niks3-server[1040]: 2026/09/20 08:19:26 INFO Completed upload id=525927worker1 # [ 152.935341] nix-grpc-daemon[1531]: time=2026-09-20T08:19:26.519Z level=INFO msg="Upload complete. (576ms)"5928lb # [ 152.965235] niks3-server[1040]: 2026/09/20 08:19:26 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo5929worker1 # [ 152.948342] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54082 duration_s=0 paths=1 nar_bytes_in=6245930worker1 # [ 152.961344] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540825931worker1 # [ 152.980494] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5932worker1 # [ 152.988188] nix-daemon[837]: reaped child process 1869, status = succeeded5933worker1 # [ 153.007696] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5934worker1 # [ 153.676926] nix-daemon[837]: reaped child process 1883, status = succeeded5935worker1 # [ 153.870200] nix-daemon[837]: accepted connection from pid 1898, user nix-grpc-daemon (trusted)5936worker1 # [ 153.888775] nix-daemon[837]: reaped child process 1901, status = succeeded5937lb # [ 153.927086] niks3-server[1040]: 2026/09/20 08:19:27 INFO Received uploads request method=POST path=/api/pending_closures5938worker1 # [ 153.912380] nix-grpc-daemon[1531]: time=2026-09-20T08:19:27.495Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5939worker1 # [ 153.913895] nix-grpc-daemon[1531]: time=2026-09-20T08:19:27.495Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"5940lb # [ 153.970185] niks3-server[1040]: 2026/09/20 08:19:27 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst5941lb # [ 153.983004] niks3-server[1040]: 2026/09/20 08:19:27 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv5942lb # [ 153.993565] niks3-server[1040]: 2026/09/20 08:19:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign5943worker1 # [ 153.974719] nix-grpc-daemon[1531]: time=2026-09-20T08:19:27.558Z level=INFO msg="Uploading 1 narinfos"5944lb # [ 154.003118] niks3-server[1040]: 2026/09/20 08:19:27 INFO Signed narinfos id=53 count=15945lb # [ 154.008237] niks3-server[1040]: 2026/09/20 08:19:27 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls5946lb # [ 154.015692] niks3-server[1040]: 2026/09/20 08:19:27 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete5947lb # [ 154.021845] niks3-server[1040]: 2026/09/20 08:19:27 INFO Completed upload id=535948worker1 # [ 153.996592] nix-grpc-daemon[1531]: time=2026-09-20T08:19:27.580Z level=INFO msg="Upload complete. (365ms)"5949lb # [ 154.024327] niks3-server[1040]: 2026/09/20 08:19:27 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo5950worker1 # [ 154.014992] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54082 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=11 outputs=15951worker1 # [ 154.031488] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:27Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=15952worker1 # [ 154.040863] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540825953worker1 # [ 154.046715] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:27Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=05954worker1 # [ 154.050252] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540825955worker1 # [ 154.054947] nix-daemon[837]: reaped child process 1881, status = succeeded5956worker1 # [ 154.065099] nix-grpc-daemon[1531]: time=2026-09-20T08:19:27.624Z level=INFO msg="All 1 paths already cached"5957worker1 # [ 154.067723] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5958worker1 # [ 154.073259] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:540825959worker1 # [ 154.255260] nix-daemon[837]: accepted connection from pid 1907, user nix-grpc-daemon (trusted)5960worker1 # [ 154.273459] nix-daemon[837]: reaped child process 1910, status = succeeded5961worker1 # [ 154.451746] nix-daemon[837]: accepted connection from pid 1912, user nix-grpc-daemon (trusted)5962worker1 # [ 154.469420] nix-daemon[837]: reaped child process 1915, status = succeeded5963lb # [ 154.507987] niks3-server[1040]: 2026/09/20 08:19:28 INFO Received uploads request method=POST path=/api/pending_closures5964worker1 # [ 154.491964] nix-grpc-daemon[1531]: time=2026-09-20T08:19:28.075Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5965worker1 # [ 154.493737] nix-grpc-daemon[1531]: time=2026-09-20T08:19:28.075Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"5966lb # [ 154.536675] niks3-server[1040]: 2026/09/20 08:19:28 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst5967worker1 # [ 154.523415] nix-grpc-daemon[1531]: time=2026-09-20T08:19:28.107Z level=INFO msg="Uploading 1 narinfos"5968lb # [ 154.552974] niks3-server[1040]: 2026/09/20 08:19:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign5969lb # [ 154.563834] niks3-server[1040]: 2026/09/20 08:19:28 INFO Signed narinfos id=54 count=15970lb # [ 154.568720] niks3-server[1040]: 2026/09/20 08:19:28 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls5971lb # [ 154.578499] niks3-server[1040]: 2026/09/20 08:19:28 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete5972lb # [ 154.584858] niks3-server[1040]: 2026/09/20 08:19:28 INFO Completed upload id=545973worker1 # [ 154.561507] nix-grpc-daemon[1531]: time=2026-09-20T08:19:28.144Z level=INFO msg="Upload complete. (480ms)"5974lb # [ 154.589379] niks3-server[1040]: 2026/09/20 08:19:28 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo5975worker1 # [ 154.568393] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54082 duration_s=0 paths=1 nar_bytes_in=6245976worker1 # [ 154.579664] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540825977worker1 # [ 154.585568] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5978worker1 # [ 154.590500] nix-daemon[837]: reaped child process 1905, status = succeeded5979worker1 # [ 154.603545] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5980worker1 # [ 155.824940] nix-daemon[837]: reaped child process 1919, status = succeeded5981worker1 # [ 155.987363] nix-daemon[837]: accepted connection from pid 1934, user nix-grpc-daemon (trusted)5982worker1 # [ 156.006464] nix-daemon[837]: reaped child process 1937, status = succeeded5983lb # [ 156.043794] niks3-server[1040]: 2026/09/20 08:19:29 INFO Received uploads request method=POST path=/api/pending_closures5984worker1 # [ 156.028672] nix-grpc-daemon[1531]: time=2026-09-20T08:19:29.612Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5985worker1 # [ 156.034639] nix-grpc-daemon[1531]: time=2026-09-20T08:19:29.612Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"5986lb # [ 156.083301] niks3-server[1040]: 2026/09/20 08:19:29 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst5987lb # [ 156.097334] niks3-server[1040]: 2026/09/20 08:19:29 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv5988worker1 # [ 156.083487] nix-grpc-daemon[1531]: time=2026-09-20T08:19:29.667Z level=INFO msg="Uploading 1 narinfos"5989lb # [ 156.109858] niks3-server[1040]: 2026/09/20 08:19:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign5990lb # [ 156.118219] niks3-server[1040]: 2026/09/20 08:19:29 INFO Signed narinfos id=55 count=15991lb # [ 156.121416] niks3-server[1040]: 2026/09/20 08:19:29 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls5992worker1 # [ 156.107045] nix-grpc-daemon[1531]: time=2026-09-20T08:19:29.691Z level=INFO msg="Upload complete. (294ms)"5993lb # [ 156.132297] niks3-server[1040]: 2026/09/20 08:19:29 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete5994lb # [ 156.135251] niks3-server[1040]: 2026/09/20 08:19:29 INFO Completed upload id=555995lb # [ 156.140527] niks3-server[1040]: 2026/09/20 08:19:29 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo5996worker1 # [ 156.121328] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54082 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=12 outputs=15997worker1 # [ 156.136297] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:29Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=15998worker1 # [ 156.146844] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540825999worker1 # [ 156.150995] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:29Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=06000worker1 # [ 156.155860] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540826001worker1 # [ 156.160579] nix-grpc-daemon[1531]: time=2026-09-20T08:19:29.743Z level=INFO msg="All 2 paths already cached"6002worker1 # [ 156.163136] nix-daemon[837]: reaped child process 1917, status = succeeded6003worker1 # [ 156.167436] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:540826004worker1 # [ 156.175701] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)6005worker1 # [ 156.362956] nix-daemon[837]: accepted connection from pid 1943, user nix-grpc-daemon (trusted)6006worker1 # [ 156.380855] nix-daemon[837]: reaped child process 1946, status = succeeded6007worker1 # [ 156.556478] nix-daemon[837]: accepted connection from pid 1948, user nix-grpc-daemon (trusted)6008worker1 # [ 156.575477] nix-daemon[837]: reaped child process 1951, status = succeeded6009lb # [ 156.612210] niks3-server[1040]: 2026/09/20 08:19:30 INFO Received uploads request method=POST path=/api/pending_closures6010worker1 # [ 156.596091] nix-grpc-daemon[1531]: time=2026-09-20T08:19:30.179Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6011worker1 # [ 156.597579] nix-grpc-daemon[1531]: time=2026-09-20T08:19:30.180Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"6012lb # [ 156.644527] niks3-server[1040]: 2026/09/20 08:19:30 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst6013lb # [ 156.656383] niks3-server[1040]: 2026/09/20 08:19:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6014worker1 # [ 156.637636] nix-grpc-daemon[1531]: time=2026-09-20T08:19:30.221Z level=INFO msg="Uploading 1 narinfos"6015lb # [ 156.667675] niks3-server[1040]: 2026/09/20 08:19:30 INFO Signed narinfos id=56 count=16016lb # [ 156.678207] niks3-server[1040]: 2026/09/20 08:19:30 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls6017lb # [ 156.687705] niks3-server[1040]: 2026/09/20 08:19:30 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6018lb # [ 156.693103] niks3-server[1040]: 2026/09/20 08:19:30 INFO Completed upload id=566019worker1 # [ 156.668214] nix-grpc-daemon[1531]: time=2026-09-20T08:19:30.252Z level=INFO msg="Upload complete. (482ms)"6020lb # [ 156.696118] niks3-server[1040]: 2026/09/20 08:19:30 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo6021worker1 # [ 156.676301] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54082 duration_s=0 paths=1 nar_bytes_in=7526022worker1 # [ 156.690377] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540826023worker1 # [ 156.696901] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)6024worker1 # [ 156.701928] nix-daemon[837]: reaped child process 1941, status = succeeded6025worker1 # [ 156.716207] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)6026worker1 # [ 158.138729] nix-daemon[837]: reaped child process 1955, status = succeeded6027worker1 # [ 158.301175] nix-daemon[837]: accepted connection from pid 1970, user nix-grpc-daemon (trusted)6028worker1 # [ 158.318978] nix-daemon[837]: reaped child process 1973, status = succeeded6029lb # [ 158.356630] niks3-server[1040]: 2026/09/20 08:19:31 INFO Received uploads request method=POST path=/api/pending_closures6030worker1 # [ 158.344223] nix-grpc-daemon[1531]: time=2026-09-20T08:19:31.926Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6031worker1 # [ 158.345694] nix-grpc-daemon[1531]: time=2026-09-20T08:19:31.926Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"6032lb # [ 158.390703] niks3-server[1040]: 2026/09/20 08:19:31 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv6033lb # [ 158.403354] niks3-server[1040]: 2026/09/20 08:19:31 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst6034lb # [ 158.414943] niks3-server[1040]: 2026/09/20 08:19:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6035worker1 # [ 158.398603] nix-grpc-daemon[1531]: time=2026-09-20T08:19:31.982Z level=INFO msg="Uploading 1 narinfos"6036lb # [ 158.423357] niks3-server[1040]: 2026/09/20 08:19:32 INFO Signed narinfos id=57 count=16037lb # [ 158.427789] niks3-server[1040]: 2026/09/20 08:19:32 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls6038lb # [ 158.440686] niks3-server[1040]: 2026/09/20 08:19:32 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6039worker1 # [ 158.421239] nix-grpc-daemon[1531]: time=2026-09-20T08:19:32.005Z level=INFO msg="Upload complete. (294ms)"6040lb # [ 158.447614] niks3-server[1040]: 2026/09/20 08:19:32 INFO Completed upload id=576041lb # [ 158.451538] niks3-server[1040]: 2026/09/20 08:19:32 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo6042worker1 # [ 158.432653] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54082 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=13 outputs=16043worker1 # [ 158.449627] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:32Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=16044worker1 # [ 158.455030] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540826045worker1 # [ 158.460891] nix-daemon[837]: reaped child process 1953, status = succeeded6046worker1 # [ 158.464597] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540826047worker1 # [ 158.475270] nix-grpc-daemon[1531]: time=2026-09-20T08:19:32.059Z level=INFO msg="All 2 paths already cached"6048worker1 # [ 158.482766] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:540826049worker1 # [ 158.493055] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)6050worker1 # [ 158.678221] nix-daemon[837]: accepted connection from pid 1977, user nix-grpc-daemon (trusted)6051worker1 # [ 158.695672] nix-daemon[837]: reaped child process 1980, status = succeeded6052worker1 # [ 158.872414] nix-daemon[837]: accepted connection from pid 1982, user nix-grpc-daemon (trusted)6053worker1 # [ 158.889311] nix-daemon[837]: reaped child process 1985, status = succeeded6054lb # [ 158.927960] niks3-server[1040]: 2026/09/20 08:19:32 INFO Received uploads request method=POST path=/api/pending_closures6055worker1 # [ 158.912252] nix-grpc-daemon[1531]: time=2026-09-20T08:19:32.496Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6056worker1 # [ 158.914143] nix-grpc-daemon[1531]: time=2026-09-20T08:19:32.496Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"6057lb # [ 158.955684] niks3-server[1040]: 2026/09/20 08:19:32 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst6058lb # [ 158.971198] niks3-server[1040]: 2026/09/20 08:19:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6059worker1 # [ 158.952672] nix-grpc-daemon[1531]: time=2026-09-20T08:19:32.536Z level=INFO msg="Uploading 1 narinfos"6060lb # [ 158.980604] niks3-server[1040]: 2026/09/20 08:19:32 INFO Signed narinfos id=58 count=16061lb # [ 158.987510] niks3-server[1040]: 2026/09/20 08:19:32 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls6062lb # [ 158.995638] niks3-server[1040]: 2026/09/20 08:19:32 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6063lb # [ 159.002313] niks3-server[1040]: 2026/09/20 08:19:32 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo6064lb # [ 159.007685] niks3-server[1040]: 2026/09/20 08:19:32 INFO Completed upload id=586065worker1 # [ 158.982988] nix-grpc-daemon[1531]: time=2026-09-20T08:19:32.567Z level=INFO msg="Upload complete. (477ms)"6066worker1 # [ 158.991205] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54082 duration_s=0 paths=1 nar_bytes_in=7526067worker1 # [ 159.005424] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540826068worker1 # [ 159.011817] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)6069worker1 # [ 159.016992] nix-daemon[837]: reaped child process 1975, status = succeeded6070worker1 # [ 159.030523] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)6071worker1 # [ 159.853608] nix-daemon[837]: reaped child process 1989, status = succeeded6072worker1 # [ 160.010670] nix-daemon[837]: accepted connection from pid 2004, user nix-grpc-daemon (trusted)6073worker1 # [ 160.030077] nix-daemon[837]: reaped child process 2007, status = succeeded6074lb # [ 160.069420] niks3-server[1040]: 2026/09/20 08:19:33 INFO Received uploads request method=POST path=/api/pending_closures6075worker1 # [ 160.056396] nix-grpc-daemon[1531]: time=2026-09-20T08:19:33.638Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6076worker1 # [ 160.057859] nix-grpc-daemon[1531]: time=2026-09-20T08:19:33.638Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"6077lb # [ 160.107186] niks3-server[1040]: 2026/09/20 08:19:33 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv6078lb # [ 160.120657] niks3-server[1040]: 2026/09/20 08:19:33 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst6079lb # [ 160.130871] niks3-server[1040]: 2026/09/20 08:19:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6080worker1 # [ 160.111245] nix-grpc-daemon[1531]: time=2026-09-20T08:19:33.694Z level=INFO msg="Uploading 1 narinfos"6081lb # [ 160.142547] niks3-server[1040]: 2026/09/20 08:19:33 INFO Signed narinfos id=59 count=16082lb # [ 160.148174] niks3-server[1040]: 2026/09/20 08:19:33 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls6083lb # [ 160.155081] niks3-server[1040]: 2026/09/20 08:19:33 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6084lb # [ 160.160784] niks3-server[1040]: 2026/09/20 08:19:33 INFO Completed upload id=596085worker1 # [ 160.135086] nix-grpc-daemon[1531]: time=2026-09-20T08:19:33.719Z level=INFO msg="Upload complete. (295ms)"6086lb # [ 160.163695] niks3-server[1040]: 2026/09/20 08:19:33 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo6087worker1 # [ 160.148462] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54082 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=14 outputs=16088worker1 # [ 160.161027] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:33Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=16089worker1 # [ 160.171259] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540826090worker1 # [ 160.176343] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540826091worker1 # [ 160.180564] nix-grpc-daemon[1531]: time=2026-09-20T08:19:33.763Z level=INFO msg="All 2 paths already cached"6092worker1 # [ 160.183195] nix-daemon[837]: reaped child process 1987, status = succeeded6093worker1 # [ 160.186933] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:540826094worker1 # [ 160.196257] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)6095worker1 # [ 160.378253] nix-daemon[837]: accepted connection from pid 2011, user nix-grpc-daemon (trusted)6096worker1 # [ 160.397634] nix-daemon[837]: reaped child process 2014, status = succeeded6097worker1 # [ 160.579089] nix-daemon[837]: accepted connection from pid 2016, user nix-grpc-daemon (trusted)6098worker1 # [ 160.596674] nix-daemon[837]: reaped child process 2019, status = succeeded6099lb # [ 160.632739] niks3-server[1040]: 2026/09/20 08:19:34 INFO Received uploads request method=POST path=/api/pending_closures6100worker1 # [ 160.616115] nix-grpc-daemon[1531]: time=2026-09-20T08:19:34.200Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6101worker1 # [ 160.618011] nix-grpc-daemon[1531]: time=2026-09-20T08:19:34.201Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"6102lb # [ 160.659600] niks3-server[1040]: 2026/09/20 08:19:34 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst6103lb # [ 160.674241] niks3-server[1040]: 2026/09/20 08:19:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6104worker1 # [ 160.655121] nix-grpc-daemon[1531]: time=2026-09-20T08:19:34.238Z level=INFO msg="Uploading 1 narinfos"6105lb # [ 160.686536] niks3-server[1040]: 2026/09/20 08:19:34 INFO Signed narinfos id=60 count=16106lb # [ 160.693530] niks3-server[1040]: 2026/09/20 08:19:34 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls6107worker1 # [ 160.680152] nix-grpc-daemon[1531]: time=2026-09-20T08:19:34.264Z level=INFO msg="Upload complete. (474ms)"6108lb # [ 160.704364] niks3-server[1040]: 2026/09/20 08:19:34 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6109lb # [ 160.711330] niks3-server[1040]: 2026/09/20 08:19:34 INFO Completed upload id=606110worker1 # [ 160.688228] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54082 duration_s=0 paths=1 nar_bytes_in=7526111lb # [ 160.715588] niks3-server[1040]: 2026/09/20 08:19:34 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo6112worker1 # [ 160.699745] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540826113worker1 # [ 160.708314] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)6114worker1 # [ 160.710866] nix-daemon[837]: reaped child process 2009, status = succeeded6115worker1 # [ 160.721656] nix-daemon[837]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)6116worker1 # [ 162.148838] nix-daemon[837]: reaped child process 2023, status = succeeded6117worker1 # [ 162.311439] nix-daemon[837]: accepted connection from pid 2038, user nix-grpc-daemon (trusted)6118worker1 # [ 162.330842] nix-daemon[837]: reaped child process 2041, status = succeeded6119lb # [ 162.370116] niks3-server[1040]: 2026/09/20 08:19:35 INFO Received uploads request method=POST path=/api/pending_closures6120worker1 # [ 162.354142] nix-grpc-daemon[1531]: time=2026-09-20T08:19:35.937Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6121worker1 # [ 162.355627] nix-grpc-daemon[1531]: time=2026-09-20T08:19:35.937Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"6122lb # [ 162.402786] niks3-server[1040]: 2026/09/20 08:19:35 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst6123lb # [ 162.417748] niks3-server[1040]: 2026/09/20 08:19:36 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv6124worker1 # [ 162.403130] nix-grpc-daemon[1531]: time=2026-09-20T08:19:35.986Z level=INFO msg="Uploading 1 narinfos"6125lb # [ 162.430121] niks3-server[1040]: 2026/09/20 08:19:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6126lb # [ 162.437532] niks3-server[1040]: 2026/09/20 08:19:36 INFO Signed narinfos id=61 count=16127lb # [ 162.439713] niks3-server[1040]: 2026/09/20 08:19:36 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls6128lb # [ 162.446940] niks3-server[1040]: 2026/09/20 08:19:36 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6129lb # [ 162.451316] niks3-server[1040]: 2026/09/20 08:19:36 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo6130lb # [ 162.454840] niks3-server[1040]: 2026/09/20 08:19:36 INFO Completed upload id=616131worker1 # [ 162.429831] nix-grpc-daemon[1531]: time=2026-09-20T08:19:36.013Z level=INFO msg="Upload complete. (296ms)"6132worker1 # [ 162.440990] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54082 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=15 outputs=16133worker1 # [ 162.457957] nix-daemon[837]: reaped child process 2021, status = succeeded6134client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 19.83 seconds)6135worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6136worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.08 seconds)6137client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag f5 --arg features '["gpu"]'6138client # [ 162.753006] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag f5 --arg features "[\"gpu\"]".6139client # Running as unit: gpu.service; invocation ID: ba43d9c69e28420fb68cc9ca3b51bc056140client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.11 seconds)6141lb: must succeed: curl -sf localhost:9901/clusters6142lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)6143lb: must succeed: curl -sf localhost:9901/clusters6144lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)6145worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="aarch64-linux"} ' || true6146worker1 # [ 162.924922] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:540826147client # [ 162.996950] nix[1318]: don't know how to build these paths:6148client # [ 162.997940] nix[1318]: /nix/store/3i1nziwpdqq19lzpqy4rywzxnm8dlps6-farm-top.drv6149worker1 # [ 162.940379] nix-grpc-daemon[1439]: ts=2026-09-20T08:19:36Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=06150client # [ 163.007532] nix[1318]: warning: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, waiting up to 120s for a worker6151worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="aarch64-linux"} ' || true, in 0.10 seconds)6152client: waiting for success: systemctl show -p Result gpu | grep -q exit-code6153lb # [ 170.437389] envoy[910]: conn peer=[2001:db8:1::1]:47412 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=26854 tx=10652 ms=195306154client # [ 283.014172] nix[1318]: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}6155client # [ 283.028279] nix[1318]: error: dependency '1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv' failed6156client # [ 283.068585] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE6157client # [ 283.075216] systemd[1]: gpu.service: Failed with result 'exit-code'.6158client # [ 283.078249] systemd[1]: gpu.service: Consumed 201ms CPU time over 2min 319ms wall clock time, 33.2M memory peak, 4K written to disk, 6.5K incoming IP traffic, 5.5K outgoing IP traffic.6159client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 120.08 seconds)6160client: must succeed: journalctl -u gpu -o cat6161client: (finished: must succeed: journalctl -u gpu -o cat, in 0.03 seconds)6162lb: must succeed: curl -sf localhost:9901/clusters6163lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)6164lb: must succeed: curl -sf localhost:9901/clusters6165lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)6166worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="aarch64-linux"} ' || true6167worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="aarch64-linux"} ' || true, in 0.09 seconds)6168(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 140.61 seconds)6169subtest: low disk drains a worker and builds go to the other6170worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6171worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.10 seconds)6172worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6173worker1 # [ 285.166070] nix-grpc-daemon[1439]: ts=2026-09-20T08:21:38Z level=info event=unhealthy reason=min_free6174worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.13 seconds)6175client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain >&26176worker2 # [ 285.799161] nix-grpc-daemon[1695]: ts=2026-09-20T08:21:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:561666177worker2 # [ 285.817820] nix-daemon[863]: accepted connection from pid 1695, user nix-grpc-daemon (trusted)6178client # don't know how to build these paths:6179client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6180worker1 # [ 285.837549] nix-grpc-daemon[1439]: ts=2026-09-20T08:21:39Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=06181worker1 # [ 285.838012] nix-grpc-daemon[1439]: ts=2026-09-20T08:21:39Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=16182worker2 # [ 285.902076] nix-grpc-daemon[1695]: ts=2026-09-20T08:21:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:561666183worker2 # [ 285.923246] nix-grpc-daemon[1695]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 87 ms (attempt 1/5)6184worker2 # [ 286.018062] nix-grpc-daemon[1695]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 134 ms (attempt 2/5)6185worker2 # [ 286.159724] nix-grpc-daemon[1695]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 365 ms (attempt 3/5)6186worker2 # [ 286.525229] nix-grpc-daemon[1695]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 306 ms (attempt 4/5)6187worker2 # [ 286.840949] nix-grpc-daemon[1695]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6188worker2 # [ 286.870381] nix-grpc-daemon[1695]: ts=2026-09-20T08:21:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:561666189client # copying 1 paths to 'lb:50051'...6190client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...6191worker2 # [ 286.887536] nix-grpc-daemon[1695]: ts=2026-09-20T08:21:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:561666192worker2 # [ 286.905243] nix-daemon[863]: accepted connection from pid 1695, user nix-grpc-daemon (trusted)6193worker2 # [ 286.938129] nix-grpc-daemon[1695]: ts=2026-09-20T08:21:40Z level=info event=niks3_push_started pid=17516194worker2 # [ 287.339591] nix-daemon[863]: accepted connection from pid 1764, user nix-grpc-daemon (trusted)6195worker2 # [ 287.359918] nix-daemon[863]: reaped child process 1767, status = succeeded6196worker2 # [ 287.532778] nix-daemon[863]: accepted connection from pid 1769, user nix-grpc-daemon (trusted)6197worker2 # [ 287.551303] nix-daemon[863]: reaped child process 1772, status = succeeded6198lb # [ 287.575437] niks3-server[1040]: 2026/09/20 08:21:41 INFO Received uploads request method=POST path=/api/pending_closures6199worker2 # [ 287.580365] nix-grpc-daemon[1751]: time=2026-09-20T08:21:41.156Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6200worker2 # [ 287.581960] nix-grpc-daemon[1751]: time=2026-09-20T08:21:41.156Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6201lb # [ 287.622053] niks3-server[1040]: 2026/09/20 08:21:41 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6202worker2 # [ 287.628491] nix-grpc-daemon[1751]: time=2026-09-20T08:21:41.206Z level=INFO msg="Uploading 1 narinfos"6203lb # [ 287.636655] niks3-server[1040]: 2026/09/20 08:21:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6204lb # [ 287.647981] niks3-server[1040]: 2026/09/20 08:21:41 INFO Signed narinfos id=62 count=16205lb # [ 287.651349] niks3-server[1040]: 2026/09/20 08:21:41 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6206lb # [ 287.665916] niks3-server[1040]: 2026/09/20 08:21:41 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6207lb # [ 287.674146] niks3-server[1040]: 2026/09/20 08:21:41 INFO Completed upload id=626208worker2 # [ 287.664603] nix-grpc-daemon[1751]: time=2026-09-20T08:21:41.242Z level=INFO msg="Upload complete. (497ms)"6209lb # [ 287.676839] niks3-server[1040]: 2026/09/20 08:21:41 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6210worker2 # [ 287.676801] nix-grpc-daemon[1695]: ts=2026-09-20T08:21:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56166 duration_s=0 paths=1 nar_bytes_in=5126211worker2 # [ 287.692443] nix-grpc-daemon[1695]: ts=2026-09-20T08:21:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:561666212worker2 # [ 287.699975] nix-daemon[863]: accepted connection from pid 1695, user nix-grpc-daemon (trusted)6213worker2 # [ 287.706175] nix-daemon[863]: reaped child process 1749, status = succeeded6214client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6215client # farm-a> worker2-next: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6216worker2 # [ 287.721850] nix-daemon[863]: accepted connection from pid 1695, user nix-grpc-daemon (trusted)6217client # farm-a> LOG-farm-a-drain6218worker2 # [ 288.566838] nix-daemon[863]: reaped child process 1776, status = succeeded6219worker2 # [ 288.752199] nix-daemon[863]: accepted connection from pid 1791, user nix-grpc-daemon (trusted)6220worker2 # [ 288.774390] nix-daemon[863]: reaped child process 1794, status = succeeded6221lb # [ 288.794664] niks3-server[1040]: 2026/09/20 08:21:42 INFO Received uploads request method=POST path=/api/pending_closures6222worker2 # [ 288.800616] nix-grpc-daemon[1751]: time=2026-09-20T08:21:42.376Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6223worker2 # [ 288.805763] nix-grpc-daemon[1751]: time=2026-09-20T08:21:42.376Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6224lb # [ 288.851589] niks3-server[1040]: 2026/09/20 08:21:42 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6225lb # [ 288.861716] niks3-server[1040]: 2026/09/20 08:21:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6226worker2 # [ 288.854631] nix-grpc-daemon[1751]: time=2026-09-20T08:21:42.430Z level=INFO msg="Uploading 1 narinfos"6227lb # [ 288.866742] niks3-server[1040]: 2026/09/20 08:21:42 INFO Signed narinfos id=63 count=16228lb # [ 288.873792] niks3-server[1040]: 2026/09/20 08:21:42 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6229lb # [ 288.882820] niks3-server[1040]: 2026/09/20 08:21:42 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6230lb # [ 288.889517] niks3-server[1040]: 2026/09/20 08:21:42 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6231lb # [ 288.897436] niks3-server[1040]: 2026/09/20 08:21:42 INFO Completed upload id=636232worker2 # [ 288.887836] nix-grpc-daemon[1751]: time=2026-09-20T08:21:42.466Z level=INFO msg="Upload complete. (354ms)"6233lb # [ 288.900127] niks3-server[1040]: 2026/09/20 08:21:42 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6234worker2 # [ 288.901305] nix-grpc-daemon[1695]: ts=2026-09-20T08:21:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56166 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=16 outputs=16235worker1 # [ 288.889465] nix-grpc-daemon[1439]: ts=2026-09-20T08:21:42Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06236worker1 # [ 288.896173] nix-grpc-daemon[1439]: ts=2026-09-20T08:21:42Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16237worker2 # [ 288.922131] nix-daemon[863]: reaped child process 1774, status = succeeded6238worker2 # [ 288.961764] nix-grpc-daemon[1695]: ts=2026-09-20T08:21:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:561666239worker2 # [ 288.979523] nix-grpc-daemon[1695]: ts=2026-09-20T08:21:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:561666240worker2 # [ 288.995693] nix-grpc-daemon[1751]: time=2026-09-20T08:21:42.573Z level=INFO msg="All 1 paths already cached"6241client # copying 1 paths to 'lb:50051'...6242worker2 # [ 289.005918] nix-grpc-daemon[1695]: ts=2026-09-20T08:21:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:561666243client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6244worker2 # [ 289.022772] nix-daemon[863]: accepted connection from pid 1695, user nix-grpc-daemon (trusted)6245worker2 # [ 289.229214] nix-daemon[863]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)6246worker2 # [ 289.251766] nix-daemon[863]: reaped child process 1801, status = succeeded6247worker2 # [ 289.424753] nix-daemon[863]: accepted connection from pid 1803, user nix-grpc-daemon (trusted)6248worker2 # [ 289.446600] nix-daemon[863]: reaped child process 1806, status = succeeded6249lb # [ 289.468167] niks3-server[1040]: 2026/09/20 08:21:43 INFO Received uploads request method=POST path=/api/pending_closures6250worker2 # [ 289.470079] nix-grpc-daemon[1751]: time=2026-09-20T08:21:43.048Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6251worker2 # [ 289.472270] nix-grpc-daemon[1751]: time=2026-09-20T08:21:43.050Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6252lb # [ 289.501290] niks3-server[1040]: 2026/09/20 08:21:43 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6253lb # [ 289.518002] niks3-server[1040]: 2026/09/20 08:21:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6254worker2 # [ 289.515410] nix-grpc-daemon[1751]: time=2026-09-20T08:21:43.093Z level=INFO msg="Uploading 1 narinfos"6255lb # [ 289.531349] niks3-server[1040]: 2026/09/20 08:21:43 INFO Signed narinfos id=64 count=16256lb # [ 289.538632] niks3-server[1040]: 2026/09/20 08:21:43 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6257lb # [ 289.551943] niks3-server[1040]: 2026/09/20 08:21:43 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6258lb # [ 289.556972] niks3-server[1040]: 2026/09/20 08:21:43 INFO Completed upload id=646259worker2 # [ 289.548117] nix-grpc-daemon[1751]: time=2026-09-20T08:21:43.126Z level=INFO msg="Upload complete. (506ms)"6260lb # [ 289.559931] niks3-server[1040]: 2026/09/20 08:21:43 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6261worker2 # [ 289.555670] nix-grpc-daemon[1695]: ts=2026-09-20T08:21:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56166 duration_s=0 paths=1 nar_bytes_in=6326262worker2 # [ 289.572543] nix-grpc-daemon[1695]: ts=2026-09-20T08:21:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:561666263worker2 # [ 289.579853] nix-daemon[863]: accepted connection from pid 1695, user nix-grpc-daemon (trusted)6264worker2 # [ 289.585492] nix-daemon[863]: reaped child process 1796, status = succeeded6265client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6266worker2 # [ 289.598212] nix-daemon[863]: accepted connection from pid 1695, user nix-grpc-daemon (trusted)6267client # farm-b> worker2-next: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6268client # farm-b> LOG-farm-b-drain6269worker2 # [ 290.426059] nix-daemon[863]: reaped child process 1810, status = succeeded6270lb # [ 290.458040] envoy[910]: conn peer=[2001:db8:1::1]:45776 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=727 tx=456 ms=1200486271worker2 # [ 290.590085] nix-daemon[863]: accepted connection from pid 1825, user nix-grpc-daemon (trusted)6272worker2 # [ 290.612383] nix-daemon[863]: reaped child process 1828, status = succeeded6273lb # [ 290.633382] niks3-server[1040]: 2026/09/20 08:21:44 INFO Received uploads request method=POST path=/api/pending_closures6274worker2 # [ 290.635421] nix-grpc-daemon[1751]: time=2026-09-20T08:21:44.212Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6275worker2 # [ 290.637078] nix-grpc-daemon[1751]: time=2026-09-20T08:21:44.212Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6276lb # [ 290.655935] niks3-server[1040]: 2026/09/20 08:21:44 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6277lb # [ 290.669082] niks3-server[1040]: 2026/09/20 08:21:44 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6278lb # [ 290.677607] niks3-server[1040]: 2026/09/20 08:21:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6279worker2 # [ 290.672695] nix-grpc-daemon[1751]: time=2026-09-20T08:21:44.250Z level=INFO msg="Uploading 1 narinfos"6280lb # [ 290.684280] niks3-server[1040]: 2026/09/20 08:21:44 INFO Signed narinfos id=65 count=16281lb # [ 290.688814] niks3-server[1040]: 2026/09/20 08:21:44 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6282lb # [ 290.696221] niks3-server[1040]: 2026/09/20 08:21:44 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6283worker2 # [ 290.692981] nix-grpc-daemon[1751]: time=2026-09-20T08:21:44.271Z level=INFO msg="Upload complete. (281ms)"6284lb # [ 290.703332] niks3-server[1040]: 2026/09/20 08:21:44 INFO Completed upload id=656285lb # [ 290.705659] niks3-server[1040]: 2026/09/20 08:21:44 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6286worker2 # [ 290.700760] nix-grpc-daemon[1695]: ts=2026-09-20T08:21:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56166 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=17 outputs=16287worker1 # [ 290.694885] nix-grpc-daemon[1439]: ts=2026-09-20T08:21:44Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06288worker2 # [ 290.716686] nix-daemon[863]: reaped child process 1808, status = succeeded6289worker1 # [ 290.701292] nix-grpc-daemon[1439]: ts=2026-09-20T08:21:44Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16290worker2 # [ 290.756196] nix-grpc-daemon[1695]: ts=2026-09-20T08:21:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:561666291worker2 # [ 290.771243] nix-grpc-daemon[1695]: ts=2026-09-20T08:21:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:561666292worker2 # [ 290.788203] nix-grpc-daemon[1751]: time=2026-09-20T08:21:44.366Z level=INFO msg="All 2 paths already cached"6293client # copying 1 paths to 'lb:50051'...6294client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6295worker2 # [ 290.799170] nix-grpc-daemon[1695]: ts=2026-09-20T08:21:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:561666296worker2 # [ 290.812057] nix-daemon[863]: accepted connection from pid 1695, user nix-grpc-daemon (trusted)6297worker2 # [ 291.014810] nix-daemon[863]: accepted connection from pid 1832, user nix-grpc-daemon (trusted)6298worker2 # [ 291.035588] nix-daemon[863]: reaped child process 1835, status = succeeded6299worker2 # [ 291.216996] nix-daemon[863]: accepted connection from pid 1837, user nix-grpc-daemon (trusted)6300worker2 # [ 291.237650] nix-daemon[863]: reaped child process 1840, status = succeeded6301lb # [ 291.257175] niks3-server[1040]: 2026/09/20 08:21:44 INFO Received uploads request method=POST path=/api/pending_closures6302worker2 # [ 291.254683] nix-grpc-daemon[1751]: time=2026-09-20T08:21:44.832Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6303worker2 # [ 291.256554] nix-grpc-daemon[1751]: time=2026-09-20T08:21:44.832Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6304lb # [ 291.278525] niks3-server[1040]: 2026/09/20 08:21:44 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6305lb # [ 291.286158] niks3-server[1040]: 2026/09/20 08:21:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6306worker2 # [ 291.282598] nix-grpc-daemon[1751]: time=2026-09-20T08:21:44.860Z level=INFO msg="Uploading 1 narinfos"6307lb # [ 291.291785] niks3-server[1040]: 2026/09/20 08:21:44 INFO Signed narinfos id=66 count=16308lb # [ 291.296429] niks3-server[1040]: 2026/09/20 08:21:44 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6309lb # [ 291.305518] niks3-server[1040]: 2026/09/20 08:21:44 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6310lb # [ 291.312133] niks3-server[1040]: 2026/09/20 08:21:44 INFO Completed upload id=666311worker2 # [ 291.303022] nix-grpc-daemon[1751]: time=2026-09-20T08:21:44.881Z level=INFO msg="Upload complete. (476ms)"6312lb # [ 291.314404] niks3-server[1040]: 2026/09/20 08:21:44 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6313worker2 # [ 291.308294] nix-grpc-daemon[1695]: ts=2026-09-20T08:21:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56166 duration_s=0 paths=1 nar_bytes_in=7606314worker2 # [ 291.319835] nix-grpc-daemon[1695]: ts=2026-09-20T08:21:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:561666315worker2 # [ 291.325201] nix-daemon[863]: accepted connection from pid 1695, user nix-grpc-daemon (trusted)6316worker2 # [ 291.329426] nix-daemon[863]: reaped child process 1830, status = succeeded6317client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6318worker2 # [ 291.342325] nix-daemon[863]: accepted connection from pid 1695, user nix-grpc-daemon (trusted)6319client # farm-top> worker2-next: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6320client # farm-top> LOG-farm-top-drain6321worker2 # [ 292.590740] nix-daemon[863]: reaped child process 1844, status = succeeded6322worker2 # [ 292.775150] nix-daemon[863]: accepted connection from pid 1859, user nix-grpc-daemon (trusted)6323worker2 # [ 292.798503] nix-daemon[863]: reaped child process 1862, status = succeeded6324lb # [ 292.820959] niks3-server[1040]: 2026/09/20 08:21:46 INFO Received uploads request method=POST path=/api/pending_closures6325worker2 # [ 292.822511] nix-grpc-daemon[1751]: time=2026-09-20T08:21:46.398Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6326worker2 # [ 292.824203] nix-grpc-daemon[1751]: time=2026-09-20T08:21:46.398Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6327lb # [ 292.860117] niks3-server[1040]: 2026/09/20 08:21:46 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6328lb # [ 292.872755] niks3-server[1040]: 2026/09/20 08:21:46 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6329lb # [ 292.881821] niks3-server[1040]: 2026/09/20 08:21:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6330worker2 # [ 292.879603] nix-grpc-daemon[1751]: time=2026-09-20T08:21:46.457Z level=INFO msg="Uploading 1 narinfos"6331lb # [ 292.888171] niks3-server[1040]: 2026/09/20 08:21:46 INFO Signed narinfos id=67 count=16332lb # [ 292.894634] niks3-server[1040]: 2026/09/20 08:21:46 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6333lb # [ 292.904420] niks3-server[1040]: 2026/09/20 08:21:46 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6334lb # [ 292.912789] niks3-server[1040]: 2026/09/20 08:21:46 INFO Completed upload id=676335worker2 # [ 292.903911] nix-grpc-daemon[1751]: time=2026-09-20T08:21:46.482Z level=INFO msg="Upload complete. (351ms)"6336lb # [ 292.915739] niks3-server[1040]: 2026/09/20 08:21:46 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6337worker2 # [ 292.914482] nix-grpc-daemon[1695]: ts=2026-09-20T08:21:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56166 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=18 outputs=16338worker2 # [ 292.933457] nix-daemon[863]: reaped child process 1842, status = succeeded6339client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain >&2, in 7.43 seconds)6340client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain outPath6341client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain outPath, in 0.24 seconds)6342worker1: must succeed: rm /nix/.rw-store/fill6343worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds)6344worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6345worker1 # [ 294.178743] nix-grpc-daemon[1439]: ts=2026-09-20T08:21:47Z level=info event=healthy reason=min_free6346worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds)6347(finished: subtest: low disk drains a worker and builds go to the other, in 11.28 seconds)6348(finished: run the VM test script, in 295.53 seconds)6349test script finished in 295.81s6350cleanup6351kill QemuMachine (pid 49)6352client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6353kill QemuMachine (pid 51)6354lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6355kill QemuMachine (pid 50)6356worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6357kill QemuMachine (pid 52)6358worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6359(finished: cleanup, in 1.21 seconds)6360additionally exposed symbols:6361 client, lb, worker1, worker2,6362 vlan1,6363 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh