vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #350
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker2 # Disk image does not exist, creating the virtualisation disk image...13worker2: QEMU running (pid 49)14worker2 # Formatting '/build/vm-state-worker2/tmp.3my0TsJCgh', fmt=raw size=107374182415client: QEMU running (pid 51)16lb # Disk image does not exist, creating the virtualisation disk image...17worker2 # mke2fs 1.47.4 (6-Mar-2025)18worker1 # Disk image does not exist, creating the virtualisation disk image...19client # Disk image does not exist, creating the virtualisation disk image...20worker1: QEMU running (pid 52)21lb: QEMU running (pid 50)22worker1 # Formatting '/build/vm-state-worker1/tmp.fKN39y8ufs', fmt=raw size=107374182423client # Formatting '/build/vm-state-client/tmp.QjTqmFOPfP', fmt=raw size=107374182424lb # Formatting '/build/vm-state-lb/tmp.7JJFhULkWZ', fmt=raw size=107374182425worker2 # Discarding device blocks: 0/262144 done26worker1 # mke2fs 1.47.4 (6-Mar-2025)27client # mke2fs 1.47.4 (6-Mar-2025)28lb # mke2fs 1.47.4 (6-Mar-2025)29worker1 # Discarding device blocks: 0/262144 done30client # Discarding device blocks: 0/262144 done31lb # Discarding device blocks: 0/262144 done32worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes33client # Creating filesystem with 262144 4k blocks and 65536 inodes34lb # Creating filesystem with 262144 4k blocks and 65536 inodes35worker1 # Filesystem UUID: 3f7529e9-ab0e-4f05-b891-70c2fdc0925f36client # Filesystem UUID: 06bb7e13-5214-4938-a8f7-2621e293705837lb # Filesystem UUID: 422dbe56-f045-4405-bb0d-87f7d3d13e0738worker1 # Superblock backups stored on blocks:39client # Superblock backups stored on blocks:40lb # Superblock backups stored on blocks:41worker1 # 32768, 98304, 163840, 22937642client # 32768, 98304, 163840, 22937643lb # 32768, 98304, 163840, 22937644worker1 # 45client # 46lb # 47worker1 # Allocating group tables: 0/8 done48client # Allocating group tables: 0/8 done49lb # Allocating group tables: 0/8 done50worker1 # Writing inode tables: 0/8 done51client # Writing inode tables: 0/8 done52lb # Writing inode tables: 0/8 done53worker1 # Creating journal (8192 blocks): done54client # Creating journal (8192 blocks): done55lb # Creating journal (8192 blocks): done56worker1 # Writing superblocks and filesystem accounting information: 0/8 done57client # Writing superblocks and filesystem accounting information: 0/8 done58lb # Writing superblocks and filesystem accounting information: 0/8 done59worker1 # 60client # 61lb # 62worker1 # Virtualisation disk image created.63client # Virtualisation disk image created.64lb # Virtualisation disk image created.65worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes66(finished: start all VMs, in 0.57 seconds)67worker2 # Filesystem UUID: b5e2efcc-94a2-4ccd-baf5-577ffb9adfaa68worker2 # Superblock backups stored on blocks:69client: waiting for unit network-addresses-eth1.service70worker2 # 32768, 98304, 163840, 22937671client: waiting for the VM to finish booting72worker2 # 73worker2 # Allocating group tables: 0/8 done74worker2 # Writing inode tables: 0/8 done75worker2 # Creating journal (8192 blocks): done76worker2 # Writing superblocks and filesystem accounting information: 0/8 done77worker2 # 78worker2 # Virtualisation disk image created.79client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]80client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202681client # [ 0.000000] KASLR enabled82client # [ 0.000000] random: crng init done83client # [ 0.000000] Machine model: linux,dummy-virt84client # [ 0.000000] efi: UEFI not found.85client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT86client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]87client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]88client # [ 0.000000] Zone ranges:89client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]90client # [ 0.000000] DMA32 empty91client # [ 0.000000] Normal empty92client # [ 0.000000] Device empty93client # [ 0.000000] Movable zone start for each node94client # [ 0.000000] Early memory node ranges95client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]96client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]97client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c40000098client # [ 0.000000] psci: probing for conduit method from DT.99client # [ 0.000000] psci: PSCIv1.3 detected in firmware.100client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs101client # [ 0.000000] psci: Trusted OS migration not required102client # [ 0.000000] psci: SMC Calling Convention v1.1103client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)104client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296105client # [ 0.000000] Detected PIPT I-cache on CPU0106client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)107client # [ 0.000000] CPU features: detected: GICv3 CPU interface108client # [ 0.000000] CPU features: detected: Spectre-v4109client # [ 0.000000] CPU features: detected: Spectre-BHB110client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38111client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23112client # [ 0.000000] alternatives: applying boot alternatives113client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/mhssi7nybyxsq0dawx0m7y4mkj4b8s2a-nixos-system-client-test/init regInfo=/nix/store/jxgsx4568vjrn0ldvf374k83qv8gi6a1-closure-info/registration console=ttyAMA0,115200n8 console=tty0114client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/jxgsx4568vjrn0ldvf374k83qv8gi6a1-closure-info/registration", will be passed to user space.115client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes116client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)117client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)118client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB119client # [ 0.000000] software IO TLB: area num 1.120client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB121client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)122client # [ 0.000000] Fallback order for Node 0: 0123client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216124client # [ 0.000000] Policy zone: DMA125client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off126client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1127client # [ 0.000000] allocated 3145728 bytes of page_ext128client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages129client # [ 0.000000] ftrace: allocated 294 pages with 4 groups130client # [ 0.000000] rcu: Hierarchical RCU implementation.131client # [ 0.000000] rcu: RCU event tracing is enabled.132client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.133client # [ 0.000000] Trampoline variant of Tasks RCU enabled.134client # [ 0.000000] Rude variant of Tasks RCU enabled.135client # [ 0.000000] Tracing variant of Tasks RCU enabled.136client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.137client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1138client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.139client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.140client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.141client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0142client # [ 0.000000] GICv3: 256 SPIs implemented143client # [ 0.000000] GICv3: 0 Extended SPIs implemented144client # [ 0.000000] Root IRQ handler: gic_handle_irq145client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI146client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0147client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000148client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]149client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)150client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)151client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000152client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000153client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.154worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]155client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns156client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).157worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026158worker2 # [ 0.000000] KASLR enabled159client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns160worker2 # [ 0.000000] random: crng init done161worker2 # [ 0.000000] Machine model: linux,dummy-virt162client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns163worker2 # [ 0.000000] efi: UEFI not found.164client # [ 0.000037] arm-pv: using stolen time PV165worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT166client # [ 0.000715] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)167worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]168client # [ 0.000886] Console: colour dummy device 80x25169client # [ 0.000894] printk: legacy console [tty0] enabled170worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]171worker2 # [ 0.000000] Zone ranges:172worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]173client # [ 0.001083] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)174worker2 # [ 0.000000] DMA32 empty175worker2 # [ 0.000000] Normal empty176client # [ 0.001090] pid_max: default: 32768 minimum: 301177worker2 # [ 0.000000] Device empty178client # [ 0.001171] LSM: initializing lsm=capability,landlock,yama,bpf,ima179worker2 # [ 0.000000] Movable zone start for each node180client # [ 0.001408] landlock: Up and running.181worker2 # [ 0.000000] Early memory node ranges182client # [ 0.001412] Yama: becoming mindful.183client # [ 0.002129] LSM support for eBPF active184worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]185client # [ 0.002303] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)186worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]187worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000188client # [ 0.002335] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)189worker2 # [ 0.000000] psci: probing for conduit method from DT.190client # [ 0.003528] cacheinfo: Unable to detect cache hierarchy for CPU 0191worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.192client # [ 0.004306] rcu: Hierarchical SRCU implementation.193worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs194client # [ 0.004311] rcu: Max phase no-delay instances is 1000.195worker2 # [ 0.000000] psci: Trusted OS migration not required196client # [ 0.005559] fsl-mc MSI: its@8080000 domain created197worker2 # [ 0.000000] psci: SMC Calling Convention v1.1198client # [ 0.005654] EFI services will not be available.199client # [ 0.005726] smp: Bringing up secondary CPUs ...200worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)201client # [ 0.005735] smp: Brought up 1 node, 1 CPU202worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296203client # [ 0.005738] SMP: Total of 1 processors activated.204worker2 # [ 0.000000] Detected PIPT I-cache on CPU0205client # [ 0.005743] CPU: All CPU(s) started at EL1206client # [ 0.005756] CPU features: detected: Branch Target Identification207worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)208client # [ 0.005760] CPU features: detected: ARMv8.4 Translation Table Level209worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface210worker2 # [ 0.000000] CPU features: detected: Spectre-v4211client # [ 0.005764] CPU features: detected: Instruction cache invalidation not required for I/D coherence212worker2 # [ 0.000000] CPU features: detected: Spectre-BHB213worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38214client # [ 0.005767] CPU features: detected: Data cache clean to the PoU not required for I/D coherence215worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23216worker2 # [ 0.000000] alternatives: applying boot alternatives217client # [ 0.005771] CPU features: detected: Common not Private translations218client # [ 0.005774] CPU features: detected: CRC32 instructions219client # [ 0.005777] CPU features: detected: Data cache clean to Point of Deep Persistence220client # [ 0.005781] CPU features: detected: Data cache clean to Point of Persistence221client # [ 0.005784] CPU features: detected: Data independent timing control (DIT)222worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/zm9saadm008a4p1l5yv9vh944f1w20hz-nixos-system-worker2-test/init regInfo=/nix/store/pjbf7lvrmcmnyxysj2clskpi21y333ri-closure-info/registration console=ttyAMA0,115200n8 console=tty0223client # [ 0.005787] CPU features: detected: E0PD224client # [ 0.005789] CPU features: detected: Enhanced Counter Virtualization225worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/pjbf7lvrmcmnyxysj2clskpi21y333ri-closure-info/registration", will be passed to user space.226client # [ 0.005792] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)227client # [ 0.005796] CPU features: detected: Enhanced Virtualization Traps228worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes229client # [ 0.005799] CPU features: detected: Fine Grained Traps230worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)231lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]232client # [ 0.005803] CPU features: detected: Generic authentication (architected QARMA5 algorithm)233worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)234client # [ 0.005808] CPU features: detected: RCpc load-acquire (LDAPR)235lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026236worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB237client # [ 0.005811] CPU features: detected: LSE atomic instructions238lb # [ 0.000000] KASLR enabled239worker2 # [ 0.000000] software IO TLB: area num 1.240lb # [ 0.000000] random: crng init done241client # [ 0.005814] CPU features: detected: Privileged Access Never242lb # [ 0.000000] Machine model: linux,dummy-virt243worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB244client # [ 0.005817] CPU features: detected: PMUv3245lb # [ 0.000000] efi: UEFI not found.246client # [ 0.005820] CPU features: detected: RAS Extension Support247worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)248lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT249client # [ 0.005822] CPU features: detected: RASv1p1 Extension Support250worker2 # [ 0.000000] Fallback order for Node 0: 0251lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]252client # [ 0.005825] CPU features: detected: Random Number Generator253worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216254worker2 # [ 0.000000] Policy zone: DMA255lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]256client # [ 0.005828] CPU features: detected: Speculation barrier (SB)257lb # [ 0.000000] Zone ranges:258client # [ 0.005831] CPU features: detected: Stage-2 Force Write-Back259worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off260lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]261lb # [ 0.000000] DMA32 empty262client # [ 0.005834] CPU features: detected: TLB range maintenance instructions263worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1264lb # [ 0.000000] Normal empty265worker2 # [ 0.000000] allocated 3145728 bytes of page_ext266lb # [ 0.000000] Device empty267client # [ 0.005838] CPU features: detected: Speculative Store Bypassing Safe (SSBS)268lb # [ 0.000000] Movable zone start for each node269worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages270client # [ 0.005889] alternatives: applying system-wide alternatives271lb # [ 0.000000] Early memory node ranges272worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups273lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]274client # [ 0.009079] CPU features: detected: BBM Level 2 without TLB conflict abort275worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.276worker2 # [ 0.000000] rcu: RCU event tracing is enabled.277lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]278lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000279worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.280client # [ 0.009257] Memory: 1406516K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)281lb # [ 0.000000] psci: probing for conduit method from DT.282client # [ 0.009696] devtmpfs: initialized283worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.284lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.285worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.286client # [ 0.011646] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)287lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs288worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.289lb # [ 0.000000] psci: Trusted OS migration not required290client # [ 0.011670] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).291worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.292lb # [ 0.000000] psci: SMC Calling Convention v1.1293client # [ 0.011865] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL294worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1295client # [ 0.011870] 0 pages in range for non-PLT usage296lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)297client # [ 0.011871] 508288 pages in range for PLT usage298lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296299worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.300client # [ 0.012002] pinctrl core: initialized pinctrl subsystem301lb # [ 0.000000] Detected PIPT I-cache on CPU0302client # [ 0.012789] DMI not present or invalid.303worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.304lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)305client # [ 0.016650] NET: Registered PF_NETLINK/PF_ROUTE protocol family306lb # [ 0.000000] CPU features: detected: GICv3 CPU interface307worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.308client # [ 0.019035] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations309lb # [ 0.000000] CPU features: detected: Spectre-v4310worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0311lb # [ 0.000000] CPU features: detected: Spectre-BHB312client # [ 0.019220] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations313worker2 # [ 0.000000] GICv3: 256 SPIs implemented314lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38315worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented316client # [ 0.019433] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations317worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq318lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23319client # [ 0.019459] audit: initializing netlink subsys (disabled)320worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI321lb # [ 0.000000] alternatives: applying boot alternatives322client # [ 0.020113] thermal_sys: Registered thermal governor 'fair_share'323worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0324client # [ 0.020115] thermal_sys: Registered thermal governor 'bang_bang'325worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000326worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]327client # [ 0.020119] thermal_sys: Registered thermal governor 'step_wise'328client # [ 0.020127] thermal_sys: Registered thermal governor 'user_space'329worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)330worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]331client # [ 0.020130] thermal_sys: Registered thermal governor 'power_allocator'332lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/lai4n7chb0cnvnygfis27sipihspygia-nixos-system-lb-test/init regInfo=/nix/store/qdg5w64gnxykmz82pw25fgmx46q7lp99-closure-info/registration console=ttyAMA0,115200n8 console=tty0333worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)334client # [ 0.020166] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1335client # [ 0.020174] cpuidle: using governor ladder336worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000337worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026338client # [ 0.020180] cpuidle: using governor menu339worker1 # [ 0.000000] KASLR enabled340lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/qdg5w64gnxykmz82pw25fgmx46q7lp99-closure-info/registration", will be passed to user space.341worker1 # [ 0.000000] random: crng init done342worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000343client # [ 0.020381] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.344worker1 # [ 0.000000] Machine model: linux,dummy-virt345lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes346worker1 # [ 0.000000] efi: UEFI not found.347worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.348client # [ 0.020398] ASID allocator initialised with 65536 entries349client # [ 0.021649] Serial: AMBA PL011 UART driver350lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)351worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT352worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns353lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)354client # [ 0.027121] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1355worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]356worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).357client # [ 0.027297] printk: console [ttyAMA0] enabled358lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB359worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]360worker1 # [ 0.000000] Zone ranges:361lb # [ 0.000000] software IO TLB: area num 1.362worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns363worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]364lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB365worker1 # [ 0.000000] DMA32 empty366worker1 # [ 0.000000] Normal empty367worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns368lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)369worker1 # [ 0.000000] Device empty370worker2 # [ 0.000032] arm-pv: using stolen time PV371lb # [ 0.000000] Fallback order for Node 0: 0372worker1 # [ 0.000000] Movable zone start for each node373worker1 # [ 0.000000] Early memory node ranges374lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216375worker2 # [ 0.000554] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)376lb # [ 0.000000] Policy zone: DMA377worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]378worker2 # [ 0.000728] Console: colour dummy device 80x25379lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off380worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]381worker2 # [ 0.000737] printk: legacy console [tty0] enabled382lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1383worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000384lb # [ 0.000000] allocated 3145728 bytes of page_ext385worker1 # [ 0.000000] psci: probing for conduit method from DT.386worker2 # [ 0.000934] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)387lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages388worker2 # [ 0.000941] pid_max: default: 32768 minimum: 301389worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.390lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups391worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs392worker2 # [ 0.001012] LSM: initializing lsm=capability,landlock,yama,bpf,ima393lb # [ 0.000000] rcu: Hierarchical RCU implementation.394worker1 # [ 0.000000] psci: Trusted OS migration not required395worker2 # [ 0.001194] landlock: Up and running.396client # [ 0.151524] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages397lb # [ 0.000000] rcu: RCU event tracing is enabled.398worker1 # [ 0.000000] psci: SMC Calling Convention v1.1399worker2 # [ 0.001197] Yama: becoming mindful.400worker2 # [ 0.001799] LSM support for eBPF active401client # [ 0.151548] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page402lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.403worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)404worker2 # [ 0.001951] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)405lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.406client # [ 0.151553] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages407lb # [ 0.000000] Rude variant of Tasks RCU enabled.408worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296409client # [ 0.151558] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page410worker2 # [ 0.001984] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)411lb # [ 0.000000] Tracing variant of Tasks RCU enabled.412worker1 # [ 0.000000] Detected PIPT I-cache on CPU0413client # [ 0.151562] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages414worker2 # [ 0.003090] cacheinfo: Unable to detect cache hierarchy for CPU 0415lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.416worker2 # [ 0.003827] rcu: Hierarchical SRCU implementation.417worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)418client # [ 0.151566] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page419worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface420lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1421worker2 # [ 0.003832] rcu: Max phase no-delay instances is 1000.422client # [ 0.151571] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages423worker1 # [ 0.000000] CPU features: detected: Spectre-v4424worker2 # [ 0.005064] fsl-mc MSI: its@8080000 domain created425worker1 # [ 0.000000] CPU features: detected: Spectre-BHB426client # [ 0.151575] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page427worker2 # [ 0.005155] EFI services will not be available.428lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.429worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38430worker2 # [ 0.005223] smp: Bringing up secondary CPUs ...431lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.432worker2 # [ 0.005231] smp: Brought up 1 node, 1 CPU433worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23434worker2 # [ 0.005234] SMP: Total of 1 processors activated.435worker1 # [ 0.000000] alternatives: applying boot alternatives436lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.437worker2 # [ 0.005239] CPU: All CPU(s) started at EL1438client # [ 0.158928] fbcon: Taking over console439client # [ 0.158947] ACPI: Interpreter disabled.440lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0441worker2 # [ 0.005251] CPU features: detected: Branch Target Identification442lb # [ 0.000000] GICv3: 256 SPIs implemented443worker2 # [ 0.005254] CPU features: detected: ARMv8.4 Translation Table Level444lb # [ 0.000000] GICv3: 0 Extended SPIs implemented445lb # [ 0.000000] Root IRQ handler: gic_handle_irq446worker2 # [ 0.005258] CPU features: detected: Instruction cache invalidation not required for I/D coherence447lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI448lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0449worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/kcsw5x2nlhhi9a035r8fp2hq3vlijh0g-nixos-system-worker1-test/init regInfo=/nix/store/zxg54nf64ixjv3kflrqn05q06fi3m9qz-closure-info/registration console=ttyAMA0,115200n8 console=tty0450worker2 # [ 0.005262] CPU features: detected: Data cache clean to the PoU not required for I/D coherence451lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000452worker2 # [ 0.005265] CPU features: detected: Common not Private translations453lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]454worker2 # [ 0.005268] CPU features: detected: CRC32 instructions455worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/zxg54nf64ixjv3kflrqn05q06fi3m9qz-closure-info/registration", will be passed to user space.456lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)457worker2 # [ 0.005271] CPU features: detected: Data cache clean to Point of Deep Persistence458worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes459worker2 # [ 0.005275] CPU features: detected: Data cache clean to Point of Persistence460lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)461worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)462worker2 # [ 0.005278] CPU features: detected: Data independent timing control (DIT)463lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000464worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)465worker2 # [ 0.005281] CPU features: detected: E0PD466lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000467worker2 # [ 0.005284] CPU features: detected: Enhanced Counter Virtualization468worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB469lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.470client # [ 0.167995] iommu: Default domain type: Translated471worker1 # [ 0.000000] software IO TLB: area num 1.472worker2 # [ 0.005287] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)473client # [ 0.168010] iommu: DMA domain TLB invalidation policy: strict mode474worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB475worker2 # [ 0.005290] CPU features: detected: Enhanced Virtualization Traps476lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns477client # [ 0.168518] SCSI subsystem initialized478worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)479lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).480worker2 # [ 0.005293] CPU features: detected: Fine Grained Traps481worker1 # [ 0.000000] Fallback order for Node 0: 0482client # [ 0.170505] usbcore: registered new interface driver usbfs483worker2 # [ 0.005298] CPU features: detected: Generic authentication (architected QARMA5 algorithm)484worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216485lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns486client # [ 0.170545] usbcore: registered new interface driver hub487worker2 # [ 0.005303] CPU features: detected: RCpc load-acquire (LDAPR)488worker1 # [ 0.000000] Policy zone: DMA489client # [ 0.170563] usbcore: registered new device driver usb490lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns491worker2 # [ 0.005306] CPU features: detected: LSE atomic instructions492worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off493lb # [ 0.000032] arm-pv: using stolen time PV494client # [ 0.170829] pps_core: LinuxPPS API ver. 1 registered495worker2 # [ 0.005309] CPU features: detected: Privileged Access Never496worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1497worker2 # [ 0.005312] CPU features: detected: PMUv3498worker1 # [ 0.000000] allocated 3145728 bytes of page_ext499client # [ 0.170836] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>500lb # [ 0.000463] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)501worker2 # [ 0.005314] CPU features: detected: RAS Extension Support502client # [ 0.170847] PTP clock support registered503worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages504lb # [ 0.000850] Console: colour dummy device 80x25505client # [ 0.170911] EDAC MC: Ver: 3.0.0506worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups507lb # [ 0.000859] printk: legacy console [tty0] enabled508worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.509client # [ 0.175394] scmi_core: SCMI protocol bus registered510worker2 # [ 0.005317] CPU features: detected: RASv1p1 Extension Support511worker1 # [ 0.000000] rcu: RCU event tracing is enabled.512lb # [ 0.001059] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)513worker2 # [ 0.005319] CPU features: detected: Random Number Generator514client # [ 0.176345] FPGA manager framework515lb # [ 0.001066] pid_max: default: 32768 minimum: 301516worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.517client # [ 0.177274] vgaarb: loaded518worker2 # [ 0.005322] CPU features: detected: Speculation barrier (SB)519worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.520lb # [ 0.001147] LSM: initializing lsm=capability,landlock,yama,bpf,ima521worker2 # [ 0.005325] CPU features: detected: Stage-2 Force Write-Back522lb # [ 0.001298] landlock: Up and running.523worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.524client # [ 0.177894] clocksource: Switched to clocksource arch_sys_counter525lb # [ 0.001301] Yama: becoming mindful.526worker2 # [ 0.005328] CPU features: detected: TLB range maintenance instructions527worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.528lb # [ 0.001868] LSM support for eBPF active529worker2 # [ 0.005332] CPU features: detected: Speculative Store Bypassing Safe (SSBS)530worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.531lb # [ 0.002026] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)532worker2 # [ 0.005372] alternatives: applying system-wide alternatives533worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1534lb # [ 0.002065] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)535worker2 # [ 0.008386] CPU features: detected: BBM Level 2 without TLB conflict abort536client # [ 0.181037] VFS: Disk quotas dquot_6.6.0537worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.538lb # [ 0.003197] cacheinfo: Unable to detect cache hierarchy for CPU 0539lb # [ 0.003980] rcu: Hierarchical SRCU implementation.540client # [ 0.181078] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)541worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.542lb # [ 0.003985] rcu: Max phase no-delay instances is 1000.543worker2 # [ 0.008582] Memory: 1406540K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)544worker2 # [ 0.008988] devtmpfs: initialized545lb # [ 0.005215] fsl-mc MSI: its@8080000 domain created546worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.547lb # [ 0.005336] EFI services will not be available.548worker2 # [ 0.010859] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)549worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0550lb # [ 0.005456] smp: Bringing up secondary CPUs ...551worker1 # [ 0.000000] GICv3: 256 SPIs implemented552lb # [ 0.005465] smp: Brought up 1 node, 1 CPU553worker2 # [ 0.010882] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).554client # [ 0.184857] netfs: FS-Cache loaded555worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented556lb # [ 0.005468] SMP: Total of 1 processors activated.557client # [ 0.184995] pnp: PnP ACPI: disabled558worker2 # [ 0.011129] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL559lb # [ 0.005474] CPU: All CPU(s) started at EL1560worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq561worker2 # [ 0.011134] 0 pages in range for non-PLT usage562worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI563lb # [ 0.005484] CPU features: detected: Branch Target Identification564worker2 # [ 0.011135] 508288 pages in range for PLT usage565worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0566lb # [ 0.005489] CPU features: detected: ARMv8.4 Translation Table Level567worker2 # [ 0.011270] pinctrl core: initialized pinctrl subsystem568worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000569worker2 # [ 0.012086] DMI not present or invalid.570worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]571lb # [ 0.005492] CPU features: detected: Instruction cache invalidation not required for I/D coherence572worker2 # [ 0.015764] NET: Registered PF_NETLINK/PF_ROUTE protocol family573lb # [ 0.005496] CPU features: detected: Data cache clean to the PoU not required for I/D coherence574worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)575worker2 # [ 0.018023] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations576lb # [ 0.005500] CPU features: detected: Common not Private translations577client # [ 0.188962] NET: Registered PF_INET protocol family578worker2 # [ 0.018206] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations579worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)580lb # [ 0.005503] CPU features: detected: CRC32 instructions581client # [ 0.189226] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)582worker2 # [ 0.018418] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations583worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000584lb # [ 0.005506] CPU features: detected: Data cache clean to Point of Deep Persistence585worker2 # [ 0.018443] audit: initializing netlink subsys (disabled)586worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000587lb # [ 0.005509] CPU features: detected: Data cache clean to Point of Persistence588worker2 # [ 0.019094] thermal_sys: Registered thermal governor 'fair_share'589worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.590lb # [ 0.005512] CPU features: detected: Data independent timing control (DIT)591worker2 # [ 0.019096] thermal_sys: Registered thermal governor 'bang_bang'592lb # [ 0.005515] CPU features: detected: E0PD593worker2 # [ 0.019100] thermal_sys: Registered thermal governor 'step_wise'594worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns595lb # [ 0.005518] CPU features: detected: Enhanced Counter Virtualization596worker2 # [ 0.019107] thermal_sys: Registered thermal governor 'user_space'597worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).598lb # [ 0.005521] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)599worker2 # [ 0.019110] thermal_sys: Registered thermal governor 'power_allocator'600lb # [ 0.005524] CPU features: detected: Enhanced Virtualization Traps601worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns602lb # [ 0.005527] CPU features: detected: Fine Grained Traps603worker2 # [ 0.019146] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1604worker2 # [ 0.019154] cpuidle: using governor ladder605worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns606lb # [ 0.005531] CPU features: detected: Generic authentication (architected QARMA5 algorithm)607worker2 # [ 0.019160] cpuidle: using governor menu608worker1 # [ 0.000031] arm-pv: using stolen time PV609lb # [ 0.005536] CPU features: detected: RCpc load-acquire (LDAPR)610worker2 # [ 0.019363] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.611lb # [ 0.005539] CPU features: detected: LSE atomic instructions612worker1 # [ 0.000401] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)613worker2 # [ 0.019378] ASID allocator initialised with 65536 entries614lb # [ 0.005542] CPU features: detected: Privileged Access Never615worker1 # [ 0.000556] Console: colour dummy device 80x25616worker2 # [ 0.020674] Serial: AMBA PL011 UART driver617lb # [ 0.005545] CPU features: detected: PMUv3618worker1 # [ 0.000564] printk: legacy console [tty0] enabled619worker2 # [ 0.026035] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1620lb # [ 0.005547] CPU features: detected: RAS Extension Support621worker2 # [ 0.026180] printk: console [ttyAMA0] enabled622worker1 # [ 0.000753] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)623worker1 # [ 0.000761] pid_max: default: 32768 minimum: 301624lb # [ 0.005550] CPU features: detected: RASv1p1 Extension Support625worker1 # [ 0.000842] LSM: initializing lsm=capability,landlock,yama,bpf,ima626lb # [ 0.005553] CPU features: detected: Random Number Generator627worker1 # [ 0.001003] landlock: Up and running.628worker1 # [ 0.001006] Yama: becoming mindful.629lb # [ 0.005555] CPU features: detected: Speculation barrier (SB)630worker1 # [ 0.001447] LSM support for eBPF active631lb # [ 0.005558] CPU features: detected: Stage-2 Force Write-Back632worker1 # [ 0.001602] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)633lb # [ 0.005561] CPU features: detected: TLB range maintenance instructions634worker1 # [ 0.001634] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)635lb # [ 0.005566] CPU features: detected: Speculative Store Bypassing Safe (SSBS)636worker1 # [ 0.002739] cacheinfo: Unable to detect cache hierarchy for CPU 0637lb # [ 0.005604] alternatives: applying system-wide alternatives638worker1 # [ 0.003499] rcu: Hierarchical SRCU implementation.639lb # [ 0.008677] CPU features: detected: BBM Level 2 without TLB conflict abort640worker1 # [ 0.003504] rcu: Max phase no-delay instances is 1000.641worker1 # [ 0.004783] fsl-mc MSI: its@8080000 domain created642worker1 # [ 0.004877] EFI services will not be available.643lb # [ 0.008832] Memory: 1406560K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)644worker1 # [ 0.004951] smp: Bringing up secondary CPUs ...645lb # [ 0.009284] devtmpfs: initialized646worker1 # [ 0.004960] smp: Brought up 1 node, 1 CPU647lb # [ 0.011186] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)648worker1 # [ 0.004964] SMP: Total of 1 processors activated.649worker2 # [ 0.150772] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages650worker1 # [ 0.004969] CPU: All CPU(s) started at EL1651worker2 # [ 0.150793] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page652lb # [ 0.011209] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).653worker1 # [ 0.005003] CPU features: detected: Branch Target Identification654worker2 # [ 0.150799] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages655lb # [ 0.011408] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL656worker1 # [ 0.005008] CPU features: detected: ARMv8.4 Translation Table Level657lb # [ 0.011413] 0 pages in range for non-PLT usage658worker2 # [ 0.150803] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page659lb # [ 0.011414] 508288 pages in range for PLT usage660worker1 # [ 0.005011] CPU features: detected: Instruction cache invalidation not required for I/D coherence661worker2 # [ 0.150807] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages662lb # [ 0.011552] pinctrl core: initialized pinctrl subsystem663lb # [ 0.012386] DMI not present or invalid.664worker2 # [ 0.150812] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page665worker1 # [ 0.005015] CPU features: detected: Data cache clean to the PoU not required for I/D coherence666lb # [ 0.015628] NET: Registered PF_NETLINK/PF_ROUTE protocol family667worker2 # [ 0.150816] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages668worker1 # [ 0.005019] CPU features: detected: Common not Private translations669lb # [ 0.017960] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations670worker2 # [ 0.150820] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page671worker1 # [ 0.005022] CPU features: detected: CRC32 instructions672lb # [ 0.018170] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations673worker1 # [ 0.005025] CPU features: detected: Data cache clean to Point of Deep Persistence674lb # [ 0.018390] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations675worker1 # [ 0.005029] CPU features: detected: Data cache clean to Point of Persistence676worker2 # [ 0.158230] fbcon: Taking over console677lb # [ 0.018418] audit: initializing netlink subsys (disabled)678worker1 # [ 0.005032] CPU features: detected: Data independent timing control (DIT)679worker2 # [ 0.158249] ACPI: Interpreter disabled.680worker1 # [ 0.005035] CPU features: detected: E0PD681lb # [ 0.019054] thermal_sys: Registered thermal governor 'fair_share'682worker1 # [ 0.005037] CPU features: detected: Enhanced Counter Virtualization683lb # [ 0.019057] thermal_sys: Registered thermal governor 'bang_bang'684lb # [ 0.019060] thermal_sys: Registered thermal governor 'step_wise'685worker1 # [ 0.005040] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)686lb # [ 0.019066] thermal_sys: Registered thermal governor 'user_space'687worker1 # [ 0.005044] CPU features: detected: Enhanced Virtualization Traps688worker1 # [ 0.005047] CPU features: detected: Fine Grained Traps689lb # [ 0.019068] thermal_sys: Registered thermal governor 'power_allocator'690worker1 # [ 0.005050] CPU features: detected: Generic authentication (architected QARMA5 algorithm)691lb # [ 0.019095] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1692lb # [ 0.019103] cpuidle: using governor ladder693worker1 # [ 0.005056] CPU features: detected: RCpc load-acquire (LDAPR)694lb # [ 0.019109] cpuidle: using governor menu695worker1 # [ 0.005058] CPU features: detected: LSE atomic instructions696lb # [ 0.019308] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.697worker1 # [ 0.005062] CPU features: detected: Privileged Access Never698lb # [ 0.019323] ASID allocator initialised with 65536 entries699worker1 # [ 0.005065] CPU features: detected: PMUv3700lb # [ 0.020517] Serial: AMBA PL011 UART driver701worker1 # [ 0.005068] CPU features: detected: RAS Extension Support702worker2 # [ 0.166963] iommu: Default domain type: Translated703worker1 # [ 0.005071] CPU features: detected: RASv1p1 Extension Support704lb # [ 0.026024] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1705worker2 # [ 0.166976] iommu: DMA domain TLB invalidation policy: strict mode706lb # [ 0.026198] printk: console [ttyAMA0] enabled707worker1 # [ 0.005073] CPU features: detected: Random Number Generator708worker2 # [ 0.167365] SCSI subsystem initialized709worker1 # [ 0.005076] CPU features: detected: Speculation barrier (SB)710worker1 # [ 0.005079] CPU features: detected: Stage-2 Force Write-Back711worker2 # [ 0.169357] usbcore: registered new interface driver usbfs712worker1 # [ 0.005082] CPU features: detected: TLB range maintenance instructions713worker2 # [ 0.169391] usbcore: registered new interface driver hub714worker2 # [ 0.169408] usbcore: registered new device driver usb715worker1 # [ 0.005087] CPU features: detected: Speculative Store Bypassing Safe (SSBS)716client # [ 0.220514] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)717worker2 # [ 0.169700] pps_core: LinuxPPS API ver. 1 registered718worker1 # [ 0.005126] alternatives: applying system-wide alternatives719client # [ 0.220576] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)720worker1 # [ 0.008261] CPU features: detected: BBM Level 2 without TLB conflict abort721worker2 # [ 0.169706] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>722client # [ 0.220610] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)723worker2 # [ 0.169716] PTP clock support registered724worker2 # [ 0.169764] EDAC MC: Ver: 3.0.0725client # [ 0.220702] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)726worker1 # [ 0.008518] Memory: 1406524K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)727worker2 # [ 0.174392] scmi_core: SCMI protocol bus registered728worker1 # [ 0.008915] devtmpfs: initialized729client # [ 0.220845] TCP: Hash tables configured (established 16384 bind 16384)730worker1 # [ 0.010787] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)731worker2 # [ 0.175425] FPGA manager framework732client # [ 0.220942] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)733worker2 # [ 0.176348] vgaarb: loaded734client # [ 0.220982] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)735worker1 # [ 0.010810] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).736worker2 # [ 0.176982] clocksource: Switched to clocksource arch_sys_counter737worker1 # [ 0.010985] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL738client # [ 0.221021] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)739lb # [ 0.147500] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages740worker1 # [ 0.010990] 0 pages in range for non-PLT usage741client # [ 0.221125] NET: Registered PF_UNIX/PF_LOCAL protocol family742lb # [ 0.147522] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page743worker1 # [ 0.010991] 508288 pages in range for PLT usage744client # [ 0.221148] NET: Registered PF_XDP protocol family745worker2 # [ 0.178724] VFS: Disk quotas dquot_6.6.0746worker1 # [ 0.011116] pinctrl core: initialized pinctrl subsystem747lb # [ 0.147527] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages748client # [ 0.221167] PCI: CLS 0 bytes, default 64749worker1 # [ 0.011892] DMI not present or invalid.750worker2 # [ 0.178759] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)751lb # [ 0.147531] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page752client # [ 0.221429] Trying to unpack rootfs image as initramfs...753worker1 # [ 0.015037] NET: Registered PF_NETLINK/PF_ROUTE protocol family754lb # [ 0.147537] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages755worker1 # [ 0.017591] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations756lb # [ 0.147541] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page757worker1 # [ 0.017797] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations758lb # [ 0.147545] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages759worker2 # [ 0.182454] netfs: FS-Cache loaded760worker1 # [ 0.018007] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations761worker2 # [ 0.182594] pnp: PnP ACPI: disabled762lb # [ 0.147550] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page763worker1 # [ 0.018035] audit: initializing netlink subsys (disabled)764worker1 # [ 0.018612] thermal_sys: Registered thermal governor 'fair_share'765lb # [ 0.154979] fbcon: Taking over console766lb # [ 0.154996] ACPI: Interpreter disabled.767worker1 # [ 0.018614] thermal_sys: Registered thermal governor 'bang_bang'768lb # [ 0.156938] iommu: Default domain type: Translated769worker1 # [ 0.018617] thermal_sys: Registered thermal governor 'step_wise'770client # [ 0.239471] kvm [1]: HYP mode not available771worker1 # [ 0.018623] thermal_sys: Registered thermal governor 'user_space'772lb # [ 0.156949] iommu: DMA domain TLB invalidation policy: strict mode773worker1 # [ 0.018626] thermal_sys: Registered thermal governor 'power_allocator'774worker2 # [ 0.186425] NET: Registered PF_INET protocol family775worker1 # [ 0.018652] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1776worker1 # [ 0.018661] cpuidle: using governor ladder777worker2 # [ 0.186693] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)778worker1 # [ 0.018666] cpuidle: using governor menu779worker1 # [ 0.018862] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.780worker1 # [ 0.018878] ASID allocator initialised with 65536 entries781worker1 # [ 0.020072] Serial: AMBA PL011 UART driver782worker1 # [ 0.025372] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1783lb # [ 0.164015] SCSI subsystem initialized784worker1 # [ 0.025519] printk: console [ttyAMA0] enabled785lb # [ 0.164727] usbcore: registered new interface driver usbfs786lb # [ 0.164763] usbcore: registered new interface driver hub787lb # [ 0.164782] usbcore: registered new device driver usb788lb # [ 0.165094] pps_core: LinuxPPS API ver. 1 registered789lb # [ 0.165100] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>790lb # [ 0.165110] PTP clock support registered791lb # [ 0.165158] EDAC MC: Ver: 3.0.0792lb # [ 0.169877] scmi_core: SCMI protocol bus registered793lb # [ 0.170863] FPGA manager framework794lb # [ 0.171867] vgaarb: loaded795lb # [ 0.172527] clocksource: Switched to clocksource arch_sys_counter796worker1 # [ 0.148277] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages797worker1 # [ 0.148300] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page798worker1 # [ 0.148306] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages799worker1 # [ 0.148310] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page800worker1 # [ 0.148314] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages801worker1 # [ 0.148318] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page802worker1 # [ 0.148323] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages803lb # [ 0.177992] VFS: Disk quotas dquot_6.6.0804worker1 # [ 0.148327] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page805lb # [ 0.178050] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)806lb # [ 0.179709] netfs: FS-Cache loaded807lb # [ 0.179825] pnp: PnP ACPI: disabled808worker1 # [ 0.155977] fbcon: Taking over console809worker1 # [ 0.155997] ACPI: Interpreter disabled.810worker1 # [ 0.157958] iommu: Default domain type: Translated811worker1 # [ 0.157969] iommu: DMA domain TLB invalidation policy: strict mode812worker1 # [ 0.159688] SCSI subsystem initialized813lb # [ 0.183755] NET: Registered PF_INET protocol family814lb # [ 0.184005] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)815worker1 # [ 0.164812] usbcore: registered new interface driver usbfs816worker1 # [ 0.164845] usbcore: registered new interface driver hub817worker1 # [ 0.164863] usbcore: registered new device driver usb818worker1 # [ 0.165184] pps_core: LinuxPPS API ver. 1 registered819worker1 # [ 0.165190] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>820worker1 # [ 0.165200] PTP clock support registered821worker1 # [ 0.165249] EDAC MC: Ver: 3.0.0822worker1 # [ 0.170075] scmi_core: SCMI protocol bus registered823worker1 # [ 0.171065] FPGA manager framework824worker2 # [ 0.217227] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)825worker1 # [ 0.172048] vgaarb: loaded826worker2 # [ 0.217286] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)827worker1 # [ 0.172693] clocksource: Switched to clocksource arch_sys_counter828worker2 # [ 0.217321] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)829worker2 # [ 0.217412] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)830worker2 # [ 0.217556] TCP: Hash tables configured (established 16384 bind 16384)831worker2 # [ 0.217655] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)832worker2 # [ 0.217692] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)833worker1 # [ 0.177614] VFS: Disk quotas dquot_6.6.0834worker2 # [ 0.217729] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)835worker1 # [ 0.177655] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)836worker2 # [ 0.217829] NET: Registered PF_UNIX/PF_LOCAL protocol family837worker2 # [ 0.217857] NET: Registered PF_XDP protocol family838worker2 # [ 0.217876] PCI: CLS 0 bytes, default 64839worker2 # [ 0.218152] Trying to unpack rootfs image as initramfs...840worker1 # [ 0.181403] netfs: FS-Cache loaded841worker1 # [ 0.181540] pnp: PnP ACPI: disabled842worker2 # [ 0.235054] kvm [1]: HYP mode not available843worker1 # [ 0.185530] NET: Registered PF_INET protocol family844worker1 # [ 0.185810] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)845lb # [ 0.214554] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)846lb # [ 0.214616] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)847lb # [ 0.214649] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)848lb # [ 0.214745] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)849lb # [ 0.214890] TCP: Hash tables configured (established 16384 bind 16384)850lb # [ 0.214981] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)851lb # [ 0.215020] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)852lb # [ 0.215059] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)853lb # [ 0.215163] NET: Registered PF_UNIX/PF_LOCAL protocol family854lb # [ 0.215212] NET: Registered PF_XDP protocol family855lb # [ 0.215233] PCI: CLS 0 bytes, default 64856lb # [ 0.215476] Trying to unpack rootfs image as initramfs...857lb # [ 0.230392] kvm [1]: HYP mode not available858worker1 # [ 0.216424] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)859worker1 # [ 0.216482] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)860worker1 # [ 0.216512] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)861worker1 # [ 0.216603] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)862worker1 # [ 0.220713] TCP: Hash tables configured (established 16384 bind 16384)863worker1 # [ 0.220816] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)864worker1 # [ 0.220855] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)865worker1 # [ 0.220893] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)866worker1 # [ 0.221012] NET: Registered PF_UNIX/PF_LOCAL protocol family867worker1 # [ 0.221042] NET: Registered PF_XDP protocol family868worker1 # [ 0.221062] PCI: CLS 0 bytes, default 64869worker1 # [ 0.221314] Trying to unpack rootfs image as initramfs...870worker1 # [ 0.234703] kvm [1]: HYP mode not available871client # [ 0.370491] Initialise system trusted keyrings872client # [ 0.371246] workingset: timestamp_bits=42 max_order=19 bucket_order=0873client # [ 0.372498] squashfs: version 4.0 (2009/01/31) Phillip Lougher874client # [ 0.373281] 9p: Installing v9fs 9p2000 file system support875client # [ 0.401973] Key type asymmetric registered876client # [ 0.402003] Asymmetric key parser 'x509' registered877client # [ 0.402074] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)878client # [ 0.404221] io scheduler mq-deadline registered879client # [ 0.404234] io scheduler kyber registered880client # [ 0.414184] pl061_gpio 9030000.pl061: PL061 GPIO chip registered881client # [ 0.415597] ledtrig-cpu: registered to indicate activity on CPUs882client # [ 0.416123] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:883client # [ 0.416140] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000884client # [ 0.416153] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000885client # [ 0.416161] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000886client # [ 0.416184] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits887client # [ 0.416223] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]888client # [ 0.416325] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00889client # [ 0.416334] pci_bus 0000:00: root bus resource [bus 00-ff]890client # [ 0.416339] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]891client # [ 0.416345] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]892client # [ 0.416350] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]893client # [ 0.416440] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint894client # [ 0.416880] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint895client # [ 0.417066] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]896client # [ 0.417083] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]897worker2 # [ 0.373562] Initialise system trusted keyrings898client # [ 0.417112] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]899worker2 # [ 0.374344] workingset: timestamp_bits=42 max_order=19 bucket_order=0900client # [ 0.417129] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]901worker2 # [ 0.375697] squashfs: version 4.0 (2009/01/31) Phillip Lougher902client # [ 0.417581] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint903client # [ 0.417765] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]904worker2 # [ 0.376492] 9p: Installing v9fs 9p2000 file system support905client # [ 0.417781] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]906client # [ 0.417810] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]907client # [ 0.438124] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint908client # [ 0.438316] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]909client # [ 0.438333] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]910client # [ 0.438363] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]911client # [ 0.438823] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint912client # [ 0.439004] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]913client # [ 0.439020] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]914client # [ 0.439052] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]915client # [ 0.439513] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint916client # [ 0.439692] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]917client # [ 0.439709] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]918client # [ 0.439738] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]919client # [ 0.440188] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint920client # [ 0.440375] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]921client # [ 0.440391] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]922client # [ 0.440420] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]923client # [ 0.440870] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint924client # [ 0.441052] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]925client # [ 0.441068] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]926client # [ 0.441097] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]927client # [ 0.441113] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]928client # [ 0.441616] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint929client # [ 0.441807] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]930client # [ 0.441837] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]931lb # [ 0.375082] Initialise system trusted keyrings932worker2 # [ 0.405159] Key type asymmetric registered933lb # [ 0.375873] workingset: timestamp_bits=42 max_order=19 bucket_order=0934worker2 # [ 0.405190] Asymmetric key parser 'x509' registered935worker2 # [ 0.405266] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)936lb # [ 0.377222] squashfs: version 4.0 (2009/01/31) Phillip Lougher937worker2 # [ 0.407490] io scheduler mq-deadline registered938worker2 # [ 0.407503] io scheduler kyber registered939worker2 # [ 0.417280] pl061_gpio 9030000.pl061: PL061 GPIO chip registered940client # [ 0.470537] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint941client # [ 0.470757] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]942client # [ 0.470789] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]943worker2 # [ 0.418792] ledtrig-cpu: registered to indicate activity on CPUs944client # [ 0.471192] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint945client # [ 0.471374] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]946worker2 # [ 0.419250] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:947lb # [ 0.384628] 9p: Installing v9fs 9p2000 file system support948client # [ 0.471629] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint949worker2 # [ 0.419269] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000950client # [ 0.471915] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]951worker2 # [ 0.419282] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000952client # [ 0.471933] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]953client # [ 0.471963] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]954worker2 # [ 0.419290] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000955client # [ 0.472424] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint956worker2 # [ 0.419313] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits957client # [ 0.472617] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]958worker2 # [ 0.419342] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]959client # [ 0.472634] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]960worker2 # [ 0.419430] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00961client # [ 0.472663] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]962worker2 # [ 0.419439] pci_bus 0000:00: root bus resource [bus 00-ff]963client # [ 0.473260] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned964worker2 # [ 0.419446] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]965client # [ 0.473272] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned966worker2 # [ 0.419451] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]967client # [ 0.473278] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned968worker2 # [ 0.419456] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]969client # [ 0.473324] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned970worker2 # [ 0.419543] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint971client # [ 0.473372] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned972worker2 # [ 0.419980] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint973client # [ 0.473424] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned974worker1 # [ 0.379932] Initialise system trusted keyrings975worker2 # [ 0.420166] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]976lb # [ 0.404605] Key type asymmetric registered977worker2 # [ 0.420182] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]978lb # [ 0.404627] Asymmetric key parser 'x509' registered979client # [ 0.473472] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned980worker2 # [ 0.420212] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]981lb # [ 0.404695] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)982client # [ 0.473520] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned983worker2 # [ 0.420228] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]984lb # [ 0.406786] io scheduler mq-deadline registered985lb # [ 0.406796] io scheduler kyber registered986client # [ 0.473568] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned987worker2 # [ 0.420701] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint988client # [ 0.473617] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned989worker2 # [ 0.420886] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]990worker2 # [ 0.420902] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]991client # [ 0.473665] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned992worker2 # [ 0.420937] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]993client # [ 0.473711] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned994client # [ 0.473785] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned995worker2 # [ 0.440752] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint996client # [ 0.473831] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned997worker2 # [ 0.440940] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]998client # [ 0.473853] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned999worker2 # [ 0.440956] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1000worker1 # [ 0.388785] workingset: timestamp_bits=42 max_order=19 bucket_order=01001client # [ 0.473875] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1002client # [ 0.473941] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1003worker1 # [ 0.390285] squashfs: version 4.0 (2009/01/31) Phillip Lougher1004client # [ 0.473966] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1005client # [ 0.473988] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1006client # [ 0.474010] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1007lb # [ 0.416698] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1008client # [ 0.474032] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1009client # [ 0.474054] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1010client # [ 0.474076] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1011client # [ 0.474099] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1012lb # [ 0.418305] ledtrig-cpu: registered to indicate activity on CPUs1013worker1 # [ 0.391081] 9p: Installing v9fs 9p2000 file system support1014client # [ 0.474122] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1015lb # [ 0.418746] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1016client # [ 0.474143] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1017client # [ 0.474165] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1018lb # [ 0.418765] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001019client # [ 0.474186] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1020lb # [ 0.418779] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001021worker2 # [ 0.449060] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1022client # [ 0.474207] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1023worker2 # [ 0.449626] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1024lb # [ 0.418787] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001025client # [ 0.474228] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1026worker2 # [ 0.449821] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1027client # [ 0.474250] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1028lb # [ 0.418809] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1029worker2 # [ 0.449838] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1030client # [ 0.474272] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1031worker2 # [ 0.449871] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1032lb # [ 0.418837] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1033client # [ 0.474293] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1034lb # [ 0.418919] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001035worker2 # [ 0.450335] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1036client # [ 0.474316] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1037worker2 # [ 0.450518] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1038lb # [ 0.418929] pci_bus 0000:00: root bus resource [bus 00-ff]1039client # [ 0.474344] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1040worker2 # [ 0.450534] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1041lb # [ 0.418935] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1042client # [ 0.474354] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1043worker2 # [ 0.450563] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1044lb # [ 0.418941] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1045client # [ 0.474358] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1046client # [ 0.475541] pci 0000:00:0a.0: enabling device (0000 -> 0002)1047lb # [ 0.418946] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1048worker2 # [ 0.451054] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1049worker2 # [ 0.451240] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1050lb # [ 0.419046] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1051worker2 # [ 0.451256] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1052lb # [ 0.419502] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1053worker2 # [ 0.451285] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1054lb # [ 0.419694] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1055worker2 # [ 0.451747] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1056lb # [ 0.419711] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1057worker2 # [ 0.451933] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1058lb # [ 0.419741] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1059worker2 # [ 0.451949] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1060lb # [ 0.419757] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1061worker1 # [ 0.411152] Key type asymmetric registered1062worker2 # [ 0.451978] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1063worker1 # [ 0.411201] Asymmetric key parser 'x509' registered1064lb # [ 0.420213] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1065worker2 # [ 0.451994] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1066worker1 # [ 0.411279] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)1067lb # [ 0.420402] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1068worker1 # [ 0.413756] io scheduler mq-deadline registered1069worker2 # [ 0.452481] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1070lb # [ 0.420419] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1071worker1 # [ 0.413769] io scheduler kyber registered1072worker2 # [ 0.452672] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1073lb # [ 0.420448] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1074worker2 # [ 0.452702] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1075worker2 # [ 0.470294] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1076worker2 # [ 0.470485] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1077worker2 # [ 0.470516] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1078worker2 # [ 0.470903] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1079worker2 # [ 0.471097] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1080worker2 # [ 0.471356] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1081worker2 # [ 0.471672] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1082lb # [ 0.445078] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1083lb # [ 0.445298] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1084worker2 # [ 0.471692] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1085worker1 # [ 0.424881] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1086lb # [ 0.445341] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1087worker2 # [ 0.471724] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1088lb # [ 0.445373] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1089worker2 # [ 0.472183] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1090lb # [ 0.445848] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1091worker2 # [ 0.472364] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1092lb # [ 0.446040] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1093worker2 # [ 0.472380] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1094worker1 # [ 0.426363] ledtrig-cpu: registered to indicate activity on CPUs1095lb # [ 0.446056] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1096worker2 # [ 0.472411] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1097worker1 # [ 0.426814] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1098lb # [ 0.446088] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1099worker1 # [ 0.426833] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001100lb # [ 0.446556] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1101lb # [ 0.446742] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1102worker1 # [ 0.426846] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001103lb # [ 0.446759] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1104worker1 # [ 0.426854] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001105client # [ 0.544616] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1106lb # [ 0.446788] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1107worker1 # [ 0.426875] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1108lb # [ 0.447261] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1109lb # [ 0.447457] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1110worker1 # [ 0.426899] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1111lb # [ 0.447473] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1112worker1 # [ 0.426977] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001113lb # [ 0.447504] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1114worker1 # [ 0.426986] pci_bus 0000:00: root bus resource [bus 00-ff]1115lb # [ 0.447972] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1116worker1 # [ 0.426992] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1117lb # [ 0.448161] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1118worker1 # [ 0.426997] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1119lb # [ 0.448176] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1120worker1 # [ 0.427002] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1121worker2 # [ 0.489077] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1122lb # [ 0.448205] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1123worker2 # [ 0.489100] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1124worker1 # [ 0.427090] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1125lb # [ 0.448221] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1126worker2 # [ 0.489107] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1127worker1 # [ 0.427536] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1128client # [ 0.551056] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1129worker1 # [ 0.427728] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1130worker2 # [ 0.489191] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1131worker1 # [ 0.427744] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1132client # [ 0.553095] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1133worker2 # [ 0.489243] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1134worker1 # [ 0.427774] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1135worker1 # [ 0.427790] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1136worker2 # [ 0.489291] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1137worker1 # [ 0.428256] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1138worker2 # [ 0.489339] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1139worker1 # [ 0.428443] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1140worker2 # [ 0.489386] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1141worker1 # [ 0.428459] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1142worker2 # [ 0.489435] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1143worker1 # [ 0.428490] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1144worker2 # [ 0.489483] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1145worker2 # [ 0.489532] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1146worker2 # [ 0.489580] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1147worker2 # [ 0.489715] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1148worker2 # [ 0.489766] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1149worker2 # [ 0.489788] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1150client # [ 0.563453] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1151worker2 # [ 0.489810] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1152worker2 # [ 0.489831] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1153client # [ 0.565439] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1154worker2 # [ 0.489856] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1155worker2 # [ 0.489878] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1156lb # [ 0.472826] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1157lb # [ 0.473046] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1158worker2 # [ 0.489900] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1159lb # [ 0.473078] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1160worker2 # [ 0.489922] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1161worker2 # [ 0.489945] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1162lb # [ 0.473595] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1163lb # [ 0.473788] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1164worker2 # [ 0.489969] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1165worker2 # [ 0.489992] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1166lb # [ 0.473817] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1167worker2 # [ 0.490015] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1168lb # [ 0.474219] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1169worker2 # [ 0.490036] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1170lb # [ 0.474409] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1171worker2 # [ 0.490057] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1172lb # [ 0.474666] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1173worker2 # [ 0.490081] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1174lb # [ 0.474974] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1175worker2 # [ 0.490102] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1176lb # [ 0.474992] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1177worker1 # [ 0.457141] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1178worker2 # [ 0.490124] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1179client # [ 0.576779] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1180lb # [ 0.475024] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1181worker1 # [ 0.457360] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1182worker2 # [ 0.490145] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1183lb # [ 0.475490] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1184worker1 # [ 0.457377] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1185worker2 # [ 0.490167] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1186lb # [ 0.475681] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1187worker1 # [ 0.457408] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1188worker2 # [ 0.490189] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1189lb # [ 0.475696] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1190worker2 # [ 0.490211] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1191worker1 # [ 0.457893] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1192lb # [ 0.475726] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1193worker2 # [ 0.490240] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1194worker1 # [ 0.458078] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1195lb # [ 0.476353] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1196worker2 # [ 0.490250] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1197worker1 # [ 0.458094] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1198client # [ 0.579788] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1199lb # [ 0.476364] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1200worker2 # [ 0.490254] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1201worker1 # [ 0.458127] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1202client # [ 0.581822] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1203worker2 # [ 0.491481] pci 0000:00:0a.0: enabling device (0000 -> 0002)1204lb # [ 0.476370] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1205worker1 # [ 0.458599] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1206lb # [ 0.476417] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1207worker1 # [ 0.458786] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1208worker1 # [ 0.458802] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1209lb # [ 0.476466] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1210worker1 # [ 0.458832] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1211lb # [ 0.476515] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1212worker1 # [ 0.459299] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1213lb # [ 0.476576] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1214worker1 # [ 0.459487] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1215lb # [ 0.476627] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1216worker1 # [ 0.459502] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1217worker1 # [ 0.459532] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1218lb # [ 0.476677] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1219lb # [ 0.476727] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1220worker1 # [ 0.460001] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1221worker1 # [ 0.460189] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1222lb # [ 0.476775] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1223worker1 # [ 0.460205] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1224lb # [ 0.476827] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1225worker1 # [ 0.460235] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1226lb # [ 0.476901] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1227worker1 # [ 0.460251] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1228client # [ 0.592412] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1229lb # [ 0.476949] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1230worker1 # [ 0.460774] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1231lb # [ 0.476971] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1232worker1 # [ 0.460965] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1233lb # [ 0.476992] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1234worker1 # [ 0.461021] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1235lb # [ 0.477014] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1236worker1 # [ 0.461497] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1237lb # [ 0.477040] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1238worker1 # [ 0.461687] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1239lb # [ 0.477062] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1240worker1 # [ 0.461719] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1241lb # [ 0.477086] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1242worker1 # [ 0.462136] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1243lb # [ 0.477109] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1244worker1 # [ 0.462329] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1245lb # [ 0.477131] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1246lb # [ 0.477153] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1247worker1 # [ 0.462587] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1248client # [ 0.598576] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1249worker1 # [ 0.462872] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1250lb # [ 0.477176] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1251worker1 # [ 0.462890] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1252lb # [ 0.477200] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1253lb # [ 0.477221] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1254worker1 # [ 0.462919] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1255client # [ 0.600996] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1256lb # [ 0.477243] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1257worker1 # [ 0.463392] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1258lb # [ 0.477265] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1259worker1 # [ 0.463581] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1260lb # [ 0.477286] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1261worker1 # [ 0.463597] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1262lb # [ 0.477335] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1263worker1 # [ 0.463627] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1264lb # [ 0.477357] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1265worker2 # [ 0.547873] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1266worker1 # [ 0.464234] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1267lb # [ 0.477379] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1268worker1 # [ 0.464245] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1269lb # [ 0.477401] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1270lb # [ 0.477423] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1271worker1 # [ 0.464250] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1272lb # [ 0.477451] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1273worker1 # [ 0.464297] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1274lb # [ 0.477461] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1275worker1 # [ 0.464344] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1276lb # [ 0.477466] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1277lb # [ 0.478659] pci 0000:00:0a.0: enabling device (0000 -> 0002)1278worker1 # [ 0.464391] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1279worker1 # [ 0.464437] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1280worker1 # [ 0.464484] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1281worker1 # [ 0.464533] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1282worker2 # [ 0.554221] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1283worker1 # [ 0.464580] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1284worker2 # [ 0.556251] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1285worker1 # [ 0.464627] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1286worker1 # [ 0.464675] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1287client # [ 0.618520] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1288client # [ 0.621355] msm_serial: driver initialized1289client # [ 0.621506] SuperH (H)SCI(F) driver initialized1290client # [ 0.621560] STM32 USART driver initialized1291worker2 # [ 0.566704] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1292worker1 # [ 0.512888] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1293worker1 # [ 0.513035] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1294worker1 # [ 0.513060] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1295worker1 # [ 0.513083] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1296worker1 # [ 0.513107] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1297worker1 # [ 0.513134] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1298worker1 # [ 0.513157] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1299worker1 # [ 0.513181] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1300worker1 # [ 0.513204] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1301worker2 # [ 0.573161] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1302worker1 # [ 0.513228] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1303lb # [ 0.547661] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1304worker2 # [ 0.575307] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1305worker1 # [ 0.513251] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1306worker1 # [ 0.513275] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1307worker1 # [ 0.513299] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1308worker1 # [ 0.513321] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1309worker1 # [ 0.513347] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1310worker1 # [ 0.513368] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1311worker1 # [ 0.513390] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1312worker1 # [ 0.513412] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1313worker1 # [ 0.513435] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1314worker1 # [ 0.513458] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1315lb # [ 0.554036] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1316worker1 # [ 0.513480] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1317worker1 # [ 0.513502] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1318lb # [ 0.556297] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1319worker1 # [ 0.513534] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1320worker2 # [ 0.585259] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1321worker1 # [ 0.513544] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1322worker2 # [ 0.587580] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1323worker1 # [ 0.513548] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1324worker1 # [ 0.514768] pci 0000:00:0a.0: enabling device (0000 -> 0002)1325lb # [ 0.566203] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1326lb # [ 0.568338] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1327client # [ 0.657261] loop: module loaded1328client # [ 0.657482] virtio_blk virtio5: 1/0/0 default/read/poll queues1329worker2 # [ 0.598069] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1330client # [ 0.658418] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1331worker2 # [ 0.600154] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1332worker2 # [ 0.604193] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1333lb # [ 0.579196] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1334worker1 # [ 0.556443] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1335lb # [ 0.585640] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1336worker2 # [ 0.618193] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1337client # [ 0.670768] megasas: 07.734.00.00-rc11338lb # [ 0.587816] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1339client # [ 0.671583] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1340client # [ 0.673617] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001341client # [ 0.673659] Intel/Sharp Extended Query Table at 0x00311342worker1 # [ 0.566281] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1343client # [ 0.675506] Using buffer write method1344client # [ 0.675607] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1345client # [ 0.677446] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001346client # [ 0.677494] Intel/Sharp Extended Query Table at 0x00311347worker1 # [ 0.570424] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1348worker1 # [ 0.572511] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1349worker2 # [ 0.626426] msm_serial: driver initialized1350worker2 # [ 0.626652] SuperH (H)SCI(F) driver initialized1351worker2 # [ 0.626707] STM32 USART driver initialized1352lb # [ 0.598558] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1353lb # [ 0.600411] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1354client # [ 0.697667] Using buffer write method1355client # [ 0.697727] Concatenating MTD devices:1356client # [ 0.697731] (0): "0.flash"1357client # [ 0.697735] (1): "0.flash"1358client # [ 0.697739] into device "0.flash"1359lb # [ 0.610724] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1360worker1 # [ 0.583874] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1361worker1 # [ 0.590992] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1362lb # [ 0.621843] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1363lb # [ 0.624768] msm_serial: driver initialized1364lb # [ 0.624924] SuperH (H)SCI(F) driver initialized1365worker1 # [ 0.601482] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1366lb # [ 0.624980] STM32 USART driver initialized1367worker2 # [ 0.657984] loop: module loaded1368worker1 # [ 0.603825] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1369worker2 # [ 0.658178] virtio_blk virtio5: 1/0/0 default/read/poll queues1370worker2 # [ 0.658891] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1371worker1 # [ 0.608079] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1372worker1 # [ 0.615842] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1373worker2 # [ 0.669869] megasas: 07.734.00.00-rc11374worker2 # [ 0.670657] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1375worker2 # [ 0.672796] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001376worker2 # [ 0.672835] Intel/Sharp Extended Query Table at 0x00311377worker2 # [ 0.674617] Using buffer write method1378worker2 # [ 0.674707] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1379worker1 # [ 0.626945] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1380worker2 # [ 0.676473] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001381worker2 # [ 0.676512] Intel/Sharp Extended Query Table at 0x00311382lb # [ 0.659575] loop: module loaded1383lb # [ 0.659814] virtio_blk virtio5: 1/0/0 default/read/poll queues1384lb # [ 0.661865] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1385worker2 # [ 0.695949] Using buffer write method1386worker2 # [ 0.696003] Concatenating MTD devices:1387worker2 # [ 0.696007] (0): "0.flash"1388worker2 # [ 0.696012] (1): "0.flash"1389worker1 # [ 0.642226] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1390worker2 # [ 0.696015] into device "0.flash"1391worker1 # [ 0.645254] msm_serial: driver initialized1392worker1 # [ 0.645460] SuperH (H)SCI(F) driver initialized1393worker1 # [ 0.645517] STM32 USART driver initialized1394lb # [ 0.673362] megasas: 07.734.00.00-rc11395lb # [ 0.674138] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1396lb # [ 0.676149] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001397lb # [ 0.676184] Intel/Sharp Extended Query Table at 0x00311398lb # [ 0.677930] Using buffer write method1399lb # [ 0.678031] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1400lb # [ 0.679925] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001401lb # [ 0.679966] Intel/Sharp Extended Query Table at 0x00311402lb # [ 0.700485] Using buffer write method1403lb # [ 0.701205] Concatenating MTD devices:1404lb # [ 0.701210] (0): "0.flash"1405lb # [ 0.701215] (1): "0.flash"1406lb # [ 0.701218] into device "0.flash"1407worker1 # [ 0.678339] loop: module loaded1408worker1 # [ 0.678549] virtio_blk virtio5: 1/0/0 default/read/poll queues1409worker1 # [ 0.679382] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1410worker1 # [ 0.697573] megasas: 07.734.00.00-rc11411worker1 # [ 0.698383] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1412worker1 # [ 0.700896] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001413worker1 # [ 0.700932] Intel/Sharp Extended Query Table at 0x00311414worker1 # [ 0.702568] Using buffer write method1415worker1 # [ 0.702667] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1416worker1 # [ 0.704505] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001417worker1 # [ 0.704550] Intel/Sharp Extended Query Table at 0x00311418worker1 # [ 0.722861] Using buffer write method1419worker1 # [ 0.722918] Concatenating MTD devices:1420worker1 # [ 0.722922] (0): "0.flash"1421worker1 # [ 0.722927] (1): "0.flash"1422worker1 # [ 0.722930] into device "0.flash"1423client # [ 0.977237] Freeing initrd memory: 26160K1424client # [ 0.983336] tun: Universal TUN/TAP device driver, 1.61425client # [ 0.987425] thunder_xcv, ver 1.01426client # [ 0.987479] thunder_bgx, ver 1.01427client # [ 0.987502] nicpf, ver 1.01428client # [ 0.988057] e1000: Intel(R) PRO/1000 Network Driver1429client # [ 0.988065] e1000: Copyright (c) 1999-2006 Intel Corporation.1430client # [ 0.988089] e1000e: Intel(R) PRO/1000 Network Driver1431client # [ 0.988098] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1432client # [ 0.988126] igb: Intel(R) Gigabit Ethernet Network Driver1433client # [ 0.988131] igb: Copyright (c) 2007-2014 Intel Corporation.1434client # [ 0.988154] igbvf: Intel(R) Gigabit Virtual Function Network Driver1435client # [ 0.988160] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1436client # [ 0.988297] sky2: driver version 1.301437client # [ 0.989866] usbcore: registered new interface driver usb-storage1438client # [ 0.990707] ehci-pci 0000:00:0a.0: EHCI Host Controller1439client # [ 0.990737] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11440client # [ 0.990909] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001441client # [ 1.001593] usbcore: registered new interface driver usbserial_generic1442client # [ 1.001616] usbserial: USB Serial support registered for generic1443client # [ 1.001964] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001444client # [ 1.002324] hub 1-0:1.0: USB hub found1445client # [ 1.002345] hub 1-0:1.0: 6 ports detected1446client # [ 1.006383] hv_vmbus: registering driver hyperv_keyboard1447client # [ 1.007960] rtc-pl031 9010000.pl031: registered as rtc01448client # [ 1.007989] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:47:25 UTC (1789908445)1449client # [ 1.008305] i2c_dev: i2c /dev entries driver1450client # [ 1.013984] sdhci: Secure Digital Host Controller Interface driver1451client # [ 1.013994] sdhci: Copyright(c) Pierre Ossman1452client # [ 1.014256] Synopsys Designware Multimedia Card Interface Driver1453client # [ 1.014618] sdhci-pltfm: SDHCI platform and OF driver helper1454client # [ 1.016316] hid: raw HID events driver (C) Jiri Kosina1455client # [ 1.016563] usbcore: registered new interface driver usbhid1456client # [ 1.016569] usbhid: USB HID core driver1457client # [ 1.022332] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1458client # [ 1.023827] drop_monitor: Initializing network drop monitor service1459client # [ 1.023984] NET: Registered PF_INET6 protocol family1460client # [ 1.027294] Segment Routing with IPv61461client # [ 1.027319] In-situ OAM (IOAM) with IPv61462client # [ 1.027362] NET: Registered PF_PACKET protocol family1463worker2 # [ 0.970840] Freeing initrd memory: 26148K1464client # [ 1.029016] 9pnet: Installing 9P2000 support1465client # [ 1.031932] Key type dns_resolver registered1466worker2 # [ 0.977046] tun: Universal TUN/TAP device driver, 1.61467client # [ 1.038549] registered taskstats version 11468client # [ 1.038698] Loading compiled-in X.509 certificates1469worker2 # [ 0.981252] thunder_xcv, ver 1.01470worker2 # [ 0.981301] thunder_bgx, ver 1.01471worker2 # [ 0.981324] nicpf, ver 1.01472worker2 # [ 0.981880] e1000: Intel(R) PRO/1000 Network Driver1473worker2 # [ 0.981888] e1000: Copyright (c) 1999-2006 Intel Corporation.1474worker2 # [ 0.981912] e1000e: Intel(R) PRO/1000 Network Driver1475worker2 # [ 0.981922] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1476worker2 # [ 0.981952] igb: Intel(R) Gigabit Ethernet Network Driver1477client # [ 1.047738] Demotion targets for Node 0: null1478client # [ 1.047868] Key type .fscrypt registered1479worker2 # [ 0.981957] igb: Copyright (c) 2007-2014 Intel Corporation.1480client # [ 1.047874] Key type fscrypt-provisioning registered1481worker2 # [ 0.981981] igbvf: Intel(R) Gigabit Virtual Function Network Driver1482client # [ 1.047978] ima: No TPM chip found, activating TPM-bypass!1483worker2 # [ 0.981986] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1484client # [ 1.047997] ima: Allocated hash algorithm: sha11485worker2 # [ 0.982122] sky2: driver version 1.301486client # [ 1.048019] ima: No architecture policies found1487worker2 # [ 0.983788] usbcore: registered new interface driver usb-storage1488worker2 # [ 0.983839] usbcore: registered new interface driver usbserial_generic1489client # [ 1.052241] input: gpio-keys as /devices/platform/gpio-keys/input/input01490worker2 # [ 0.983855] usbserial: USB Serial support registered for generic1491worker2 # [ 0.984451] hv_vmbus: registering driver hyperv_keyboard1492worker2 # [ 0.996542] ehci-pci 0000:00:0a.0: EHCI Host Controller1493worker2 # [ 0.996576] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11494worker2 # [ 0.996895] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001495worker2 # [ 0.999853] rtc-pl031 9010000.pl031: registered as rtc01496worker2 # [ 0.999887] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:47:25 UTC (1789908445)1497worker2 # [ 1.000282] i2c_dev: i2c /dev entries driver1498lb # [ 0.974170] Freeing initrd memory: 26140K1499worker2 # [ 1.005419] sdhci: Secure Digital Host Controller Interface driver1500worker2 # [ 1.005431] sdhci: Copyright(c) Pierre Ossman1501lb # [ 0.980450] tun: Universal TUN/TAP device driver, 1.61502worker2 # [ 1.005702] Synopsys Designware Multimedia Card Interface Driver1503worker2 # [ 1.006073] sdhci-pltfm: SDHCI platform and OF driver helper1504worker2 # [ 1.007798] hid: raw HID events driver (C) Jiri Kosina1505worker2 # [ 1.008040] usbcore: registered new interface driver usbhid1506worker2 # [ 1.008046] usbhid: USB HID core driver1507lb # [ 0.984350] thunder_xcv, ver 1.01508worker2 # [ 1.013657] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001509lb # [ 0.984406] thunder_bgx, ver 1.01510client # [ 1.071338] clk: Disabling unused clocks1511lb # [ 0.984429] nicpf, ver 1.01512worker2 # [ 1.014004] hub 1-0:1.0: USB hub found1513client # [ 1.071378] PM: genpd: Disabling unused power domains1514worker2 # [ 1.014025] hub 1-0:1.0: 6 ports detected1515client # [ 1.075664] Freeing unused kernel memory: 4736K1516worker2 # [ 1.016242] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1517client # [ 1.075881] Run /init as init process1518lb # [ 0.986332] e1000: Intel(R) PRO/1000 Network Driver1519worker2 # [ 1.019024] drop_monitor: Initializing network drop monitor service1520lb # [ 0.986347] e1000: Copyright (c) 1999-2006 Intel Corporation.1521worker2 # [ 1.019196] NET: Registered PF_INET6 protocol family1522lb # [ 0.986376] e1000e: Intel(R) PRO/1000 Network Driver1523worker2 # [ 1.021216] Segment Routing with IPv61524lb # [ 0.986385] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1525worker2 # [ 1.021236] In-situ OAM (IOAM) with IPv61526lb # [ 0.986415] igb: Intel(R) Gigabit Ethernet Network Driver1527worker2 # [ 1.021285] NET: Registered PF_PACKET protocol family1528lb # [ 0.986420] igb: Copyright (c) 2007-2014 Intel Corporation.1529lb # [ 0.986444] igbvf: Intel(R) Gigabit Virtual Function Network Driver1530lb # [ 0.986449] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1531lb # [ 0.986589] sky2: driver version 1.301532worker2 # [ 1.022965] 9pnet: Installing 9P2000 support1533lb # [ 0.988292] usbcore: registered new interface driver usb-storage1534lb # [ 0.988345] usbcore: registered new interface driver usbserial_generic1535lb # [ 0.988361] usbserial: USB Serial support registered for generic1536lb # [ 0.989328] ehci-pci 0000:00:0a.0: EHCI Host Controller1537lb # [ 0.989358] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11538worker2 # [ 1.025919] Key type dns_resolver registered1539lb # [ 0.989527] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001540lb # [ 1.001025] hv_vmbus: registering driver hyperv_keyboard1541lb # [ 1.002524] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001542worker2 # [ 1.032439] registered taskstats version 11543lb # [ 1.003621] hub 1-0:1.0: USB hub found1544worker2 # [ 1.032597] Loading compiled-in X.509 certificates1545lb # [ 1.004108] hub 1-0:1.0: 6 ports detected1546client # [ 1.092567] systemd[1]: Successfully made /usr/ read-only.1547lb # [ 1.005237] rtc-pl031 9010000.pl031: registered as rtc01548lb # [ 1.005269] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:47:25 UTC (1789908445)1549lb # [ 1.005687] i2c_dev: i2c /dev entries driver1550worker2 # [ 1.041685] Demotion targets for Node 0: null1551lb # [ 1.010865] sdhci: Secure Digital Host Controller Interface driver1552worker2 # [ 1.041823] Key type .fscrypt registered1553lb # [ 1.010876] sdhci: Copyright(c) Pierre Ossman1554worker2 # [ 1.041831] Key type fscrypt-provisioning registered1555worker1 # [ 0.989495] Freeing initrd memory: 26148K1556lb # [ 1.011151] Synopsys Designware Multimedia Card Interface Driver1557worker2 # [ 1.041938] ima: No TPM chip found, activating TPM-bypass!1558lb # [ 1.011540] sdhci-pltfm: SDHCI platform and OF driver helper1559worker2 # [ 1.041958] ima: Allocated hash algorithm: sha11560worker2 # [ 1.041983] ima: No architecture policies found1561lb # [ 1.016218] hid: raw HID events driver (C) Jiri Kosina1562worker2 # [ 1.046377] input: gpio-keys as /devices/platform/gpio-keys/input/input01563lb # [ 1.016482] usbcore: registered new interface driver usbhid1564lb # [ 1.016488] usbhid: USB HID core driver1565worker1 # [ 0.995790] tun: Universal TUN/TAP device driver, 1.61566lb # [ 1.019516] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1567lb # [ 1.022456] drop_monitor: Initializing network drop monitor service1568lb # [ 1.022660] NET: Registered PF_INET6 protocol family1569lb # [ 1.024721] Segment Routing with IPv61570worker1 # [ 1.000155] thunder_xcv, ver 1.01571lb # [ 1.024741] In-situ OAM (IOAM) with IPv61572worker1 # [ 1.000215] thunder_bgx, ver 1.01573worker1 # [ 1.000244] nicpf, ver 1.01574lb # [ 1.024773] NET: Registered PF_PACKET protocol family1575lb # [ 1.026430] 9pnet: Installing 9P2000 support1576worker1 # [ 1.002073] e1000: Intel(R) PRO/1000 Network Driver1577worker1 # [ 1.002085] e1000: Copyright (c) 1999-2006 Intel Corporation.1578worker1 # [ 1.002111] e1000e: Intel(R) PRO/1000 Network Driver1579worker1 # [ 1.002121] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1580lb # [ 1.029521] Key type dns_resolver registered1581worker1 # [ 1.002154] igb: Intel(R) Gigabit Ethernet Network Driver1582worker1 # [ 1.002160] igb: Copyright (c) 2007-2014 Intel Corporation.1583worker1 # [ 1.002187] igbvf: Intel(R) Gigabit Virtual Function Network Driver1584worker1 # [ 1.002192] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1585worker1 # [ 1.002335] sky2: driver version 1.301586lb # [ 1.035938] registered taskstats version 11587worker1 # [ 1.003989] usbcore: registered new interface driver usb-storage1588lb # [ 1.036101] Loading compiled-in X.509 certificates1589worker1 # [ 1.004068] usbcore: registered new interface driver usbserial_generic1590worker1 # [ 1.004083] usbserial: USB Serial support registered for generic1591worker2 # [ 1.066135] clk: Disabling unused clocks1592worker1 # [ 1.004696] hv_vmbus: registering driver hyperv_keyboard1593worker2 # [ 1.066175] PM: genpd: Disabling unused power domains1594worker1 # [ 1.005658] ehci-pci 0000:00:0a.0: EHCI Host Controller1595worker1 # [ 1.005728] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11596worker2 # [ 1.070523] Freeing unused kernel memory: 4736K1597worker2 # [ 1.070762] Run /init as init process1598worker1 # [ 1.005946] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001599worker1 # [ 1.016930] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001600worker1 # [ 1.017368] hub 1-0:1.0: USB hub found1601worker1 # [ 1.017393] hub 1-0:1.0: 6 ports detected1602lb # [ 1.044945] Demotion targets for Node 0: null1603lb # [ 1.045077] Key type .fscrypt registered1604lb # [ 1.045084] Key type fscrypt-provisioning registered1605worker1 # [ 1.021508] rtc-pl031 9010000.pl031: registered as rtc01606lb # [ 1.045185] ima: No TPM chip found, activating TPM-bypass!1607lb # [ 1.045205] ima: Allocated hash algorithm: sha11608worker1 # [ 1.021549] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:47:25 UTC (1789908445)1609lb # [ 1.045227] ima: No architecture policies found1610worker1 # [ 1.021893] i2c_dev: i2c /dev entries driver1611lb # [ 1.049762] input: gpio-keys as /devices/platform/gpio-keys/input/input01612worker1 # [ 1.027095] sdhci: Secure Digital Host Controller Interface driver1613worker1 # [ 1.027107] sdhci: Copyright(c) Pierre Ossman1614worker1 # [ 1.027385] Synopsys Designware Multimedia Card Interface Driver1615worker1 # [ 1.027778] sdhci-pltfm: SDHCI platform and OF driver helper1616worker1 # [ 1.032435] hid: raw HID events driver (C) Jiri Kosina1617worker2 # [ 1.087458] systemd[1]: Successfully made /usr/ read-only.1618worker1 # [ 1.033419] usbcore: registered new interface driver usbhid1619worker1 # [ 1.033430] usbhid: USB HID core driver1620worker1 # [ 1.035844] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1621worker1 # [ 1.038681] drop_monitor: Initializing network drop monitor service1622worker1 # [ 1.038857] NET: Registered PF_INET6 protocol family1623worker1 # [ 1.041292] Segment Routing with IPv61624worker1 # [ 1.041317] In-situ OAM (IOAM) with IPv61625worker1 # [ 1.041353] NET: Registered PF_PACKET protocol family1626worker1 # [ 1.043053] 9pnet: Installing 9P2000 support1627lb # [ 1.069759] clk: Disabling unused clocks1628lb # [ 1.069796] PM: genpd: Disabling unused power domains1629worker1 # [ 1.046116] Key type dns_resolver registered1630lb # [ 1.074119] Freeing unused kernel memory: 4736K1631lb # [ 1.074326] Run /init as init process1632worker1 # [ 1.052758] registered taskstats version 11633worker1 # [ 1.052919] Loading compiled-in X.509 certificates1634worker1 # [ 1.061925] Demotion targets for Node 0: null1635worker1 # [ 1.062072] Key type .fscrypt registered1636worker1 # [ 1.062080] Key type fscrypt-provisioning registered1637worker1 # [ 1.062197] ima: No TPM chip found, activating TPM-bypass!1638worker1 # [ 1.062219] ima: Allocated hash algorithm: sha11639worker1 # [ 1.062245] ima: No architecture policies found1640lb # [ 1.091014] systemd[1]: Successfully made /usr/ read-only.1641worker1 # [ 1.067095] input: gpio-keys as /devices/platform/gpio-keys/input/input01642worker1 # [ 1.087041] clk: Disabling unused clocks1643worker1 # [ 1.087088] PM: genpd: Disabling unused power domains1644worker1 # [ 1.091605] Freeing unused kernel memory: 4736K1645worker1 # [ 1.091852] Run /init as init process1646worker1 # [ 1.107420] systemd[1]: Successfully made /usr/ read-only.1647client # [ 1.250033] usb 1-1: new high-speed USB device number 2 using ehci-pci1648worker2 # [ 1.261056] usb 1-1: new high-speed USB device number 2 using ehci-pci1649lb # [ 1.252645] usb 1-1: new high-speed USB device number 2 using ehci-pci1650worker1 # [ 1.264873] usb 1-1: new high-speed USB device number 2 using ehci-pci1651client # [ 1.404534] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11652client # [ 1.427679] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1653client # [ 1.440816] systemd[1]: Detected virtualization qemu.1654client # [ 1.443170] systemd[1]: Detected architecture arm64.1655client # [ 1.445257] systemd[1]: Running in initrd.1656client # [ 1.448410] systemd[1]: Initializing machine ID from random generator.1657client # [ 1.451739] systemd[1]: Hostname set to <client>.1658worker2 # [ 1.417756] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11659worker2 # [ 1.424438] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1660lb # [ 1.404912] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11661worker2 # [ 1.437925] systemd[1]: Detected virtualization qemu.1662worker2 # [ 1.440192] systemd[1]: Detected architecture arm64.1663client # [ 1.498254] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01664worker2 # [ 1.442418] systemd[1]: Running in initrd.1665worker2 # [ 1.445384] systemd[1]: Initializing machine ID from random generator.1666worker2 # [ 1.448426] systemd[1]: Hostname set to <worker2>.1667lb # [ 1.425814] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1668lb # [ 1.430835] systemd[1]: Detected virtualization qemu.1669lb # [ 1.431713] systemd[1]: Detected architecture arm64.1670lb # [ 1.432495] systemd[1]: Running in initrd.1671lb # [ 1.433716] systemd[1]: Initializing machine ID from random generator.1672lb # [ 1.434943] systemd[1]: Hostname set to <lb>.1673worker1 # [ 1.421677] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11674worker1 # [ 1.442458] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1675worker2 # [ 1.509288] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01676worker1 # [ 1.454886] systemd[1]: Detected virtualization qemu.1677worker1 # [ 1.454999] systemd[1]: Detected architecture arm64.1678worker1 # [ 1.455024] systemd[1]: Running in initrd.1679worker1 # [ 1.456006] systemd[1]: Initializing machine ID from random generator.1680worker1 # [ 1.456301] systemd[1]: Hostname set to <worker1>.1681lb # [ 1.500791] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01682client # [ 1.621978] usb 1-2: new high-speed USB device number 3 using ehci-pci1683worker1 # [ 1.509049] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01684worker2 # [ 1.629044] usb 1-2: new high-speed USB device number 3 using ehci-pci1685lb # [ 1.620571] usb 1-2: new high-speed USB device number 3 using ehci-pci1686client # [ 1.736455] systemd[1]: bpf-restrict-fs: LSM BPF program attached1687worker1 # [ 1.632772] usb 1-2: new high-speed USB device number 3 using ehci-pci1688client # [ 1.780679] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21689client # [ 1.782608] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01690worker2 # [ 1.738960] systemd[1]: bpf-restrict-fs: LSM BPF program attached1691client # [ 1.802014] systemd[1]: Queued start job for default target Initrd Default Target.1692client # [ 1.811962] systemd[1]: Created slice Slice /system/modprobe.1693client # [ 1.813018] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1694client # [ 1.814107] systemd[1]: Expecting device /dev/disk/by-label/nixos...1695client # [ 1.814943] systemd[1]: Reached target Path Units.1696client # [ 1.815567] systemd[1]: Reached target Slice Units.1697client # [ 1.816206] systemd[1]: Reached target Swaps.1698client # [ 1.816827] systemd[1]: Reached target Timer Units.1699client # [ 1.817648] systemd[1]: Listening on D-Bus System Message Bus Socket.1700client # [ 1.818701] systemd[1]: Listening on Journal Socket (/dev/log).1701client # [ 1.819576] systemd[1]: Listening on Journal Sockets.1702client # [ 1.820325] systemd[1]: Listening on udev Control Socket.1703client # [ 1.821096] systemd[1]: Listening on udev Kernel Socket.1704client # [ 1.821764] systemd[1]: Reached target Socket Units.1705client # [ 1.823966] systemd[1]: Starting Create List of Static Device Nodes...1706lb # [ 1.736323] systemd[1]: bpf-restrict-fs: LSM BPF program attached1707client # [ 1.833708] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1708client # [ 1.834911] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1709worker2 # [ 1.782564] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21710worker2 # [ 1.784508] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01711client # [ 1.843332] systemd[1]: Mounting Kernel Configuration File System...1712client # [ 1.860342] systemd[1]: Starting Journal Service...1713worker2 # [ 1.804909] systemd[1]: Queued start job for default target Initrd Default Target.1714lb # [ 1.778782] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21715lb # [ 1.782328] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01716worker2 # [ 1.815059] systemd[1]: Created slice Slice /system/modprobe.1717client # [ 1.874136] systemd[1]: Starting Load Kernel Modules...1718worker2 # [ 1.816059] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1719worker2 # [ 1.817199] systemd[1]: Expecting device /dev/disk/by-label/nixos...1720client # [ 1.874277] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1721worker2 # [ 1.818039] systemd[1]: Reached target Path Units.1722worker2 # [ 1.818675] systemd[1]: Reached target Slice Units.1723worker2 # [ 1.819355] systemd[1]: Reached target Swaps.1724worker2 # [ 1.819941] systemd[1]: Reached target Timer Units.1725worker2 # [ 1.820774] systemd[1]: Listening on D-Bus System Message Bus Socket.1726worker2 # [ 1.821857] systemd[1]: Listening on Journal Socket (/dev/log).1727worker2 # [ 1.822762] systemd[1]: Listening on Journal Sockets.1728worker2 # [ 1.823595] systemd[1]: Listening on udev Control Socket.1729worker2 # [ 1.824424] systemd[1]: Listening on udev Kernel Socket.1730worker2 # [ 1.825177] systemd[1]: Reached target Socket Units.1731worker2 # [ 1.827318] systemd[1]: Starting Create List of Static Device Nodes...1732worker2 # [ 1.833879] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1733worker2 # [ 1.834842] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1734client # [ 1.902238] systemd[1]: Starting Coldplug All udev Devices...1735worker2 # [ 1.845158] systemd[1]: Mounting Kernel Configuration File System...1736worker1 # [ 1.789790] systemd[1]: bpf-restrict-fs: LSM BPF program attached1737worker1 # [ 1.794148] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21738client # [ 1.913786] systemd-journald[73]: Collecting audit messages is disabled.1739worker1 # [ 1.794463] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01740worker2 # [ 1.859299] systemd[1]: Starting Journal Service...1741client # [ 1.922078] systemd[1]: Finished Create List of Static Device Nodes.1742client # [ 1.923110] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1743lb # [ 1.839217] systemd[1]: Queued start job for default target Initrd Default Target.1744worker2 # [ 1.873279] systemd[1]: Starting Load Kernel Modules...1745worker2 # [ 1.874192] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1746client # [ 1.934232] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1747lb # [ 1.851345] systemd[1]: Created slice Slice /system/modprobe.1748lb # [ 1.852809] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1749lb # [ 1.852858] systemd[1]: Expecting device /dev/disk/by-label/nixos...1750worker2 # [ 1.887243] systemd[1]: Starting Coldplug All udev Devices...1751lb # [ 1.852894] systemd[1]: Reached target Path Units.1752lb # [ 1.852916] systemd[1]: Reached target Slice Units.1753lb # [ 1.852939] systemd[1]: Reached target Swaps.1754lb # [ 1.852959] systemd[1]: Reached target Timer Units.1755lb # [ 1.853179] systemd[1]: Listening on D-Bus System Message Bus Socket.1756lb # [ 1.853401] systemd[1]: Listening on Journal Socket (/dev/log).1757lb # [ 1.853561] systemd[1]: Listening on Journal Sockets.1758lb # [ 1.853718] systemd[1]: Listening on udev Control Socket.1759lb # [ 1.853846] systemd[1]: Listening on udev Kernel Socket.1760client # [ 1.954660] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1761lb # [ 1.853873] systemd[1]: Reached target Socket Units.1762client # [ 1.956306] systemd[1]: Mounted Kernel Configuration File System.1763lb # [ 1.867754] systemd[1]: Starting Create List of Static Device Nodes...1764worker2 # [ 1.905315] systemd[1]: Finished Create List of Static Device Nodes.1765lb # [ 1.876819] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1766worker2 # [ 1.906283] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1767lb # [ 1.878127] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1768client # [ 1.974917] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1769worker2 # [ 1.921194] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1770worker2 # [ 1.921691] systemd[1]: Mounted Kernel Configuration File System.1771worker2 # [ 1.924870] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1772lb # [ 1.897207] systemd[1]: Mounting Kernel Configuration File System...1773client # [ 1.997978] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1774worker2 # [ 1.940781] systemd-journald[73]: Collecting audit messages is disabled.1775client # [ 2.006041] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01776worker1 # [ 1.894112] systemd[1]: Queued start job for default target Initrd Default Target.1777client # [ 2.006283] [drm] features: -virgl +edid -resource_blob -host_visible1778client # [ 2.006293] [drm] features: -context_init1779client # [ 2.007041] [drm] number of scanouts: 11780client # [ 2.007060] [drm] number of cap sets: 01781lb # [ 1.920898] systemd[1]: Starting Journal Service...1782lb # [ 1.924756] systemd[1]: Starting Load Kernel Modules...1783lb # [ 1.925742] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1784worker1 # [ 1.903130] systemd[1]: Created slice Slice /system/modprobe.1785worker1 # [ 1.904335] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1786client # [ 2.018765] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1787worker1 # [ 1.905777] systemd[1]: Expecting device /dev/disk/by-label/nixos...1788worker1 # [ 1.905815] systemd[1]: Reached target Path Units.1789worker1 # [ 1.905837] systemd[1]: Reached target Slice Units.1790worker1 # [ 1.905857] systemd[1]: Reached target Swaps.1791worker1 # [ 1.905876] systemd[1]: Reached target Timer Units.1792worker2 # [ 1.964314] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1793worker1 # [ 1.906087] systemd[1]: Listening on D-Bus System Message Bus Socket.1794worker1 # [ 1.906235] systemd[1]: Listening on Journal Socket (/dev/log).1795client # [ 2.022290] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1796worker1 # [ 1.906393] systemd[1]: Listening on Journal Sockets.1797client # [ 2.022315] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01798worker1 # [ 1.906528] systemd[1]: Listening on udev Control Socket.1799worker1 # [ 1.906638] systemd[1]: Listening on udev Kernel Socket.1800worker1 # [ 1.906660] systemd[1]: Reached target Socket Units.1801lb # [ 1.940872] systemd[1]: Starting Coldplug All udev Devices...1802worker1 # [ 1.917592] systemd[1]: Starting Create List of Static Device Nodes...1803worker2 # [ 1.973098] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1804client # [ 2.034428] systemd[1]: Starting Create Static Device Nodes in /dev...1805worker1 # [ 1.928243] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1806worker1 # [ 1.929688] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1807worker2 # [ 1.985234] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01808worker2 # [ 1.985492] [drm] features: -virgl +edid -resource_blob -host_visible1809worker2 # [ 1.985503] [drm] features: -context_init1810lb # [ 1.960747] systemd[1]: Finished Create List of Static Device Nodes.1811worker2 # [ 1.986298] [drm] number of scanouts: 11812worker2 # [ 1.986317] [drm] number of cap sets: 01813lb # [ 1.962637] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1814worker2 # [ 1.993049] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1815worker2 # [ 1.997488] systemd[1]: Starting Create Static Device Nodes in /dev...1816worker1 # [ 1.942474] systemd[1]: Mounting Kernel Configuration File System...1817lb # [ 1.969410] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1818lb # [ 1.969780] systemd[1]: Mounted Kernel Configuration File System.1819client # [ 2.054356] Console: switching to colour frame buffer device 160x501820lb # [ 1.977111] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1821worker2 # [ 2.009423] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1822worker2 # [ 2.009453] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01823worker1 # [ 1.965086] systemd[1]: Starting Journal Service...1824worker1 # [ 1.968856] systemd[1]: Starting Load Kernel Modules...1825worker1 # [ 1.969826] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1826client # [ 2.086971] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1827client # [ 2.089818] systemd[1]: Finished Create Static Device Nodes in /dev.1828client # [ 2.090137] systemd[1]: Reached target Preparation for Local File Systems.1829client # [ 2.090173] systemd[1]: Reached target Local File Systems.1830client # [ 2.096349] systemd[1]: Starting Rule-based Manager for Device Events and Files...1831lb # [ 2.010286] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1832worker2 # [ 2.041829] Console: switching to colour frame buffer device 160x501833lb # [ 2.016684] systemd-journald[73]: Collecting audit messages is disabled.1834client # [ 2.092884] systemd-modules-load[74]: Inserted module 'dm_mod'1835client # [ 2.094009] systemd-modules-load[74]: Module 'virtio_balloon' is built in1836worker1 # [ 1.996937] systemd[1]: Starting Coldplug All udev Devices...1837client # [ 2.095139] systemd-modules-load[74]: Module 'virtio_console' is built in1838client # [ 2.114147] systemd[1]: Finished Load Kernel Modules.1839client # [ 2.116542] systemd[1]: Started Journal Service.1840lb # [ 2.028803] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1841client # [ 2.104525] systemd-modules-load[74]: Inserted module 'virtio_gpu'1842client # [ 2.105622] systemd-modules-load[74]: Module 'virtio_rng' is built in1843worker1 # [ 2.010254] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1844worker2 # [ 2.069067] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1845lb # [ 2.040656] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01846lb # [ 2.040902] [drm] features: -virgl +edid -resource_blob -host_visible1847lb # [ 2.040913] [drm] features: -context_init1848lb # [ 2.041720] [drm] number of scanouts: 11849lb # [ 2.041741] [drm] number of cap sets: 01850worker1 # [ 2.016923] systemd[1]: Finished Create List of Static Device Nodes.1851worker2 # [ 2.072217] systemd[1]: Finished Create Static Device Nodes in /dev.1852worker1 # [ 2.018149] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1853worker2 # [ 2.072660] systemd[1]: Reached target Preparation for Local File Systems.1854worker1 # [ 2.018475] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1855worker2 # [ 2.072698] systemd[1]: Reached target Local File Systems.1856worker1 # [ 2.018724] systemd[1]: Mounted Kernel Configuration File System.1857lb # [ 2.051052] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1858worker1 # [ 2.029050] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1859worker2 # [ 2.081608] systemd[1]: Starting Rule-based Manager for Device Events and Files...1860lb # [ 2.056985] systemd[1]: Starting Create Static Device Nodes in /dev...1861client # [ 2.130586] systemd[1]: Starting Apply Kernel Variables...1862worker1 # [ 2.036940] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01863worker1 # [ 2.037215] [drm] features: -virgl +edid -resource_blob -host_visible1864worker1 # [ 2.037224] [drm] features: -context_init1865worker1 # [ 2.037988] [drm] number of scanouts: 11866worker1 # [ 2.038007] [drm] number of cap sets: 01867worker1 # [ 2.041995] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1868lb # [ 2.064991] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1869lb # [ 2.065019] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01870worker1 # [ 2.051380] systemd-journald[73]: Collecting audit messages is disabled.1871worker2 # [ 2.105247] systemd[1]: Finished Load Kernel Modules.1872worker2 # [ 2.109112] systemd[1]: Starting Apply Kernel Variables...1873worker1 # [ 2.052627] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1874client # [ 2.152285] systemd[1]: Starting Create System Files and Directories...1875worker1 # [ 2.052656] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01876lb # [ 2.092888] Console: switching to colour frame buffer device 160x501877worker2 # [ 2.126349] systemd-modules-load[74]: Inserted module 'dm_mod'1878worker1 # [ 2.089508] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1879worker2 # [ 2.144615] systemd[1]: Started Journal Service.1880worker1 # [ 2.093198] systemd[1]: Starting Create Static Device Nodes in /dev...1881lb # [ 2.117557] systemd[1]: Finished Create Static Device Nodes in /dev.1882lb # [ 2.117959] systemd[1]: Reached target Preparation for Local File Systems.1883lb # [ 2.117987] systemd[1]: Reached target Local File Systems.1884worker1 # [ 2.097142] Console: switching to colour frame buffer device 160x501885client # [ 2.198150] systemd-udevd[80]: Using default interface naming scheme 'v261'.1886worker2 # [ 2.141350] systemd-modules-load[74]: Module 'virtio_balloon' is built in1887client # [ 2.200158] systemd[1]: Finished Apply Kernel Variables.1888worker2 # [ 2.142595] systemd-modules-load[74]: Module 'virtio_console' is built in1889worker2 # [ 2.143758] systemd-modules-load[74]: Inserted module 'virtio_gpu'1890lb # [ 2.129173] systemd[1]: Starting Rule-based Manager for Device Events and Files...1891lb # [ 2.133498] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1892client # [ 2.208371] systemd[1]: Finished Create System Files and Directories.1893worker1 # [ 2.115226] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1894lb # [ 2.145215] systemd[1]: Finished Load Kernel Modules.1895worker2 # [ 2.160588] systemd-modules-load[74]: Module 'virtio_rng' is built in1896worker2 # [ 2.161735] systemd[1]: Starting Create System Files and Directories...1897worker1 # [ 2.129541] systemd[1]: Finished Load Kernel Modules.1898client # [ 2.233446] systemd[1]: Started Rule-based Manager for Device Events and Files.1899worker2 # [ 2.176406] systemd[1]: Finished Apply Kernel Variables.1900worker1 # [ 2.141277] systemd[1]: Starting Apply Kernel Variables...1901lb # [ 2.169804] systemd[1]: Starting Apply Kernel Variables...1902worker2 # [ 2.186795] systemd-udevd[79]: Using default interface naming scheme 'v261'.1903worker1 # [ 2.161630] systemd[1]: Finished Create Static Device Nodes in /dev.1904worker1 # [ 2.163870] systemd[1]: Reached target Preparation for Local File Systems.1905worker1 # [ 2.165898] systemd[1]: Reached target Local File Systems.1906worker2 # [ 2.206936] systemd[1]: Finished Create System Files and Directories.1907lb # [ 2.197799] systemd[1]: Started Journal Service.1908worker1 # [ 2.174640] systemd[1]: Starting Rule-based Manager for Device Events and Files...1909lb # [ 2.192421] systemd-modules-load[74]: Inserted module 'dm_mod'1910lb # [ 2.198050] systemd-modules-load[74]: Module 'virtio_balloon' is built in1911lb # [ 2.199226] systemd-modules-load[74]: Module 'virtio_console' is built in1912worker2 # [ 2.225543] systemd[1]: Started Rule-based Manager for Device Events and Files.1913lb # [ 2.211219] systemd-modules-load[74]: Inserted module 'virtio_gpu'1914client # [ 2.296881] systemd[1]: Starting Virtual Console Setup...1915lb # [ 2.216506] systemd-modules-load[74]: Module 'virtio_rng' is built in1916lb # [ 2.217640] systemd[1]: Starting Create System Files and Directories...1917worker1 # [ 2.209223] systemd[1]: Finished Apply Kernel Variables.1918lb # [ 2.231277] systemd[1]: Finished Apply Kernel Variables.1919lb # [ 2.257961] systemd[1]: Finished Create System Files and Directories.1920worker1 # [ 2.250751] systemd[1]: Started Journal Service.1921lb # [ 2.265920] systemd-udevd[79]: Using default interface naming scheme 'v261'.1922client # [ 2.352651] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1923worker2 # [ 2.296150] systemd[1]: Starting Virtual Console Setup...1924client # [ 2.356498] systemd[1]: Finished Virtual Console Setup.1925worker1 # [ 2.248428] systemd-modules-load[74]: Inserted module 'dm_mod'1926worker1 # [ 2.249669] systemd-modules-load[74]: Module 'virtio_balloon' is built in1927worker1 # [ 2.250789] systemd-modules-load[74]: Module 'virtio_console' is built in1928worker1 # [ 2.251870] systemd-modules-load[74]: Inserted module 'virtio_gpu'1929worker1 # [ 2.261450] systemd-modules-load[74]: Module 'virtio_rng' is built in1930worker1 # [ 2.262560] systemd[1]: Starting Create System Files and Directories...1931worker1 # [ 2.263944] systemd-udevd[81]: Using default interface naming scheme 'v261'.1932lb # [ 2.295557] systemd[1]: Started Rule-based Manager for Device Events and Files.1933worker2 # [ 2.344629] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones.1934worker2 # [ 2.348516] systemd[1]: Finished Virtual Console Setup.1935worker1 # [ 2.297572] systemd[1]: Finished Create System Files and Directories.1936worker1 # [ 2.314595] systemd[1]: Started Rule-based Manager for Device Events and Files.1937lb # [ 2.358481] systemd[1]: Starting Virtual Console Setup...1938worker1 # [ 2.372646] systemd[1]: Starting Virtual Console Setup...1939lb # [ 2.412552] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1940lb # [ 2.416167] systemd[1]: Finished Virtual Console Setup.1941worker1 # [ 2.436559] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1942worker1 # [ 2.439601] systemd[1]: Finished Virtual Console Setup.1943client # [ 2.929666] systemd[1]: Finished Coldplug All udev Devices.1944client # [ 2.930686] systemd[1]: Reached target System Initialization.1945client # [ 2.931523] systemd[1]: Reached target Basic System.1946worker2 # [ 2.957755] systemd[1]: Finished Coldplug All udev Devices.1947worker2 # [ 2.958780] systemd[1]: Reached target System Initialization.1948worker2 # [ 2.964145] systemd[1]: Reached target Basic System.1949client # [ 3.072596] (udev-worker)[106]: Network interface NamePolicy= disabled on kernel command line.1950client # [ 3.087176] (udev-worker)[98]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1951lb # [ 3.013927] systemd[1]: Finished Coldplug All udev Devices.1952lb # [ 3.014870] systemd[1]: Reached target System Initialization.1953lb # [ 3.020127] systemd[1]: Reached target Basic System.1954client # [ 3.104926] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line.1955worker2 # [ 3.088355] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line.1956worker1 # [ 3.041964] systemd[1]: Finished Coldplug All udev Devices.1957worker1 # [ 3.042973] systemd[1]: Reached target System Initialization.1958worker1 # [ 3.044382] systemd[1]: Reached target Basic System.1959client # [ 3.204148] systemd[1]: Found device /dev/disk/by-label/nixos.1960worker2 # [ 3.146252] (udev-worker)[94]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1961client # [ 3.205768] systemd[1]: Reached target Initrd Root Device.1962worker2 # [ 3.149807] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line.1963client # [ 3.208691] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1964client # [ 3.259964] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1965worker2 # [ 3.210535] systemd[1]: Found device /dev/disk/by-label/nixos.1966worker2 # [ 3.212935] systemd[1]: Reached target Initrd Root Device.1967lb # [ 3.186932] (udev-worker)[94]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1968client # [ 3.272768] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1969worker2 # [ 3.216740] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1970client # [ 3.276275] systemd[1]: Mounting /sysroot...1971lb # [ 3.198909] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line.1972lb # [ 3.205950] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line.1973worker1 # [ 3.180126] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line.1974client # [ 3.335761] EXT4-fs (vda): mounted filesystem 06bb7e13-5214-4938-a8f7-2621e2937058 r/w with ordered data mode. Quota mode: none.1975client # [ 3.324575] systemd[1]: Mounted /sysroot.1976client # [ 3.326190] systemd[1]: Reached target Initrd Root File System.1977worker2 # [ 3.272718] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks1978client # [ 3.332072] systemd[1]: Starting Mountpoints Configured in the Real Root...1979worker1 # [ 3.224555] (udev-worker)[99]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1980worker2 # [ 3.280294] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1981worker1 # [ 3.232247] (udev-worker)[99]: Network interface NamePolicy= disabled on kernel command line.1982worker2 # [ 3.288329] systemd[1]: Mounting /sysroot...1983client # [ 3.363332] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload.1984lb # [ 3.280827] systemd[1]: Found device /dev/disk/by-label/nixos.1985lb # [ 3.286881] systemd[1]: Reached target Initrd Root Device.1986client # [ 3.372191] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)...1987lb # [ 3.291831] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1988client # [ 3.376204] systemd[1]: Reloading...1989worker2 # [ 3.343733] EXT4-fs (vda): mounted filesystem b5e2efcc-94a2-4ccd-baf5-577ffb9adfaa r/w with ordered data mode. Quota mode: none.1990worker2 # [ 3.332118] systemd[1]: Mounted /sysroot.1991worker2 # [ 3.334972] systemd[1]: Reached target Initrd Root File System.1992worker2 # [ 3.344146] systemd[1]: Starting Mountpoints Configured in the Real Root...1993worker1 # [ 3.293437] systemd[1]: Found device /dev/disk/by-label/nixos.1994worker1 # [ 3.294819] systemd[1]: Reached target Initrd Root Device.1995worker1 # [ 3.300168] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1996worker2 # [ 3.371875] systemd-sysroot-fstab-check[119]: /sysroot should be mounted in the initrd, will request daemon-reload.1997lb # [ 3.351980] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1998worker2 # [ 3.380125] systemd[1]: Reload requested from client PID 119 ('systemd-sysroot') (unit initrd-parse-etc.service)...1999worker2 # [ 3.383832] systemd[1]: Reloading...2000lb # [ 3.361805] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.
loading 1,357 hidden lines…
3358client # [ 15.574499] dhcpcd[542]: eth0: soliciting an IPv6 router3359client # [ 15.578176] dhcpcd[542]: eth0: Router Advertisement from fe80::23360client # [ 15.580817] dhcpcd[542]: eth0: adding address fec0::5054:ff:fe12:3456/643361client # [ 15.583510] dhcpcd[542]: eth0: adding route to fec0::/643362client # [ 15.585983] dhcpcd[542]: eth0: adding default route via fe80::23363lb: (finished: waiting for unit network-addresses-eth1.service, in 2.11 seconds)3364lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }3365lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.05 seconds)3366worker1: waiting for unit network-addresses-eth1.service3367worker1: waiting for the VM to finish booting3368worker1: Guest shell says: b'Spawning backdoor root shell...\n'3369worker1: connected to guest root shell3370worker1: (connecting took 0.00 seconds)3371worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3372worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.12 seconds)3373worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3374worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.04 seconds)3375worker2: waiting for unit network-addresses-eth1.service3376worker2: waiting for the VM to finish booting3377worker2: Guest shell says: b'Spawning backdoor root shell...\n'3378worker2: connected to guest root shell3379worker2: (connecting took 0.00 seconds)3380worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3381lb # [ 15.940615] dhcpcd[659]: eth0: soliciting a DHCP lease3382lb # [ 15.948550] dhcpcd[659]: eth0: offered 10.0.2.15 from 10.0.2.23383lb # [ 15.956517] dhcpcd[659]: eth0: probing address 10.0.2.15/243384worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.12 seconds)3385worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3386worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.05 seconds)3387lb: waiting for unit niks3.service3388lb # [ 16.578255] postgresql-pre-start[682]: selecting default time zone ... UTC3389lb # [ 16.583062] postgresql-pre-start[682]: creating configuration files ... ok3390lb # [ 16.756317] dhcpcd[659]: eth0: soliciting an IPv6 router3391lb # [ 16.757657] dhcpcd[659]: eth0: Router Advertisement from fe80::23392lb # [ 16.758532] dhcpcd[659]: eth0: adding address fec0::5054:ff:fe12:3456/643393lb # [ 16.765949] dhcpcd[659]: eth0: adding route to fec0::/643394lb # [ 16.766893] dhcpcd[659]: eth0: adding default route via fe80::23395lb # [ 17.140857] postgresql-pre-start[682]: running bootstrap script ... ok3396lb # [ 17.167894] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3397lb # [ 17.174262] systemd[1]: Stopped Virtual Console Setup.3398lb # [ 17.177163] systemd[1]: Stopping Virtual Console Setup...3399lb # [ 17.181400] systemd[1]: Starting Virtual Console Setup...3400lb # [ 17.233397] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3401lb # [ 17.252135] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3402lb # [ 17.254270] systemd[1]: Stopped Virtual Console Setup.3403lb # [ 17.276989] systemd[1]: Starting Virtual Console Setup...3404lb # [ 17.369425] systemd-logind[525]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3405lb # [ 17.770115] systemd-vconsole-setup[796]: Configuration of first virtual console was skipped, ignoring remaining ones.3406lb # [ 17.779605] systemd[1]: Finished Virtual Console Setup.3407lb # [ 18.103366] postgresql-pre-start[682]: performing post-bootstrap initialization ... ok3408client # [ 18.249092] dhcpcd[542]: eth0: leased 10.0.2.15 for 86400 seconds3409client # [ 18.251891] dhcpcd[542]: eth0: adding route to 10.0.2.0/243410client # [ 18.254822] dhcpcd[542]: eth0: adding default route via 10.0.2.23411lb # [ 18.240743] postgresql-pre-start[682]: syncing data to disk ... ok3412lb # [ 18.241725] postgresql-pre-start[682]: initdb: warning: enabling "trust" authentication for local connections3413lb # [ 18.243188] postgresql-pre-start[682]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3414lb # [ 18.245510] postgresql-pre-start[682]: Success. You can now start the database server using:3415lb # [ 18.246745] postgresql-pre-start[682]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3416worker2 # [ 18.340811] dhcpcd[639]: eth0: leased 10.0.2.15 for 86400 seconds3417worker2 # [ 18.345466] dhcpcd[639]: eth0: adding route to 10.0.2.0/243418worker2 # [ 18.350228] dhcpcd[639]: eth0: adding default route via 10.0.2.23419client # [ 18.425076] systemd[1]: Started DHCP Client.3420client # [ 18.427894] systemd[1]: Reached target Multi-User System.3421client # [ 18.433895] systemd[1]: Startup finished in 1.062s (kernel) + 5.635s (initrd) + 11.732s (userspace) = 18.430s.3422lb # [ 18.377631] postgres[809]: [809] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit3423lb # [ 18.381935] postgres[809]: [809] LOG: listening on IPv6 address "::1", port 54323424lb # [ 18.383149] postgres[809]: [809] LOG: listening on IPv4 address "127.0.0.1", port 54323425lb # [ 18.385022] postgres[809]: [809] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3426lb # [ 18.399831] postgres[818]: [818] LOG: database system was shut down at 2026-09-20 12:47:42 GMT3427lb # [ 18.405983] postgres[809]: [809] LOG: database system is ready to accept connections3428lb # [ 18.410941] systemd[1]: Started PostgreSQL Server.3429lb # [ 18.420157] systemd[1]: Starting PostgreSQL Setup Scripts...3430worker2 # [ 18.535239] systemd[1]: Started DHCP Client.3431worker2 # [ 18.537552] systemd[1]: Reached target Multi-User System.3432worker2 # [ 18.538482] systemd[1]: Startup finished in 1.058s (kernel) + 5.580s (initrd) + 11.898s (userspace) = 18.536s.3433lb # [ 18.682240] postgresql-setup-start[838]: CREATE DATABASE3434lb # [ 18.740660] postgresql-setup-start[843]: CREATE ROLE3435lb # [ 18.780286] postgresql-setup-start[847]: ALTER DATABASE3436lb # [ 18.785456] systemd[1]: Finished PostgreSQL Setup Scripts.3437lb # [ 18.787216] systemd[1]: Reached target PostgreSQL.3438worker1 # [ 20.061387] dhcpcd[646]: eth0: leased 10.0.2.15 for 86400 seconds3439worker1 # [ 20.061638] dhcpcd[646]: eth0: adding route to 10.0.2.0/243440worker1 # [ 20.061718] dhcpcd[646]: eth0: adding default route via 10.0.2.23441worker1 # [ 20.193090] systemd[1]: Started DHCP Client.3442worker1 # [ 20.194774] systemd[1]: Reached target Multi-User System.3443worker1 # [ 20.196350] systemd[1]: Startup finished in 1.080s (kernel) + 5.541s (initrd) + 13.573s (userspace) = 20.195s.3444lb # [ 21.038032] dhcpcd[659]: eth0: leased 10.0.2.15 for 86400 seconds3445lb # [ 21.040812] dhcpcd[659]: eth0: adding route to 10.0.2.0/243446lb # [ 21.040957] dhcpcd[659]: eth0: adding default route via 10.0.2.23447lb # [ 21.181343] systemd[1]: Started DHCP Client.3448lb # [ 21.187283] systemd[1]: Reached target Network is Online.3449lb # [ 21.190100] systemd[1]: Started Envoy reverse proxy.3450lb # [ 21.197491] systemd[1]: Started mock-oidc.service.3451lb # [ 21.290188] mock-oidc-server[928]: Mock OIDC Server running3452lb # [ 21.291259] mock-oidc-server[928]: OIDC Address: 192.168.1.2:80803453lb # [ 21.292662] mock-oidc-server[928]: Issue Address: 0.0.0.0:80813454lb # [ 21.293748] mock-oidc-server[928]: Issuer: http://192.168.1.2:8080/oidc3455lb # [ 21.294946] mock-oidc-server[928]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3456lb # [ 21.296512] mock-oidc-server[928]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3457lb # [ 21.298134] mock-oidc-server[928]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3458lb # [ 21.880828] envoy[927]: [2026-09-20 12:47:46.387][927][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120)3459lb # [ 21.883641] envoy[927]: [2026-09-20 12:47:46.389][927][info][main] [source/server/server.cc:469] statically linked extensions:3460lb # [ 21.886499] envoy[927]: [2026-09-20 12:47:46.389][927][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3461lb # [ 21.888885] envoy[927]: [2026-09-20 12:47:46.389][927][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3462lb # [ 21.894455] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3463lb # [ 21.898928] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3464lb # [ 21.902613] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3465lb # [ 21.904480] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3466lb # [ 21.912133] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3467lb # [ 21.914864] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3468lb # [ 21.957199] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3469lb # [ 21.959819] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3470lb # [ 21.962443] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3471lb # [ 21.964724] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter3472lb # [ 21.966902] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3473lb # [ 21.974441] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3474lb # [ 21.979076] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3475lb # [ 21.981439] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3476lb # [ 21.983251] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3477lb # [ 21.986515] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3478lb # [ 21.988472] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3479lb # [ 21.990869] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso3480lb # [ 21.996152] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3481lb # [ 22.002971] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23482lb # [ 22.005143] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3483lb # [ 22.011731] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator3484lb # [ 22.015100] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift3485lb # [ 22.018744] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3486lb # [ 22.020804] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy3487lb # [ 22.023777] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3488lb # [ 22.026146] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert3489lb # [ 22.028123] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3490lb # [ 22.032893] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3491lb # [ 22.035918] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection3492lb # [ 22.041451] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3493lb # [ 22.044679] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23494lb # [ 22.046561] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind3495lb # [ 22.048679] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13496lb # [ 22.050909] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3497lb # [ 22.054377] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3498lb # [ 22.057636] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3499lb # [ 22.059586] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default3500lb # [ 22.061769] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default3501lb # [ 22.064093] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3502lb # [ 22.066394] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3503lb # [ 22.068363] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3504lb # [ 22.071579] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3505lb # [ 22.073776] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction3506lb # [ 22.079842] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3507lb # [ 22.083634] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3508lb # [ 22.086477] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default3509lb # [ 22.088417] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3510lb # [ 22.090650] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy3511lb # [ 22.104420] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3512lb # [ 22.112301] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3513lb # [ 22.115192] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic3514lb # [ 22.117225] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple3515lb # [ 22.119565] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3516lb # [ 22.121976] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3517lb # [ 22.124240] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector3518lb # [ 22.131699] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo3519lb # [ 22.134324] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3520lb # [ 22.141717] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3521lb # [ 22.146642] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3522lb # [ 22.149686] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3523lb # [ 22.151635] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3524lb # [ 22.154907] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3525lb # [ 22.162244] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3526lb # [ 22.165188] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3527lb # [ 22.170943] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3528lb # [ 22.173723] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based3529lb # [ 22.178320] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy3530lb # [ 22.181668] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default3531lb # [ 22.183367] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params3532lb # [ 22.194563] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3533lb # [ 22.197069] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua3534lb # [ 22.198804] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3535lb # [ 22.200882] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3536lb # [ 22.203866] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3537lb # [ 22.206122] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable3538lb # [ 22.208347] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override3539lb # [ 22.211266] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3540lb # [ 22.214657] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3541lb # [ 22.216833] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3542lb # [ 22.218783] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth23543lb # [ 22.221884] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3544lb # [ 22.223614] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3545lb # [ 22.226070] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3546lb # [ 22.228475] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3547lb # [ 22.232055] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3548lb # [ 22.234076] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3549lb # [ 22.236246] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3550lb # [ 22.239029] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor3551lb # [ 22.241953] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case3552lb # [ 22.244470] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection3553lb # [ 22.246501] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats3554lb # [ 22.249288] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3555lb # [ 22.251763] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83556lb # [ 22.254118] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3557lb # [ 22.256470] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3558lb # [ 22.261496] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3559lb # [ 22.264398] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default3560lb # [ 22.266427] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid3561lb # [ 22.268090] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3562lb # [ 22.270716] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3563lb # [ 22.279456] envoy[927]: [2026-09-20 12:47:46.390][927][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3564lb # [ 22.282815] envoy[927]: [2026-09-20 12:47:46.451][927][info][main] [source/server/server.cc:531] HTTP header map info:3565lb # [ 22.284384] envoy[927]: [2026-09-20 12:47:46.453][927][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id3566lb # [ 22.300130] envoy[927]: [2026-09-20 12:47:46.453][927][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:3567lb # [ 22.301793] envoy[927]: [2026-09-20 12:47:46.453][927][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id3568lb # [ 22.311000] envoy[927]: [2026-09-20 12:47:46.453][927][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status3569lb # [ 22.313122] envoy[927]: [2026-09-20 12:47:46.619][927][info][main] [source/server/server.cc:968] runtime: {}3570lb # [ 22.314640] envoy[927]: [2026-09-20 12:47:46.641][927][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.3571lb # [ 22.316670] envoy[927]: [2026-09-20 12:47:46.641][927][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99013572lb # [ 22.318405] envoy[927]: [2026-09-20 12:47:46.641][927][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99013573lb # [ 22.320003] envoy[927]: [2026-09-20 12:47:46.656][927][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration3574lb # [ 22.321765] envoy[927]: [2026-09-20 12:47:46.656][927][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)3575lb # [ 22.323446] envoy[927]: [2026-09-20 12:47:46.656][927][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)3576lb # [ 22.343857] envoy[927]: [2026-09-20 12:47:46.850][927][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)3577worker2 # [ 22.373245] systemd[1]: Reached target Network is Online.3578lb # [ 22.354411] envoy[927]: [2026-09-20 12:47:46.861][927][info][config] [source/server/configuration_impl.cc:164] loading stats configuration3579worker1 # [ 22.327021] systemd[1]: Starting Nix worker-protocol over gRPC...3580lb # [ 22.357170] envoy[927]: [2026-09-20 12:47:46.863][927][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.3581lb # [ 22.360658] envoy[927]: [2026-09-20 12:47:46.863][927][info][main] [source/server/server.cc:1077] starting main dispatch loop3582worker2 # [ 22.385494] systemd[1]: Starting scheduler-token.service...3583worker2 # [ 22.523905] systemd[1]: scheduler-token.service: Deactivated successfully.3584worker2 # [ 22.528235] systemd[1]: Finished scheduler-token.service.3585worker2 # [ 22.529596] systemd[1]: scheduler-token.service: Consumed 57ms CPU time over 141ms wall clock time, 2.9M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.3586worker2 # [ 22.538716] systemd[1]: Starting Nix worker-protocol over gRPC...3587worker1 # [ 22.574169] nix-grpc-daemon[776]: ts=2026-09-20T12:47:47Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"3588worker1 # [ 22.586323] nix-grpc-daemon[776]: ts=2026-09-20T12:47:47Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3589worker1 # [ 22.589001] nix-grpc-daemon[776]: ts=2026-09-20T12:47:47Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=13590worker1 # [ 22.635457] nix-grpc-daemon[776]: ts=2026-09-20T12:47:47Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3591worker1 # [ 22.640338] systemd[1]: Started Nix worker-protocol over gRPC.3592worker1 # [ 22.669851] nix-grpc-daemon[776]: ts=2026-09-20T12:47:47Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3593lb # [ 22.702676] envoy[927]: [2026-09-20 12:47:47.209][927][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization3594lb # [ 22.709911] envoy[927]: [2026-09-20 12:47:47.209][927][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized3595lb # [ 22.715436] envoy[927]: [2026-09-20 12:47:47.209][927][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager3596lb # [ 22.720872] envoy[927]: [2026-09-20 12:47:47.209][927][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers3597worker2 # [ 22.759234] nix-grpc-daemon[775]: ts=2026-09-20T12:47:47Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"3598worker2 # [ 22.771405] nix-grpc-daemon[775]: ts=2026-09-20T12:47:47Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3599worker2 # [ 22.773850] nix-grpc-daemon[775]: ts=2026-09-20T12:47:47Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=13600worker2 # [ 22.822877] nix-grpc-daemon[775]: ts=2026-09-20T12:47:47Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3601worker2 # [ 22.828986] systemd[1]: Started Nix worker-protocol over gRPC.3602worker2 # [ 22.866496] nix-grpc-daemon[775]: ts=2026-09-20T12:47:47Z level=info event=scheduler_connected addr=lb:500513603worker2 # [ 22.872247] nix-grpc-daemon[775]: ts=2026-09-20T12:47:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3604worker1 # [ 22.870725] nix-grpc-daemon[776]: ts=2026-09-20T12:47:47Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3605worker2 # [ 23.074463] nix-grpc-daemon[775]: ts=2026-09-20T12:47:47Z level=info event=scheduler_connected addr=lb:500513606worker2 # [ 23.079877] nix-grpc-daemon[775]: ts=2026-09-20T12:47:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3607worker2 # [ 23.281936] nix-grpc-daemon[775]: ts=2026-09-20T12:47:47Z level=info event=scheduler_connected addr=lb:500513608worker2 # [ 23.287835] nix-grpc-daemon[775]: ts=2026-09-20T12:47:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3609worker1 # [ 23.271635] nix-grpc-daemon[776]: ts=2026-09-20T12:47:47Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3610worker2 # [ 23.489034] nix-grpc-daemon[775]: ts=2026-09-20T12:47:48Z level=info event=scheduler_connected addr=lb:500513611worker2 # [ 23.494882] nix-grpc-daemon[775]: ts=2026-09-20T12:47:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3612worker2 # [ 23.696124] nix-grpc-daemon[775]: ts=2026-09-20T12:47:48Z level=info event=scheduler_connected addr=lb:500513613worker2 # [ 23.701239] nix-grpc-daemon[775]: ts=2026-09-20T12:47:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3614lb # [ 23.802387] envoy[927]: conn peer=192.168.1.3:44746 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=43615worker2 # [ 23.904861] nix-grpc-daemon[775]: ts=2026-09-20T12:47:48Z level=info event=scheduler_connected addr=lb:500513616worker2 # [ 23.909082] nix-grpc-daemon[775]: ts=2026-09-20T12:47:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3617worker2 # [ 24.106107] nix-grpc-daemon[775]: ts=2026-09-20T12:47:48Z level=info event=scheduler_connected addr=lb:500513618worker2 # [ 24.111458] nix-grpc-daemon[775]: ts=2026-09-20T12:47:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3619worker1 # [ 24.075181] nix-grpc-daemon[776]: ts=2026-09-20T12:47:48Z level=info event=scheduler_connected addr=lb:500513620worker1 # [ 24.075547] nix-grpc-daemon[776]: ts=2026-09-20T12:47:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3621worker2 # [ 24.313116] nix-grpc-daemon[775]: ts=2026-09-20T12:47:48Z level=info event=scheduler_connected addr=lb:500513622worker2 # [ 24.318596] nix-grpc-daemon[775]: ts=2026-09-20T12:47:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3623worker1 # [ 24.276252] nix-grpc-daemon[776]: ts=2026-09-20T12:47:48Z level=info event=scheduler_connected addr=lb:500513624worker1 # [ 24.281487] nix-grpc-daemon[776]: ts=2026-09-20T12:47:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3625worker2 # [ 24.520073] nix-grpc-daemon[775]: ts=2026-09-20T12:47:49Z level=info event=scheduler_connected addr=lb:500513626worker2 # [ 24.525557] nix-grpc-daemon[775]: ts=2026-09-20T12:47:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3627worker1 # [ 24.482375] nix-grpc-daemon[776]: ts=2026-09-20T12:47:48Z level=info event=scheduler_connected addr=lb:500513628worker1 # [ 24.487801] nix-grpc-daemon[776]: ts=2026-09-20T12:47:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3629worker2 # [ 24.727246] nix-grpc-daemon[775]: ts=2026-09-20T12:47:49Z level=info event=scheduler_connected addr=lb:500513630worker2 # [ 24.732812] nix-grpc-daemon[775]: ts=2026-09-20T12:47:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3631worker1 # [ 24.688519] nix-grpc-daemon[776]: ts=2026-09-20T12:47:49Z level=info event=scheduler_connected addr=lb:500513632worker1 # [ 24.693827] nix-grpc-daemon[776]: ts=2026-09-20T12:47:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3633worker2 # [ 24.935879] nix-grpc-daemon[775]: ts=2026-09-20T12:47:49Z level=info event=scheduler_connected addr=lb:500513634worker2 # [ 24.940309] nix-grpc-daemon[775]: ts=2026-09-20T12:47:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3635worker1 # [ 24.894726] nix-grpc-daemon[776]: ts=2026-09-20T12:47:49Z level=info event=scheduler_connected addr=lb:500513636worker1 # [ 24.900195] nix-grpc-daemon[776]: ts=2026-09-20T12:47:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3637worker2 # [ 25.136991] nix-grpc-daemon[775]: ts=2026-09-20T12:47:49Z level=info event=scheduler_connected addr=lb:500513638worker2 # [ 25.142323] nix-grpc-daemon[775]: ts=2026-09-20T12:47:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3639worker1 # [ 25.102795] nix-grpc-daemon[776]: ts=2026-09-20T12:47:49Z level=info event=scheduler_connected addr=lb:500513640worker1 # [ 25.107099] nix-grpc-daemon[776]: ts=2026-09-20T12:47:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3641worker2 # [ 25.343722] nix-grpc-daemon[775]: ts=2026-09-20T12:47:49Z level=info event=scheduler_connected addr=lb:500513642worker2 # [ 25.349334] nix-grpc-daemon[775]: ts=2026-09-20T12:47:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3643worker1 # [ 25.303541] nix-grpc-daemon[776]: ts=2026-09-20T12:47:49Z level=info event=scheduler_connected addr=lb:500513644worker1 # [ 25.309173] nix-grpc-daemon[776]: ts=2026-09-20T12:47:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3645worker2 # [ 25.550819] nix-grpc-daemon[775]: ts=2026-09-20T12:47:50Z level=info event=scheduler_connected addr=lb:500513646worker2 # [ 25.556453] nix-grpc-daemon[775]: ts=2026-09-20T12:47:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3647worker1 # [ 25.509984] nix-grpc-daemon[776]: ts=2026-09-20T12:47:50Z level=info event=scheduler_connected addr=lb:500513648worker1 # [ 25.515314] nix-grpc-daemon[776]: ts=2026-09-20T12:47:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3649worker2 # [ 25.757720] nix-grpc-daemon[775]: ts=2026-09-20T12:47:50Z level=info event=scheduler_connected addr=lb:500513650worker2 # [ 25.763234] nix-grpc-daemon[775]: ts=2026-09-20T12:47:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3651worker1 # [ 25.716145] nix-grpc-daemon[776]: ts=2026-09-20T12:47:50Z level=info event=scheduler_connected addr=lb:500513652worker1 # [ 25.721365] nix-grpc-daemon[776]: ts=2026-09-20T12:47:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3653worker2 # [ 25.966633] nix-grpc-daemon[775]: ts=2026-09-20T12:47:50Z level=info event=scheduler_connected addr=lb:500513654worker2 # [ 25.970908] nix-grpc-daemon[775]: ts=2026-09-20T12:47:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3655worker1 # [ 25.922278] nix-grpc-daemon[776]: ts=2026-09-20T12:47:50Z level=info event=scheduler_connected addr=lb:500513656worker1 # [ 25.927637] nix-grpc-daemon[776]: ts=2026-09-20T12:47:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3657worker2 # [ 26.167713] nix-grpc-daemon[775]: ts=2026-09-20T12:47:50Z level=info event=scheduler_connected addr=lb:500513658worker2 # [ 26.173220] nix-grpc-daemon[775]: ts=2026-09-20T12:47:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3659worker1 # [ 26.130848] nix-grpc-daemon[776]: ts=2026-09-20T12:47:50Z level=info event=scheduler_connected addr=lb:500513660worker1 # [ 26.135201] nix-grpc-daemon[776]: ts=2026-09-20T12:47:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3661worker2 # [ 26.374696] nix-grpc-daemon[775]: ts=2026-09-20T12:47:50Z level=info event=scheduler_connected addr=lb:500513662worker2 # [ 26.380536] nix-grpc-daemon[775]: ts=2026-09-20T12:47:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3663worker1 # [ 26.331590] nix-grpc-daemon[776]: ts=2026-09-20T12:47:50Z level=info event=scheduler_connected addr=lb:500513664worker1 # [ 26.337158] nix-grpc-daemon[776]: ts=2026-09-20T12:47:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3665worker2 # [ 26.581922] nix-grpc-daemon[775]: ts=2026-09-20T12:47:51Z level=info event=scheduler_connected addr=lb:500513666worker2 # [ 26.587376] nix-grpc-daemon[775]: ts=2026-09-20T12:47:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3667worker1 # [ 26.538135] nix-grpc-daemon[776]: ts=2026-09-20T12:47:51Z level=info event=scheduler_connected addr=lb:500513668worker1 # [ 26.543608] nix-grpc-daemon[776]: ts=2026-09-20T12:47:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3669worker2 # [ 26.788893] nix-grpc-daemon[775]: ts=2026-09-20T12:47:51Z level=info event=scheduler_connected addr=lb:500513670worker2 # [ 26.794289] nix-grpc-daemon[775]: ts=2026-09-20T12:47:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3671worker1 # [ 26.744548] nix-grpc-daemon[776]: ts=2026-09-20T12:47:51Z level=info event=scheduler_connected addr=lb:500513672worker1 # [ 26.749721] nix-grpc-daemon[776]: ts=2026-09-20T12:47:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3673worker2 # [ 26.996926] nix-grpc-daemon[775]: ts=2026-09-20T12:47:51Z level=info event=scheduler_connected addr=lb:500513674worker2 # [ 27.001801] nix-grpc-daemon[775]: ts=2026-09-20T12:47:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3675worker1 # [ 26.950380] nix-grpc-daemon[776]: ts=2026-09-20T12:47:51Z level=info event=scheduler_connected addr=lb:500513676worker1 # [ 26.955585] nix-grpc-daemon[776]: ts=2026-09-20T12:47:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3677worker2 # [ 27.203275] nix-grpc-daemon[775]: ts=2026-09-20T12:47:51Z level=info event=scheduler_connected addr=lb:500513678worker2 # [ 27.208905] nix-grpc-daemon[775]: ts=2026-09-20T12:47:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3679worker1 # [ 27.158432] nix-grpc-daemon[776]: ts=2026-09-20T12:47:51Z level=info event=scheduler_connected addr=lb:500513680worker1 # [ 27.162769] nix-grpc-daemon[776]: ts=2026-09-20T12:47:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3681worker2 # [ 27.410063] nix-grpc-daemon[775]: ts=2026-09-20T12:47:51Z level=info event=scheduler_connected addr=lb:500513682worker1 # [ 27.359026] nix-grpc-daemon[776]: ts=2026-09-20T12:47:51Z level=info event=scheduler_connected addr=lb:500513683worker2 # [ 27.415383] nix-grpc-daemon[775]: ts=2026-09-20T12:47:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3684worker1 # [ 27.364787] nix-grpc-daemon[776]: ts=2026-09-20T12:47:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3685worker2 # [ 27.616997] nix-grpc-daemon[775]: ts=2026-09-20T12:47:52Z level=info event=scheduler_connected addr=lb:500513686worker1 # [ 27.565521] nix-grpc-daemon[776]: ts=2026-09-20T12:47:52Z level=info event=scheduler_connected addr=lb:500513687worker2 # [ 27.622339] nix-grpc-daemon[775]: ts=2026-09-20T12:47:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3688lb # [ 27.599279] rustfs-bucket-start[1000]: mb s3://farm3689worker1 # [ 27.570621] nix-grpc-daemon[776]: ts=2026-09-20T12:47:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3690lb # [ 27.606417] systemd[1]: Finished rustfs-bucket.service.3691lb # [ 27.615085] systemd[1]: Starting niks3 server...3692worker2 # [ 27.823613] nix-grpc-daemon[775]: ts=2026-09-20T12:47:52Z level=info event=scheduler_connected addr=lb:500513693worker1 # [ 27.771373] nix-grpc-daemon[776]: ts=2026-09-20T12:47:52Z level=info event=scheduler_connected addr=lb:500513694worker2 # [ 27.829922] nix-grpc-daemon[775]: ts=2026-09-20T12:47:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3695worker1 # [ 27.776753] nix-grpc-daemon[776]: ts=2026-09-20T12:47:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3696lb # [ 27.853163] postgres[1018]: [1018] ERROR: relation "goose_db_version" does not exist at character 363697lb # [ 27.854473] postgres[1018]: [1018] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC3698lb # [ 27.885205] niks3-server[1010]: 2026/09/20 12:47:52 OK 20241026095416_initial_model.sql (19.14ms)3699lb # [ 27.888722] niks3-server[1010]: 2026/09/20 12:47:52 OK 20251210153512_drop_unused_gin_index.sql (3.85ms)3700lb # [ 27.894431] niks3-server[1010]: 2026/09/20 12:47:52 OK 20251218171726_add_pins.sql (5.73ms)3701lb # [ 27.899475] niks3-server[1010]: 2026/09/20 12:47:52 OK 20260628120000_add_object_size_and_stats.sql (3.58ms)3702lb # [ 27.904860] niks3-server[1010]: 2026/09/20 12:47:52 OK 20260905000000_add_claims.sql (5.4ms)3703lb # [ 27.909750] niks3-server[1010]: 2026/09/20 12:47:52 OK 20260920000000_drop_claims.sql (4.74ms)3704lb # [ 27.911724] niks3-server[1010]: 2026/09/20 12:47:52 goose: successfully migrated database to version: 202609200000003705lb # [ 27.916241] niks3-server[1010]: 2026/09/20 12:47:52 OK 1_commit_pending_closure.sql (6.48ms)3706lb # [ 27.918927] niks3-server[1010]: 2026/09/20 12:47:52 OK 2_object_stats_trigger.sql (2.54ms)3707lb # [ 27.920480] niks3-server[1010]: 2026/09/20 12:47:52 goose: up to current file version: 23708lb # [ 27.924595] niks3-server[1010]: 2026/09/20 12:47:52 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key3709lb # [ 27.968880] niks3-server[1010]: 2026/09/20 12:47:52 INFO Read proxy enabled — serving cache objects from S33710lb # [ 27.970657] niks3-server[1010]: 2026/09/20 12:47:52 INFO Using socket-activated listener address=0.0.0.0:57513711lb # [ 27.975536] niks3-server[1010]: 2026/09/20 12:47:52 INFO systemd watchdog enabled interval=15s3712lb # [ 27.981102] systemd[1]: Started niks3 server.3713lb # [ 27.983512] niks3-server[1010]: 2026/09/20 12:47:52 INFO Starting HTTP server address=0.0.0.0:57513714lb # [ 27.987415] niks3-server[1010]: 2026/09/20 12:47:52 INFO lead: acquired remote=192.168.1.4:428643715lb # [ 27.991860] systemd[1]: Reached target Multi-User System.3716worker2 # [ 28.015426] nix-grpc-daemon[775]: ts=2026-09-20T12:47:52Z level=info event=scheduler_take_over3717lb # [ 27.993921] systemd[1]: Startup finished in 1.066s (kernel) + 4.743s (initrd) + 22.169s (userspace) = 27.979s.3718worker2 # [ 28.031260] nix-grpc-daemon[775]: ts=2026-09-20T12:47:52Z level=info event=scheduler_connected addr=lb:500513719worker1 # [ 27.977860] nix-grpc-daemon[776]: ts=2026-09-20T12:47:52Z level=info event=scheduler_connected addr=lb:500513720worker1 # [ 27.983116] nix-grpc-daemon[776]: ts=2026-09-20T12:47:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3721worker2 # [ 28.037062] nix-grpc-daemon[775]: ts=2026-09-20T12:47:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3722worker1 # [ 28.182100] nix-grpc-daemon[776]: ts=2026-09-20T12:47:52Z level=info event=scheduler_connected addr=lb:500513723worker2 # [ 28.238417] nix-grpc-daemon[775]: ts=2026-09-20T12:47:52Z level=info event=scheduler_connected addr=lb:500513724worker1 # [ 28.186464] nix-grpc-daemon[776]: ts=2026-09-20T12:47:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3725worker2 # [ 28.243761] nix-grpc-daemon[775]: ts=2026-09-20T12:47:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3726worker1 # [ 28.382974] nix-grpc-daemon[776]: ts=2026-09-20T12:47:52Z level=info event=scheduler_connected addr=lb:500513727worker1 # [ 28.388475] nix-grpc-daemon[776]: ts=2026-09-20T12:47:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3728worker2 # [ 28.445227] nix-grpc-daemon[775]: ts=2026-09-20T12:47:52Z level=info event=scheduler_connected addr=lb:500513729worker2 # [ 28.450590] nix-grpc-daemon[775]: ts=2026-09-20T12:47:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3730lb: (finished: waiting for unit niks3.service, in 12.56 seconds)3731lb: waiting for TCP port 5751 on localhost3732worker1 # [ 28.589592] nix-grpc-daemon[776]: ts=2026-09-20T12:47:53Z level=info event=scheduler_connected addr=lb:500513733worker1 # [ 28.595000] nix-grpc-daemon[776]: ts=2026-09-20T12:47:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3734worker2 # [ 28.651901] nix-grpc-daemon[775]: ts=2026-09-20T12:47:53Z level=info event=scheduler_connected addr=lb:500513735worker2 # [ 28.657306] nix-grpc-daemon[775]: ts=2026-09-20T12:47:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3736lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!3737lb: (finished: waiting for TCP port 5751 on localhost, in 0.09 seconds)3738lb: waiting for unit envoy.service3739lb: (finished: waiting for unit envoy.service, in 0.07 seconds)3740lb: waiting for TCP port 50051 on localhost3741lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!3742lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds)3743worker1 # [ 28.795904] nix-grpc-daemon[776]: ts=2026-09-20T12:47:53Z level=info event=scheduler_connected addr=lb:500513744worker2 # [ 28.858441] nix-grpc-daemon[775]: ts=2026-09-20T12:47:53Z level=info event=scheduler_connected addr=lb:500513745worker1 # [ 28.805164] nix-grpc-daemon[776]: ts=2026-09-20T12:47:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3746worker2 # [ 28.863492] nix-grpc-daemon[775]: ts=2026-09-20T12:47:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3747worker2 # [ 29.039233] systemd[1]: Starting scheduler-token.service...3748worker1 # [ 29.003741] nix-grpc-daemon[776]: ts=2026-09-20T12:47:53Z level=info event=scheduler_connected addr=lb:500513749worker2 # [ 29.065223] nix-grpc-daemon[775]: ts=2026-09-20T12:47:53Z level=info event=scheduler_connected addr=lb:500513750worker2 # [ 29.067667] nix-grpc-daemon[775]: ts=2026-09-20T12:47:53Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:514223751worker2 # [ 29.070923] nix-grpc-daemon[775]: ts=2026-09-20T12:47:53Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=03752worker2 # [ 29.080075] nix-grpc-daemon[775]: ts=2026-09-20T12:47:53Z level=info event=oidc_jwks provider=mock keys=13753worker2 # [ 29.082432] nix-grpc-daemon[775]: ts=2026-09-20T12:47:53Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:514223754worker2 # [ 29.085869] nix-grpc-daemon[775]: ts=2026-09-20T12:47:53Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=03755worker2 # [ 29.159179] systemd[1]: scheduler-token.service: Deactivated successfully.3756worker2 # [ 29.163740] systemd[1]: Finished scheduler-token.service.3757worker2 # [ 29.165410] systemd[1]: scheduler-token.service: Consumed 37ms CPU time over 120ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.3758lb: waiting until exactly no endpoints of aarch64-linux are unhealthy3759??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.3760 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1283761lb: must succeed: curl -sf localhost:9901/clusters3762lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)3763lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.11 seconds)3764subtest: one node schedules and both builders hold a WorkerSession on it3765lb: must succeed: curl -sf localhost:9901/clusters3766lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)3767worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics3768worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds)3769lb: must succeed: curl -sf localhost:9901/clusters3770lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)3771lb: must succeed: curl -sf localhost:9901/clusters3772lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)3773worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open'3774worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.07 seconds)3775(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.36 seconds)3776subtest: balancer auth: client cert, bearer token, nothing, unknown CN3777worker2 # [ 30.018967] nix-grpc-daemon[775]: ts=2026-09-20T12:47:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:514283778worker2 # [ 30.032530] systemd[1]: Started Nix Daemon.3779worker2 # [ 30.354113] nix-daemon[842]: accepted connection from pid 775, user nix-grpc-daemon (trusted)3780worker2 # [ 30.401067] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 35 ms (attempt 1/5)3781worker2 # [ 30.441471] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 180 ms (attempt 2/5)3782worker2 # [ 30.629571] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 95 ms (attempt 3/5)3783worker2 # [ 30.732616] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 219 ms (attempt 4/5)3784worker2 # [ 30.954551] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3785worker1 # [ 30.953319] nix-grpc-daemon[776]: ts=2026-09-20T12:47:55Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:534303786worker1 # [ 30.973741] systemd[1]: Started Nix Daemon.3787worker1 # [ 31.365104] nix-daemon[833]: accepted connection from pid 776, user nix-grpc-daemon (trusted)3788worker1 # [ 31.395856] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 87 ms (attempt 1/5)3789worker1 # [ 31.488310] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 22 ms (attempt 2/5)3790worker1 # [ 31.518050] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 102 ms (attempt 3/5)3791worker1 # [ 31.628125] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 751 ms (attempt 4/5)3792lb # [ 32.349209] envoy[927]: conn peer=[::1]:51020 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=33793worker1 # [ 32.390632] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3794worker1 # [ 32.408983] nix-grpc-daemon[776]: ts=2026-09-20T12:47:56Z level=debug event=path_info_miss path=mhssi7nybyxsq0dawx0m7y4mkj4b8s2a-nixos-system-client-test error="error: path '/nix/store/mhssi7nybyxsq0dawx0m7y4mkj4b8s2a-nixos-system-client-test' is required, but there is no substituter that can build it"3795worker1 # [ 32.423956] nix-grpc-daemon[776]: ts=2026-09-20T12:47:56Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:534303796worker1 # [ 32.439505] nix-grpc-daemon[776]: ts=2026-09-20T12:47:56Z level=debug event=path_info_miss path=mhssi7nybyxsq0dawx0m7y4mkj4b8s2a-nixos-system-client-test error="error: path '/nix/store/mhssi7nybyxsq0dawx0m7y4mkj4b8s2a-nixos-system-client-test' is required, but there is no substituter that can build it"3797client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt3798client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.11 seconds)3799client: must succeed: install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key3800client: (finished: must succeed: install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds)3801worker1 # [ 32.928321] nix-grpc-daemon[776]: ts=2026-09-20T12:47:57Z level=info event=oidc_jwks provider=mock keys=13802worker1 # [ 32.933933] nix-grpc-daemon[776]: ts=2026-09-20T12:47:57Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:534303803worker1 # [ 32.953080] nix-grpc-daemon[776]: ts=2026-09-20T12:47:57Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:534303804worker1 # [ 32.967292] nix-grpc-daemon[776]: ts=2026-09-20T12:47:57Z level=debug event=path_info_miss path=mhssi7nybyxsq0dawx0m7y4mkj4b8s2a-nixos-system-client-test error="error: path '/nix/store/mhssi7nybyxsq0dawx0m7y4mkj4b8s2a-nixos-system-client-test' is required, but there is no substituter that can build it"3805worker2 # [ 33.031762] nix-grpc-daemon[775]: ts=2026-09-20T12:47:57Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:514283806worker2 # [ 33.051751] nix-grpc-daemon[775]: ts=2026-09-20T12:47:57Z level=debug event=path_info_miss path=mhssi7nybyxsq0dawx0m7y4mkj4b8s2a-nixos-system-client-test error="error: path '/nix/store/mhssi7nybyxsq0dawx0m7y4mkj4b8s2a-nixos-system-client-test' is required, but there is no substituter that can build it"3807client: must succeed: rm -r /var/lib/nix-grpc-store3808client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds)3809worker1 # [ 33.284628] nix-grpc-daemon[776]: ts=2026-09-20T12:47:57Z level=info event=denied method=QueryMissing cn=- role=none3810worker1 # [ 33.546293] nix-grpc-daemon[776]: ts=2026-09-20T12:47:58Z level=info event=denied method=QueryMissing cn=stranger role=none3811(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.99 seconds)3812subtest: DAG build is scheduled across workers and lands in the cache3813client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&23814worker1 # [ 33.820169] nix-grpc-daemon[776]: ts=2026-09-20T12:47:58Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:534303815client # don't know how to build these paths:3816client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3817worker2 # [ 33.890178] nix-grpc-daemon[775]: ts=2026-09-20T12:47:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:514283818worker2 # [ 33.942179] nix-grpc-daemon[775]: ts=2026-09-20T12:47:58Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=03819worker2 # [ 33.948578] nix-grpc-daemon[775]: ts=2026-09-20T12:47:58Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.3:50051 clients=13820worker1 # [ 33.939328] nix-grpc-daemon[776]: ts=2026-09-20T12:47:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:534303821worker1 # [ 33.971003] nix-grpc-daemon[776]: ts=2026-09-20T12:47:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:534303822client # copying 1 paths to 'lb:50051'...3823worker1 # [ 33.993737] nix-grpc-daemon[776]: ts=2026-09-20T12:47:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:534303824client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...3825worker1 # [ 34.022429] nix-daemon[833]: accepted connection from pid 776, user nix-grpc-daemon (trusted)3826worker1 # [ 34.067261] nix-grpc-daemon[776]: ts=2026-09-20T12:47:58Z level=info event=niks3_push_started pid=8433827worker1 # [ 34.373899] nix-grpc-daemon[843]: time=2026-09-20T12:47:58.866Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca=""3828worker1 # [ 34.581387] nix-daemon[833]: accepted connection from pid 856, user nix-grpc-daemon (trusted)3829worker1 # [ 34.602276] nix-daemon[833]: reaped child process 859, status = succeeded3830worker1 # [ 34.802638] nix-daemon[833]: accepted connection from pid 861, user nix-grpc-daemon (trusted)3831worker1 # [ 34.822702] nix-daemon[833]: reaped child process 864, status = succeeded3832lb # [ 34.869038] niks3-server[1010]: 2026/09/20 12:47:59 INFO Received uploads request method=POST path=/api/pending_closures3833worker1 # [ 34.874356] nix-grpc-daemon[843]: time=2026-09-20T12:47:59.369Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3834worker1 # [ 34.879378] nix-grpc-daemon[843]: time=2026-09-20T12:47:59.369Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"3835lb # [ 34.962081] niks3-server[1010]: 2026/09/20 12:47:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign3836lb # [ 34.975766] niks3-server[1010]: 2026/09/20 12:47:59 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst3837lb # [ 35.020603] niks3-server[1010]: 2026/09/20 12:47:59 INFO Signed narinfos id=1 count=13838worker1 # [ 34.998024] nix-grpc-daemon[843]: time=2026-09-20T12:47:59.491Z level=INFO msg="Uploading 1 narinfos"3839lb # [ 35.041856] niks3-server[1010]: 2026/09/20 12:47:59 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls3840lb # [ 35.043893] niks3-server[1010]: 2026/09/20 12:47:59 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete3841lb # [ 35.062035] niks3-server[1010]: 2026/09/20 12:47:59 INFO Completed upload id=13842worker1 # [ 35.034271] nix-grpc-daemon[843]: time=2026-09-20T12:47:59.529Z level=INFO msg="Upload complete. (651ms)"3843lb # [ 35.074151] niks3-server[1010]: 2026/09/20 12:47:59 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo3844worker1 # [ 35.052564] nix-grpc-daemon[776]: ts=2026-09-20T12:47:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53430 duration_s=1 paths=1 nar_bytes_in=5043845worker1 # [ 35.076853] nix-grpc-daemon[776]: ts=2026-09-20T12:47:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:534303846worker1 # [ 35.082582] nix-daemon[833]: accepted connection from pid 776, user nix-grpc-daemon (trusted)3847worker1 # [ 35.096396] nix-daemon[833]: reaped child process 841, status = succeeded3848client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...3849client # farm-a> node-a: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3850worker1 # [ 35.110603] nix-daemon[833]: accepted connection from pid 776, user nix-grpc-daemon (trusted)3851client # farm-a> LOG-farm-a-t13852worker1 # [ 36.143287] nix-daemon[833]: reaped child process 868, status = succeeded3853worker1 # [ 36.325239] nix-daemon[833]: accepted connection from pid 883, user nix-grpc-daemon (trusted)3854worker1 # [ 36.346665] nix-daemon[833]: reaped child process 886, status = succeeded3855lb # [ 36.389358] niks3-server[1010]: 2026/09/20 12:48:00 INFO Received uploads request method=POST path=/api/pending_closures3856worker1 # [ 36.378797] nix-grpc-daemon[843]: time=2026-09-20T12:48:00.872Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3857worker1 # [ 36.380953] nix-grpc-daemon[843]: time=2026-09-20T12:48:00.872Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"3858lb # [ 36.455966] niks3-server[1010]: 2026/09/20 12:48:00 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3859lb # [ 36.466886] niks3-server[1010]: 2026/09/20 12:48:00 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst3860lb # [ 36.478267] niks3-server[1010]: 2026/09/20 12:48:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign3861lb # [ 36.484250] niks3-server[1010]: 2026/09/20 12:48:00 INFO Signed narinfos id=2 count=13862worker1 # [ 36.456059] nix-grpc-daemon[843]: time=2026-09-20T12:48:00.949Z level=INFO msg="Uploading 1 narinfos"3863lb # [ 36.487369] niks3-server[1010]: 2026/09/20 12:48:00 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls3864lb # [ 36.498243] niks3-server[1010]: 2026/09/20 12:48:01 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete3865lb # [ 36.510966] niks3-server[1010]: 2026/09/20 12:48:01 INFO Completed upload id=23866worker1 # [ 36.483055] nix-grpc-daemon[843]: time=2026-09-20T12:48:00.977Z level=INFO msg="Upload complete. (357ms)"3867lb # [ 36.513782] niks3-server[1010]: 2026/09/20 12:48:01 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo3868worker1 # [ 36.497518] nix-grpc-daemon[776]: ts=2026-09-20T12:48:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53430 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=13869worker2 # [ 36.565468] nix-grpc-daemon[775]: ts=2026-09-20T12:48:01Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=03870worker1 # [ 36.518723] nix-daemon[833]: reaped child process 866, status = succeeded3871worker2 # [ 36.572160] nix-grpc-daemon[775]: ts=2026-09-20T12:48:01Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.3:50051 clients=13872worker1 # [ 36.557158] nix-grpc-daemon[776]: ts=2026-09-20T12:48:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:534303873worker1 # [ 36.577453] nix-grpc-daemon[776]: ts=2026-09-20T12:48:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:534303874client # copying 1 paths to 'lb:50051'...3875worker1 # [ 36.597609] nix-grpc-daemon[843]: time=2026-09-20T12:48:01.091Z level=INFO msg="All 1 paths already cached"3876client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...3877worker1 # [ 36.603775] nix-grpc-daemon[776]: ts=2026-09-20T12:48:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:534303878worker1 # [ 36.626545] nix-daemon[833]: accepted connection from pid 776, user nix-grpc-daemon (trusted)3879worker1 # [ 36.861379] nix-daemon[833]: accepted connection from pid 890, user nix-grpc-daemon (trusted)3880worker1 # [ 36.883176] nix-daemon[833]: reaped child process 894, status = succeeded3881worker1 # [ 37.075315] nix-daemon[833]: accepted connection from pid 896, user nix-grpc-daemon (trusted)3882worker1 # [ 37.094163] nix-daemon[833]: reaped child process 899, status = succeeded3883lb # [ 37.135626] niks3-server[1010]: 2026/09/20 12:48:01 INFO Received uploads request method=POST path=/api/pending_closures3884worker1 # [ 37.123366] nix-grpc-daemon[843]: time=2026-09-20T12:48:01.617Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3885worker1 # [ 37.125066] nix-grpc-daemon[843]: time=2026-09-20T12:48:01.617Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"3886lb # [ 37.183022] niks3-server[1010]: 2026/09/20 12:48:01 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst3887worker1 # [ 37.162579] nix-grpc-daemon[843]: time=2026-09-20T12:48:01.657Z level=INFO msg="Uploading 1 narinfos"3888lb # [ 37.201263] niks3-server[1010]: 2026/09/20 12:48:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign3889lb # [ 37.212873] niks3-server[1010]: 2026/09/20 12:48:01 INFO Signed narinfos id=3 count=13890lb # [ 37.215170] niks3-server[1010]: 2026/09/20 12:48:01 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls3891worker1 # [ 37.194248] nix-grpc-daemon[843]: time=2026-09-20T12:48:01.689Z level=INFO msg="Upload complete. (541ms)"3892lb # [ 37.222912] niks3-server[1010]: 2026/09/20 12:48:01 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete3893lb # [ 37.226788] niks3-server[1010]: 2026/09/20 12:48:01 INFO Completed upload id=33894lb # [ 37.230774] niks3-server[1010]: 2026/09/20 12:48:01 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo3895worker1 # [ 37.202235] nix-grpc-daemon[776]: ts=2026-09-20T12:48:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53430 duration_s=0 paths=1 nar_bytes_in=6243896worker1 # [ 37.215392] nix-grpc-daemon[776]: ts=2026-09-20T12:48:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:534303897worker1 # [ 37.231610] nix-daemon[833]: accepted connection from pid 776, user nix-grpc-daemon (trusted)3898worker1 # [ 37.238093] nix-daemon[833]: reaped child process 888, status = succeeded3899client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...3900client # farm-b> node-a: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3901worker1 # [ 37.255622] nix-daemon[833]: accepted connection from pid 776, user nix-grpc-daemon (trusted)3902client # farm-b> LOG-farm-b-t13903worker1 # [ 39.117564] nix-daemon[833]: reaped child process 903, status = succeeded3904worker1 # [ 39.306935] nix-daemon[833]: accepted connection from pid 918, user nix-grpc-daemon (trusted)3905worker1 # [ 39.327278] nix-daemon[833]: reaped child process 921, status = succeeded3906lb # [ 39.370696] niks3-server[1010]: 2026/09/20 12:48:03 INFO Received uploads request method=POST path=/api/pending_closures3907worker1 # [ 39.352988] nix-grpc-daemon[843]: time=2026-09-20T12:48:03.846Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3908worker1 # [ 39.354517] nix-grpc-daemon[843]: time=2026-09-20T12:48:03.846Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"3909lb # [ 39.419069] niks3-server[1010]: 2026/09/20 12:48:03 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3910lb # [ 39.431376] niks3-server[1010]: 2026/09/20 12:48:03 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst3911lb # [ 39.439838] niks3-server[1010]: 2026/09/20 12:48:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign3912worker1 # [ 39.419065] nix-grpc-daemon[843]: time=2026-09-20T12:48:03.913Z level=INFO msg="Uploading 1 narinfos"3913lb # [ 39.450474] niks3-server[1010]: 2026/09/20 12:48:03 INFO Signed narinfos id=4 count=13914lb # [ 39.455531] niks3-server[1010]: 2026/09/20 12:48:03 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls3915lb # [ 39.467858] niks3-server[1010]: 2026/09/20 12:48:03 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete3916lb # [ 39.476967] niks3-server[1010]: 2026/09/20 12:48:03 INFO Completed upload id=43917worker1 # [ 39.446835] nix-grpc-daemon[843]: time=2026-09-20T12:48:03.941Z level=INFO msg="Upload complete. (375ms)"3918lb # [ 39.480352] niks3-server[1010]: 2026/09/20 12:48:03 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo3919worker1 # [ 39.461459] nix-grpc-daemon[776]: ts=2026-09-20T12:48:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53430 duration_s=2 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=13920worker2 # [ 39.523034] nix-grpc-daemon[775]: ts=2026-09-20T12:48:04Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=03921worker2 # [ 39.529548] nix-grpc-daemon[775]: ts=2026-09-20T12:48:04Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.3:50051 clients=13922worker1 # [ 39.483087] nix-daemon[833]: reaped child process 901, status = succeeded3923worker1 # [ 39.518482] nix-grpc-daemon[776]: ts=2026-09-20T12:48:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:534303924worker1 # [ 39.537760] nix-grpc-daemon[776]: ts=2026-09-20T12:48:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:534303925worker1 # [ 39.557127] nix-grpc-daemon[843]: time=2026-09-20T12:48:04.052Z level=INFO msg="All 2 paths already cached"3926client # copying 1 paths to 'lb:50051'...3927worker1 # [ 39.572942] nix-grpc-daemon[776]: ts=2026-09-20T12:48:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:534303928client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...3929worker1 # [ 39.607637] nix-daemon[833]: accepted connection from pid 776, user nix-grpc-daemon (trusted)3930worker1 # [ 39.844660] nix-daemon[833]: accepted connection from pid 925, user nix-grpc-daemon (trusted)3931worker1 # [ 39.869035] nix-daemon[833]: reaped child process 928, status = succeeded3932worker1 # [ 40.089237] nix-daemon[833]: accepted connection from pid 930, user nix-grpc-daemon (trusted)3933worker1 # [ 40.109289] nix-daemon[833]: reaped child process 934, status = succeeded3934lb # [ 40.148550] niks3-server[1010]: 2026/09/20 12:48:04 INFO Received uploads request method=POST path=/api/pending_closures3935worker1 # [ 40.132820] nix-grpc-daemon[843]: time=2026-09-20T12:48:04.627Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3936worker1 # [ 40.134349] nix-grpc-daemon[843]: time=2026-09-20T12:48:04.627Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"3937lb # [ 40.193444] niks3-server[1010]: 2026/09/20 12:48:04 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst3938worker1 # [ 40.178239] nix-grpc-daemon[843]: time=2026-09-20T12:48:04.673Z level=INFO msg="Uploading 1 narinfos"3939lb # [ 40.207111] niks3-server[1010]: 2026/09/20 12:48:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign3940lb # [ 40.213930] niks3-server[1010]: 2026/09/20 12:48:04 INFO Signed narinfos id=5 count=13941lb # [ 40.220060] niks3-server[1010]: 2026/09/20 12:48:04 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls3942lb # [ 40.228604] niks3-server[1010]: 2026/09/20 12:48:04 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete3943lb # [ 40.236514] niks3-server[1010]: 2026/09/20 12:48:04 INFO Completed upload id=53944worker1 # [ 40.208398] nix-grpc-daemon[843]: time=2026-09-20T12:48:04.703Z level=INFO msg="Upload complete. (572ms)"3945lb # [ 40.238894] niks3-server[1010]: 2026/09/20 12:48:04 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo3946worker1 # [ 40.218524] nix-grpc-daemon[776]: ts=2026-09-20T12:48:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53430 duration_s=0 paths=1 nar_bytes_in=7523947worker1 # [ 40.229118] nix-grpc-daemon[776]: ts=2026-09-20T12:48:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:534303948worker1 # [ 40.243960] nix-daemon[833]: accepted connection from pid 776, user nix-grpc-daemon (trusted)3949worker1 # [ 40.250322] nix-daemon[833]: reaped child process 923, status = succeeded3950client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...3951worker1 # [ 40.264536] nix-daemon[833]: accepted connection from pid 776, user nix-grpc-daemon (trusted)3952client # farm-top> node-a: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3953client # farm-top> LOG-farm-top-t13954worker1 # [ 41.122369] nix-daemon[833]: reaped child process 938, status = succeeded3955worker1 # [ 41.302220] nix-daemon[833]: accepted connection from pid 953, user nix-grpc-daemon (trusted)3956worker1 # [ 41.327387] nix-daemon[833]: reaped child process 956, status = succeeded3957lb # [ 41.370528] niks3-server[1010]: 2026/09/20 12:48:05 INFO Received uploads request method=POST path=/api/pending_closures3958worker1 # [ 41.359224] nix-grpc-daemon[843]: time=2026-09-20T12:48:05.851Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3959worker1 # [ 41.361272] nix-grpc-daemon[843]: time=2026-09-20T12:48:05.851Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"3960lb # [ 41.417216] niks3-server[1010]: 2026/09/20 12:48:05 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst3961lb # [ 41.431941] niks3-server[1010]: 2026/09/20 12:48:05 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3962lb # [ 41.441382] niks3-server[1010]: 2026/09/20 12:48:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign3963worker1 # [ 41.418801] nix-grpc-daemon[843]: time=2026-09-20T12:48:05.913Z level=INFO msg="Uploading 1 narinfos"3964lb # [ 41.449005] niks3-server[1010]: 2026/09/20 12:48:05 INFO Signed narinfos id=6 count=13965lb # [ 41.451501] niks3-server[1010]: 2026/09/20 12:48:05 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls3966lb # [ 41.464103] niks3-server[1010]: 2026/09/20 12:48:05 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete3967lb # [ 41.471342] niks3-server[1010]: 2026/09/20 12:48:05 INFO Completed upload id=63968worker1 # [ 41.441706] nix-grpc-daemon[843]: time=2026-09-20T12:48:05.936Z level=INFO msg="Upload complete. (361ms)"3969lb # [ 41.474258] niks3-server[1010]: 2026/09/20 12:48:05 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo3970worker1 # [ 41.457855] nix-grpc-daemon[776]: ts=2026-09-20T12:48:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53430 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=13971worker1 # [ 41.482583] nix-daemon[833]: reaped child process 936, status = succeeded3972client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 7.94 seconds)3973client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath3974client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.26 seconds)3975client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3976client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.04 seconds)3977client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3978client # copying 3 paths...3979client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...3980client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...3981client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...3982client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.33 seconds)3983(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 8.69 seconds)3984subtest: repeat is answered Cached by the scheduler without building3985worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3986lb # [ 42.349183] envoy[927]: conn peer=[2001:db8:1::1]:43082 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=25213987lb # [ 42.354587] envoy[927]: conn peer=[2001:db8:1::1]:59288 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=1013988lb # [ 42.360443] envoy[927]: conn peer=[2001:db8:1::1]:59296 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=153989lb # [ 42.365031] envoy[927]: conn peer=[2001:db8:1::1]:59312 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=203990lb # [ 42.370191] envoy[927]: conn peer=[2001:db8:1::1]:59314 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9566 tx=3899 ms=76653991worker1 # finding garbage collector roots...3992worker1 # deleting specified paths...3993worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'3994worker1 # deleting unused links...3995worker1 # note: hard linking is currently saving 0.0 KiB3996worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.33 seconds)3997worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top3998worker2 # finding garbage collector roots...3999worker2 # deleting specified paths...4000worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4001worker2 # deleting unused links...4002worker2 # note: hard linking is currently saving 0.0 KiB4003worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.32 seconds)4004client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&24005worker1 # [ 43.195825] nix-grpc-daemon[776]: ts=2026-09-20T12:48:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:534304006client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):4007client # /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4008worker1 # [ 43.213923] nix-grpc-daemon[776]: ts=2026-09-20T12:48:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:534304009worker1 # [ 43.226531] nix-grpc-daemon[843]: time=2026-09-20T12:48:07.720Z level=INFO msg="All 2 paths already cached"4010worker2 # [ 43.305755] nix-grpc-daemon[775]: ts=2026-09-20T12:48:07Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=14011client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.39 seconds)4012client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4013client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.24 seconds)4014lb: must succeed: curl -sf localhost:9901/clusters4015lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)4016lb: must succeed: curl -sf localhost:9901/clusters4017lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4018worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4019worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds)4020(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.64 seconds)4021subtest: inputs already in the cache are not sent to the scheduler4022lb: must succeed: curl -sf localhost:9901/clusters4023lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4024lb: must succeed: curl -sf localhost:9901/clusters4025lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4026worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4027worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds)4028client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&24029worker2 # [ 44.447165] nix-grpc-daemon[775]: ts=2026-09-20T12:48:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:514284030client # don't know how to build these paths:4031client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4032worker1 # [ 44.407577] nix-grpc-daemon[776]: ts=2026-09-20T12:48:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:534304033worker1 # [ 44.421773] nix-grpc-daemon[843]: time=2026-09-20T12:48:08.914Z level=INFO msg="All 2 paths already cached"4034worker2 # [ 44.489722] nix-grpc-daemon[775]: ts=2026-09-20T12:48:09Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=04035worker2 # [ 44.496387] nix-grpc-daemon[775]: ts=2026-09-20T12:48:09Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.3:50051 clients=14036worker1 # [ 44.489020] nix-grpc-daemon[776]: ts=2026-09-20T12:48:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:534304037worker1 # [ 44.508975] nix-grpc-daemon[776]: ts=2026-09-20T12:48:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:534304038worker1 # [ 44.532108] nix-grpc-daemon[843]: time=2026-09-20T12:48:09.026Z level=INFO msg="All 2 paths already cached"4039client # copying 1 paths to 'lb:50051'...4040worker1 # [ 44.544421] nix-grpc-daemon[776]: ts=2026-09-20T12:48:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:534304041client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'...4042worker1 # [ 44.562237] nix-daemon[833]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4043worker1 # [ 44.790379] nix-daemon[833]: accepted connection from pid 974, user nix-grpc-daemon (trusted)4044worker1 # [ 44.811925] nix-daemon[833]: reaped child process 977, status = succeeded4045worker1 # [ 44.991188] nix-daemon[833]: accepted connection from pid 979, user nix-grpc-daemon (trusted)4046worker1 # [ 45.010011] nix-daemon[833]: reaped child process 982, status = succeeded4047lb # [ 45.052916] niks3-server[1010]: 2026/09/20 12:48:09 INFO Received uploads request method=POST path=/api/pending_closures4048worker1 # [ 45.035124] nix-grpc-daemon[843]: time=2026-09-20T12:48:09.529Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4049worker1 # [ 45.036837] nix-grpc-daemon[843]: time=2026-09-20T12:48:09.529Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)"4050lb # [ 45.083096] niks3-server[1010]: 2026/09/20 12:48:09 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst4051lb # [ 45.099966] niks3-server[1010]: 2026/09/20 12:48:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4052worker1 # [ 45.077535] nix-grpc-daemon[843]: time=2026-09-20T12:48:09.572Z level=INFO msg="Uploading 1 narinfos"4053lb # [ 45.113549] niks3-server[1010]: 2026/09/20 12:48:09 INFO Signed narinfos id=7 count=14054lb # [ 45.119076] niks3-server[1010]: 2026/09/20 12:48:09 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls4055worker1 # [ 45.100674] nix-grpc-daemon[843]: time=2026-09-20T12:48:09.595Z level=INFO msg="Upload complete. (512ms)"4056lb # [ 45.130001] niks3-server[1010]: 2026/09/20 12:48:09 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4057lb # [ 45.136686] niks3-server[1010]: 2026/09/20 12:48:09 INFO Completed upload id=74058worker1 # [ 45.107564] nix-grpc-daemon[776]: ts=2026-09-20T12:48:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53430 duration_s=0 paths=1 nar_bytes_in=7524059lb # [ 45.140089] niks3-server[1010]: 2026/09/20 12:48:09 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo4060worker1 # [ 45.121133] nix-grpc-daemon[776]: ts=2026-09-20T12:48:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:534304061worker1 # [ 45.128492] nix-daemon[833]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4062worker1 # [ 45.133838] nix-daemon[833]: reaped child process 972, status = succeeded4063client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051...4064client # farm-top> node-a: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4065worker1 # [ 45.149110] nix-daemon[833]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4066client # farm-top> LOG-farm-top-t1b4067worker1 # [ 46.582844] nix-daemon[833]: reaped child process 986, status = succeeded4068worker1 # [ 46.759992] nix-daemon[833]: accepted connection from pid 1001, user nix-grpc-daemon (trusted)4069worker1 # [ 46.779080] nix-daemon[833]: reaped child process 1005, status = succeeded4070lb # [ 46.821424] niks3-server[1010]: 2026/09/20 12:48:11 INFO Received uploads request method=POST path=/api/pending_closures4071worker1 # [ 46.804431] nix-grpc-daemon[843]: time=2026-09-20T12:48:11.298Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4072worker1 # [ 46.805963] nix-grpc-daemon[843]: time=2026-09-20T12:48:11.298Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)"4073lb # [ 46.860006] niks3-server[1010]: 2026/09/20 12:48:11 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4074lb # [ 46.879299] niks3-server[1010]: 2026/09/20 12:48:11 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst4075lb # [ 46.892890] niks3-server[1010]: 2026/09/20 12:48:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4076worker1 # [ 46.872192] nix-grpc-daemon[843]: time=2026-09-20T12:48:11.366Z level=INFO msg="Uploading 1 narinfos"4077lb # [ 46.906071] niks3-server[1010]: 2026/09/20 12:48:11 INFO Signed narinfos id=8 count=14078lb # [ 46.912486] niks3-server[1010]: 2026/09/20 12:48:11 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls4079lb # [ 46.920966] niks3-server[1010]: 2026/09/20 12:48:11 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4080worker1 # [ 46.898420] nix-grpc-daemon[843]: time=2026-09-20T12:48:11.393Z level=INFO msg="Upload complete. (338ms)"4081lb # [ 46.928972] niks3-server[1010]: 2026/09/20 12:48:11 INFO Completed upload id=84082lb # [ 46.932404] niks3-server[1010]: 2026/09/20 12:48:11 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo4083worker1 # [ 46.913285] nix-grpc-daemon[776]: ts=2026-09-20T12:48:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53430 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=14084worker1 # [ 46.929967] nix-daemon[833]: reaped child process 984, status = succeeded4085client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.82 seconds)4086client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath4087client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.24 seconds)4088lb: must succeed: curl -sf localhost:9901/clusters4089lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4090lb: must succeed: curl -sf localhost:9901/clusters4091lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4092worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4093worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds)4094(finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.48 seconds)4095subtest: two clients wanting the same drv build it once4096client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4097client # [ 47.586348] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4098client # Running as unit: dedup1.service; invocation ID: 50087157d0694212864ac6b41dea298d4099client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.10 seconds)4100client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4101worker2 # [ 47.776738] nix-grpc-daemon[775]: ts=2026-09-20T12:48:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:514284102client # [ 47.842503] nix[879]: don't know how to build these paths:4103client # [ 47.843528] nix[879]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4104worker2 # [ 47.796238] nix-grpc-daemon[775]: ts=2026-09-20T12:48:12Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04105worker2 # [ 47.802756] nix-grpc-daemon[775]: ts=2026-09-20T12:48:12Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=14106worker2 # [ 47.811932] nix-grpc-daemon[775]: ts=2026-09-20T12:48:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:514284107worker2 # [ 47.831347] nix-grpc-daemon[775]: ts=2026-09-20T12:48:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:514284108client # [ 47.901624] nix[879]: copying 1 paths to 'lb:50051'...4109client # [ 47.905159] nix[879]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4110worker2 # [ 47.848126] nix-grpc-daemon[775]: ts=2026-09-20T12:48:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:514284111worker2 # [ 47.865495] nix-daemon[842]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4112worker2 # [ 47.907126] nix-grpc-daemon[775]: ts=2026-09-20T12:48:12Z level=info event=niks3_push_started pid=8954113worker2 # [ 48.182807] nix-grpc-daemon[895]: time=2026-09-20T12:48:12.697Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""4114worker2 # [ 48.376094] nix-daemon[842]: accepted connection from pid 908, user nix-grpc-daemon (trusted)4115worker2 # [ 48.398404] nix-daemon[842]: reaped child process 911, status = succeeded4116worker2 # [ 48.568965] nix-daemon[842]: accepted connection from pid 913, user nix-grpc-daemon (trusted)4117worker2 # [ 48.589716] nix-daemon[842]: reaped child process 916, status = succeeded4118lb # [ 48.577719] niks3-server[1010]: 2026/09/20 12:48:13 INFO Received uploads request method=POST path=/api/pending_closures4119worker2 # [ 48.612442] nix-grpc-daemon[895]: time=2026-09-20T12:48:13.129Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4120worker2 # [ 48.614983] nix-grpc-daemon[895]: time=2026-09-20T12:48:13.129Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4121lb # [ 48.613997] niks3-server[1010]: 2026/09/20 12:48:13 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4122worker2 # [ 48.651707] nix-grpc-daemon[895]: time=2026-09-20T12:48:13.168Z level=INFO msg="Uploading 1 narinfos"4123lb # [ 48.626018] niks3-server[1010]: 2026/09/20 12:48:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4124client # [ 48.706210] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4125lb # [ 48.636490] niks3-server[1010]: 2026/09/20 12:48:13 INFO Signed narinfos id=9 count=14126lb # [ 48.644119] niks3-server[1010]: 2026/09/20 12:48:13 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4127client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.13 seconds)4128lb # [ 48.658943] niks3-server[1010]: 2026/09/20 12:48:13 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4129worker2 # [ 48.689315] nix-grpc-daemon[895]: time=2026-09-20T12:48:13.206Z level=INFO msg="Upload complete. (498ms)"4130lb # [ 48.665034] niks3-server[1010]: 2026/09/20 12:48:13 INFO Completed upload id=94131lb # [ 48.667818] niks3-server[1010]: 2026/09/20 12:48:13 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4132worker2 # [ 48.696130] nix-grpc-daemon[775]: ts=2026-09-20T12:48:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51428 duration_s=0 paths=1 nar_bytes_in=4324133worker2 # [ 48.711145] nix-grpc-daemon[775]: ts=2026-09-20T12:48:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:514284134worker2 # [ 48.717716] nix-daemon[842]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4135worker2 # [ 48.723300] nix-daemon[842]: reaped child process 893, status = succeeded4136client # Running as unit: dedup2.service; invocation ID: b3b14b56134c421b9a5f5416e3cd0f704137client # [ 48.791477] nix[879]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4138worker2 # [ 48.734637] nix-daemon[842]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4139worker2 # [ 49.005795] nix-grpc-daemon[775]: ts=2026-09-20T12:48:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:514284140client # [ 49.078920] nix[894]: this derivation will be built:4141worker1 # [ 48.973138] nix-grpc-daemon[776]: ts=2026-09-20T12:48:13Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:534304142worker1 # [ 48.987885] nix-grpc-daemon[776]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' from 'http://lb:5751'...4143client # [ 49.124163] nix[894]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4144worker2 # [ 49.082281] nix-grpc-daemon[775]: ts=2026-09-20T12:48:13Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04145worker2 # [ 49.092212] nix-grpc-daemon[775]: ts=2026-09-20T12:48:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:514284146client # [ 49.158009] nix[894]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4147client: must succeed: sleep 24148client: (finished: must succeed: sleep 2, in 2.07 seconds)4149??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4150 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394151client: waiting for success: ! systemctl is-active dedup1 dedup24152??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4153 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394154worker2 # [ 52.368894] nix-daemon[842]: reaped child process 920, status = succeeded4155lb # [ 52.349980] envoy[927]: conn peer=[2001:db8:1::1]:51392 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=874156lb # [ 52.354920] envoy[927]: conn peer=[2001:db8:1::1]:51394 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4172 tx=1729 ms=25364157worker2 # [ 52.540602] nix-daemon[842]: accepted connection from pid 951, user nix-grpc-daemon (trusted)4158worker2 # [ 52.561963] nix-daemon[842]: reaped child process 954, status = succeeded4159lb # [ 52.548879] niks3-server[1010]: 2026/09/20 12:48:17 INFO Received uploads request method=POST path=/api/pending_closures4160worker2 # [ 52.585168] nix-grpc-daemon[895]: time=2026-09-20T12:48:17.100Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4161worker2 # [ 52.587700] nix-grpc-daemon[895]: time=2026-09-20T12:48:17.100Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4162lb # [ 52.607039] niks3-server[1010]: 2026/09/20 12:48:17 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4163lb # [ 52.619010] niks3-server[1010]: 2026/09/20 12:48:17 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4164worker2 # [ 52.655535] nix-grpc-daemon[895]: time=2026-09-20T12:48:17.170Z level=INFO msg="Uploading 1 narinfos"4165lb # [ 52.631321] niks3-server[1010]: 2026/09/20 12:48:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4166lb # [ 52.636244] niks3-server[1010]: 2026/09/20 12:48:17 INFO Signed narinfos id=10 count=14167lb # [ 52.638239] niks3-server[1010]: 2026/09/20 12:48:17 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4168lb # [ 52.648352] niks3-server[1010]: 2026/09/20 12:48:17 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4169lb # [ 52.656133] niks3-server[1010]: 2026/09/20 12:48:17 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4170lb # [ 52.661005] niks3-server[1010]: 2026/09/20 12:48:17 INFO Completed upload id=104171worker2 # [ 52.686633] nix-grpc-daemon[895]: time=2026-09-20T12:48:17.203Z level=INFO msg="Upload complete. (336ms)"4172worker2 # [ 52.704924] nix-grpc-daemon[775]: ts=2026-09-20T12:48:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51428 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14173worker2 # [ 52.719721] nix-grpc-daemon[775]: ts=2026-09-20T12:48:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51428 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14174worker2 # [ 52.726063] nix-daemon[842]: reaped child process 918, status = succeeded4175client # [ 52.814120] systemd[1]: dedup2.service: Deactivated successfully.4176client # [ 52.818689] systemd[1]: dedup2.service: Consumed 205ms CPU time over 4.112s wall clock time, 31M memory peak, 7.9K incoming IP traffic, 6.6K outgoing IP traffic.4177client # [ 52.830553] systemd[1]: dedup1.service: Deactivated successfully.4178client # [ 52.834430] systemd[1]: dedup1.service: Consumed 156ms CPU time over 5.241s wall clock time, 37.1M memory peak, 8.6K incoming IP traffic, 9.1K outgoing IP traffic.4179client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.14 seconds)4180client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4181client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds)4182worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4183worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds)4184worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4185worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4186worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4187worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds)4188worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4189worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)4190(finished: subtest: two clients wanting the same drv build it once, in 6.31 seconds)4191subtest: build hook: nix-daemon with builders = grpc://lb4192client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log4193client # [ 54.059543] systemd[1]: Started Nix Daemon.4194client # [ 54.256539] nix-daemon[934]: accepted connection from pid 931, user root (trusted)4195worker1 # [ 54.359670] nix-grpc-daemon[776]: ts=2026-09-20T12:48:18Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:534304196worker1 # [ 54.367092] nix-grpc-daemon[776]: ts=2026-09-20T12:48:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:534304197worker2 # [ 54.437103] nix-grpc-daemon[775]: ts=2026-09-20T12:48:18Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04198worker2 # [ 54.437455] nix-grpc-daemon[775]: ts=2026-09-20T12:48:18Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.3:50051 clients=14199worker1 # [ 54.429109] nix-grpc-daemon[776]: ts=2026-09-20T12:48:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:534304200worker1 # [ 54.446096] nix-grpc-daemon[776]: ts=2026-09-20T12:48:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:534304201worker1 # [ 54.463978] nix-grpc-daemon[776]: ts=2026-09-20T12:48:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:534304202worker1 # [ 54.480689] nix-daemon[833]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4203worker1 # [ 54.699021] nix-daemon[833]: accepted connection from pid 1031, user nix-grpc-daemon (trusted)4204worker1 # [ 54.721822] nix-daemon[833]: reaped child process 1034, status = succeeded4205worker1 # [ 54.899272] nix-daemon[833]: accepted connection from pid 1036, user nix-grpc-daemon (trusted)4206worker1 # [ 54.916635] nix-daemon[833]: reaped child process 1039, status = succeeded4207lb # [ 54.961457] niks3-server[1010]: 2026/09/20 12:48:19 INFO Received uploads request method=POST path=/api/pending_closures4208worker1 # [ 54.946533] nix-grpc-daemon[843]: time=2026-09-20T12:48:19.440Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4209worker1 # [ 54.948095] nix-grpc-daemon[843]: time=2026-09-20T12:48:19.440Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4210lb # [ 54.995943] niks3-server[1010]: 2026/09/20 12:48:19 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4211worker1 # [ 54.981763] nix-grpc-daemon[843]: time=2026-09-20T12:48:19.476Z level=INFO msg="Uploading 1 narinfos"4212lb # [ 55.013213] niks3-server[1010]: 2026/09/20 12:48:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4213lb # [ 55.022221] niks3-server[1010]: 2026/09/20 12:48:19 INFO Signed narinfos id=11 count=14214lb # [ 55.032159] niks3-server[1010]: 2026/09/20 12:48:19 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4215lb # [ 55.035449] niks3-server[1010]: 2026/09/20 12:48:19 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4216worker1 # [ 55.011859] nix-grpc-daemon[843]: time=2026-09-20T12:48:19.506Z level=INFO msg="Upload complete. (513ms)"4217lb # [ 55.040968] niks3-server[1010]: 2026/09/20 12:48:19 INFO Completed upload id=114218lb # [ 55.043518] niks3-server[1010]: 2026/09/20 12:48:19 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4219worker1 # [ 55.020336] nix-grpc-daemon[776]: ts=2026-09-20T12:48:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53430 duration_s=0 paths=1 nar_bytes_in=5124220worker1 # [ 55.031710] nix-grpc-daemon[776]: ts=2026-09-20T12:48:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:534304221worker1 # [ 55.038954] nix-daemon[833]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4222worker1 # [ 55.044647] nix-daemon[833]: reaped child process 1029, status = succeeded4223worker1 # [ 55.055946] nix-daemon[833]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4224worker1 # [ 56.093013] nix-daemon[833]: reaped child process 1043, status = succeeded4225worker1 # [ 56.263644] nix-daemon[833]: accepted connection from pid 1058, user nix-grpc-daemon (trusted)4226worker1 # [ 56.284841] nix-daemon[833]: reaped child process 1061, status = succeeded4227lb # [ 56.325203] niks3-server[1010]: 2026/09/20 12:48:20 INFO Received uploads request method=POST path=/api/pending_closures4228worker1 # [ 56.308441] nix-grpc-daemon[843]: time=2026-09-20T12:48:20.801Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4229worker1 # [ 56.309954] nix-grpc-daemon[843]: time=2026-09-20T12:48:20.801Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4230lb # [ 56.368085] niks3-server[1010]: 2026/09/20 12:48:20 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4231worker1 # [ 56.353784] nix-grpc-daemon[843]: time=2026-09-20T12:48:20.848Z level=INFO msg="Uploading 1 narinfos"4232lb # [ 56.382385] niks3-server[1010]: 2026/09/20 12:48:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4233lb # [ 56.394475] niks3-server[1010]: 2026/09/20 12:48:20 INFO Signed narinfos id=12 count=14234lb # [ 56.399911] niks3-server[1010]: 2026/09/20 12:48:20 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4235lb # [ 56.405148] niks3-server[1010]: 2026/09/20 12:48:20 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4236lb # [ 56.412195] niks3-server[1010]: 2026/09/20 12:48:20 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4237lb # [ 56.416842] niks3-server[1010]: 2026/09/20 12:48:20 INFO Completed upload id=124238worker1 # [ 56.388262] nix-grpc-daemon[843]: time=2026-09-20T12:48:20.883Z level=INFO msg="Upload complete. (319ms)"4239lb # [ 56.419612] niks3-server[1010]: 2026/09/20 12:48:20 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4240worker1 # [ 56.400983] nix-grpc-daemon[776]: ts=2026-09-20T12:48:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53430 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=14241worker1 # [ 56.417461] nix-grpc-daemon[776]: ts=2026-09-20T12:48:20Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:534304242worker1 # [ 56.422188] nix-daemon[833]: reaped child process 1041, status = succeeded4243worker1 # [ 56.442444] nix-grpc-daemon[776]: ts=2026-09-20T12:48:20Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:534304244worker1 # [ 56.449268] nix-grpc-daemon[776]: ts=2026-09-20T12:48:20Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53430 duration_s=0 paths=1 nar_bytes_out=1284245worker1 # [ 56.763081] nix-grpc-daemon[776]: ts=2026-09-20T12:48:21Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:534304246worker1 # [ 56.770892] nix-grpc-daemon[776]: ts=2026-09-20T12:48:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:534304247worker1 # [ 56.777693] nix-grpc-daemon[843]: time=2026-09-20T12:48:21.271Z level=INFO msg="All 1 paths already cached"4248worker2 # [ 56.847597] nix-grpc-daemon[775]: ts=2026-09-20T12:48:21Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04249worker1 # [ 56.796130] nix-grpc-daemon[776]: ts=2026-09-20T12:48:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:534304250worker2 # [ 56.853113] nix-grpc-daemon[775]: ts=2026-09-20T12:48:21Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.3:50051 clients=14251worker1 # [ 56.811578] nix-grpc-daemon[776]: ts=2026-09-20T12:48:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:534304252worker1 # [ 56.826100] nix-grpc-daemon[843]: time=2026-09-20T12:48:21.321Z level=INFO msg="All 1 paths already cached"4253worker1 # [ 56.835209] nix-grpc-daemon[776]: ts=2026-09-20T12:48:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:534304254worker1 # [ 56.849693] nix-daemon[833]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4255worker1 # [ 57.057110] nix-daemon[833]: accepted connection from pid 1065, user nix-grpc-daemon (trusted)4256worker1 # [ 57.079391] nix-daemon[833]: reaped child process 1068, status = succeeded4257worker1 # [ 57.258101] nix-daemon[833]: accepted connection from pid 1070, user nix-grpc-daemon (trusted)4258worker1 # [ 57.278482] nix-daemon[833]: reaped child process 1073, status = succeeded4259lb # [ 57.319179] niks3-server[1010]: 2026/09/20 12:48:21 INFO Received uploads request method=POST path=/api/pending_closures4260worker1 # [ 57.300757] nix-grpc-daemon[843]: time=2026-09-20T12:48:21.795Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4261worker1 # [ 57.302306] nix-grpc-daemon[843]: time=2026-09-20T12:48:21.795Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4262lb # [ 57.351355] niks3-server[1010]: 2026/09/20 12:48:21 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4263lb # [ 57.364744] niks3-server[1010]: 2026/09/20 12:48:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4264worker1 # [ 57.344413] nix-grpc-daemon[843]: time=2026-09-20T12:48:21.838Z level=INFO msg="Uploading 1 narinfos"4265lb # [ 57.372490] niks3-server[1010]: 2026/09/20 12:48:21 INFO Signed narinfos id=13 count=14266lb # [ 57.378158] niks3-server[1010]: 2026/09/20 12:48:21 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4267lb # [ 57.392469] niks3-server[1010]: 2026/09/20 12:48:21 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4268worker1 # [ 57.370408] nix-grpc-daemon[843]: time=2026-09-20T12:48:21.865Z level=INFO msg="Upload complete. (503ms)"4269lb # [ 57.399383] niks3-server[1010]: 2026/09/20 12:48:21 INFO Completed upload id=134270lb # [ 57.403705] niks3-server[1010]: 2026/09/20 12:48:21 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4271worker1 # [ 57.380548] nix-grpc-daemon[776]: ts=2026-09-20T12:48:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53430 duration_s=0 paths=1 nar_bytes_in=6244272worker1 # [ 57.394791] nix-grpc-daemon[776]: ts=2026-09-20T12:48:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:534304273worker1 # [ 57.401695] nix-daemon[833]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4274worker1 # [ 57.407141] nix-daemon[833]: reaped child process 1063, status = succeeded4275worker1 # [ 57.422117] nix-daemon[833]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4276worker1 # [ 58.863561] nix-daemon[833]: reaped child process 1077, status = succeeded4277worker1 # [ 59.053211] nix-daemon[833]: accepted connection from pid 1092, user nix-grpc-daemon (trusted)4278worker1 # [ 59.071971] nix-daemon[833]: reaped child process 1095, status = succeeded4279lb # [ 59.113018] niks3-server[1010]: 2026/09/20 12:48:23 INFO Received uploads request method=POST path=/api/pending_closures4280worker1 # [ 59.095372] nix-grpc-daemon[843]: time=2026-09-20T12:48:23.589Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4281worker1 # [ 59.097054] nix-grpc-daemon[843]: time=2026-09-20T12:48:23.589Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4282lb # [ 59.158137] niks3-server[1010]: 2026/09/20 12:48:23 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4283lb # [ 59.167995] niks3-server[1010]: 2026/09/20 12:48:23 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4284worker1 # [ 59.149760] nix-grpc-daemon[843]: time=2026-09-20T12:48:23.644Z level=INFO msg="Uploading 1 narinfos"4285lb # [ 59.178146] niks3-server[1010]: 2026/09/20 12:48:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4286lb # [ 59.185642] niks3-server[1010]: 2026/09/20 12:48:23 INFO Signed narinfos id=14 count=14287lb # [ 59.187463] niks3-server[1010]: 2026/09/20 12:48:23 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4288lb # [ 59.196123] niks3-server[1010]: 2026/09/20 12:48:23 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4289lb # [ 59.200175] niks3-server[1010]: 2026/09/20 12:48:23 INFO Completed upload id=144290worker1 # [ 59.171944] nix-grpc-daemon[843]: time=2026-09-20T12:48:23.666Z level=INFO msg="Upload complete. (334ms)"4291lb # [ 59.202434] niks3-server[1010]: 2026/09/20 12:48:23 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4292worker1 # [ 59.184969] nix-grpc-daemon[776]: ts=2026-09-20T12:48:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53430 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=14293worker2 # [ 59.240776] nix-grpc-daemon[775]: ts=2026-09-20T12:48:23Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:514284294worker1 # [ 59.200921] nix-daemon[833]: reaped child process 1075, status = succeeded4295worker2 # [ 59.263720] nix-grpc-daemon[775]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4296worker2 # [ 59.284637] nix-grpc-daemon[775]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4297worker1 # [ 59.273410] nix-grpc-daemon[776]: ts=2026-09-20T12:48:23Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:534304298worker1 # [ 59.280505] nix-grpc-daemon[776]: ts=2026-09-20T12:48:23Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53430 duration_s=0 paths=1 nar_bytes_out=1764299worker1 # [ 59.543363] nix-grpc-daemon[776]: ts=2026-09-20T12:48:24Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:534304300worker2 # [ 59.601208] nix-grpc-daemon[775]: ts=2026-09-20T12:48:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:514284301worker2 # [ 59.611917] nix-grpc-daemon[895]: time=2026-09-20T12:48:24.128Z level=INFO msg="All 2 paths already cached"4302worker2 # [ 59.631029] nix-grpc-daemon[775]: ts=2026-09-20T12:48:24Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04303worker2 # [ 59.637486] nix-grpc-daemon[775]: ts=2026-09-20T12:48:24Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.3:50051 clients=14304worker1 # [ 59.587100] nix-grpc-daemon[776]: ts=2026-09-20T12:48:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:534304305worker1 # [ 59.602702] nix-grpc-daemon[776]: ts=2026-09-20T12:48:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:534304306worker1 # [ 59.617770] nix-grpc-daemon[843]: time=2026-09-20T12:48:24.112Z level=INFO msg="All 2 paths already cached"4307worker1 # [ 59.627879] nix-grpc-daemon[776]: ts=2026-09-20T12:48:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:534304308worker1 # [ 59.642218] nix-daemon[833]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4309worker1 # [ 59.852163] nix-daemon[833]: accepted connection from pid 1099, user nix-grpc-daemon (trusted)4310worker1 # [ 59.873297] nix-daemon[833]: reaped child process 1102, status = succeeded4311worker1 # [ 60.044397] nix-daemon[833]: accepted connection from pid 1104, user nix-grpc-daemon (trusted)4312worker1 # [ 60.064679] nix-daemon[833]: reaped child process 1107, status = succeeded4313lb # [ 60.104137] niks3-server[1010]: 2026/09/20 12:48:24 INFO Received uploads request method=POST path=/api/pending_closures4314worker1 # [ 60.085013] nix-grpc-daemon[843]: time=2026-09-20T12:48:24.580Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4315worker1 # [ 60.086953] nix-grpc-daemon[843]: time=2026-09-20T12:48:24.581Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4316lb # [ 60.137436] niks3-server[1010]: 2026/09/20 12:48:24 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4317worker1 # [ 60.122340] nix-grpc-daemon[843]: time=2026-09-20T12:48:24.616Z level=INFO msg="Uploading 1 narinfos"4318lb # [ 60.151636] niks3-server[1010]: 2026/09/20 12:48:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4319lb # [ 60.164929] niks3-server[1010]: 2026/09/20 12:48:24 INFO Signed narinfos id=15 count=14320lb # [ 60.167560] niks3-server[1010]: 2026/09/20 12:48:24 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4321lb # [ 60.175827] niks3-server[1010]: 2026/09/20 12:48:24 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4322worker1 # [ 60.154229] nix-grpc-daemon[843]: time=2026-09-20T12:48:24.649Z level=INFO msg="Upload complete. (494ms)"4323lb # [ 60.183467] niks3-server[1010]: 2026/09/20 12:48:24 INFO Completed upload id=154324lb # [ 60.186256] niks3-server[1010]: 2026/09/20 12:48:24 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4325worker1 # [ 60.164311] nix-grpc-daemon[776]: ts=2026-09-20T12:48:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53430 duration_s=0 paths=1 nar_bytes_in=7524326worker1 # [ 60.176414] nix-grpc-daemon[776]: ts=2026-09-20T12:48:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:534304327worker1 # [ 60.183574] nix-daemon[833]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4328worker1 # [ 60.189258] nix-daemon[833]: reaped child process 1097, status = succeeded4329worker1 # [ 60.204164] nix-daemon[833]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4330worker1 # [ 61.428879] nix-daemon[833]: reaped child process 1111, status = succeeded4331worker1 # [ 61.594113] nix-daemon[833]: accepted connection from pid 1126, user nix-grpc-daemon (trusted)4332worker1 # [ 61.616194] nix-daemon[833]: reaped child process 1129, status = succeeded4333lb # [ 61.657195] niks3-server[1010]: 2026/09/20 12:48:26 INFO Received uploads request method=POST path=/api/pending_closures4334worker1 # [ 61.644467] nix-grpc-daemon[843]: time=2026-09-20T12:48:26.137Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4335worker1 # [ 61.646024] nix-grpc-daemon[843]: time=2026-09-20T12:48:26.137Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4336lb # [ 61.713257] niks3-server[1010]: 2026/09/20 12:48:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4337worker1 # [ 61.694041] nix-grpc-daemon[843]: time=2026-09-20T12:48:26.188Z level=INFO msg="Uploading 1 narinfos"4338lb # [ 61.724319] niks3-server[1010]: 2026/09/20 12:48:26 INFO Signed narinfos id=16 count=14339lb # [ 61.738931] niks3-server[1010]: 2026/09/20 12:48:26 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4340lb # [ 61.910563] niks3-server[1010]: 2026/09/20 12:48:26 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4341lb # [ 61.921251] niks3-server[1010]: 2026/09/20 12:48:26 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4342lb # [ 61.935776] niks3-server[1010]: 2026/09/20 12:48:26 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4343lb # [ 61.942679] niks3-server[1010]: 2026/09/20 12:48:26 INFO Completed upload id=164344worker1 # [ 61.913569] nix-grpc-daemon[843]: time=2026-09-20T12:48:26.408Z level=INFO msg="Upload complete. (498ms)"4345lb # [ 61.952132] niks3-server[1010]: 2026/09/20 12:48:26 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4346worker1 # [ 61.925489] nix-grpc-daemon[776]: ts=2026-09-20T12:48:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53430 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=14347worker1 # [ 61.945821] nix-daemon[833]: reaped child process 1109, status = succeeded4348worker1 # [ 61.968682] nix-grpc-daemon[776]: ts=2026-09-20T12:48:26Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:534304349worker1 # [ 61.994938] nix-grpc-daemon[776]: ts=2026-09-20T12:48:26Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:534304350worker1 # [ 62.000605] nix-grpc-daemon[776]: ts=2026-09-20T12:48:26Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53430 duration_s=0 paths=1 nar_bytes_out=2324351client # [ 62.246781] nix-daemon[934]: reaped child process 936, status = succeeded4352client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.45 seconds)4353client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4354client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.05 seconds)4355client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4356client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.06 seconds)4357client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4358client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.04 seconds)4359(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 8.58 seconds)4360subtest: an input only one worker has still reaches the builder4361client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4362lb # [ 62.349319] envoy[927]: conn peer=[2001:db8:1::1]:51410 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1579 tx=1487 ms=37124363lb # [ 62.354320] envoy[927]: conn peer=[2001:db8:1::1]:51396 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2992 tx=1374 ms=49394364lb # [ 62.359313] envoy[927]: conn peer=[2001:db8:1::1]:38198 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3391 tx=1663 ms=21524365lb # [ 62.365131] envoy[927]: conn peer=[2001:db8:1::1]:38200 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=333 ms=724366lb # [ 62.369891] envoy[927]: conn peer=[2001:db8:1::1]:38206 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3901 tx=1989 ms=25344367lb # [ 62.374723] envoy[927]: conn peer=[2001:db8:1::1]:38220 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=375 ms=304368lb # [ 62.379416] envoy[927]: conn peer=[2001:db8:1::1]:38228 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4339 tx=2110 ms=25144369lb # [ 62.384257] envoy[927]: conn peer=[2001:db8:1::1]:42182 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=406 ms=644370client # this derivation will be built:4371client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4372client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4373client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.46 seconds)4374client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4375client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.21 seconds)4376worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4377worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.26 seconds)4378worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4379worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds)4380client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24381client # [ 63.590647] nix-daemon[934]: accepted connection from pid 1014, user root (trusted)4382client # this derivation will be built:4383client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4384worker1 # [ 63.684728] nix-grpc-daemon[776]: ts=2026-09-20T12:48:28Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:534304385client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'...4386worker1 # [ 63.692426] nix-grpc-daemon[776]: ts=2026-09-20T12:48:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:534304387worker1 # [ 63.904143] nix-daemon[833]: accepted connection from pid 1136, user nix-grpc-daemon (trusted)4388worker1 # [ 63.924703] nix-daemon[833]: reaped child process 1139, status = succeeded4389lb # [ 63.965236] niks3-server[1010]: 2026/09/20 12:48:28 INFO Received uploads request method=POST path=/api/pending_closures4390worker1 # [ 63.947895] nix-grpc-daemon[843]: time=2026-09-20T12:48:28.442Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4391worker1 # [ 63.949640] nix-grpc-daemon[843]: time=2026-09-20T12:48:28.442Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4392lb # [ 63.996344] niks3-server[1010]: 2026/09/20 12:48:28 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4393lb # [ 64.011911] niks3-server[1010]: 2026/09/20 12:48:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4394worker1 # [ 63.989224] nix-grpc-daemon[843]: time=2026-09-20T12:48:28.484Z level=INFO msg="Uploading 1 narinfos"4395lb # [ 64.024917] niks3-server[1010]: 2026/09/20 12:48:28 INFO Signed narinfos id=17 count=14396lb # [ 64.030188] niks3-server[1010]: 2026/09/20 12:48:28 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4397lb # [ 64.035759] niks3-server[1010]: 2026/09/20 12:48:28 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4398lb # [ 64.046752] niks3-server[1010]: 2026/09/20 12:48:28 INFO Completed upload id=174399worker1 # [ 64.018653] nix-grpc-daemon[843]: time=2026-09-20T12:48:28.513Z level=INFO msg="Upload complete. (320ms)"4400lb # [ 64.049139] niks3-server[1010]: 2026/09/20 12:48:28 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4401worker2 # [ 64.097359] nix-grpc-daemon[775]: ts=2026-09-20T12:48:28Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04402worker2 # [ 64.105836] nix-grpc-daemon[775]: ts=2026-09-20T12:48:28Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=14403worker2 # [ 64.150743] nix-grpc-daemon[775]: ts=2026-09-20T12:48:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:514284404worker2 # [ 64.167906] nix-grpc-daemon[775]: ts=2026-09-20T12:48:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:514284405client # copying 2 paths to 'lb:50051'...4406client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4407worker2 # [ 64.188090] nix-grpc-daemon[775]: ts=2026-09-20T12:48:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:514284408client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4409worker2 # [ 64.203940] nix-daemon[842]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4410worker2 # [ 64.432583] nix-daemon[842]: accepted connection from pid 980, user nix-grpc-daemon (trusted)4411worker2 # [ 64.456295] nix-daemon[842]: reaped child process 983, status = succeeded4412worker2 # [ 64.633023] nix-daemon[842]: accepted connection from pid 985, user nix-grpc-daemon (trusted)4413worker2 # [ 64.655525] nix-daemon[842]: reaped child process 988, status = succeeded4414lb # [ 64.643669] niks3-server[1010]: 2026/09/20 12:48:29 INFO Received uploads request method=POST path=/api/pending_closures4415lb # [ 64.711666] niks3-server[1010]: 2026/09/20 12:48:29 INFO Received uploads request method=POST path=/api/pending_closures4416worker2 # [ 64.760816] nix-grpc-daemon[895]: time=2026-09-20T12:48:29.276Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4417worker2 # [ 64.765023] nix-grpc-daemon[895]: time=2026-09-20T12:48:29.276Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4418worker2 # [ 64.768906] nix-grpc-daemon[895]: time=2026-09-20T12:48:29.276Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4419lb # [ 64.774635] niks3-server[1010]: 2026/09/20 12:48:29 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4420lb # [ 64.791786] niks3-server[1010]: 2026/09/20 12:48:29 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4421lb # [ 64.799591] niks3-server[1010]: 2026/09/20 12:48:29 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4422lb # [ 64.810336] niks3-server[1010]: 2026/09/20 12:48:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4423worker2 # [ 64.834958] nix-grpc-daemon[895]: time=2026-09-20T12:48:29.350Z level=INFO msg="Uploading 3 narinfos"4424lb # [ 64.815850] niks3-server[1010]: 2026/09/20 12:48:29 INFO Signed narinfos id=18 count=14425lb # [ 64.820931] niks3-server[1010]: 2026/09/20 12:48:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4426lb # [ 64.827368] niks3-server[1010]: 2026/09/20 12:48:29 INFO Signed narinfos id=19 count=24427lb # [ 64.836571] niks3-server[1010]: 2026/09/20 12:48:29 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4428lb # [ 64.844423] niks3-server[1010]: 2026/09/20 12:48:29 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4429lb # [ 64.852370] niks3-server[1010]: 2026/09/20 12:48:29 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4430lb # [ 64.860540] niks3-server[1010]: 2026/09/20 12:48:29 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4431lb # [ 64.866151] niks3-server[1010]: 2026/09/20 12:48:29 INFO Completed upload id=184432lb # [ 64.870840] niks3-server[1010]: 2026/09/20 12:48:29 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4433lb # [ 64.874937] niks3-server[1010]: 2026/09/20 12:48:29 INFO Completed upload id=194434worker2 # [ 64.899001] nix-grpc-daemon[895]: time=2026-09-20T12:48:29.415Z level=INFO msg="Upload complete. (673ms)"4435lb # [ 64.876780] niks3-server[1010]: 2026/09/20 12:48:29 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4436worker2 # [ 64.910060] nix-grpc-daemon[775]: ts=2026-09-20T12:48:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51428 duration_s=0 paths=2 nar_bytes_in=9844437worker2 # [ 64.928889] nix-grpc-daemon[775]: ts=2026-09-20T12:48:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:514284438worker2 # [ 64.939219] nix-daemon[842]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4439worker2 # [ 64.947580] nix-daemon[842]: reaped child process 978, status = succeeded4440worker2 # [ 64.966171] nix-grpc-daemon[775]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...4441client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4442client # uses-input-w1onlya> worker2: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4443worker2 # [ 64.988963] nix-daemon[842]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4444worker2 # [ 66.032867] nix-daemon[842]: reaped child process 993, status = succeeded4445worker2 # [ 66.202559] nix-daemon[842]: accepted connection from pid 1008, user nix-grpc-daemon (trusted)4446worker2 # [ 66.223350] nix-daemon[842]: reaped child process 1011, status = succeeded4447lb # [ 66.214918] niks3-server[1010]: 2026/09/20 12:48:30 INFO Received uploads request method=POST path=/api/pending_closures4448worker2 # [ 66.251352] nix-grpc-daemon[895]: time=2026-09-20T12:48:30.767Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4449lb # [ 66.247461] niks3-server[1010]: 2026/09/20 12:48:30 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4450worker2 # [ 66.282516] nix-grpc-daemon[895]: time=2026-09-20T12:48:30.799Z level=INFO msg="Uploading 1 narinfos"4451lb # [ 66.260827] niks3-server[1010]: 2026/09/20 12:48:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4452lb # [ 66.271299] niks3-server[1010]: 2026/09/20 12:48:30 INFO Signed narinfos id=20 count=14453lb # [ 66.276730] niks3-server[1010]: 2026/09/20 12:48:30 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4454lb # [ 66.284610] niks3-server[1010]: 2026/09/20 12:48:30 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4455lb # [ 66.290961] niks3-server[1010]: 2026/09/20 12:48:30 INFO Completed upload id=204456worker2 # [ 66.315655] nix-grpc-daemon[895]: time=2026-09-20T12:48:30.832Z level=INFO msg="Upload complete. (312ms)"4457lb # [ 66.293758] niks3-server[1010]: 2026/09/20 12:48:30 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4458worker2 # [ 66.325269] nix-grpc-daemon[775]: ts=2026-09-20T12:48:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51428 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=14459worker2 # [ 66.341477] nix-daemon[842]: reaped child process 990, status = succeeded4460client # copying 1 paths...4461worker2 # [ 66.376205] nix-grpc-daemon[775]: ts=2026-09-20T12:48:30Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:514284462client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4463worker1 # [ 66.353975] nix-grpc-daemon[776]: ts=2026-09-20T12:48:30Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:534304464worker1 # [ 66.371928] nix-grpc-daemon[776]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'...4465worker1 # [ 66.391323] nix-grpc-daemon[776]: ts=2026-09-20T12:48:30Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53430 duration_s=0 paths=1 nar_bytes_out=1204466client # [ 66.632347] nix-daemon[934]: reaped child process 1017, status = succeeded4467client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.29 seconds)4468client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24469client # [ 66.861172] nix-daemon[934]: accepted connection from pid 1034, user root (trusted)4470client # this derivation will be built:4471client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4472worker2 # [ 67.009059] nix-grpc-daemon[775]: ts=2026-09-20T12:48:31Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:514284473client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'...4474worker1 # [ 66.960748] nix-grpc-daemon[776]: ts=2026-09-20T12:48:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:534304475worker1 # [ 66.980899] nix-grpc-daemon[843]: time=2026-09-20T12:48:31.474Z level=INFO msg="All 1 paths already cached"4476worker2 # [ 67.053707] nix-grpc-daemon[775]: ts=2026-09-20T12:48:31Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04477worker2 # [ 67.060517] nix-grpc-daemon[775]: ts=2026-09-20T12:48:31Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=14478worker1 # [ 67.010339] nix-grpc-daemon[776]: ts=2026-09-20T12:48:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:534304479worker1 # [ 67.027204] nix-grpc-daemon[776]: ts=2026-09-20T12:48:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:534304480client # copying 1 paths to 'lb:50051'...4481client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4482worker1 # [ 67.052147] nix-grpc-daemon[776]: ts=2026-09-20T12:48:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:534304483worker1 # [ 67.068089] nix-daemon[833]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4484worker1 # [ 67.092819] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 84 ms (attempt 1/5)4485worker1 # [ 67.184119] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 126 ms (attempt 2/5)4486worker1 # [ 67.318005] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 22 ms (attempt 3/5)4487worker1 # [ 67.340288] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 616 ms (attempt 4/5)4488worker1 # [ 67.958346] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4489worker1 # [ 67.968488] nix-grpc-daemon[776]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4490worker1 # [ 68.204234] nix-daemon[833]: accepted connection from pid 1148, user nix-grpc-daemon (trusted)4491worker1 # [ 68.223887] nix-daemon[833]: reaped child process 1151, status = succeeded4492worker1 # [ 68.407526] nix-daemon[833]: accepted connection from pid 1153, user nix-grpc-daemon (trusted)4493worker1 # [ 68.427074] nix-daemon[833]: reaped child process 1156, status = succeeded4494lb # [ 68.470333] niks3-server[1010]: 2026/09/20 12:48:32 INFO Received uploads request method=POST path=/api/pending_closures4495worker1 # [ 68.451067] nix-grpc-daemon[843]: time=2026-09-20T12:48:32.945Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4496worker1 # [ 68.452760] nix-grpc-daemon[843]: time=2026-09-20T12:48:32.945Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4497lb # [ 68.507787] niks3-server[1010]: 2026/09/20 12:48:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4498worker1 # [ 68.486331] nix-grpc-daemon[843]: time=2026-09-20T12:48:32.981Z level=INFO msg="Uploading 1 narinfos"4499lb # [ 68.521261] niks3-server[1010]: 2026/09/20 12:48:33 INFO Signed narinfos id=21 count=14500lb # [ 68.531179] niks3-server[1010]: 2026/09/20 12:48:33 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4501lb # [ 68.559948] niks3-server[1010]: 2026/09/20 12:48:33 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4502lb # [ 68.653839] niks3-server[1010]: 2026/09/20 12:48:33 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4503lb # [ 68.661387] niks3-server[1010]: 2026/09/20 12:48:33 INFO Completed upload id=214504worker1 # [ 68.633318] nix-grpc-daemon[843]: time=2026-09-20T12:48:33.128Z level=INFO msg="Upload complete. (640ms)"4505lb # [ 68.668359] niks3-server[1010]: 2026/09/20 12:48:33 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4506worker1 # [ 68.644457] nix-grpc-daemon[776]: ts=2026-09-20T12:48:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53430 duration_s=1 paths=1 nar_bytes_in=5684507worker1 # [ 68.659774] nix-grpc-daemon[776]: ts=2026-09-20T12:48:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:534304508worker1 # [ 68.679237] nix-daemon[833]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4509worker1 # [ 68.687744] nix-daemon[833]: reaped child process 1142, status = succeeded4510client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4511worker1 # [ 68.706120] nix-daemon[833]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4512client # uses-input-w1onlyb> node-a: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4513worker1 # [ 69.939797] nix-daemon[833]: reaped child process 1160, status = succeeded4514worker1 # [ 70.104961] nix-daemon[833]: accepted connection from pid 1175, user nix-grpc-daemon (trusted)4515worker1 # [ 70.126356] nix-daemon[833]: reaped child process 1178, status = succeeded4516lb # [ 70.168891] niks3-server[1010]: 2026/09/20 12:48:34 INFO Received uploads request method=POST path=/api/pending_closures4517worker1 # [ 70.282824] nix-grpc-daemon[843]: time=2026-09-20T12:48:34.775Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4518lb # [ 70.329887] niks3-server[1010]: 2026/09/20 12:48:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4519worker1 # [ 70.309447] nix-grpc-daemon[843]: time=2026-09-20T12:48:34.804Z level=INFO msg="Uploading 1 narinfos"4520lb # [ 70.344895] niks3-server[1010]: 2026/09/20 12:48:34 INFO Signed narinfos id=22 count=14521lb # [ 70.353989] niks3-server[1010]: 2026/09/20 12:48:34 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4522lb # [ 70.362225] niks3-server[1010]: 2026/09/20 12:48:34 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4523lb # [ 70.370937] niks3-server[1010]: 2026/09/20 12:48:34 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4524lb # [ 70.432143] niks3-server[1010]: 2026/09/20 12:48:34 INFO Completed upload id=224525lb # [ 70.436302] niks3-server[1010]: 2026/09/20 12:48:34 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4526worker1 # [ 70.410006] nix-grpc-daemon[843]: time=2026-09-20T12:48:34.902Z level=INFO msg="Upload complete. (483ms)"4527worker1 # [ 70.421250] nix-grpc-daemon[776]: ts=2026-09-20T12:48:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53430 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=14528worker1 # [ 70.439237] nix-daemon[833]: reaped child process 1158, status = succeeded4529client # copying 1 paths...4530worker2 # [ 70.521612] nix-grpc-daemon[775]: ts=2026-09-20T12:48:35Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:514284531worker2 # [ 70.534713] nix-grpc-daemon[775]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'...4532client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4533worker1 # [ 70.528191] nix-grpc-daemon[776]: ts=2026-09-20T12:48:35Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:534304534worker1 # [ 70.535039] nix-grpc-daemon[776]: ts=2026-09-20T12:48:35Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53430 duration_s=0 paths=1 nar_bytes_out=1204535client # [ 70.734376] nix-daemon[934]: reaped child process 1037, status = succeeded4536client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 4.10 seconds)4537client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24538client # [ 70.964398] nix-daemon[934]: accepted connection from pid 1055, user root (trusted)4539client # this derivation will be built:4540client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4541worker1 # [ 71.056142] nix-grpc-daemon[776]: ts=2026-09-20T12:48:35Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:534304542client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'...4543worker2 # [ 71.113665] nix-grpc-daemon[775]: ts=2026-09-20T12:48:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:514284544worker2 # [ 71.138431] nix-grpc-daemon[895]: time=2026-09-20T12:48:35.654Z level=INFO msg="All 1 paths already cached"4545worker2 # [ 71.157249] nix-grpc-daemon[775]: ts=2026-09-20T12:48:35Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04546worker2 # [ 71.165005] nix-grpc-daemon[775]: ts=2026-09-20T12:48:35Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=14547worker2 # [ 71.174644] nix-grpc-daemon[775]: ts=2026-09-20T12:48:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:514284548worker2 # [ 71.186813] nix-grpc-daemon[775]: ts=2026-09-20T12:48:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:514284549worker2 # [ 71.451121] nix-grpc-daemon[895]: time=2026-09-20T12:48:35.967Z level=INFO msg="All 1 paths already cached"4550client # copying 1 paths to 'lb:50051'...4551client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4552worker2 # [ 71.463520] nix-grpc-daemon[775]: ts=2026-09-20T12:48:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:514284553worker2 # [ 71.479201] nix-daemon[842]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4554worker2 # [ 71.689125] nix-daemon[842]: accepted connection from pid 1020, user nix-grpc-daemon (trusted)4555worker2 # [ 71.709623] nix-daemon[842]: reaped child process 1023, status = succeeded4556worker2 # [ 71.885352] nix-daemon[842]: accepted connection from pid 1025, user nix-grpc-daemon (trusted)4557worker2 # [ 71.905469] nix-daemon[842]: reaped child process 1028, status = succeeded4558lb # [ 71.894687] niks3-server[1010]: 2026/09/20 12:48:36 INFO Received uploads request method=POST path=/api/pending_closures4559worker2 # [ 71.930879] nix-grpc-daemon[895]: time=2026-09-20T12:48:36.447Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4560worker2 # [ 71.932557] nix-grpc-daemon[895]: time=2026-09-20T12:48:36.447Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4561lb # [ 71.926543] niks3-server[1010]: 2026/09/20 12:48:36 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4562lb # [ 71.941682] niks3-server[1010]: 2026/09/20 12:48:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4563worker2 # [ 71.972535] nix-grpc-daemon[895]: time=2026-09-20T12:48:36.489Z level=INFO msg="Uploading 1 narinfos"4564lb # [ 71.952536] niks3-server[1010]: 2026/09/20 12:48:36 INFO Signed narinfos id=23 count=14565lb # [ 71.957962] niks3-server[1010]: 2026/09/20 12:48:36 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4566lb # [ 71.966956] niks3-server[1010]: 2026/09/20 12:48:36 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4567lb # [ 72.069249] niks3-server[1010]: 2026/09/20 12:48:36 INFO Completed upload id=234568worker2 # [ 72.094970] nix-grpc-daemon[895]: time=2026-09-20T12:48:36.611Z level=INFO msg="Upload complete. (596ms)"4569lb # [ 72.074161] niks3-server[1010]: 2026/09/20 12:48:36 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4570worker2 # [ 72.105343] nix-grpc-daemon[775]: ts=2026-09-20T12:48:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51428 duration_s=0 paths=1 nar_bytes_in=5684571worker2 # [ 72.124591] nix-grpc-daemon[775]: ts=2026-09-20T12:48:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:514284572worker2 # [ 72.140810] nix-daemon[842]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4573worker2 # [ 72.145512] nix-daemon[842]: reaped child process 1018, status = succeeded4574client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4575worker2 # [ 72.162626] nix-daemon[842]: accepted connection from pid 775, user nix-grpc-daemon (trusted)4576lb # [ 72.348783] envoy[927]: conn peer=[2001:db8:1::1]:42196 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3863 tx=1783 ms=27654577lb # [ 72.354013] envoy[927]: conn peer=[2001:db8:1::1]:42202 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=1014578lb # [ 72.358815] envoy[927]: conn peer=[2001:db8:1::1]:42208 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3725 tx=1917 ms=35974579lb # [ 72.363662] envoy[927]: conn peer=[2001:db8:1::1]:42222 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=294580client # uses-input-w1onlyc> worker2: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4581worker2 # [ 73.408369] nix-daemon[842]: reaped child process 1032, status = succeeded4582worker2 # [ 73.592149] nix-daemon[842]: accepted connection from pid 1047, user nix-grpc-daemon (trusted)4583worker2 # [ 73.612883] nix-daemon[842]: reaped child process 1050, status = succeeded4584lb # [ 73.599404] niks3-server[1010]: 2026/09/20 12:48:38 INFO Received uploads request method=POST path=/api/pending_closures4585worker2 # [ 73.636103] nix-grpc-daemon[895]: time=2026-09-20T12:48:38.151Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4586lb # [ 73.628847] niks3-server[1010]: 2026/09/20 12:48:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4587worker2 # [ 73.662751] nix-grpc-daemon[895]: time=2026-09-20T12:48:38.179Z level=INFO msg="Uploading 1 narinfos"4588lb # [ 73.641800] niks3-server[1010]: 2026/09/20 12:48:38 INFO Signed narinfos id=24 count=14589lb # [ 73.647836] niks3-server[1010]: 2026/09/20 12:48:38 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4590lb # [ 73.656651] niks3-server[1010]: 2026/09/20 12:48:38 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4591worker2 # [ 73.689985] nix-grpc-daemon[895]: time=2026-09-20T12:48:38.206Z level=INFO msg="Upload complete. (309ms)"4592lb # [ 73.664722] niks3-server[1010]: 2026/09/20 12:48:38 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4593lb # [ 73.669373] niks3-server[1010]: 2026/09/20 12:48:38 INFO Completed upload id=244594lb # [ 73.671833] niks3-server[1010]: 2026/09/20 12:48:38 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4595worker2 # [ 73.700841] nix-grpc-daemon[775]: ts=2026-09-20T12:48:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51428 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=14596worker2 # [ 73.710865] nix-daemon[842]: reaped child process 1030, status = succeeded4597client # copying 1 paths...4598worker2 # [ 73.746767] nix-grpc-daemon[775]: ts=2026-09-20T12:48:38Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:514284599client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4600worker1 # [ 73.731711] nix-grpc-daemon[776]: ts=2026-09-20T12:48:38Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:534304601worker1 # [ 73.747240] nix-grpc-daemon[776]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'...4602worker1 # [ 73.767421] nix-grpc-daemon[776]: ts=2026-09-20T12:48:38Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53430 duration_s=0 paths=1 nar_bytes_out=1204603client # [ 74.013540] nix-daemon[934]: reaped child process 1058, status = succeeded4604client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 3.28 seconds)4605(finished: subtest: an input only one worker has still reaches the builder, in 11.62 seconds)4606subtest: upload whose reference the worker lacks is completed from the cache4607client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4608client # this derivation will be built:4609client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4610client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4611client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.56 seconds)4612client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4613client # this derivation will be built:4614client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4615client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4616client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.60 seconds)4617client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4618client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.21 seconds)4619worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4620worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.26 seconds)4621worker2 # [ 75.658401] systemd[1]: Stopping Nix worker-protocol over gRPC...4622worker2 # [ 75.856291] nix-grpc-daemon[775]: ts=2026-09-20T12:48:40Z level=info event=signal_exit4623worker2 # [ 76.094550] nix-grpc-daemon[775]: ts=2026-09-20T12:48:40Z level=info event=scheduler_yield4624worker2 # [ 76.100380] nix-grpc-daemon[775]: ts=2026-09-20T12:48:40Z level=info event=scheduler_restarting addr=lb:500514625lb # [ 76.076330] niks3-server[1010]: 2026/09/20 12:48:40 INFO lead: released remote=192.168.1.4:428644626worker2 # [ 76.105970] nix-grpc-daemon[775]: ts=2026-09-20T12:48:40Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:514224627worker2 # [ 76.110889] nix-grpc-daemon[775]: ts=2026-09-20T12:48:40Z level=info event=worker_gone addr=192.168.1.4:500514628worker1 # [ 76.058589] nix-grpc-daemon[776]: ts=2026-09-20T12:48:40Z level=info event=scheduler_restarting addr=lb:500514629worker2 # [ 76.117048] nix-grpc-daemon[775]: ts=2026-09-20T12:48:40Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:514224630worker2 # [ 76.121711] nix-grpc-daemon[775]: ts=2026-09-20T12:48:40Z level=info event=worker_gone addr=192.168.1.3:500514631worker2 # [ 76.301724] nix-grpc-daemon[775]: ts=2026-09-20T12:48:40Z level=info event=scheduler_connected addr=lb:500514632worker2 # [ 76.307101] nix-grpc-daemon[775]: ts=2026-09-20T12:48:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4633worker1 # [ 76.258625] nix-grpc-daemon[776]: ts=2026-09-20T12:48:40Z level=info event=scheduler_connected addr=lb:500514634worker1 # [ 76.264155] nix-grpc-daemon[776]: ts=2026-09-20T12:48:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4635worker2 # [ 76.508572] nix-grpc-daemon[775]: ts=2026-09-20T12:48:41Z level=info event=scheduler_connected addr=lb:500514636worker2 # [ 76.514169] nix-grpc-daemon[775]: ts=2026-09-20T12:48:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4637worker1 # [ 76.464905] nix-grpc-daemon[776]: ts=2026-09-20T12:48:40Z level=info event=scheduler_connected addr=lb:500514638worker1 # [ 76.470180] nix-grpc-daemon[776]: ts=2026-09-20T12:48:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4639worker2 # [ 76.715359] nix-grpc-daemon[775]: ts=2026-09-20T12:48:41Z level=info event=scheduler_connected addr=lb:500514640worker2 # [ 76.721092] nix-grpc-daemon[775]: ts=2026-09-20T12:48:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4641worker1 # [ 76.671351] nix-grpc-daemon[776]: ts=2026-09-20T12:48:41Z level=info event=scheduler_connected addr=lb:500514642worker1 # [ 76.678119] nix-grpc-daemon[776]: ts=2026-09-20T12:48:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4643worker2 # [ 76.924293] nix-grpc-daemon[775]: ts=2026-09-20T12:48:41Z level=info event=scheduler_connected addr=lb:500514644worker2 # [ 76.928627] nix-grpc-daemon[775]: ts=2026-09-20T12:48:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4645worker1 # [ 76.878860] nix-grpc-daemon[776]: ts=2026-09-20T12:48:41Z level=info event=scheduler_connected addr=lb:500514646worker1 # [ 76.884374] nix-grpc-daemon[776]: ts=2026-09-20T12:48:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4647worker2 # [ 77.100196] nix-grpc-daemon[775]: ts=2026-09-20T12:48:41Z level=info event=scheduler_restarting4648worker1 # [ 77.087264] nix-grpc-daemon[776]: ts=2026-09-20T12:48:41Z level=info event=scheduler_connected addr=lb:500514649worker1 # [ 77.089680] nix-grpc-daemon[776]: ts=2026-09-20T12:48:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4650worker2 # [ 77.143347] nix-grpc-daemon[775]: ts=2026-09-20T12:48:41Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4651worker2 # [ 77.161068] nix-daemon[842]: reaped child process 845, status = succeeded4652worker1 # [ 77.288581] nix-grpc-daemon[776]: ts=2026-09-20T12:48:41Z level=info event=scheduler_connected addr=lb:500514653worker1 # [ 77.294198] nix-grpc-daemon[776]: ts=2026-09-20T12:48:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4654worker1 # [ 77.495185] nix-grpc-daemon[776]: ts=2026-09-20T12:48:41Z level=info event=scheduler_connected addr=lb:500514655worker1 # [ 77.501046] nix-grpc-daemon[776]: ts=2026-09-20T12:48:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4656worker1 # [ 77.701930] nix-grpc-daemon[776]: ts=2026-09-20T12:48:42Z level=info event=scheduler_connected addr=lb:500514657worker1 # [ 77.707481] nix-grpc-daemon[776]: ts=2026-09-20T12:48:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4658worker2 # [ 77.827977] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4659worker2 # [ 77.831566] systemd[1]: Stopped Nix worker-protocol over gRPC.4660worker2 # [ 77.839077] systemd[1]: nix-grpc-daemon.service: Consumed 1.843s CPU time over 55.284s wall clock time, 51.2M memory peak, 51.3K incoming IP traffic, 114.1K outgoing IP traffic.4661worker2 # [ 77.853579] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4662worker2 # [ 77.855682] systemd[1]: Closed Nix worker-protocol over gRPC.4663worker2 # [ 77.858422] systemd[1]: nix-grpc-daemon.socket: Consumed 653us CPU time over 1min 5.759s wall clock time, 256K memory peak, 68K incoming IP traffic, 57.6K outgoing IP traffic.4664lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4665lb: must succeed: curl -sf localhost:9901/clusters4666lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4667lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4668client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24669worker1 # [ 77.908156] nix-grpc-daemon[776]: ts=2026-09-20T12:48:42Z level=info event=scheduler_connected addr=lb:500514670worker1 # [ 77.913579] nix-grpc-daemon[776]: ts=2026-09-20T12:48:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4671worker1 # [ 77.952879] nix-grpc-daemon[776]: ts=2026-09-20T12:48:42Z level=info event=scheduler_take_over4672lb # [ 77.981970] niks3-server[1010]: 2026/09/20 12:48:42 INFO lead: acquired remote=192.168.1.3:474564673worker1 # [ 78.115917] nix-grpc-daemon[776]: ts=2026-09-20T12:48:42Z level=info event=scheduler_connected addr=lb:500514674worker1 # [ 78.121189] nix-grpc-daemon[776]: ts=2026-09-20T12:48:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4675worker1 # [ 78.146700] nix-grpc-daemon[776]: ts=2026-09-20T12:48:42Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:534304676worker1 # [ 78.156853] nix-grpc-daemon[776]: ts=2026-09-20T12:48:42Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:534304677client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4678client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.29 seconds)4679worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4680worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)4681worker2 # [ 78.367065] systemd[1]: Listening on Nix worker-protocol over gRPC.4682worker1 # [ 78.318427] nix-grpc-daemon[776]: ts=2026-09-20T12:48:42Z level=info event=scheduler_connected addr=lb:500514683worker1 # [ 78.324708] nix-grpc-daemon[776]: ts=2026-09-20T12:48:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4684worker1 # [ 78.404811] systemd[1]: Stopping Nix worker-protocol over gRPC...4685worker1 # [ 78.525672] nix-grpc-daemon[776]: ts=2026-09-20T12:48:43Z level=info event=scheduler_connected addr=lb:500514686worker1 # [ 78.533425] nix-grpc-daemon[776]: ts=2026-09-20T12:48:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4687worker1 # [ 78.684899] nix-grpc-daemon[776]: ts=2026-09-20T12:48:43Z level=info event=signal_exit4688worker1 # [ 78.734232] nix-grpc-daemon[776]: ts=2026-09-20T12:48:43Z level=info event=scheduler_connected addr=lb:500514689worker1 # [ 78.739994] nix-grpc-daemon[776]: ts=2026-09-20T12:48:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4690worker2 # [ 78.989722] systemd[1]: Starting scheduler-token.service...4691worker1 # [ 78.936723] nix-grpc-daemon[776]: ts=2026-09-20T12:48:43Z level=info event=scheduler_yield4692lb # [ 78.968893] niks3-server[1010]: 2026/09/20 12:48:43 INFO lead: released remote=192.168.1.3:474564693worker1 # [ 78.942078] nix-grpc-daemon[776]: ts=2026-09-20T12:48:43Z level=info event=scheduler_connected addr=lb:500514694worker1 # [ 78.947992] nix-grpc-daemon[776]: ts=2026-09-20T12:48:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4695worker2 # [ 79.102122] systemd[1]: scheduler-token.service: Deactivated successfully.4696worker2 # [ 79.106731] systemd[1]: Finished scheduler-token.service.4697worker2 # [ 79.113682] systemd[1]: scheduler-token.service: Consumed 56ms CPU time over 117ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.4698worker2 # [ 79.120886] systemd[1]: Starting Nix worker-protocol over gRPC...4699worker1 # [ 79.151257] nix-grpc-daemon[776]: ts=2026-09-20T12:48:43Z level=info event=scheduler_connected addr=lb:500514700worker1 # [ 79.155889] nix-grpc-daemon[776]: ts=2026-09-20T12:48:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4701worker2 # [ 79.322581] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:43Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4702worker2 # [ 79.325136] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:43Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4703worker2 # [ 79.329425] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:43Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14704worker2 # [ 79.338518] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:43Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4705worker2 # [ 79.353449] systemd[1]: Started Nix worker-protocol over gRPC.4706worker2 # [ 79.355593] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:43Z level=info event=scheduler_take_over4707lb # [ 79.331826] niks3-server[1010]: 2026/09/20 12:48:43 INFO lead: acquired remote=192.168.1.4:434804708worker2 # [ 79.375620] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:43Z level=info event=scheduler_connected addr=lb:500514709worker2 # [ 79.384069] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:43Z level=info event=oidc_jwks provider=mock keys=14710worker2 # [ 79.386491] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:43Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:543184711worker2 # [ 79.388379] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:43Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04712worker2 # [ 79.407562] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:43Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:543184713worker1 # [ 79.352806] nix-grpc-daemon[776]: ts=2026-09-20T12:48:43Z level=info event=scheduler_connected addr=lb:500514714worker2 # [ 79.409516] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:43Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04715worker1 # [ 79.938480] nix-grpc-daemon[776]: ts=2026-09-20T12:48:44Z level=info event=scheduler_restarting4716worker2 # [ 80.005147] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:44Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:543184717worker2 # [ 80.010359] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:44Z level=info event=worker_gone addr=192.168.1.3:500514718worker1 # [ 79.975784] nix-grpc-daemon[776]: ts=2026-09-20T12:48:44Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4719worker1 # [ 80.004526] nix-daemon[833]: reaped child process 835, status = succeeded4720worker1 # [ 80.771899] nix-grpc-daemon[776]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4721worker1 # [ 80.776636] nix-grpc-daemon[776]: E0000 00:00:1789908525.265319 819 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true4722worker1 # [ 80.824370] nix-grpc-daemon[776]: E0000 00:00:1789908525.319098 819 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4723worker1 # [ 81.698103] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4724worker1 # [ 81.705947] systemd[1]: Stopped Nix worker-protocol over gRPC.4725worker1 # [ 81.712723] systemd[1]: nix-grpc-daemon.service: Consumed 3.846s CPU time over 59.370s wall clock time, 59.7M memory peak, 88.8K incoming IP traffic, 157.2K outgoing IP traffic.4726worker1 # [ 81.725477] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4727worker1 # [ 81.729205] systemd[1]: Closed Nix worker-protocol over gRPC.4728worker1 # [ 81.730922] systemd[1]: nix-grpc-daemon.socket: Consumed 846us CPU time over 1min 9.718s wall clock time, 256K memory peak, 79K incoming IP traffic, 64.2K outgoing IP traffic.4729lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4730lb: must succeed: curl -sf localhost:9901/clusters4731lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4732lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4733client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24734worker2 # [ 82.167973] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:487224735worker2 # [ 82.185484] nix-daemon[842]: accepted connection from pid 1074, user nix-grpc-daemon (trusted)4736worker2 # [ 82.217338] nix-grpc-daemon[1074]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 51 ms (attempt 1/5)4737worker2 # [ 82.276346] nix-grpc-daemon[1074]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 44 ms (attempt 2/5)4738worker2 # [ 82.320810] nix-grpc-daemon[1074]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 17 ms (attempt 3/5)4739worker2 # [ 82.338328] nix-grpc-daemon[1074]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 689 ms (attempt 4/5)4740lb # [ 82.346738] envoy[927]: conn peer=[2001:db8:1::1]:50252 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3742 tx=1822 ms=27694741lb # [ 82.352110] envoy[927]: conn peer=[2001:db8:1::1]:50264 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=1014742lb # [ 82.357720] envoy[927]: conn peer=[2001:db8:1::4]:36930 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=27616 tx=1624 ms=542744743lb # [ 82.364406] envoy[927]: conn peer=[2001:db8:1::1]:50270 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=324744lb # [ 82.370063] envoy[927]: conn peer=[2001:db8:1::3]:57662 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=7465 tx=2187 ms=561984745worker2 # [ 83.035913] nix-grpc-daemon[1074]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4746client # copying 2 paths...4747client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...4748worker2 # [ 83.067469] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:487224749client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...4750worker2 # [ 83.093150] nix-daemon[842]: accepted connection from pid 1074, user nix-grpc-daemon (trusted)4751worker2 # [ 83.127501] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:47Z level=info event=niks3_push_started pid=11304752worker2 # [ 83.361217] nix-grpc-daemon[1130]: time=2026-09-20T12:48:47.876Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""4753worker2 # [ 83.551424] nix-daemon[842]: accepted connection from pid 1143, user nix-grpc-daemon (trusted)4754worker2 # [ 83.571294] nix-daemon[842]: reaped child process 1146, status = succeeded4755lb # [ 83.561023] niks3-server[1010]: 2026/09/20 12:48:48 INFO Received uploads request method=POST path=/api/pending_closures4756lb # [ 83.572639] niks3-server[1010]: 2026/09/20 12:48:48 INFO Received uploads request method=POST path=/api/pending_closures4757worker2 # [ 83.609013] nix-grpc-daemon[1130]: time=2026-09-20T12:48:48.126Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4758worker2 # [ 83.615413] nix-grpc-daemon[1130]: time=2026-09-20T12:48:48.127Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"4759worker2 # [ 83.617848] nix-grpc-daemon[1130]: time=2026-09-20T12:48:48.128Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"4760lb # [ 83.637869] niks3-server[1010]: 2026/09/20 12:48:48 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst4761worker2 # [ 83.692119] nix-grpc-daemon[1130]: time=2026-09-20T12:48:48.208Z level=INFO msg="Uploading 3 narinfos"4762lb # [ 83.657806] niks3-server[1010]: 2026/09/20 12:48:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4763lb # [ 83.670536] niks3-server[1010]: 2026/09/20 12:48:48 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls4764lb # [ 83.684473] niks3-server[1010]: 2026/09/20 12:48:48 INFO Signed narinfos id=25 count=14765lb # [ 83.686265] niks3-server[1010]: 2026/09/20 12:48:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4766lb # [ 83.704140] niks3-server[1010]: 2026/09/20 12:48:48 INFO Signed narinfos id=26 count=24767lb # [ 83.716082] niks3-server[1010]: 2026/09/20 12:48:48 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst4768lb # [ 83.726459] niks3-server[1010]: 2026/09/20 12:48:48 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls4769lb # [ 83.733737] niks3-server[1010]: 2026/09/20 12:48:48 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4770lb # [ 83.735828] niks3-server[1010]: 2026/09/20 12:48:48 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4771lb # [ 83.746273] niks3-server[1010]: 2026/09/20 12:48:48 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo4772lb # [ 83.750786] niks3-server[1010]: 2026/09/20 12:48:48 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4773lb # [ 83.753423] niks3-server[1010]: 2026/09/20 12:48:48 INFO Completed upload id=254774lb # [ 83.756465] niks3-server[1010]: 2026/09/20 12:48:48 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4775lb # [ 83.759175] niks3-server[1010]: 2026/09/20 12:48:48 INFO Completed upload id=264776worker2 # [ 83.784981] nix-grpc-daemon[1130]: time=2026-09-20T12:48:48.301Z level=INFO msg="Upload complete. (419ms)"4777worker2 # [ 83.797430] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48722 duration_s=0 paths=2 nar_bytes_in=3124778worker2 # [ 83.817549] nix-daemon[842]: reaped child process 1128, status = succeeded4779client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.95 seconds)4780worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache4781worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.04 seconds)4782worker1 # [ 83.919088] systemd[1]: Listening on Nix worker-protocol over gRPC.4783worker1 # [ 83.929656] systemd[1]: Starting Nix worker-protocol over gRPC...4784worker1 # [ 84.130554] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:48Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4785worker1 # [ 84.133132] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:48Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4786worker1 # [ 84.137237] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:48Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14787worker1 # [ 84.145681] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:48Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4788worker1 # [ 84.147483] systemd[1]: Started Nix worker-protocol over gRPC.4789lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4790lb: must succeed: curl -sf localhost:9901/clusters4791worker1 # [ 84.174326] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:48Z level=info event=scheduler_connected addr=lb:500514792worker2 # [ 84.231898] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:48Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:543184793worker2 # [ 84.237831] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:48Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04794lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)4795lb: must succeed: curl -sf localhost:9901/clusters4796lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4797lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.20 seconds)4798(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 11.44 seconds)4799subtest: scheduler down: the other node takes the lock and keeps it4800lb: must succeed: curl -sf localhost:9901/clusters4801lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4802lb: must succeed: curl -sf localhost:9901/clusters4803lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4804lb: must succeed: curl -sf localhost:9901/clusters4805lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4806lb: must succeed: curl -sf localhost:9901/clusters4807lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4808worker2 # [ 85.681692] systemd[1]: Stopping Nix worker-protocol over gRPC...4809worker2 # [ 86.350976] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:50Z level=info event=signal_exit4810worker2 # [ 86.559382] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:51Z level=info event=scheduler_yield4811lb # [ 86.537446] niks3-server[1010]: 2026/09/20 12:48:51 INFO lead: released remote=192.168.1.4:434804812worker1 # [ 86.512804] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:51Z level=info event=scheduler_restarting addr=lb:500514813worker2 # [ 86.570989] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:51Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:543184814worker2 # [ 86.578945] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:51Z level=info event=worker_gone addr=192.168.1.3:500514815worker2 # [ 86.583190] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:51Z level=info event=scheduler_restarting addr=lb:500514816worker2 # [ 86.587254] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:51Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:543184817worker2 # [ 86.591772] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:51Z level=info event=worker_gone addr=192.168.1.4:500514818worker1 # [ 86.712641] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:51Z level=info event=scheduler_connected addr=lb:500514819worker1 # [ 86.718011] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4820worker2 # [ 86.779401] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:51Z level=info event=scheduler_connected addr=lb:500514821worker2 # [ 86.784805] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4822worker1 # [ 86.918976] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:51Z level=info event=scheduler_connected addr=lb:500514823worker1 # [ 86.924578] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4824worker2 # [ 86.986062] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:51Z level=info event=scheduler_connected addr=lb:500514825worker2 # [ 86.991418] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4826worker1 # [ 87.125425] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:51Z level=info event=scheduler_connected addr=lb:500514827worker1 # [ 87.130805] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4828worker2 # [ 87.192626] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:51Z level=info event=scheduler_connected addr=lb:500514829worker2 # [ 87.197708] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4830worker1 # [ 87.331872] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:51Z level=info event=scheduler_connected addr=lb:500514831worker1 # [ 87.337411] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4832worker2 # [ 87.400737] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:51Z level=info event=scheduler_connected addr=lb:500514833worker2 # [ 87.404910] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4834worker2 # [ 87.565380] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:52Z level=info event=scheduler_restarting4835worker1 # [ 87.539934] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:52Z level=info event=scheduler_connected addr=lb:500514836worker2 # [ 87.596527] nix-daemon[842]: reaped child process 1123, status = succeeded4837worker1 # [ 87.544222] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4838worker2 # [ 87.617539] nix-grpc-daemon[1074]: ts=2026-09-20T12:48:52Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4839worker1 # [ 87.740509] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:52Z level=info event=scheduler_connected addr=lb:500514840worker1 # [ 87.745688] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4841worker1 # [ 87.946595] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:52Z level=info event=scheduler_connected addr=lb:500514842worker1 # [ 87.951896] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4843worker1 # [ 88.152848] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:52Z level=info event=scheduler_connected addr=lb:500514844worker1 # [ 88.158033] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4845worker2 # [ 88.411738] nix-grpc-daemon[1074]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4846worker1 # [ 88.359105] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:52Z level=info event=scheduler_connected addr=lb:500514847worker2 # [ 88.416275] nix-grpc-daemon[1074]: E0000 00:00:1789908532.927216 1117 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true4848worker1 # [ 88.364795] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4849worker2 # [ 88.422852] nix-grpc-daemon[1074]: E0000 00:00:1789908532.927513 1117 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4850worker1 # [ 88.567894] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:53Z level=info event=scheduler_connected addr=lb:500514851worker1 # [ 88.572436] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4852worker1 # [ 88.768367] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:53Z level=info event=scheduler_connected addr=lb:500514853worker1 # [ 88.773621] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4854worker1 # [ 88.974435] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:53Z level=info event=scheduler_connected addr=lb:500514855worker1 # [ 88.979734] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4856worker1 # [ 89.157307] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:53Z level=info event=scheduler_take_over4857lb # [ 89.186406] niks3-server[1010]: 2026/09/20 12:48:53 INFO lead: acquired remote=192.168.1.3:380264858worker1 # [ 89.180614] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:53Z level=info event=scheduler_connected addr=lb:500514859worker1 # [ 89.185772] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4860worker2 # [ 89.388728] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4861worker2 # [ 89.391832] systemd[1]: Stopped Nix worker-protocol over gRPC.4862worker2 # [ 89.399031] systemd[1]: nix-grpc-daemon.service: Consumed 498ms CPU time over 10.262s wall clock time, 31.1M memory peak, 19.6K incoming IP traffic, 26K outgoing IP traffic.4863worker2 # [ 89.410179] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4864worker2 # [ 89.415729] systemd[1]: Closed Nix worker-protocol over gRPC.4865worker2 # [ 89.418115] systemd[1]: nix-grpc-daemon.socket: Consumed 1ms CPU time over 11.055s wall clock time, 256K memory peak, 21K incoming IP traffic, 15.7K outgoing IP traffic.4866worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over4867worker1 # [ 89.387120] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:53Z level=info event=scheduler_connected addr=lb:500514868worker1 # [ 89.395904] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4869worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.09 seconds)4870worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4871worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)4872worker1 # [ 89.596516] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:54Z level=info event=scheduler_connected addr=lb:500514873worker1 # [ 89.600649] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4874worker1 # [ 89.797246] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:54Z level=info event=scheduler_connected addr=lb:500514875worker1 # [ 89.806436] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:54Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:567424876worker1 # [ 89.812233] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:54Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04877worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4878worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)4879client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&24880worker1 # [ 90.862174] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:344444881worker1 # [ 90.876191] nix-daemon[833]: accepted connection from pid 1202, user nix-grpc-daemon (trusted)4882client # don't know how to build these paths:4883client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4884worker1 # [ 90.898847] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:344444885worker1 # [ 90.917210] nix-grpc-daemon[1202]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 88 ms (attempt 1/5)4886worker1 # [ 91.012840] nix-grpc-daemon[1202]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 99 ms (attempt 2/5)4887worker1 # [ 91.119711] nix-grpc-daemon[1202]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 366 ms (attempt 3/5)4888worker1 # [ 91.486093] nix-grpc-daemon[1202]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 331 ms (attempt 4/5)4889worker1 # [ 91.825918] nix-grpc-daemon[1202]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4890worker1 # [ 91.866333] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:56Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=04891worker1 # [ 91.871893] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:56Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=14892worker1 # [ 91.908568] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:344444893worker1 # [ 91.925491] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:344444894client # copying 1 paths to 'lb:50051'...4895client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...4896worker1 # [ 91.940911] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:344444897worker1 # [ 91.958406] nix-daemon[833]: accepted connection from pid 1202, user nix-grpc-daemon (trusted)4898worker1 # [ 91.987550] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:56Z level=info event=niks3_push_started pid=12724899worker1 # [ 92.208156] nix-grpc-daemon[1272]: time=2026-09-20T12:48:56.702Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca=""4900lb # [ 92.351631] envoy[927]: conn peer=[2001:db8:1::1]:40734 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1007 tx=304 ms=16464901lb # [ 92.356794] envoy[927]: conn peer=[2001:db8:1::4]:51766 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=4158 tx=326 ms=82374902worker1 # [ 92.387229] nix-daemon[833]: accepted connection from pid 1285, user nix-grpc-daemon (trusted)4903worker1 # [ 92.405472] nix-daemon[833]: reaped child process 1288, status = succeeded4904worker1 # [ 92.584579] nix-daemon[833]: accepted connection from pid 1290, user nix-grpc-daemon (trusted)4905worker1 # [ 92.602061] nix-daemon[833]: reaped child process 1293, status = succeeded4906lb # [ 92.645800] niks3-server[1010]: 2026/09/20 12:48:57 INFO Received uploads request method=POST path=/api/pending_closures4907worker1 # [ 92.630221] nix-grpc-daemon[1272]: time=2026-09-20T12:48:57.123Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4908worker1 # [ 92.631814] nix-grpc-daemon[1272]: time=2026-09-20T12:48:57.123Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"4909lb # [ 92.692194] niks3-server[1010]: 2026/09/20 12:48:57 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst4910worker1 # [ 92.673353] nix-grpc-daemon[1272]: time=2026-09-20T12:48:57.167Z level=INFO msg="Uploading 1 narinfos"4911lb # [ 92.704820] niks3-server[1010]: 2026/09/20 12:48:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign4912lb # [ 92.715257] niks3-server[1010]: 2026/09/20 12:48:57 INFO Signed narinfos id=27 count=14913lb # [ 92.720352] niks3-server[1010]: 2026/09/20 12:48:57 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls4914lb # [ 92.729683] niks3-server[1010]: 2026/09/20 12:48:57 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete4915worker1 # [ 92.705645] nix-grpc-daemon[1272]: time=2026-09-20T12:48:57.200Z level=INFO msg="Upload complete. (493ms)"4916lb # [ 92.734303] niks3-server[1010]: 2026/09/20 12:48:57 INFO Completed upload id=274917lb # [ 92.737986] niks3-server[1010]: 2026/09/20 12:48:57 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo4918worker1 # [ 92.717659] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34444 duration_s=0 paths=1 nar_bytes_in=5204919worker1 # [ 92.730951] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:344444920worker1 # [ 92.737400] nix-daemon[833]: accepted connection from pid 1202, user nix-grpc-daemon (trusted)4921worker1 # [ 92.742441] nix-daemon[833]: reaped child process 1270, status = succeeded4922client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...4923worker1 # [ 92.753857] nix-daemon[833]: accepted connection from pid 1202, user nix-grpc-daemon (trusted)4924client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4925client # farm-a> LOG-farm-a-on-standby4926worker1 # [ 93.804002] nix-daemon[833]: reaped child process 1297, status = succeeded4927worker1 # [ 93.979669] nix-daemon[833]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)4928worker1 # [ 93.997401] nix-daemon[833]: reaped child process 1315, status = succeeded4929lb # [ 94.041956] niks3-server[1010]: 2026/09/20 12:48:58 INFO Received uploads request method=POST path=/api/pending_closures4930worker1 # [ 94.024429] nix-grpc-daemon[1272]: time=2026-09-20T12:48:58.517Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4931worker1 # [ 94.025921] nix-grpc-daemon[1272]: time=2026-09-20T12:48:58.518Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"4932lb # [ 94.087115] niks3-server[1010]: 2026/09/20 12:48:58 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4933lb # [ 94.101010] niks3-server[1010]: 2026/09/20 12:48:58 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst4934lb # [ 94.110216] niks3-server[1010]: 2026/09/20 12:48:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign4935lb # [ 94.116635] niks3-server[1010]: 2026/09/20 12:48:58 INFO Signed narinfos id=28 count=14936worker1 # [ 94.089511] nix-grpc-daemon[1272]: time=2026-09-20T12:48:58.583Z level=INFO msg="Uploading 1 narinfos"4937lb # [ 94.120251] niks3-server[1010]: 2026/09/20 12:48:58 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls4938lb # [ 94.131206] niks3-server[1010]: 2026/09/20 12:48:58 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete4939lb # [ 94.142109] niks3-server[1010]: 2026/09/20 12:48:58 INFO Completed upload id=284940worker1 # [ 94.114086] nix-grpc-daemon[1272]: time=2026-09-20T12:48:58.609Z level=INFO msg="Upload complete. (347ms)"4941lb # [ 94.146408] niks3-server[1010]: 2026/09/20 12:48:58 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo4942worker1 # [ 94.138624] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34444 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=14943worker1 # [ 94.154990] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:58Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=04944worker1 # [ 94.159668] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:58Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=14945worker1 # [ 94.164349] nix-daemon[833]: reaped child process 1295, status = succeeded4946worker1 # [ 94.184820] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:344444947worker1 # [ 94.201219] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:344444948worker1 # [ 94.217226] nix-grpc-daemon[1272]: time=2026-09-20T12:48:58.712Z level=INFO msg="All 1 paths already cached"4949client # copying 1 paths to 'lb:50051'...4950client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...4951worker1 # [ 94.227930] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:344444952worker1 # [ 94.244888] nix-daemon[833]: accepted connection from pid 1202, user nix-grpc-daemon (trusted)4953worker1 # [ 94.455430] nix-daemon[833]: accepted connection from pid 1321, user nix-grpc-daemon (trusted)4954worker1 # [ 94.476719] nix-daemon[833]: reaped child process 1324, status = succeeded4955worker1 # [ 94.652188] nix-daemon[833]: accepted connection from pid 1326, user nix-grpc-daemon (trusted)4956worker1 # [ 94.672881] nix-daemon[833]: reaped child process 1329, status = succeeded4957lb # [ 94.712215] niks3-server[1010]: 2026/09/20 12:48:59 INFO Received uploads request method=POST path=/api/pending_closures4958worker1 # [ 94.696063] nix-grpc-daemon[1272]: time=2026-09-20T12:48:59.191Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4959worker1 # [ 94.698293] nix-grpc-daemon[1272]: time=2026-09-20T12:48:59.192Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"4960lb # [ 94.747999] niks3-server[1010]: 2026/09/20 12:48:59 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst4961worker1 # [ 94.737033] nix-grpc-daemon[1272]: time=2026-09-20T12:48:59.231Z level=INFO msg="Uploading 1 narinfos"4962lb # [ 94.766216] niks3-server[1010]: 2026/09/20 12:48:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign4963lb # [ 94.777577] niks3-server[1010]: 2026/09/20 12:48:59 INFO Signed narinfos id=29 count=14964lb # [ 94.784868] niks3-server[1010]: 2026/09/20 12:48:59 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls4965worker1 # [ 94.771189] nix-grpc-daemon[1272]: time=2026-09-20T12:48:59.266Z level=INFO msg="Upload complete. (509ms)"4966lb # [ 94.800268] niks3-server[1010]: 2026/09/20 12:48:59 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete4967lb # [ 94.804129] niks3-server[1010]: 2026/09/20 12:48:59 INFO Completed upload id=294968lb # [ 94.808253] niks3-server[1010]: 2026/09/20 12:48:59 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo4969worker1 # [ 94.780770] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34444 duration_s=0 paths=1 nar_bytes_in=6404970worker1 # [ 94.795682] nix-grpc-daemon[1202]: ts=2026-09-20T12:48:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:344444971worker1 # [ 94.802431] nix-daemon[833]: accepted connection from pid 1202, user nix-grpc-daemon (trusted)4972worker1 # [ 94.807331] nix-daemon[833]: reaped child process 1319, status = succeeded4973client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...4974worker1 # [ 94.819061] nix-daemon[833]: accepted connection from pid 1202, user nix-grpc-daemon (trusted)4975client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv4976client # farm-b> LOG-farm-b-on-standby4977worker1 # [ 95.664896] nix-daemon[833]: reaped child process 1333, status = succeeded4978worker1 # [ 95.851004] nix-daemon[833]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)4979worker1 # [ 95.871352] nix-daemon[833]: reaped child process 1351, status = succeeded4980lb # [ 95.912723] niks3-server[1010]: 2026/09/20 12:49:00 INFO Received uploads request method=POST path=/api/pending_closures4981worker1 # [ 95.895610] nix-grpc-daemon[1272]: time=2026-09-20T12:49:00.389Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4982worker1 # [ 95.897340] nix-grpc-daemon[1272]: time=2026-09-20T12:49:00.389Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"4983lb # [ 95.947922] niks3-server[1010]: 2026/09/20 12:49:00 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv4984lb # [ 95.960066] niks3-server[1010]: 2026/09/20 12:49:00 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst4985lb # [ 95.971949] niks3-server[1010]: 2026/09/20 12:49:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign4986worker1 # [ 95.949598] nix-grpc-daemon[1272]: time=2026-09-20T12:49:00.444Z level=INFO msg="Uploading 1 narinfos"4987lb # [ 95.981194] niks3-server[1010]: 2026/09/20 12:49:00 INFO Signed narinfos id=30 count=14988lb # [ 95.983696] niks3-server[1010]: 2026/09/20 12:49:00 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls4989lb # [ 95.992852] niks3-server[1010]: 2026/09/20 12:49:00 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete4990worker1 # [ 95.972576] nix-grpc-daemon[1272]: time=2026-09-20T12:49:00.467Z level=INFO msg="Upload complete. (340ms)"4991lb # [ 96.002261] niks3-server[1010]: 2026/09/20 12:49:00 INFO Completed upload id=304992lb # [ 96.005351] niks3-server[1010]: 2026/09/20 12:49:00 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo4993worker1 # [ 95.990897] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34444 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=14994worker1 # [ 96.004420] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:00Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=04995worker1 # [ 96.010719] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:00Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=14996worker1 # [ 96.014749] nix-daemon[833]: reaped child process 1331, status = succeeded4997worker1 # [ 96.035808] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:344444998worker1 # [ 96.049097] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:344444999worker1 # [ 96.062457] nix-grpc-daemon[1272]: time=2026-09-20T12:49:00.557Z level=INFO msg="All 2 paths already cached"5000client # copying 1 paths to 'lb:50051'...5001client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...5002worker1 # [ 96.073023] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:344445003worker1 # [ 96.088193] nix-daemon[833]: accepted connection from pid 1202, user nix-grpc-daemon (trusted)5004worker1 # [ 96.292317] nix-daemon[833]: accepted connection from pid 1357, user nix-grpc-daemon (trusted)5005worker1 # [ 96.313903] nix-daemon[833]: reaped child process 1360, status = succeeded5006worker1 # [ 96.492306] nix-daemon[833]: accepted connection from pid 1362, user nix-grpc-daemon (trusted)5007worker1 # [ 96.510604] nix-daemon[833]: reaped child process 1365, status = succeeded5008lb # [ 96.551745] niks3-server[1010]: 2026/09/20 12:49:01 INFO Received uploads request method=POST path=/api/pending_closures5009worker1 # [ 96.534063] nix-grpc-daemon[1272]: time=2026-09-20T12:49:01.028Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5010worker1 # [ 96.535682] nix-grpc-daemon[1272]: time=2026-09-20T12:49:01.028Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"5011lb # [ 96.581378] niks3-server[1010]: 2026/09/20 12:49:01 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst5012lb # [ 96.598037] niks3-server[1010]: 2026/09/20 12:49:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5013worker1 # [ 96.576342] nix-grpc-daemon[1272]: time=2026-09-20T12:49:01.070Z level=INFO msg="Uploading 1 narinfos"5014lb # [ 96.611377] niks3-server[1010]: 2026/09/20 12:49:01 INFO Signed narinfos id=31 count=15015lb # [ 96.618635] niks3-server[1010]: 2026/09/20 12:49:01 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls5016lb # [ 96.627184] niks3-server[1010]: 2026/09/20 12:49:01 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5017lb # [ 96.634856] niks3-server[1010]: 2026/09/20 12:49:01 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo5018lb # [ 96.641072] niks3-server[1010]: 2026/09/20 12:49:01 INFO Completed upload id=315019worker1 # [ 96.612990] nix-grpc-daemon[1272]: time=2026-09-20T12:49:01.107Z level=INFO msg="Upload complete. (509ms)"5020worker1 # [ 96.621863] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34444 duration_s=0 paths=1 nar_bytes_in=7685021worker1 # [ 96.632885] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:344445022worker1 # [ 96.645800] nix-daemon[833]: accepted connection from pid 1202, user nix-grpc-daemon (trusted)5023worker1 # [ 96.650969] nix-daemon[833]: reaped child process 1355, status = succeeded5024client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...5025client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5026worker1 # [ 96.665645] nix-daemon[833]: accepted connection from pid 1202, user nix-grpc-daemon (trusted)5027client # farm-top> LOG-farm-top-on-standby5028worker1 # [ 98.093736] nix-daemon[833]: reaped child process 1369, status = succeeded5029worker1 # [ 98.259463] nix-daemon[833]: accepted connection from pid 1384, user nix-grpc-daemon (trusted)5030worker1 # [ 98.277601] nix-daemon[833]: reaped child process 1387, status = succeeded5031lb # [ 98.320844] niks3-server[1010]: 2026/09/20 12:49:02 INFO Received uploads request method=POST path=/api/pending_closures5032worker1 # [ 98.310447] nix-grpc-daemon[1272]: time=2026-09-20T12:49:02.803Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5033worker1 # [ 98.312169] nix-grpc-daemon[1272]: time=2026-09-20T12:49:02.803Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"5034lb # [ 98.364100] niks3-server[1010]: 2026/09/20 12:49:02 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5035lb # [ 98.373690] niks3-server[1010]: 2026/09/20 12:49:02 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst5036worker1 # [ 98.355221] nix-grpc-daemon[1272]: time=2026-09-20T12:49:02.849Z level=INFO msg="Uploading 1 narinfos"5037lb # [ 98.385257] niks3-server[1010]: 2026/09/20 12:49:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5038lb # [ 98.391587] niks3-server[1010]: 2026/09/20 12:49:02 INFO Signed narinfos id=32 count=15039lb # [ 98.399051] niks3-server[1010]: 2026/09/20 12:49:02 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5040lb # [ 98.403346] niks3-server[1010]: 2026/09/20 12:49:02 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls5041lb # [ 98.406983] niks3-server[1010]: 2026/09/20 12:49:02 INFO Completed upload id=325042worker1 # [ 98.377940] nix-grpc-daemon[1272]: time=2026-09-20T12:49:02.872Z level=INFO msg="Upload complete. (302ms)"5043lb # [ 98.409186] niks3-server[1010]: 2026/09/20 12:49:02 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo5044worker1 # [ 98.388942] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34444 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=15045worker1 # [ 98.403855] nix-daemon[833]: reaped child process 1367, status = succeeded5046client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 7.85 seconds)5047client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath5048client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.24 seconds)5049worker2 # [ 98.821108] systemd[1]: Listening on Nix worker-protocol over gRPC.5050worker2 # [ 98.828511] systemd[1]: Starting scheduler-token.service...5051worker2 # [ 98.927279] systemd[1]: scheduler-token.service: Deactivated successfully.5052worker2 # [ 98.933100] systemd[1]: Finished scheduler-token.service.5053worker2 # [ 98.934438] systemd[1]: scheduler-token.service: Consumed 40ms CPU time over 100ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5054worker2 # [ 98.942637] systemd[1]: Starting Nix worker-protocol over gRPC...5055worker2 # [ 99.127354] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:03Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5056worker2 # [ 99.130097] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:03Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5057worker2 # [ 99.134155] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:03Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15058worker2 # [ 99.142007] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:03Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5059worker2 # [ 99.149783] systemd[1]: Started Nix worker-protocol over gRPC.5060lb: must succeed: curl -sf localhost:9901/clusters5061worker2 # [ 99.166602] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:03Z level=info event=scheduler_connected addr=lb:500515062worker1 # [ 99.123442] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:03Z level=info event=oidc_jwks provider=mock keys=15063worker1 # [ 99.127954] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:03Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:567425064worker1 # [ 99.133235] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:03Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05065lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5066worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5067worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5068lb: must succeed: curl -sf localhost:9901/clusters5069lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5070lb: must succeed: curl -sf localhost:9901/clusters5071lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5072worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5073worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5074(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 14.12 seconds)5075subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5076client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs5077client # [ 99.659171] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.5078client # Running as unit: rs.service; invocation ID: 618bd50bb296471784e5617fa7d3f2e85079client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.10 seconds)5080client # [ 99.896614] nix[1156]: don't know how to build these paths:5081client # [ 99.897744] nix[1156]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5082worker1 # [ 99.784271] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:04Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:344445083worker1 # [ 99.798717] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:04Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=05084worker1 # [ 99.805861] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:04Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=15085worker1 # [ 99.843513] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:344445086worker1 # [ 99.860704] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:344445087client # [ 99.988171] nix[1156]: copying 1 paths to 'lb:50051'...5088worker1 # [ 99.876390] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:344445089client # [ 99.990733] nix[1156]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...5090worker1 # [ 99.891479] nix-daemon[833]: accepted connection from pid 1202, user nix-grpc-daemon (trusted)5091worker1 # [ 100.094809] nix-daemon[833]: accepted connection from pid 1400, user nix-grpc-daemon (trusted)5092worker1 # [ 100.115321] nix-daemon[833]: reaped child process 1403, status = succeeded5093worker1 # [ 100.288928] nix-daemon[833]: accepted connection from pid 1405, user nix-grpc-daemon (trusted)5094worker1 # [ 100.308703] nix-daemon[833]: reaped child process 1408, status = succeeded5095lb # [ 100.349066] niks3-server[1010]: 2026/09/20 12:49:04 INFO Received uploads request method=POST path=/api/pending_closures5096worker1 # [ 100.333307] nix-grpc-daemon[1272]: time=2026-09-20T12:49:04.827Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5097worker1 # [ 100.334836] nix-grpc-daemon[1272]: time=2026-09-20T12:49:04.827Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"5098lb # [ 100.387537] niks3-server[1010]: 2026/09/20 12:49:04 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst5099worker1 # [ 100.372841] nix-grpc-daemon[1272]: time=2026-09-20T12:49:04.867Z level=INFO msg="Uploading 1 narinfos"5100lb # [ 100.404427] niks3-server[1010]: 2026/09/20 12:49:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5101lb # [ 100.414317] niks3-server[1010]: 2026/09/20 12:49:04 INFO Signed narinfos id=33 count=15102worker1 # [ 100.396704] nix-grpc-daemon[1272]: time=2026-09-20T12:49:04.891Z level=INFO msg="Upload complete. (487ms)"5103lb # [ 100.425036] niks3-server[1010]: 2026/09/20 12:49:04 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls5104lb # [ 100.428662] niks3-server[1010]: 2026/09/20 12:49:04 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5105lb # [ 100.432466] niks3-server[1010]: 2026/09/20 12:49:04 INFO Completed upload id=335106worker1 # [ 100.404162] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34444 duration_s=0 paths=1 nar_bytes_in=4165107lb # [ 100.435264] niks3-server[1010]: 2026/09/20 12:49:04 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5108worker1 # [ 100.418532] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:344445109worker1 # [ 100.424932] nix-daemon[833]: accepted connection from pid 1202, user nix-grpc-daemon (trusted)5110worker1 # [ 100.429915] nix-daemon[833]: reaped child process 1398, status = succeeded5111client # [ 100.552235] nix[1156]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5112worker1 # [ 100.444261] nix-daemon[833]: accepted connection from pid 1202, user nix-grpc-daemon (trusted)5113lb: must succeed: curl -sf localhost:9901/clusters5114lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5115lb: must succeed: curl -sf localhost:9901/clusters5116lb # [ 102.353094] envoy[927]: conn peer=[2001:db8:1::1]:59006 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9623 tx=3913 ms=75495117lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5118lb: must succeed: curl -sf localhost:9901/clusters5119lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5120lb: must succeed: curl -sf localhost:9901/clusters5121lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5122worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5123worker2 # [ 102.567924] systemd-journald[272]: Received client request to rotate journal, rotating.5124worker2 # [ 102.585160] systemd-journald[272]: Vacuuming done, freed 0B of archived journals from /var/log/journal/b9b72e94f8584083854b77c7e4207a76.5125worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.06 seconds)5126worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5127worker1 # [ 102.574421] systemd[1]: Stopping Nix worker-protocol over gRPC...5128worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds)5129??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5130 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735131client: must succeed: sleep 5.05132worker1 # [ 103.161364] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:07Z level=info event=draining5133client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5134worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5135worker1 # [ 108.099999] nix-daemon[833]: reaped child process 1412, status = succeeded5136worker1 # [ 108.283109] nix-daemon[833]: accepted connection from pid 1452, user nix-grpc-daemon (trusted)5137worker1 # [ 108.300322] nix-daemon[833]: reaped child process 1455, status = succeeded5138worker1 # [ 108.328476] nix-grpc-daemon[1272]: time=2026-09-20T12:49:12.820Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5139worker1 # [ 108.330110] nix-grpc-daemon[1272]: time=2026-09-20T12:49:12.820Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5140lb # [ 108.343906] niks3-server[1010]: 2026/09/20 12:49:12 INFO Received uploads request method=POST path=/api/pending_closures5141lb # [ 108.381309] niks3-server[1010]: 2026/09/20 12:49:12 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5142lb # [ 108.399398] niks3-server[1010]: 2026/09/20 12:49:12 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5143lb # [ 108.409433] niks3-server[1010]: 2026/09/20 12:49:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5144worker1 # [ 108.387270] nix-grpc-daemon[1272]: time=2026-09-20T12:49:12.881Z level=INFO msg="Uploading 1 narinfos"5145lb # [ 108.418339] niks3-server[1010]: 2026/09/20 12:49:12 INFO Signed narinfos id=34 count=15146lb # [ 108.423688] niks3-server[1010]: 2026/09/20 12:49:12 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5147lb # [ 108.431450] niks3-server[1010]: 2026/09/20 12:49:12 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5148lb # [ 108.437862] niks3-server[1010]: 2026/09/20 12:49:12 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5149lb # [ 108.443196] niks3-server[1010]: 2026/09/20 12:49:12 INFO Completed upload id=345150worker1 # [ 108.415070] nix-grpc-daemon[1272]: time=2026-09-20T12:49:12.910Z level=INFO msg="Upload complete. (353ms)"5151worker1 # [ 108.429279] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34444 duration_s=8 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15152worker1 # [ 108.446311] nix-daemon[833]: reaped child process 1410, status = succeeded5153client # [ 108.579170] systemd[1]: rs.service: Deactivated successfully.5154client # [ 108.583648] systemd[1]: rs.service: Consumed 155ms CPU time over 8.923s wall clock time, 37M memory peak, 8.4K incoming IP traffic, 9K outgoing IP traffic.5155worker1 # [ 109.162441] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:13Z level=info event=signal_exit5156worker1 # [ 109.182942] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:13Z level=info event=scheduler_yield5157lb # [ 109.216303] niks3-server[1010]: 2026/09/20 12:49:13 INFO lead: released remote=192.168.1.3:380265158worker2 # [ 109.241158] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:13Z level=info event=scheduler_restarting addr=lb:500515159worker1 # [ 109.188441] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:13Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:567425160worker1 # [ 109.194668] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:13Z level=info event=worker_gone addr=192.168.1.4:500515161worker1 # [ 109.199914] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:13Z level=info event=scheduler_restarting addr=lb:500515162worker1 # [ 109.204162] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:13Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:567425163worker1 # [ 109.208752] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:13Z level=info event=worker_gone addr=192.168.1.3:500515164worker2 # [ 109.441062] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:13Z level=info event=scheduler_connected addr=lb:500515165worker2 # [ 109.446509] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:13Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5166worker1 # [ 109.395381] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:13Z level=info event=scheduler_connected addr=lb:500515167worker1 # [ 109.402345] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:13Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5168worker2 # [ 109.647563] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:14Z level=info event=scheduler_connected addr=lb:500515169worker2 # [ 109.653045] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:14Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5170worker1 # [ 109.606110] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:14Z level=info event=scheduler_connected addr=lb:500515171worker1 # [ 109.610389] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:14Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5172worker2 # [ 109.854288] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:14Z level=info event=scheduler_connected addr=lb:500515173worker2 # [ 109.859433] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5174worker1 # [ 109.806773] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:14Z level=info event=scheduler_connected addr=lb:500515175worker1 # [ 109.812163] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5176worker2 # [ 110.060626] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:14Z level=info event=scheduler_connected addr=lb:500515177worker2 # [ 110.065690] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5178worker1 # [ 110.012945] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:14Z level=info event=scheduler_connected addr=lb:500515179worker1 # [ 110.018158] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5180worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.20 seconds)5181client: waiting for success: ! systemctl is-active rs5182worker1 # [ 110.189020] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:14Z level=info event=scheduler_restarting5183worker2 # [ 110.268736] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:14Z level=info event=scheduler_connected addr=lb:500515184worker2 # [ 110.272875] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5185client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds)5186client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5187worker1 # [ 110.242188] nix-daemon[833]: reaped child process 1263, status = succeeded5188worker1 # [ 110.245078] nix-grpc-daemon[1202]: ts=2026-09-20T12:49:14Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5189client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.06 seconds)5190client: must fail: journalctl -u rs | grep -q 'reconnecting'5191client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.04 seconds)5192lb: must succeed: curl -sf localhost:9901/clusters5193worker2 # [ 110.469744] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:14Z level=info event=scheduler_connected addr=lb:500515194worker2 # [ 110.475131] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5195lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5196worker2 # [ 110.676275] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:15Z level=info event=scheduler_connected addr=lb:500515197worker2 # [ 110.681510] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5198worker1 # [ 110.756236] nix-grpc-daemon[1202]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5199worker1 # [ 110.760963] nix-grpc-daemon[1202]: E0000 00:00:1789908555.249723 1245 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5200worker1 # [ 110.767518] nix-grpc-daemon[1202]: E0000 00:00:1789908555.249995 1245 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5201worker2 # [ 110.882673] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:15Z level=info event=scheduler_connected addr=lb:500515202worker2 # [ 110.887923] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5203worker2 # [ 111.089104] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:15Z level=info event=scheduler_connected addr=lb:500515204worker2 # [ 111.094250] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5205worker2 # [ 111.296944] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:15Z level=info event=scheduler_connected addr=lb:500515206worker2 # [ 111.301597] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5207worker1 # [ 111.310663] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5208worker1 # [ 111.316939] systemd[1]: Stopped Nix worker-protocol over gRPC.5209worker1 # [ 111.319501] systemd[1]: nix-grpc-daemon.service: Consumed 1.860s CPU time over 27.378s wall clock time, 34.5M memory peak, 48.8K incoming IP traffic, 88.1K outgoing IP traffic.5210worker1 # [ 111.337847] systemd[1]: Starting Nix worker-protocol over gRPC...5211lb: must succeed: curl -sf localhost:9901/clusters5212worker2 # [ 111.502628] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:16Z level=info event=scheduler_connected addr=lb:500515213worker2 # [ 111.507936] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5214lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5215worker1 # [ 111.532425] nix-grpc-daemon[1462]: ts=2026-09-20T12:49:16Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5216worker1 # [ 111.535005] nix-grpc-daemon[1462]: ts=2026-09-20T12:49:16Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5217worker1 # [ 111.539010] nix-grpc-daemon[1462]: ts=2026-09-20T12:49:16Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15218worker1 # [ 111.546820] nix-grpc-daemon[1462]: ts=2026-09-20T12:49:16Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5219worker1 # [ 111.550749] systemd[1]: Started Nix worker-protocol over gRPC.5220worker1 # [ 111.556486] nix-grpc-daemon[1462]: ts=2026-09-20T12:49:16Z level=info event=scheduler_take_over5221lb # [ 111.585985] niks3-server[1010]: 2026/09/20 12:49:16 INFO lead: acquired remote=192.168.1.3:419685222worker1 # [ 111.571007] nix-grpc-daemon[1462]: ts=2026-09-20T12:49:16Z level=info event=scheduler_connected addr=lb:500515223worker1 # [ 111.572913] nix-grpc-daemon[1462]: ts=2026-09-20T12:49:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5224worker2 # [ 111.709458] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:16Z level=info event=scheduler_connected addr=lb:500515225worker2 # [ 111.714803] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5226worker1 # [ 111.773983] nix-grpc-daemon[1462]: ts=2026-09-20T12:49:16Z level=info event=scheduler_connected addr=lb:500515227worker1 # [ 111.779147] nix-grpc-daemon[1462]: ts=2026-09-20T12:49:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5228worker2 # [ 111.916046] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:16Z level=info event=scheduler_connected addr=lb:500515229worker2 # [ 111.921281] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5230worker1 # [ 111.979980] nix-grpc-daemon[1462]: ts=2026-09-20T12:49:16Z level=info event=scheduler_connected addr=lb:500515231worker1 # [ 111.985106] nix-grpc-daemon[1462]: ts=2026-09-20T12:49:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5232worker2 # [ 112.122332] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:16Z level=info event=scheduler_connected addr=lb:500515233worker2 # [ 112.127608] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5234worker1 # [ 112.185817] nix-grpc-daemon[1462]: ts=2026-09-20T12:49:16Z level=info event=scheduler_connected addr=lb:500515235worker1 # [ 112.191011] nix-grpc-daemon[1462]: ts=2026-09-20T12:49:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5236worker2 # [ 112.330729] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:16Z level=info event=scheduler_connected addr=lb:500515237worker2 # [ 112.334990] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5238lb # [ 112.357307] envoy[927]: conn peer=[2001:db8:1::1]:59012 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2953 tx=1325 ms=86555239lb # [ 112.362319] envoy[927]: conn peer=[2001:db8:1::3]:60558 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=4025 tx=1293 ms=260625240worker1 # [ 112.391869] nix-grpc-daemon[1462]: ts=2026-09-20T12:49:16Z level=info event=scheduler_connected addr=lb:500515241worker1 # [ 112.400420] nix-grpc-daemon[1462]: ts=2026-09-20T12:49:16Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:540865242worker1 # [ 112.405869] nix-grpc-daemon[1462]: ts=2026-09-20T12:49:16Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05243worker2 # [ 112.531514] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:17Z level=info event=scheduler_connected addr=lb:500515244worker1 # [ 112.487654] nix-grpc-daemon[1462]: ts=2026-09-20T12:49:16Z level=info event=oidc_jwks provider=mock keys=15245worker1 # [ 112.492208] nix-grpc-daemon[1462]: ts=2026-09-20T12:49:16Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:540865246worker1 # [ 112.497462] nix-grpc-daemon[1462]: ts=2026-09-20T12:49:16Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05247lb: must succeed: curl -sf localhost:9901/clusters5248lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5249worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5250worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5251(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.20 seconds)5252subtest: scheduler restart mid-build: build finishes, no double build5253client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5254client # [ 112.858295] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5255client # Running as unit: mid.service; invocation ID: ef35b0f0df5f48df9c900d59f40b1c265256client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.10 seconds)5257worker2 # [ 113.063312] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:391805258worker2 # [ 113.077873] nix-daemon[842]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5259client # [ 113.154174] nix[1191]: don't know how to build these paths:5260client # [ 113.155723] nix[1191]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5261worker1 # [ 113.057368] nix-grpc-daemon[1462]: ts=2026-09-20T12:49:17Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05262worker1 # [ 113.063798] nix-grpc-daemon[1462]: ts=2026-09-20T12:49:17Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=15263worker1 # [ 113.124140] nix-grpc-daemon[1462]: ts=2026-09-20T12:49:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540925264worker1 # [ 113.138611] nix-daemon[833]: accepted connection from pid 1462, user nix-grpc-daemon (trusted)5265worker1 # [ 113.161431] nix-grpc-daemon[1462]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 99 ms (attempt 1/5)5266worker1 # [ 113.266893] nix-grpc-daemon[1462]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 92 ms (attempt 2/5)5267worker1 # [ 113.366662] nix-grpc-daemon[1462]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 266 ms (attempt 3/5)5268worker1 # [ 113.640628] nix-grpc-daemon[1462]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 95 ms (attempt 4/5)5269worker1 # [ 113.743586] nix-grpc-daemon[1462]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5270worker1 # [ 113.764785] nix-grpc-daemon[1462]: ts=2026-09-20T12:49:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:540925271client # [ 113.892182] nix[1191]: copying 1 paths to 'lb:50051'...5272worker1 # [ 113.780644] nix-grpc-daemon[1462]: ts=2026-09-20T12:49:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:540925273client # [ 113.892511] nix[1191]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5274worker1 # [ 113.798179] nix-daemon[833]: accepted connection from pid 1462, user nix-grpc-daemon (trusted)5275worker1 # [ 113.827234] nix-grpc-daemon[1462]: ts=2026-09-20T12:49:18Z level=info event=niks3_push_started pid=15275276worker1 # [ 114.050048] nix-grpc-daemon[1527]: time=2026-09-20T12:49:18.544Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca=""5277worker1 # [ 114.222246] nix-daemon[833]: accepted connection from pid 1544, user nix-grpc-daemon (trusted)5278worker1 # [ 114.240336] nix-daemon[833]: reaped child process 1547, status = succeeded5279worker1 # [ 114.417627] nix-daemon[833]: accepted connection from pid 1549, user nix-grpc-daemon (trusted)5280worker1 # [ 114.433987] nix-daemon[833]: reaped child process 1552, status = succeeded5281lb # [ 114.479064] niks3-server[1010]: 2026/09/20 12:49:18 INFO Received uploads request method=POST path=/api/pending_closures5282worker1 # [ 114.463221] nix-grpc-daemon[1527]: time=2026-09-20T12:49:18.957Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5283worker1 # [ 114.465127] nix-grpc-daemon[1527]: time=2026-09-20T12:49:18.957Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5284lb # [ 114.523864] niks3-server[1010]: 2026/09/20 12:49:19 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5285worker1 # [ 114.510937] nix-grpc-daemon[1527]: time=2026-09-20T12:49:19.005Z level=INFO msg="Uploading 1 narinfos"5286lb # [ 114.538496] niks3-server[1010]: 2026/09/20 12:49:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5287lb # [ 114.549380] niks3-server[1010]: 2026/09/20 12:49:19 INFO Signed narinfos id=35 count=15288lb # [ 114.555886] niks3-server[1010]: 2026/09/20 12:49:19 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5289worker1 # [ 114.546573] nix-grpc-daemon[1527]: time=2026-09-20T12:49:19.041Z level=INFO msg="Upload complete. (492ms)"5290lb # [ 114.568792] niks3-server[1010]: 2026/09/20 12:49:19 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5291lb # [ 114.579543] niks3-server[1010]: 2026/09/20 12:49:19 INFO Completed upload id=355292worker1 # [ 114.557042] nix-grpc-daemon[1462]: ts=2026-09-20T12:49:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54092 duration_s=0 paths=1 nar_bytes_in=4245293worker1 # [ 114.574894] nix-grpc-daemon[1527]: time=2026-09-20T12:49:19.060Z level=WARN msg="Failed to register uploaded object" key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo error="server returned 404: object is not pending upload\n"5294worker1 # [ 114.591832] nix-grpc-daemon[1462]: ts=2026-09-20T12:49:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:540925295worker1 # [ 114.601797] nix-daemon[833]: accepted connection from pid 1462, user nix-grpc-daemon (trusted)5296client # [ 114.712864] nix[1191]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5297worker1 # [ 114.603894] nix-daemon[833]: reaped child process 1525, status = succeeded5298worker1 # [ 114.606669] nix-daemon[833]: accepted connection from pid 1462, user nix-grpc-daemon (trusted)5299lb: must succeed: curl -sf localhost:9901/clusters5300lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5301lb: must succeed: curl -sf localhost:9901/clusters5302lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5303worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5304worker1 # [ 116.731660] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1462 (nix-grpc-daemon) on client request.5305worker1 # [ 116.733684] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5306lb # [ 116.774083] niks3-server[1010]: 2026/09/20 12:49:21 INFO lead: released remote=192.168.1.3:419685307worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.08 seconds)5308client: must succeed: sleep 5.05309client # [ 116.872219] nix[1191]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5310worker2 # [ 116.814076] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:21Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5311worker1 # [ 116.777881] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5312worker1 # [ 116.779468] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5313worker1 # [ 116.786874] systemd[1]: nix-grpc-daemon.service: Consumed 516ms CPU time over 5.438s wall clock time, 31.6M memory peak, 14.5K incoming IP traffic, 16.9K outgoing IP traffic.5314worker1 # [ 116.794360] nix-daemon[833]: reaped child process 1520, status = succeeded5315worker1 # [ 116.795465] nix-daemon[833]: reaped child process 1554, status = succeeded5316worker1 # [ 116.804628] nix-daemon[1556]: unexpected Nix daemon error: error: interrupted by the user5317worker1 # [ 116.809187] nix-daemon[833]: reaped child process 1556, status = failed with exit code 15318worker1 # [ 116.919478] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5319worker1 # [ 116.931639] systemd[1]: Starting Nix worker-protocol over gRPC...5320worker2 # [ 117.014322] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:21Z level=info event=scheduler_connected addr=lb:500515321worker1 # [ 117.134089] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:21Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5322worker1 # [ 117.136705] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:21Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5323worker1 # [ 117.140684] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:21Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15324worker1 # [ 117.148566] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:21Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5325worker1 # [ 117.150298] systemd[1]: Started Nix worker-protocol over gRPC.5326worker1 # [ 117.165375] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:21Z level=info event=scheduler_take_over5327lb # [ 117.192849] niks3-server[1010]: 2026/09/20 12:49:21 INFO lead: acquired remote=192.168.1.3:420085328worker1 # [ 117.176802] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:21Z level=info event=scheduler_connected addr=lb:500515329worker1 # [ 117.178753] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:21Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:540945330worker2 # [ 117.228431] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5331worker1 # [ 117.180409] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:21Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05332worker1 # [ 117.277878] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:21Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05333worker1 # [ 117.285064] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:21Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=15334worker1 # [ 117.341994] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:541065335worker1 # [ 117.359151] nix-daemon[833]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)5336worker2 # [ 117.429849] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:21Z level=info event=scheduler_connected addr=lb:500515337worker1 # [ 117.380968] nix-daemon[833]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)5338worker1 # [ 117.390036] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:21Z level=info event=oidc_jwks provider=mock keys=15339client # [ 116.878998] nix[1191]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5340worker1 # [ 117.393380] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:21Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:540945341worker1 # [ 117.403626] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:21Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05342client # [ 117.522421] nix[1191]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5343worker1 # [ 117.415006] nix-daemon[833]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)5344client: (finished: must succeed: sleep 5.0, in 5.07 seconds)5345client: waiting for success: ! systemctl is-active mid5346worker1 # [ 122.241830] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:26Z level=info event=niks3_push_started pid=16715347worker1 # [ 122.282911] nix-daemon[833]: reaped child process 1647, status = succeeded5348lb # [ 122.360744] envoy[927]: conn peer=[2001:db8:1::3]:59118 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1015 tx=411 ms=51955349worker1 # [ 122.517688] nix-grpc-daemon[1671]: time=2026-09-20T12:49:27.011Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca=""5350worker1 # [ 122.709940] nix-daemon[833]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)5351worker1 # [ 122.729915] nix-daemon[833]: reaped child process 1687, status = succeeded5352lb # [ 122.778872] niks3-server[1010]: 2026/09/20 12:49:27 INFO Received uploads request method=POST path=/api/pending_closures5353worker1 # [ 122.764086] nix-grpc-daemon[1671]: time=2026-09-20T12:49:27.258Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5354worker1 # [ 122.765662] nix-grpc-daemon[1671]: time=2026-09-20T12:49:27.258Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5355lb # [ 122.837931] niks3-server[1010]: 2026/09/20 12:49:27 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5356lb # [ 122.856374] niks3-server[1010]: 2026/09/20 12:49:27 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5357lb # [ 122.870076] niks3-server[1010]: 2026/09/20 12:49:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5358worker1 # [ 122.848583] nix-grpc-daemon[1671]: time=2026-09-20T12:49:27.343Z level=INFO msg="Uploading 1 narinfos"5359lb # [ 122.879987] niks3-server[1010]: 2026/09/20 12:49:27 INFO Signed narinfos id=36 count=15360lb # [ 122.907815] niks3-server[1010]: 2026/09/20 12:49:27 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5361worker1 # [ 122.889043] nix-grpc-daemon[1671]: time=2026-09-20T12:49:27.383Z level=INFO msg="Upload complete. (367ms)"5362lb # [ 122.921127] niks3-server[1010]: 2026/09/20 12:49:27 INFO Completed upload id=365363worker1 # [ 122.908445] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54106 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15364lb # [ 122.950220] niks3-server[1010]: 2026/09/20 12:49:27 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls5365worker1 # [ 122.928641] nix-grpc-daemon[1671]: time=2026-09-20T12:49:27.417Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo error="server returned 404: object is not pending upload\n"5366worker1 # [ 122.936521] nix-daemon[833]: reaped child process 1645, status = succeeded5367client # [ 123.065310] systemd[1]: mid.service: Deactivated successfully.5368client # [ 123.070608] systemd[1]: mid.service: Consumed 175ms CPU time over 10.211s wall clock time, 37M memory peak, 9.7K incoming IP traffic, 10.8K outgoing IP traffic.5369client: (finished: waiting for success: ! systemctl is-active mid, in 1.17 seconds)5370client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5371client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds)5372(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.77 seconds)5373subtest: interrupting the client stops the build on the worker5374client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5375client # [ 123.603263] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5376client # Running as unit: intr.service; invocation ID: d51a810a74aa4dc68e2e7c90b1b8e4715377client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.07 seconds)5378worker2 # [ 123.802643] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:391805379client # [ 123.870919] nix[1226]: don't know how to build these paths:5380client # [ 123.871911] nix[1226]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5381worker1 # [ 123.775984] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:28Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05382worker1 # [ 123.777077] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:28Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.4:50051 clients=15383worker2 # [ 123.874290] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:391805384worker2 # [ 123.896373] nix-grpc-daemon[1170]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 93 ms (attempt 1/5)5385worker2 # [ 123.997292] nix-grpc-daemon[1170]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 124 ms (attempt 2/5)5386worker2 # [ 124.130519] nix-grpc-daemon[1170]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 400 ms (attempt 3/5)5387worker2 # [ 124.530942] nix-grpc-daemon[1170]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 65 ms (attempt 4/5)5388worker2 # [ 124.604561] nix-grpc-daemon[1170]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5389worker2 # [ 124.629956] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:391805390client # [ 124.705768] nix[1226]: copying 1 paths to 'lb:50051'...5391worker2 # [ 124.648397] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:391805392client # [ 124.710702] nix[1226]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5393worker2 # [ 124.672576] nix-daemon[842]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5394worker2 # [ 124.706722] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:29Z level=info event=niks3_push_started pid=13085395worker2 # [ 124.970810] nix-grpc-daemon[1308]: time=2026-09-20T12:49:29.483Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""5396worker2 # [ 125.170806] nix-daemon[842]: accepted connection from pid 1325, user nix-grpc-daemon (trusted)5397worker2 # [ 125.191984] nix-daemon[842]: reaped child process 1328, status = succeeded5398worker2 # [ 125.394095] nix-daemon[842]: accepted connection from pid 1330, user nix-grpc-daemon (trusted)5399worker2 # [ 125.415332] nix-daemon[842]: reaped child process 1333, status = succeeded5400lb # [ 125.406428] niks3-server[1010]: 2026/09/20 12:49:29 INFO Received uploads request method=POST path=/api/pending_closures5401worker2 # [ 125.453274] nix-grpc-daemon[1308]: time=2026-09-20T12:49:29.968Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5402worker2 # [ 125.456490] nix-grpc-daemon[1308]: time=2026-09-20T12:49:29.968Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5403lb # [ 125.465783] niks3-server[1010]: 2026/09/20 12:49:29 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5404lb # [ 125.479393] niks3-server[1010]: 2026/09/20 12:49:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5405lb # [ 125.486135] niks3-server[1010]: 2026/09/20 12:49:29 INFO Signed narinfos id=37 count=15406worker2 # [ 125.512151] nix-grpc-daemon[1308]: time=2026-09-20T12:49:30.028Z level=INFO msg="Uploading 1 narinfos"5407lb # [ 125.499813] niks3-server[1010]: 2026/09/20 12:49:30 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5408lb # [ 125.511837] niks3-server[1010]: 2026/09/20 12:49:30 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5409lb # [ 125.530804] niks3-server[1010]: 2026/09/20 12:49:30 INFO Completed upload id=375410worker2 # [ 125.556664] nix-grpc-daemon[1308]: time=2026-09-20T12:49:30.073Z level=INFO msg="Upload complete. (587ms)"5411lb # [ 125.542587] niks3-server[1010]: 2026/09/20 12:49:30 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5412worker2 # [ 125.571095] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39180 duration_s=0 paths=1 nar_bytes_in=4245413worker2 # [ 125.592847] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:391805414worker2 # [ 125.603280] nix-daemon[842]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5415worker2 # [ 125.611134] nix-daemon[842]: reaped child process 1306, status = succeeded5416client # [ 125.682103] nix[1226]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5417worker2 # [ 125.626474] nix-daemon[842]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5418client: must succeed: systemctl kill -s INT intr5419client # [ 127.465861] systemd[1]: intr.service: Sent signal SIGINT to main process 1226 (nix) on client request.5420client # [ 127.472261] nix[1226]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5421client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds)5422client # [ 127.478515] nix[1226]: error: interrupted by the user5423worker2 # [ 127.454215] nix-daemon[842]: reaped child process 1335, status = succeeded5424worker2 # [ 127.459264] nix-daemon[1337]: unexpected Nix daemon error: error: interrupted by the user5425client # [ 127.517760] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5426client # [ 127.521138] systemd[1]: intr.service: Failed with result 'exit-code'.5427worker2 # [ 127.467413] nix-daemon[842]: reaped child process 1337, status = failed with exit code 15428client # [ 127.525654] systemd[1]: intr.service: Consumed 171ms CPU time over 3.920s wall clock time, 37.2M memory peak, 7.8K incoming IP traffic, 8.7K outgoing IP traffic.5429(finished: subtest: interrupting the client stops the build on the worker, in 4.07 seconds)5430subtest: a deploy mid-build drains: the build finishes, the new generation takes over5431client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5432client # [ 127.689835] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5433client # Running as unit: sw.service; invocation ID: a402e0e495b84133a036de92223d3e785434client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.09 seconds)5435client # [ 127.934464] nix[1245]: don't know how to build these paths:5436client # [ 127.936239] nix[1245]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5437worker2 # [ 127.876149] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:391805438worker1 # [ 127.838895] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:32Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05439worker1 # [ 127.844618] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:32Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.3:50051 clients=15440worker1 # [ 127.884773] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:541065441worker1 # [ 127.904367] nix-grpc-daemon[1592]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 84 ms (attempt 1/5)5442worker1 # [ 127.996068] nix-grpc-daemon[1592]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 193 ms (attempt 2/5)5443worker1 # [ 128.196890] nix-grpc-daemon[1592]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 121 ms (attempt 3/5)5444worker1 # [ 128.325623] nix-grpc-daemon[1592]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 88 ms (attempt 4/5)5445worker1 # [ 128.421888] nix-grpc-daemon[1592]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5446worker1 # [ 128.444613] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:541065447client # [ 128.572538] nix[1245]: copying 1 paths to 'lb:50051'...5448worker1 # [ 128.460690] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:541065449client # [ 128.572861] nix[1245]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5450worker1 # [ 128.480756] nix-daemon[833]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)5451worker1 # [ 128.691642] nix-daemon[833]: accepted connection from pid 1722, user nix-grpc-daemon (trusted)5452worker1 # [ 128.709954] nix-daemon[833]: reaped child process 1725, status = succeeded5453worker1 # [ 128.903998] nix-daemon[833]: accepted connection from pid 1727, user nix-grpc-daemon (trusted)5454worker1 # [ 128.921824] nix-daemon[833]: reaped child process 1734, status = succeeded5455lb # [ 128.965150] niks3-server[1010]: 2026/09/20 12:49:33 INFO Received uploads request method=POST path=/api/pending_closures5456worker1 # [ 128.953419] nix-grpc-daemon[1671]: time=2026-09-20T12:49:33.447Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5457worker1 # [ 128.954938] nix-grpc-daemon[1671]: time=2026-09-20T12:49:33.447Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5458lb # [ 129.021272] niks3-server[1010]: 2026/09/20 12:49:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5459worker1 # [ 129.000953] nix-grpc-daemon[1671]: time=2026-09-20T12:49:33.495Z level=INFO msg="Uploading 1 narinfos"5460lb # [ 129.031921] niks3-server[1010]: 2026/09/20 12:49:33 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5461lb # [ 129.040360] niks3-server[1010]: 2026/09/20 12:49:33 INFO Signed narinfos id=38 count=15462lb # [ 129.042551] niks3-server[1010]: 2026/09/20 12:49:33 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5463lb # [ 129.048342] niks3-server[1010]: 2026/09/20 12:49:33 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5464lb # [ 129.057018] niks3-server[1010]: 2026/09/20 12:49:33 INFO Completed upload id=385465worker1 # [ 129.028943] nix-grpc-daemon[1671]: time=2026-09-20T12:49:33.523Z level=INFO msg="Upload complete. (529ms)"5466lb # [ 129.060093] niks3-server[1010]: 2026/09/20 12:49:33 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5467worker1 # [ 129.040310] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54106 duration_s=0 paths=1 nar_bytes_in=4165468worker1 # [ 129.055321] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:541065469worker1 # [ 129.062946] nix-daemon[833]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)5470worker1 # [ 129.068762] nix-daemon[833]: reaped child process 1720, status = succeeded5471worker1 # [ 129.081894] nix-daemon[833]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)5472client # [ 129.192927] nix[1245]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5473worker1: must succeed: systemctl reload nix-grpc-daemon.service5474worker1 # [ 130.280583] systemd[1]: Reloading Nix worker-protocol over gRPC...5475worker1 # [ 130.335326] systemd[1]: Reloaded Nix worker-protocol over gRPC.5476worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.11 seconds)5477worker1: must succeed: pgrep -f 'read -t [9]0 x'5478worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds)5479client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&25480worker1 # [ 130.664709] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:35Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:541065481client # don't know how to build these paths:5482client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5483worker1 # [ 130.671454] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:541065484worker1 # [ 130.690860] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:35Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05485worker1 # [ 130.692854] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:35Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.4:50051 clients=15486worker2 # [ 130.794957] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:391805487worker2 # [ 130.812313] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:391805488client # copying 1 paths to 'lb:50051'...5489worker2 # [ 130.828873] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:391805490client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5491worker2 # [ 130.852929] nix-daemon[842]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5492worker2 # [ 131.064388] nix-daemon[842]: accepted connection from pid 1383, user nix-grpc-daemon (trusted)5493worker2 # [ 131.084148] nix-daemon[842]: reaped child process 1386, status = succeeded5494worker1 # [ 131.163365] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:35Z level=info event=draining5495worker2 # [ 131.258384] nix-daemon[842]: accepted connection from pid 1388, user nix-grpc-daemon (trusted)5496worker2 # [ 131.277316] nix-daemon[842]: reaped child process 1391, status = succeeded5497lb # [ 131.268170] niks3-server[1010]: 2026/09/20 12:49:35 INFO Received uploads request method=POST path=/api/pending_closures5498worker2 # [ 131.303296] nix-grpc-daemon[1308]: time=2026-09-20T12:49:35.819Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5499worker2 # [ 131.304922] nix-grpc-daemon[1308]: time=2026-09-20T12:49:35.819Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5500lb # [ 131.297518] niks3-server[1010]: 2026/09/20 12:49:35 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5501worker2 # [ 131.336353] nix-grpc-daemon[1308]: time=2026-09-20T12:49:35.853Z level=INFO msg="Uploading 1 narinfos"5502lb # [ 131.312780] niks3-server[1010]: 2026/09/20 12:49:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5503lb # [ 131.325165] niks3-server[1010]: 2026/09/20 12:49:35 INFO Signed narinfos id=39 count=15504lb # [ 131.335524] niks3-server[1010]: 2026/09/20 12:49:35 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5505worker2 # [ 131.367846] nix-grpc-daemon[1308]: time=2026-09-20T12:49:35.884Z level=INFO msg="Upload complete. (497ms)"5506lb # [ 131.343194] niks3-server[1010]: 2026/09/20 12:49:35 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5507lb # [ 131.348996] niks3-server[1010]: 2026/09/20 12:49:35 INFO Completed upload id=395508worker2 # [ 131.376281] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39180 duration_s=0 paths=1 nar_bytes_in=5285509lb # [ 131.352550] niks3-server[1010]: 2026/09/20 12:49:35 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5510worker2 # [ 131.391699] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:391805511worker2 # [ 131.398305] nix-daemon[842]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5512worker2 # [ 131.403530] nix-daemon[842]: reaped child process 1381, status = succeeded5513client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5514worker2 # [ 131.415283] nix-daemon[842]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5515client # farm-a> worker2: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5516client # farm-a> LOG-farm-a-during-drain5517worker2 # [ 132.247669] nix-daemon[842]: reaped child process 1395, status = succeeded5518lb # [ 132.360611] envoy[927]: conn peer=[2001:db8:1::1]:59854 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3871 tx=1676 ms=99265519worker2 # [ 132.412457] nix-daemon[842]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5520worker2 # [ 132.432122] nix-daemon[842]: reaped child process 1413, status = succeeded5521lb # [ 132.365653] envoy[927]: conn peer=[2001:db8:1::1]:48716 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=756 ms=36405522lb # [ 132.418705] niks3-server[1010]: 2026/09/20 12:49:36 INFO Received uploads request method=POST path=/api/pending_closures5523worker2 # [ 132.458020] nix-grpc-daemon[1308]: time=2026-09-20T12:49:36.974Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5524worker2 # [ 132.462645] nix-grpc-daemon[1308]: time=2026-09-20T12:49:36.976Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5525lb # [ 132.461303] niks3-server[1010]: 2026/09/20 12:49:36 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5526lb # [ 132.475301] niks3-server[1010]: 2026/09/20 12:49:36 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5527lb # [ 132.490114] niks3-server[1010]: 2026/09/20 12:49:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5528worker2 # [ 132.523020] nix-grpc-daemon[1308]: time=2026-09-20T12:49:37.038Z level=INFO msg="Uploading 1 narinfos"5529lb # [ 132.500084] niks3-server[1010]: 2026/09/20 12:49:37 INFO Signed narinfos id=40 count=15530lb # [ 132.503075] niks3-server[1010]: 2026/09/20 12:49:37 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5531lb # [ 132.515169] niks3-server[1010]: 2026/09/20 12:49:37 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5532lb # [ 132.522384] niks3-server[1010]: 2026/09/20 12:49:37 INFO Completed upload id=405533worker2 # [ 132.547365] nix-grpc-daemon[1308]: time=2026-09-20T12:49:37.064Z level=INFO msg="Upload complete. (319ms)"5534lb # [ 132.525249] niks3-server[1010]: 2026/09/20 12:49:37 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo5535worker1 # [ 132.508100] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:37Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05536worker1 # [ 132.509918] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:37Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.4:50051 clients=15537worker2 # [ 132.560750] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39180 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=15538worker2 # [ 132.577748] nix-daemon[842]: reaped child process 1393, status = succeeded5539worker2 # [ 132.615794] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:391805540worker2 # [ 132.631771] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:391805541worker2 # [ 132.647458] nix-grpc-daemon[1308]: time=2026-09-20T12:49:37.164Z level=INFO msg="All 1 paths already cached"5542client # copying 1 paths to 'lb:50051'...5543worker2 # [ 132.658289] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:391805544client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5545worker2 # [ 132.681527] nix-daemon[842]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5546worker2 # [ 132.886238] nix-daemon[842]: accepted connection from pid 1417, user nix-grpc-daemon (trusted)5547worker2 # [ 132.905939] nix-daemon[842]: reaped child process 1420, status = succeeded5548worker2 # [ 133.075659] nix-daemon[842]: accepted connection from pid 1422, user nix-grpc-daemon (trusted)5549worker2 # [ 133.094764] nix-daemon[842]: reaped child process 1425, status = succeeded5550lb # [ 133.080138] niks3-server[1010]: 2026/09/20 12:49:37 INFO Received uploads request method=POST path=/api/pending_closures5551worker2 # [ 133.114931] nix-grpc-daemon[1308]: time=2026-09-20T12:49:37.631Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5552worker2 # [ 133.116567] nix-grpc-daemon[1308]: time=2026-09-20T12:49:37.631Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"5553lb # [ 133.109770] niks3-server[1010]: 2026/09/20 12:49:37 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst5554worker2 # [ 133.149203] nix-grpc-daemon[1308]: time=2026-09-20T12:49:37.665Z level=INFO msg="Uploading 1 narinfos"5555lb # [ 133.125828] niks3-server[1010]: 2026/09/20 12:49:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5556lb # [ 133.136222] niks3-server[1010]: 2026/09/20 12:49:37 INFO Signed narinfos id=41 count=15557lb # [ 133.138910] niks3-server[1010]: 2026/09/20 12:49:37 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls5558lb # [ 133.146333] niks3-server[1010]: 2026/09/20 12:49:37 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5559lb # [ 133.157708] niks3-server[1010]: 2026/09/20 12:49:37 INFO Completed upload id=415560worker2 # [ 133.183209] nix-grpc-daemon[1308]: time=2026-09-20T12:49:37.700Z level=INFO msg="Upload complete. (484ms)"5561lb # [ 133.160849] niks3-server[1010]: 2026/09/20 12:49:37 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo5562worker2 # [ 133.192268] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39180 duration_s=0 paths=1 nar_bytes_in=6405563worker2 # [ 133.203545] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:391805564worker2 # [ 133.210940] nix-daemon[842]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5565worker2 # [ 133.217158] nix-daemon[842]: reaped child process 1415, status = succeeded5566client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...5567client # farm-b> worker2: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5568worker2 # [ 133.230805] nix-daemon[842]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5569client # farm-b> LOG-farm-b-during-drain5570worker2 # [ 134.677061] nix-daemon[842]: reaped child process 1429, status = succeeded5571worker2 # [ 134.851983] nix-daemon[842]: accepted connection from pid 1444, user nix-grpc-daemon (trusted)5572worker2 # [ 134.871269] nix-daemon[842]: reaped child process 1447, status = succeeded5573lb # [ 134.858447] niks3-server[1010]: 2026/09/20 12:49:39 INFO Received uploads request method=POST path=/api/pending_closures5574worker2 # [ 134.897909] nix-grpc-daemon[1308]: time=2026-09-20T12:49:39.413Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5575worker2 # [ 134.899530] nix-grpc-daemon[1308]: time=2026-09-20T12:49:39.413Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"5576lb # [ 134.899967] niks3-server[1010]: 2026/09/20 12:49:39 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5577lb # [ 134.911839] niks3-server[1010]: 2026/09/20 12:49:39 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst5578lb # [ 134.919533] niks3-server[1010]: 2026/09/20 12:49:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5579worker2 # [ 134.949651] nix-grpc-daemon[1308]: time=2026-09-20T12:49:39.466Z level=INFO msg="Uploading 1 narinfos"5580lb # [ 134.928614] niks3-server[1010]: 2026/09/20 12:49:39 INFO Signed narinfos id=42 count=15581lb # [ 134.933317] niks3-server[1010]: 2026/09/20 12:49:39 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls5582lb # [ 134.940283] niks3-server[1010]: 2026/09/20 12:49:39 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5583lb # [ 134.945965] niks3-server[1010]: 2026/09/20 12:49:39 INFO Completed upload id=425584worker2 # [ 134.971159] nix-grpc-daemon[1308]: time=2026-09-20T12:49:39.488Z level=INFO msg="Upload complete. (329ms)"5585lb # [ 134.948486] niks3-server[1010]: 2026/09/20 12:49:39 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo5586worker1 # [ 134.930759] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:39Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=05587worker1 # [ 134.932782] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:39Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.4:50051 clients=15588worker2 # [ 134.986466] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39180 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=15589worker2 # [ 135.001597] nix-daemon[842]: reaped child process 1427, status = succeeded5590worker2 # [ 135.035756] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:391805591worker2 # [ 135.051619] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:391805592worker2 # [ 135.066828] nix-grpc-daemon[1308]: time=2026-09-20T12:49:39.583Z level=INFO msg="All 2 paths already cached"5593client # copying 1 paths to 'lb:50051'...5594worker2 # [ 135.077364] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:391805595client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...5596worker2 # [ 135.101445] nix-daemon[842]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5597worker2 # [ 135.304631] nix-daemon[842]: accepted connection from pid 1451, user nix-grpc-daemon (trusted)5598worker2 # [ 135.324330] nix-daemon[842]: reaped child process 1454, status = succeeded5599worker2 # [ 135.499055] nix-daemon[842]: accepted connection from pid 1456, user nix-grpc-daemon (trusted)5600worker2 # [ 135.516240] nix-daemon[842]: reaped child process 1459, status = succeeded5601lb # [ 135.502214] niks3-server[1010]: 2026/09/20 12:49:40 INFO Received uploads request method=POST path=/api/pending_closures5602worker2 # [ 135.538611] nix-grpc-daemon[1308]: time=2026-09-20T12:49:40.055Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5603worker2 # [ 135.540367] nix-grpc-daemon[1308]: time=2026-09-20T12:49:40.055Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"5604lb # [ 135.536849] niks3-server[1010]: 2026/09/20 12:49:40 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst5605lb # [ 135.549602] niks3-server[1010]: 2026/09/20 12:49:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5606worker2 # [ 135.581854] nix-grpc-daemon[1308]: time=2026-09-20T12:49:40.098Z level=INFO msg="Uploading 1 narinfos"5607lb # [ 135.560380] niks3-server[1010]: 2026/09/20 12:49:40 INFO Signed narinfos id=43 count=15608lb # [ 135.563093] niks3-server[1010]: 2026/09/20 12:49:40 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls5609lb # [ 135.574218] niks3-server[1010]: 2026/09/20 12:49:40 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5610lb # [ 135.580917] niks3-server[1010]: 2026/09/20 12:49:40 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo5611lb # [ 135.584869] niks3-server[1010]: 2026/09/20 12:49:40 INFO Completed upload id=435612worker2 # [ 135.610373] nix-grpc-daemon[1308]: time=2026-09-20T12:49:40.127Z level=INFO msg="Upload complete. (490ms)"5613worker2 # [ 135.618560] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39180 duration_s=0 paths=1 nar_bytes_in=7685614worker2 # [ 135.633480] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:391805615worker2 # [ 135.639199] nix-daemon[842]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5616worker2 # [ 135.643957] nix-daemon[842]: reaped child process 1449, status = succeeded5617client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...5618worker2 # [ 135.656156] nix-daemon[842]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)5619client # farm-top> worker2: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5620worker2 # [ 136.877946] nix-daemon[842]: reaped child process 1463, status = succeeded5621client # farm-top> LOG-farm-top-during-drain5622worker2 # [ 137.036790] nix-daemon[842]: accepted connection from pid 1478, user nix-grpc-daemon (trusted)5623worker2 # [ 137.056136] nix-daemon[842]: reaped child process 1481, status = succeeded5624lb # [ 137.043079] niks3-server[1010]: 2026/09/20 12:49:41 INFO Received uploads request method=POST path=/api/pending_closures5625worker2 # [ 137.079597] nix-grpc-daemon[1308]: time=2026-09-20T12:49:41.594Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5626worker2 # [ 137.081269] nix-grpc-daemon[1308]: time=2026-09-20T12:49:41.594Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"5627lb # [ 137.074564] niks3-server[1010]: 2026/09/20 12:49:41 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5628lb # [ 137.088168] niks3-server[1010]: 2026/09/20 12:49:41 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst5629lb # [ 137.101652] niks3-server[1010]: 2026/09/20 12:49:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5630worker2 # [ 137.131650] nix-grpc-daemon[1308]: time=2026-09-20T12:49:41.648Z level=INFO msg="Uploading 1 narinfos"5631lb # [ 137.111248] niks3-server[1010]: 2026/09/20 12:49:41 INFO Signed narinfos id=44 count=15632lb # [ 137.116571] niks3-server[1010]: 2026/09/20 12:49:41 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls5633lb # [ 137.123689] niks3-server[1010]: 2026/09/20 12:49:41 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5634lb # [ 137.131461] niks3-server[1010]: 2026/09/20 12:49:41 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo5635lb # [ 137.136086] niks3-server[1010]: 2026/09/20 12:49:41 INFO Completed upload id=445636worker2 # [ 137.161652] nix-grpc-daemon[1308]: time=2026-09-20T12:49:41.678Z level=INFO msg="Upload complete. (293ms)"5637worker2 # [ 137.173002] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39180 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=15638worker2 # [ 137.185783] nix-daemon[842]: reaped child process 1461, status = succeeded5639client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 6.77 seconds)5640client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath5641client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.24 seconds)5642worker1: must succeed: pkill -f 'read -t [9]0 x'5643worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds)5644client: waiting for success: ! systemctl is-active sw5645worker1 # [ 137.514612] nix-daemon[833]: reaped child process 1738, status = succeeded5646worker1 # [ 137.672544] nix-daemon[833]: accepted connection from pid 1781, user nix-grpc-daemon (trusted)5647worker1 # [ 137.692500] nix-daemon[833]: reaped child process 1784, status = succeeded5648lb # [ 137.732177] niks3-server[1010]: 2026/09/20 12:49:42 INFO Received uploads request method=POST path=/api/pending_closures5649worker1 # [ 137.713500] nix-grpc-daemon[1671]: time=2026-09-20T12:49:42.208Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5650worker1 # [ 137.715755] nix-grpc-daemon[1671]: time=2026-09-20T12:49:42.210Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"5651lb # [ 137.773749] niks3-server[1010]: 2026/09/20 12:49:42 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5652lb # [ 137.785321] niks3-server[1010]: 2026/09/20 12:49:42 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5653worker1 # [ 137.766310] nix-grpc-daemon[1671]: time=2026-09-20T12:49:42.260Z level=INFO msg="Uploading 1 narinfos"5654lb # [ 137.797414] niks3-server[1010]: 2026/09/20 12:49:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5655lb # [ 137.805022] niks3-server[1010]: 2026/09/20 12:49:42 INFO Signed narinfos id=45 count=15656lb # [ 137.807076] niks3-server[1010]: 2026/09/20 12:49:42 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls5657lb # [ 137.813300] niks3-server[1010]: 2026/09/20 12:49:42 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5658lb # [ 137.819069] niks3-server[1010]: 2026/09/20 12:49:42 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo5659lb # [ 137.823006] niks3-server[1010]: 2026/09/20 12:49:42 INFO Completed upload id=455660worker1 # [ 137.794868] nix-grpc-daemon[1671]: time=2026-09-20T12:49:42.289Z level=INFO msg="Upload complete. (292ms)"5661worker1 # [ 137.808966] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54106 duration_s=8 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=15662worker1 # [ 137.821089] nix-daemon[833]: reaped child process 1736, status = succeeded5663client # [ 137.957884] systemd[1]: sw.service: Deactivated successfully.5664client # [ 137.962530] systemd[1]: sw.service: Consumed 170ms CPU time over 10.271s wall clock time, 39M memory peak, 8.7K incoming IP traffic, 9K outgoing IP traffic.5665worker1 # [ 138.165028] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:42Z level=info event=signal_exit5666worker1 # [ 138.181503] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:42Z level=info event=scheduler_yield5667lb # [ 138.213741] niks3-server[1010]: 2026/09/20 12:49:42 INFO lead: released remote=192.168.1.3:420085668worker2 # [ 138.238983] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:42Z level=info event=scheduler_restarting addr=lb:500515669worker1 # [ 138.190498] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:42Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:540945670worker1 # [ 138.197572] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:42Z level=info event=worker_gone addr=192.168.1.4:500515671worker1 # [ 138.203260] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:42Z level=info event=scheduler_restarting addr=lb:500515672worker1 # [ 138.207423] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:42Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:540945673worker1 # [ 138.212066] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:42Z level=info event=worker_gone addr=192.168.1.3:500515674worker2 # [ 138.444882] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:42Z level=info event=scheduler_connected addr=lb:500515675worker2 # [ 138.450126] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5676worker1 # [ 138.398803] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:42Z level=info event=scheduler_connected addr=lb:500515677worker1 # [ 138.404671] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5678client: (finished: waiting for success: ! systemctl is-active sw, in 1.12 seconds)5679client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5680worker2 # [ 138.651289] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:43Z level=info event=scheduler_connected addr=lb:500515681worker2 # [ 138.656855] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5682worker1 # [ 138.605458] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:43Z level=info event=scheduler_connected addr=lb:500515683worker1 # [ 138.611045] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5684client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds)5685worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5686worker2 # [ 138.857952] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:43Z level=info event=scheduler_connected addr=lb:500515687worker2 # [ 138.863270] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5688worker1 # [ 138.813813] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:43Z level=info event=scheduler_connected addr=lb:500515689worker1 # [ 138.818293] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5690worker2 # [ 139.064414] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:43Z level=info event=scheduler_connected addr=lb:500515691worker1 # [ 139.014188] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:43Z level=info event=scheduler_connected addr=lb:500515692worker2 # [ 139.069630] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5693worker1 # [ 139.019602] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5694worker2 # [ 139.154595] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:43Z level=info event=scheduler_take_over5695lb # [ 139.128812] niks3-server[1010]: 2026/09/20 12:49:43 INFO lead: acquired remote=192.168.1.4:463725696worker1 # [ 139.187355] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:43Z level=info event=scheduler_restarting5697worker2 # [ 139.272540] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:43Z level=info event=scheduler_connected addr=lb:500515698worker2 # [ 139.276973] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5699worker1 # [ 139.238548] nix-daemon[833]: reaped child process 1643, status = succeeded5700worker1 # [ 139.241820] nix-grpc-daemon[1592]: ts=2026-09-20T12:49:43Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5701worker1 # [ 139.362809] nix-grpc-daemon[1592]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5702worker1 # [ 139.367418] nix-grpc-daemon[1592]: E0000 00:00:1789908583.857516 1635 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5703worker1 # [ 139.408253] nix-grpc-daemon[1592]: E0000 00:00:1789908583.903100 1635 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5704worker2 # [ 139.473828] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:43Z level=info event=scheduler_connected addr=lb:500515705worker2 # [ 139.480200] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5706worker2 # [ 139.681563] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:44Z level=info event=scheduler_connected addr=lb:500515707worker2 # [ 139.708141] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:44Z level=info event=oidc_jwks provider=mock keys=15708worker2 # [ 139.713902] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:44Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:500225709worker2 # [ 139.719258] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:44Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05710worker1 # [ 141.204581] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5711worker1 # [ 141.209151] systemd[1]: nix-grpc-daemon.service: Consumed 943ms CPU time over 24.426s wall clock time, 32.6M memory peak, 26.1K incoming IP traffic, 33.1K outgoing IP traffic.5712worker1 # [ 141.234978] systemd[1]: Starting Nix worker-protocol over gRPC...5713worker1 # [ 141.436518] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:45Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5714worker1 # [ 141.439256] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:45Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5715worker1 # [ 141.443474] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:45Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15716worker1 # [ 141.453351] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:45Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5717worker1 # [ 141.455566] systemd[1]: Started Nix worker-protocol over gRPC.5718worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.83 seconds)5719lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5720lb: must succeed: curl -sf localhost:9901/clusters5721worker1 # [ 141.477522] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:45Z level=info event=scheduler_connected addr=lb:500515722worker2 # [ 141.535178] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:46Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:500225723worker2 # [ 141.540712] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:46Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05724lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5725lb # [ 142.363438] envoy[927]: conn peer=[2001:db8:1::1]:48730 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9586 tx=3842 ms=64715726lb # [ 142.368583] envoy[927]: conn peer=[2001:db8:1::1]:48718 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2952 tx=1351 ms=99975727lb # [ 142.373614] envoy[927]: conn peer=[2001:db8:1::3]:59124 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1426 tx=539 ms=220585728lb: must succeed: curl -sf localhost:9901/clusters5729lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5730lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.17 seconds)5731lb: must succeed: curl -sf localhost:9901/clusters5732lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5733worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5734worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5735(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 15.28 seconds)5736subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5737client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15738worker1 # [ 143.038276] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:478725739worker1 # [ 143.053649] nix-daemon[833]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)5740worker1 # [ 143.074193] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:478725741worker1 # [ 143.090446] nix-grpc-daemon[1798]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 1/5)5742worker1 # [ 143.150192] nix-grpc-daemon[1798]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 148 ms (attempt 2/5)5743worker1 # [ 143.298717] nix-grpc-daemon[1798]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 43 ms (attempt 3/5)5744worker1 # [ 143.349300] nix-grpc-daemon[1798]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 647 ms (attempt 4/5)5745worker1 # [ 144.004647] nix-grpc-daemon[1798]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5746worker2 # [ 144.110562] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:48Z level=debug event=want client=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=05747worker2 # [ 144.116563] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:48Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=15748worker2 # [ 144.122480] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:48Z level=debug event=want client=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=05749worker2 # [ 144.127780] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:48Z level=debug event=want client=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=05750worker1 # [ 144.105867] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:478725751worker1 # [ 144.122882] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:478725752worker1 # [ 144.137792] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:478725753worker1 # [ 144.153506] nix-daemon[833]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)5754worker1 # [ 144.182409] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:48Z level=info event=niks3_push_started pid=18545755worker1 # [ 144.402943] nix-grpc-daemon[1854]: time=2026-09-20T12:49:48.897Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca=""5756worker1 # [ 144.579939] nix-daemon[833]: accepted connection from pid 1867, user nix-grpc-daemon (trusted)5757worker1 # [ 144.598016] nix-daemon[833]: reaped child process 1870, status = succeeded5758worker1 # [ 144.773967] nix-daemon[833]: accepted connection from pid 1872, user nix-grpc-daemon (trusted)5759worker1 # [ 144.793724] nix-daemon[833]: reaped child process 1875, status = succeeded5760lb # [ 144.834168] niks3-server[1010]: 2026/09/20 12:49:49 INFO Received uploads request method=POST path=/api/pending_closures5761worker1 # [ 144.816066] nix-grpc-daemon[1854]: time=2026-09-20T12:49:49.310Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5762worker1 # [ 144.817605] nix-grpc-daemon[1854]: time=2026-09-20T12:49:49.310Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"5763lb # [ 144.872364] niks3-server[1010]: 2026/09/20 12:49:49 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst5764worker1 # [ 144.863529] nix-grpc-daemon[1854]: time=2026-09-20T12:49:49.357Z level=INFO msg="Uploading 1 narinfos"5765lb # [ 144.891333] niks3-server[1010]: 2026/09/20 12:49:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5766lb # [ 144.903899] niks3-server[1010]: 2026/09/20 12:49:49 INFO Signed narinfos id=46 count=15767lb # [ 144.910209] niks3-server[1010]: 2026/09/20 12:49:49 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls5768lb # [ 144.923748] niks3-server[1010]: 2026/09/20 12:49:49 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5769worker1 # [ 144.900804] nix-grpc-daemon[1854]: time=2026-09-20T12:49:49.395Z level=INFO msg="Upload complete. (493ms)"5770lb # [ 144.930423] niks3-server[1010]: 2026/09/20 12:49:49 INFO Completed upload id=465771lb # [ 144.934998] niks3-server[1010]: 2026/09/20 12:49:49 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo5772worker1 # [ 144.908137] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47872 duration_s=0 paths=1 nar_bytes_in=5125773worker1 # [ 144.924765] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:478725774worker1 # [ 144.931348] nix-daemon[833]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)5775worker1 # [ 144.940211] nix-daemon[833]: reaped child process 1852, status = succeeded5776worker1 # [ 144.949271] nix-daemon[833]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)5777worker1 # [ 145.979156] nix-daemon[833]: reaped child process 1879, status = succeeded5778worker1 # [ 146.160054] nix-daemon[833]: accepted connection from pid 1894, user nix-grpc-daemon (trusted)5779worker1 # [ 146.177593] nix-daemon[833]: reaped child process 1897, status = succeeded5780lb # [ 146.223107] niks3-server[1010]: 2026/09/20 12:49:50 INFO Received uploads request method=POST path=/api/pending_closures5781worker1 # [ 146.207816] nix-grpc-daemon[1854]: time=2026-09-20T12:49:50.699Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5782worker1 # [ 146.210079] nix-grpc-daemon[1854]: time=2026-09-20T12:49:50.699Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"5783lb # [ 146.255629] niks3-server[1010]: 2026/09/20 12:49:50 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv5784lb # [ 146.272640] niks3-server[1010]: 2026/09/20 12:49:50 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5785lb # [ 146.289579] niks3-server[1010]: 2026/09/20 12:49:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5786worker1 # [ 146.268190] nix-grpc-daemon[1854]: time=2026-09-20T12:49:50.761Z level=INFO msg="Uploading 1 narinfos"5787lb # [ 146.297458] niks3-server[1010]: 2026/09/20 12:49:50 INFO Signed narinfos id=47 count=15788lb # [ 146.305761] niks3-server[1010]: 2026/09/20 12:49:50 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls5789lb # [ 146.319492] niks3-server[1010]: 2026/09/20 12:49:50 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5790lb # [ 146.325553] niks3-server[1010]: 2026/09/20 12:49:50 INFO Completed upload id=475791worker1 # [ 146.297455] nix-grpc-daemon[1854]: time=2026-09-20T12:49:50.792Z level=INFO msg="Upload complete. (338ms)"5792lb # [ 146.329952] niks3-server[1010]: 2026/09/20 12:49:50 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo5793worker1 # [ 146.309181] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47872 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=1 outputs=15794worker2 # [ 146.367808] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:50Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=15795worker2 # [ 146.379954] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:50Z level=debug event=want client=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=05796worker1 # [ 146.330292] nix-daemon[833]: reaped child process 1877, status = succeeded5797worker1 # [ 146.361380] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:478725798worker1 # [ 146.376301] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:478725799worker1 # [ 146.390898] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:478725800worker1 # [ 146.405100] nix-daemon[833]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)5801worker1 # [ 146.616972] nix-daemon[833]: accepted connection from pid 1901, user nix-grpc-daemon (trusted)5802worker1 # [ 146.635785] nix-daemon[833]: reaped child process 1904, status = succeeded5803worker1 # [ 146.808164] nix-daemon[833]: accepted connection from pid 1906, user nix-grpc-daemon (trusted)5804worker1 # [ 146.827971] nix-daemon[833]: reaped child process 1909, status = succeeded5805lb # [ 146.867187] niks3-server[1010]: 2026/09/20 12:49:51 INFO Received uploads request method=POST path=/api/pending_closures5806worker1 # [ 146.848106] nix-grpc-daemon[1854]: time=2026-09-20T12:49:51.342Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5807worker1 # [ 146.849621] nix-grpc-daemon[1854]: time=2026-09-20T12:49:51.342Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"5808lb # [ 146.897541] niks3-server[1010]: 2026/09/20 12:49:51 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst5809lb # [ 146.910770] niks3-server[1010]: 2026/09/20 12:49:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5810worker1 # [ 146.889243] nix-grpc-daemon[1854]: time=2026-09-20T12:49:51.384Z level=INFO msg="Uploading 1 narinfos"5811lb # [ 146.921791] niks3-server[1010]: 2026/09/20 12:49:51 INFO Signed narinfos id=48 count=15812lb # [ 146.927748] niks3-server[1010]: 2026/09/20 12:49:51 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls5813lb # [ 146.936297] niks3-server[1010]: 2026/09/20 12:49:51 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5814lb # [ 146.943797] niks3-server[1010]: 2026/09/20 12:49:51 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo5815lb # [ 146.949569] niks3-server[1010]: 2026/09/20 12:49:51 INFO Completed upload id=485816worker1 # [ 146.921377] nix-grpc-daemon[1854]: time=2026-09-20T12:49:51.416Z level=INFO msg="Upload complete. (499ms)"5817worker1 # [ 146.928986] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47872 duration_s=0 paths=1 nar_bytes_in=5125818worker1 # [ 146.943033] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:478725819worker1 # [ 146.949565] nix-daemon[833]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)5820worker1 # [ 146.954539] nix-daemon[833]: reaped child process 1899, status = succeeded5821worker1 # [ 146.967053] nix-daemon[833]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)5822worker1 # [ 148.415719] nix-daemon[833]: reaped child process 1913, status = succeeded5823worker1 # [ 148.596217] nix-daemon[833]: accepted connection from pid 1928, user nix-grpc-daemon (trusted)5824worker1 # [ 148.616750] nix-daemon[833]: reaped child process 1931, status = succeeded5825lb # [ 148.657103] niks3-server[1010]: 2026/09/20 12:49:53 INFO Received uploads request method=POST path=/api/pending_closures5826worker1 # [ 148.638707] nix-grpc-daemon[1854]: time=2026-09-20T12:49:53.133Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5827worker1 # [ 148.641253] nix-grpc-daemon[1854]: time=2026-09-20T12:49:53.135Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"5828lb # [ 148.691671] niks3-server[1010]: 2026/09/20 12:49:53 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv5829lb # [ 148.705158] niks3-server[1010]: 2026/09/20 12:49:53 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5830worker1 # [ 148.691831] nix-grpc-daemon[1854]: time=2026-09-20T12:49:53.186Z level=INFO msg="Uploading 1 narinfos"5831lb # [ 148.719680] niks3-server[1010]: 2026/09/20 12:49:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5832lb # [ 148.731818] niks3-server[1010]: 2026/09/20 12:49:53 INFO Signed narinfos id=49 count=15833lb # [ 148.738986] niks3-server[1010]: 2026/09/20 12:49:53 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls5834lb # [ 148.748955] niks3-server[1010]: 2026/09/20 12:49:53 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5835worker1 # [ 148.726747] nix-grpc-daemon[1854]: time=2026-09-20T12:49:53.221Z level=INFO msg="Upload complete. (345ms)"5836lb # [ 148.757837] niks3-server[1010]: 2026/09/20 12:49:53 INFO Completed upload id=495837lb # [ 148.762517] niks3-server[1010]: 2026/09/20 12:49:53 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo5838worker2 # [ 148.790168] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:53Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=15839worker1 # [ 148.741133] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47872 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=2 outputs=15840worker2 # [ 148.804758] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:53Z level=debug event=want client=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=05841worker1 # [ 148.760381] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:478725842worker1 # [ 148.768244] nix-daemon[833]: reaped child process 1911, status = succeeded5843worker1 # [ 148.776423] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:478725844worker1 # [ 148.790359] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:478725845worker1 # [ 148.803301] nix-daemon[833]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)5846worker1 # [ 148.995109] nix-daemon[833]: accepted connection from pid 1935, user nix-grpc-daemon (trusted)5847worker1 # [ 149.015428] nix-daemon[833]: reaped child process 1938, status = succeeded5848worker1 # [ 149.191717] nix-daemon[833]: accepted connection from pid 1940, user nix-grpc-daemon (trusted)5849worker1 # [ 149.209446] nix-daemon[833]: reaped child process 1943, status = succeeded5850lb # [ 149.251865] niks3-server[1010]: 2026/09/20 12:49:53 INFO Received uploads request method=POST path=/api/pending_closures5851worker1 # [ 149.231862] nix-grpc-daemon[1854]: time=2026-09-20T12:49:53.726Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5852worker1 # [ 149.233578] nix-grpc-daemon[1854]: time=2026-09-20T12:49:53.726Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"5853lb # [ 149.275893] niks3-server[1010]: 2026/09/20 12:49:53 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst5854worker1 # [ 149.261715] nix-grpc-daemon[1854]: time=2026-09-20T12:49:53.756Z level=INFO msg="Uploading 1 narinfos"5855lb # [ 149.290015] niks3-server[1010]: 2026/09/20 12:49:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5856lb # [ 149.303837] niks3-server[1010]: 2026/09/20 12:49:53 INFO Signed narinfos id=50 count=15857lb # [ 149.310386] niks3-server[1010]: 2026/09/20 12:49:53 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls5858worker1 # [ 149.292193] nix-grpc-daemon[1854]: time=2026-09-20T12:49:53.787Z level=INFO msg="Upload complete. (474ms)"5859lb # [ 149.321412] niks3-server[1010]: 2026/09/20 12:49:53 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5860lb # [ 149.328090] niks3-server[1010]: 2026/09/20 12:49:53 INFO Completed upload id=505861lb # [ 149.332277] niks3-server[1010]: 2026/09/20 12:49:53 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo5862worker1 # [ 149.299593] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47872 duration_s=0 paths=1 nar_bytes_in=5125863worker1 # [ 149.311488] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:478725864worker1 # [ 149.314938] nix-daemon[833]: reaped child process 1933, status = succeeded5865worker1 # [ 149.321814] nix-daemon[833]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)5866worker1 # [ 149.335216] nix-daemon[833]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)5867worker1 # [ 150.776766] nix-daemon[833]: reaped child process 1947, status = succeeded5868worker1 # [ 150.961726] nix-daemon[833]: accepted connection from pid 1962, user nix-grpc-daemon (trusted)5869worker1 # [ 150.979874] nix-daemon[833]: reaped child process 1965, status = succeeded5870lb # [ 151.021005] niks3-server[1010]: 2026/09/20 12:49:55 INFO Received uploads request method=POST path=/api/pending_closures5871worker1 # [ 151.005621] nix-grpc-daemon[1854]: time=2026-09-20T12:49:55.499Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5872worker1 # [ 151.007279] nix-grpc-daemon[1854]: time=2026-09-20T12:49:55.499Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"5873lb # [ 151.053718] niks3-server[1010]: 2026/09/20 12:49:55 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv5874lb # [ 151.068790] niks3-server[1010]: 2026/09/20 12:49:55 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst5875lb # [ 151.081091] niks3-server[1010]: 2026/09/20 12:49:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign5876worker1 # [ 151.057802] nix-grpc-daemon[1854]: time=2026-09-20T12:49:55.552Z level=INFO msg="Uploading 1 narinfos"5877lb # [ 151.088927] niks3-server[1010]: 2026/09/20 12:49:55 INFO Signed narinfos id=51 count=15878lb # [ 151.091420] niks3-server[1010]: 2026/09/20 12:49:55 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls5879lb # [ 151.101483] niks3-server[1010]: 2026/09/20 12:49:55 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete5880lb # [ 151.109287] niks3-server[1010]: 2026/09/20 12:49:55 INFO Completed upload id=515881worker1 # [ 151.080730] nix-grpc-daemon[1854]: time=2026-09-20T12:49:55.575Z level=INFO msg="Upload complete. (335ms)"5882lb # [ 151.112788] niks3-server[1010]: 2026/09/20 12:49:55 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo5883worker2 # [ 151.145983] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:55Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=15884worker1 # [ 151.092930] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47872 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=3 outputs=15885worker2 # [ 151.157873] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:55Z level=debug event=want client=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=05886worker1 # [ 151.111686] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:478725887worker1 # [ 151.117628] nix-daemon[833]: reaped child process 1945, status = succeeded5888worker1 # [ 151.125411] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:478725889worker1 # [ 151.138954] nix-grpc-daemon[1854]: time=2026-09-20T12:49:55.633Z level=INFO msg="All 1 paths already cached"5890worker1 # [ 151.146847] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:478725891worker1 # [ 151.158016] nix-daemon[833]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)5892worker1 # [ 151.353070] nix-daemon[833]: accepted connection from pid 1969, user nix-grpc-daemon (trusted)5893worker1 # [ 151.371633] nix-daemon[833]: reaped child process 1972, status = succeeded5894worker1 # [ 151.546212] nix-daemon[833]: accepted connection from pid 1974, user nix-grpc-daemon (trusted)5895worker1 # [ 151.563736] nix-daemon[833]: reaped child process 1977, status = succeeded5896lb # [ 151.603248] niks3-server[1010]: 2026/09/20 12:49:56 INFO Received uploads request method=POST path=/api/pending_closures5897worker1 # [ 151.584112] nix-grpc-daemon[1854]: time=2026-09-20T12:49:56.079Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5898worker1 # [ 151.585636] nix-grpc-daemon[1854]: time=2026-09-20T12:49:56.079Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"5899lb # [ 151.635175] niks3-server[1010]: 2026/09/20 12:49:56 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst5900lb # [ 151.647450] niks3-server[1010]: 2026/09/20 12:49:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign5901worker1 # [ 151.625550] nix-grpc-daemon[1854]: time=2026-09-20T12:49:56.120Z level=INFO msg="Uploading 1 narinfos"5902lb # [ 151.659769] niks3-server[1010]: 2026/09/20 12:49:56 INFO Signed narinfos id=52 count=15903lb # [ 151.666066] niks3-server[1010]: 2026/09/20 12:49:56 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls5904lb # [ 151.676918] niks3-server[1010]: 2026/09/20 12:49:56 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete5905lb # [ 151.684840] niks3-server[1010]: 2026/09/20 12:49:56 INFO Completed upload id=525906worker1 # [ 151.656631] nix-grpc-daemon[1854]: time=2026-09-20T12:49:56.151Z level=INFO msg="Upload complete. (485ms)"5907lb # [ 151.688766] niks3-server[1010]: 2026/09/20 12:49:56 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo5908worker1 # [ 151.664136] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47872 duration_s=0 paths=1 nar_bytes_in=6245909worker1 # [ 151.678324] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:478725910worker1 # [ 151.686271] nix-daemon[833]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)5911worker1 # [ 151.691494] nix-daemon[833]: reaped child process 1967, status = succeeded5912worker1 # [ 151.703085] nix-daemon[833]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)5913worker1 # [ 152.552673] nix-daemon[833]: reaped child process 1981, status = succeeded5914worker1 # [ 152.734541] nix-daemon[833]: accepted connection from pid 1996, user nix-grpc-daemon (trusted)5915worker1 # [ 152.752880] nix-daemon[833]: reaped child process 1999, status = succeeded5916lb # [ 152.793768] niks3-server[1010]: 2026/09/20 12:49:57 INFO Received uploads request method=POST path=/api/pending_closures5917worker1 # [ 152.776397] nix-grpc-daemon[1854]: time=2026-09-20T12:49:57.270Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5918worker1 # [ 152.777918] nix-grpc-daemon[1854]: time=2026-09-20T12:49:57.270Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"5919lb # [ 152.826688] niks3-server[1010]: 2026/09/20 12:49:57 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv5920lb # [ 152.847998] niks3-server[1010]: 2026/09/20 12:49:57 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst5921lb # [ 152.858573] niks3-server[1010]: 2026/09/20 12:49:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign5922lb # [ 152.865038] niks3-server[1010]: 2026/09/20 12:49:57 INFO Signed narinfos id=53 count=15923worker1 # [ 152.837130] nix-grpc-daemon[1854]: time=2026-09-20T12:49:57.331Z level=INFO msg="Uploading 1 narinfos"5924lb # [ 152.869620] niks3-server[1010]: 2026/09/20 12:49:57 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls5925lb # [ 152.882869] niks3-server[1010]: 2026/09/20 12:49:57 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete5926lb # [ 152.889713] niks3-server[1010]: 2026/09/20 12:49:57 INFO Completed upload id=535927worker1 # [ 152.860922] nix-grpc-daemon[1854]: time=2026-09-20T12:49:57.355Z level=INFO msg="Upload complete. (345ms)"5928lb # [ 152.892939] niks3-server[1010]: 2026/09/20 12:49:57 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo5929worker2 # [ 152.925439] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:57Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=15930worker1 # [ 152.874309] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47872 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=4 outputs=15931worker2 # [ 152.938541] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:57Z level=debug event=want client=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=05932worker1 # [ 152.896943] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:478725933worker1 # [ 152.901328] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:478725934worker1 # [ 152.907463] nix-daemon[833]: reaped child process 1979, status = succeeded5935worker1 # [ 152.914223] nix-grpc-daemon[1854]: time=2026-09-20T12:49:57.409Z level=INFO msg="All 1 paths already cached"5936worker1 # [ 152.921664] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:478725937worker1 # [ 152.934496] nix-daemon[833]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)5938worker1 # [ 153.127694] nix-daemon[833]: accepted connection from pid 2003, user nix-grpc-daemon (trusted)5939worker1 # [ 153.148244] nix-daemon[833]: reaped child process 2006, status = succeeded5940worker1 # [ 153.323668] nix-daemon[833]: accepted connection from pid 2008, user nix-grpc-daemon (trusted)5941worker1 # [ 153.341172] nix-daemon[833]: reaped child process 2011, status = succeeded5942lb # [ 153.381080] niks3-server[1010]: 2026/09/20 12:49:57 INFO Received uploads request method=POST path=/api/pending_closures5943worker1 # [ 153.361469] nix-grpc-daemon[1854]: time=2026-09-20T12:49:57.856Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5944worker1 # [ 153.363009] nix-grpc-daemon[1854]: time=2026-09-20T12:49:57.856Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"5945lb # [ 153.407430] niks3-server[1010]: 2026/09/20 12:49:57 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst5946lb # [ 153.422296] niks3-server[1010]: 2026/09/20 12:49:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign5947worker1 # [ 153.399815] nix-grpc-daemon[1854]: time=2026-09-20T12:49:57.894Z level=INFO msg="Uploading 1 narinfos"5948lb # [ 153.434724] niks3-server[1010]: 2026/09/20 12:49:57 INFO Signed narinfos id=54 count=15949lb # [ 153.440808] niks3-server[1010]: 2026/09/20 12:49:57 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls5950worker1 # [ 153.419850] nix-grpc-daemon[1854]: time=2026-09-20T12:49:57.914Z level=INFO msg="Upload complete. (471ms)"5951lb # [ 153.449728] niks3-server[1010]: 2026/09/20 12:49:57 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete5952lb # [ 153.454936] niks3-server[1010]: 2026/09/20 12:49:57 INFO Completed upload id=545953worker1 # [ 153.428209] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47872 duration_s=0 paths=1 nar_bytes_in=6245954lb # [ 153.458261] niks3-server[1010]: 2026/09/20 12:49:57 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo5955worker1 # [ 153.439877] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:478725956worker1 # [ 153.448280] nix-daemon[833]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)5957worker1 # [ 153.450855] nix-daemon[833]: reaped child process 2001, status = succeeded5958worker1 # [ 153.461418] nix-daemon[833]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)5959worker1 # [ 154.510369] nix-daemon[833]: reaped child process 2015, status = succeeded5960worker1 # [ 154.683986] nix-daemon[833]: accepted connection from pid 2030, user nix-grpc-daemon (trusted)5961worker1 # [ 154.703803] nix-daemon[833]: reaped child process 2033, status = succeeded5962lb # [ 154.746506] niks3-server[1010]: 2026/09/20 12:49:59 INFO Received uploads request method=POST path=/api/pending_closures5963worker1 # [ 154.731752] nix-grpc-daemon[1854]: time=2026-09-20T12:49:59.222Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5964worker1 # [ 154.733611] nix-grpc-daemon[1854]: time=2026-09-20T12:49:59.222Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"5965lb # [ 154.779942] niks3-server[1010]: 2026/09/20 12:49:59 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv5966lb # [ 154.792393] niks3-server[1010]: 2026/09/20 12:49:59 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst5967lb # [ 154.808211] niks3-server[1010]: 2026/09/20 12:49:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign5968worker1 # [ 154.785608] nix-grpc-daemon[1854]: time=2026-09-20T12:49:59.280Z level=INFO msg="Uploading 1 narinfos"5969lb # [ 154.820152] niks3-server[1010]: 2026/09/20 12:49:59 INFO Signed narinfos id=55 count=15970lb # [ 154.827005] niks3-server[1010]: 2026/09/20 12:49:59 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls5971lb # [ 154.833457] niks3-server[1010]: 2026/09/20 12:49:59 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete5972worker1 # [ 154.810360] nix-grpc-daemon[1854]: time=2026-09-20T12:49:59.305Z level=INFO msg="Upload complete. (336ms)"5973lb # [ 154.842471] niks3-server[1010]: 2026/09/20 12:49:59 INFO Completed upload id=555974lb # [ 154.846907] niks3-server[1010]: 2026/09/20 12:49:59 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo5975worker2 # [ 154.873371] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:59Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=15976worker1 # [ 154.825123] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47872 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=5 outputs=15977worker2 # [ 154.886281] nix-grpc-daemon[1170]: ts=2026-09-20T12:49:59Z level=debug event=want client=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=05978worker1 # [ 154.841685] nix-daemon[833]: reaped child process 2013, status = succeeded5979worker1 # [ 154.872798] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:478725980worker1 # [ 154.888109] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:478725981worker1 # [ 154.903463] nix-grpc-daemon[1854]: time=2026-09-20T12:49:59.398Z level=INFO msg="All 1 paths already cached"5982worker1 # [ 154.912528] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:478725983worker1 # [ 154.926971] nix-daemon[833]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)5984worker1 # [ 155.130971] nix-daemon[833]: accepted connection from pid 2037, user nix-grpc-daemon (trusted)5985worker1 # [ 155.148957] nix-daemon[833]: reaped child process 2040, status = succeeded5986worker1 # [ 155.329322] nix-daemon[833]: accepted connection from pid 2042, user nix-grpc-daemon (trusted)5987worker1 # [ 155.347595] nix-daemon[833]: reaped child process 2045, status = succeeded5988lb # [ 155.387719] niks3-server[1010]: 2026/09/20 12:49:59 INFO Received uploads request method=POST path=/api/pending_closures5989worker1 # [ 155.368880] nix-grpc-daemon[1854]: time=2026-09-20T12:49:59.863Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5990worker1 # [ 155.370447] nix-grpc-daemon[1854]: time=2026-09-20T12:49:59.863Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"5991lb # [ 155.416124] niks3-server[1010]: 2026/09/20 12:49:59 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst5992worker1 # [ 155.401296] nix-grpc-daemon[1854]: time=2026-09-20T12:49:59.896Z level=INFO msg="Uploading 1 narinfos"5993lb # [ 155.433912] niks3-server[1010]: 2026/09/20 12:49:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign5994lb # [ 155.443431] niks3-server[1010]: 2026/09/20 12:49:59 INFO Signed narinfos id=56 count=15995lb # [ 155.447873] niks3-server[1010]: 2026/09/20 12:49:59 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls5996lb # [ 155.455398] niks3-server[1010]: 2026/09/20 12:49:59 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete5997lb # [ 155.460544] niks3-server[1010]: 2026/09/20 12:49:59 INFO Completed upload id=565998worker1 # [ 155.432303] nix-grpc-daemon[1854]: time=2026-09-20T12:49:59.927Z level=INFO msg="Upload complete. (488ms)"5999lb # [ 155.463326] niks3-server[1010]: 2026/09/20 12:49:59 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo6000worker1 # [ 155.440367] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47872 duration_s=0 paths=1 nar_bytes_in=6246001worker1 # [ 155.448657] nix-grpc-daemon[1798]: ts=2026-09-20T12:49:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:478726002worker1 # [ 155.459465] nix-daemon[833]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)6003worker1 # [ 155.465138] nix-daemon[833]: reaped child process 2035, status = succeeded6004worker1 # [ 155.478958] nix-daemon[833]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)6005worker1 # [ 156.524902] nix-daemon[833]: reaped child process 2049, status = succeeded6006worker1 # [ 156.697209] nix-daemon[833]: accepted connection from pid 2064, user nix-grpc-daemon (trusted)6007worker1 # [ 156.716602] nix-daemon[833]: reaped child process 2067, status = succeeded6008lb # [ 156.757620] niks3-server[1010]: 2026/09/20 12:50:01 INFO Received uploads request method=POST path=/api/pending_closures6009worker1 # [ 156.740440] nix-grpc-daemon[1854]: time=2026-09-20T12:50:01.233Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6010worker1 # [ 156.742173] nix-grpc-daemon[1854]: time=2026-09-20T12:50:01.233Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"6011lb # [ 156.795447] niks3-server[1010]: 2026/09/20 12:50:01 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst6012lb # [ 156.812534] niks3-server[1010]: 2026/09/20 12:50:01 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv6013lb # [ 156.820074] niks3-server[1010]: 2026/09/20 12:50:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6014worker1 # [ 156.797190] nix-grpc-daemon[1854]: time=2026-09-20T12:50:01.291Z level=INFO msg="Uploading 1 narinfos"6015lb # [ 156.829480] niks3-server[1010]: 2026/09/20 12:50:01 INFO Signed narinfos id=57 count=16016lb # [ 156.834408] niks3-server[1010]: 2026/09/20 12:50:01 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls6017lb # [ 156.840285] niks3-server[1010]: 2026/09/20 12:50:01 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6018lb # [ 156.847337] niks3-server[1010]: 2026/09/20 12:50:01 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo6019lb # [ 156.852192] niks3-server[1010]: 2026/09/20 12:50:01 INFO Completed upload id=576020worker1 # [ 156.824143] nix-grpc-daemon[1854]: time=2026-09-20T12:50:01.319Z level=INFO msg="Upload complete. (334ms)"6021worker2 # [ 156.886174] nix-grpc-daemon[1170]: ts=2026-09-20T12:50:01Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=16022worker1 # [ 156.837099] nix-grpc-daemon[1798]: ts=2026-09-20T12:50:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47872 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=6 outputs=16023worker2 # [ 156.899288] nix-grpc-daemon[1170]: ts=2026-09-20T12:50:01Z level=debug event=want client=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=06024worker1 # [ 156.860817] nix-grpc-daemon[1798]: ts=2026-09-20T12:50:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:478726025worker1 # [ 156.864916] nix-grpc-daemon[1798]: ts=2026-09-20T12:50:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:478726026worker1 # [ 156.870278] nix-daemon[833]: reaped child process 2047, status = succeeded6027worker1 # [ 156.877115] nix-grpc-daemon[1854]: time=2026-09-20T12:50:01.372Z level=INFO msg="All 2 paths already cached"6028worker1 # [ 156.884988] nix-grpc-daemon[1798]: ts=2026-09-20T12:50:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:478726029worker1 # [ 156.896306] nix-daemon[833]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)6030worker1 # [ 157.092486] nix-daemon[833]: accepted connection from pid 2071, user nix-grpc-daemon (trusted)6031worker1 # [ 157.110024] nix-daemon[833]: reaped child process 2074, status = succeeded6032worker1 # [ 157.288102] nix-daemon[833]: accepted connection from pid 2076, user nix-grpc-daemon (trusted)6033worker1 # [ 157.304849] nix-daemon[833]: reaped child process 2079, status = succeeded6034lb # [ 157.347308] niks3-server[1010]: 2026/09/20 12:50:01 INFO Received uploads request method=POST path=/api/pending_closures6035worker1 # [ 157.328653] nix-grpc-daemon[1854]: time=2026-09-20T12:50:01.823Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6036worker1 # [ 157.330167] nix-grpc-daemon[1854]: time=2026-09-20T12:50:01.823Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"6037lb # [ 157.374352] niks3-server[1010]: 2026/09/20 12:50:01 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst6038lb # [ 157.390076] niks3-server[1010]: 2026/09/20 12:50:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6039worker1 # [ 157.367821] nix-grpc-daemon[1854]: time=2026-09-20T12:50:01.862Z level=INFO msg="Uploading 1 narinfos"6040lb # [ 157.402873] niks3-server[1010]: 2026/09/20 12:50:01 INFO Signed narinfos id=58 count=16041lb # [ 157.408488] niks3-server[1010]: 2026/09/20 12:50:01 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls6042worker1 # [ 157.387551] nix-grpc-daemon[1854]: time=2026-09-20T12:50:01.882Z level=INFO msg="Upload complete. (478ms)"6043lb # [ 157.417618] niks3-server[1010]: 2026/09/20 12:50:01 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6044lb # [ 157.422908] niks3-server[1010]: 2026/09/20 12:50:01 INFO Completed upload id=586045lb # [ 157.426228] niks3-server[1010]: 2026/09/20 12:50:01 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo6046worker1 # [ 157.394058] nix-grpc-daemon[1798]: ts=2026-09-20T12:50:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47872 duration_s=0 paths=1 nar_bytes_in=7526047worker1 # [ 157.407553] nix-grpc-daemon[1798]: ts=2026-09-20T12:50:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:478726048worker1 # [ 157.413726] nix-daemon[833]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)6049worker1 # [ 157.418380] nix-daemon[833]: reaped child process 2069, status = succeeded6050worker1 # [ 157.431152] nix-daemon[833]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)6051worker1 # [ 158.259264] nix-daemon[833]: reaped child process 2083, status = succeeded6052worker1 # [ 158.423600] nix-daemon[833]: accepted connection from pid 2098, user nix-grpc-daemon (trusted)6053worker1 # [ 158.440545] nix-daemon[833]: reaped child process 2101, status = succeeded6054lb # [ 158.487832] niks3-server[1010]: 2026/09/20 12:50:02 INFO Received uploads request method=POST path=/api/pending_closures6055worker1 # [ 158.467676] nix-grpc-daemon[1854]: time=2026-09-20T12:50:02.961Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6056worker1 # [ 158.470655] nix-grpc-daemon[1854]: time=2026-09-20T12:50:02.961Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"6057lb # [ 158.528069] niks3-server[1010]: 2026/09/20 12:50:03 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv6058lb # [ 158.545195] niks3-server[1010]: 2026/09/20 12:50:03 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst6059worker1 # [ 158.530686] nix-grpc-daemon[1854]: time=2026-09-20T12:50:03.025Z level=INFO msg="Uploading 1 narinfos"6060lb # [ 158.554851] niks3-server[1010]: 2026/09/20 12:50:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6061lb # [ 158.563417] niks3-server[1010]: 2026/09/20 12:50:03 INFO Signed narinfos id=59 count=16062lb # [ 158.570039] niks3-server[1010]: 2026/09/20 12:50:03 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls6063lb # [ 158.583196] niks3-server[1010]: 2026/09/20 12:50:03 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6064lb # [ 158.588560] niks3-server[1010]: 2026/09/20 12:50:03 INFO Completed upload id=596065worker1 # [ 158.561667] nix-grpc-daemon[1854]: time=2026-09-20T12:50:03.056Z level=INFO msg="Upload complete. (321ms)"6066lb # [ 158.593953] niks3-server[1010]: 2026/09/20 12:50:03 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo6067worker2 # [ 158.625609] nix-grpc-daemon[1170]: ts=2026-09-20T12:50:03Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=16068worker1 # [ 158.573093] nix-grpc-daemon[1798]: ts=2026-09-20T12:50:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47872 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=7 outputs=16069worker1 # [ 158.590678] nix-daemon[833]: reaped child process 2081, status = succeeded6070worker1 # [ 158.616557] nix-grpc-daemon[1798]: ts=2026-09-20T12:50:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:478726071worker1 # [ 158.632119] nix-grpc-daemon[1798]: ts=2026-09-20T12:50:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:478726072worker1 # [ 158.647866] nix-grpc-daemon[1854]: time=2026-09-20T12:50:03.142Z level=INFO msg="All 2 paths already cached"6073worker1 # [ 158.657143] nix-grpc-daemon[1798]: ts=2026-09-20T12:50:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:478726074worker1 # [ 158.671028] nix-daemon[833]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)6075worker1 # [ 158.876235] nix-daemon[833]: accepted connection from pid 2105, user nix-grpc-daemon (trusted)6076worker1 # [ 158.894168] nix-daemon[833]: reaped child process 2108, status = succeeded6077worker1 # [ 159.072159] nix-daemon[833]: accepted connection from pid 2110, user nix-grpc-daemon (trusted)6078worker1 # [ 159.089348] nix-daemon[833]: reaped child process 2113, status = succeeded6079lb # [ 159.131649] niks3-server[1010]: 2026/09/20 12:50:03 INFO Received uploads request method=POST path=/api/pending_closures6080worker1 # [ 159.114982] nix-grpc-daemon[1854]: time=2026-09-20T12:50:03.609Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6081worker1 # [ 159.116607] nix-grpc-daemon[1854]: time=2026-09-20T12:50:03.609Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"6082lb # [ 159.163827] niks3-server[1010]: 2026/09/20 12:50:03 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst6083worker1 # [ 159.149462] nix-grpc-daemon[1854]: time=2026-09-20T12:50:03.644Z level=INFO msg="Uploading 1 narinfos"6084lb # [ 159.180443] niks3-server[1010]: 2026/09/20 12:50:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6085lb # [ 159.193953] niks3-server[1010]: 2026/09/20 12:50:03 INFO Signed narinfos id=60 count=16086lb # [ 159.198482] niks3-server[1010]: 2026/09/20 12:50:03 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls6087lb # [ 159.209970] niks3-server[1010]: 2026/09/20 12:50:03 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6088lb # [ 159.215827] niks3-server[1010]: 2026/09/20 12:50:03 INFO Completed upload id=606089worker1 # [ 159.186387] nix-grpc-daemon[1854]: time=2026-09-20T12:50:03.681Z level=INFO msg="Upload complete. (499ms)"6090lb # [ 159.220453] niks3-server[1010]: 2026/09/20 12:50:03 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo6091worker1 # [ 159.193792] nix-grpc-daemon[1798]: ts=2026-09-20T12:50:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47872 duration_s=0 paths=1 nar_bytes_in=7526092worker1 # [ 159.204881] nix-grpc-daemon[1798]: ts=2026-09-20T12:50:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:478726093worker1 # [ 159.216473] nix-daemon[833]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)6094worker1 # [ 159.222046] nix-daemon[833]: reaped child process 2103, status = succeeded6095worker1 # [ 159.237161] nix-daemon[833]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)6096worker1 # [ 160.285169] nix-daemon[833]: reaped child process 2117, status = succeeded6097worker1 # [ 160.472648] nix-daemon[833]: accepted connection from pid 2132, user nix-grpc-daemon (trusted)6098worker1 # [ 160.490531] nix-daemon[833]: reaped child process 2135, status = succeeded6099lb # [ 160.537861] niks3-server[1010]: 2026/09/20 12:50:05 INFO Received uploads request method=POST path=/api/pending_closures6100worker1 # [ 160.520369] nix-grpc-daemon[1854]: time=2026-09-20T12:50:05.013Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6101worker1 # [ 160.521901] nix-grpc-daemon[1854]: time=2026-09-20T12:50:05.014Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"6102lb # [ 160.571886] niks3-server[1010]: 2026/09/20 12:50:05 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst6103lb # [ 160.589315] niks3-server[1010]: 2026/09/20 12:50:05 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv6104lb # [ 160.597480] niks3-server[1010]: 2026/09/20 12:50:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6105worker1 # [ 160.574632] nix-grpc-daemon[1854]: time=2026-09-20T12:50:05.069Z level=INFO msg="Uploading 1 narinfos"6106lb # [ 160.606862] niks3-server[1010]: 2026/09/20 12:50:05 INFO Signed narinfos id=61 count=16107lb # [ 160.612321] niks3-server[1010]: 2026/09/20 12:50:05 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls6108lb # [ 160.620649] niks3-server[1010]: 2026/09/20 12:50:05 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6109worker1 # [ 160.598431] nix-grpc-daemon[1854]: time=2026-09-20T12:50:05.093Z level=INFO msg="Upload complete. (344ms)"6110lb # [ 160.628460] niks3-server[1010]: 2026/09/20 12:50:05 INFO Completed upload id=616111lb # [ 160.631581] niks3-server[1010]: 2026/09/20 12:50:05 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo6112worker2 # [ 160.663791] nix-grpc-daemon[1170]: ts=2026-09-20T12:50:05Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=16113worker1 # [ 160.612268] nix-grpc-daemon[1798]: ts=2026-09-20T12:50:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47872 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=8 outputs=16114worker1 # [ 160.626764] nix-daemon[833]: reaped child process 2115, status = succeeded6115worker1 # [ 160.656230] nix-grpc-daemon[1798]: ts=2026-09-20T12:50:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:478726116worker1 # [ 160.671367] nix-grpc-daemon[1798]: ts=2026-09-20T12:50:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:478726117worker1 # [ 160.686516] nix-grpc-daemon[1854]: time=2026-09-20T12:50:05.181Z level=INFO msg="All 2 paths already cached"6118worker1 # [ 160.695565] nix-grpc-daemon[1798]: ts=2026-09-20T12:50:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:478726119worker1 # [ 160.709628] nix-daemon[833]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)6120worker1 # [ 160.911742] nix-daemon[833]: accepted connection from pid 2139, user nix-grpc-daemon (trusted)6121worker1 # [ 160.929439] nix-daemon[833]: reaped child process 2142, status = succeeded6122worker1 # [ 161.104387] nix-daemon[833]: accepted connection from pid 2144, user nix-grpc-daemon (trusted)6123worker1 # [ 161.121979] nix-daemon[833]: reaped child process 2147, status = succeeded6124lb # [ 161.163633] niks3-server[1010]: 2026/09/20 12:50:05 INFO Received uploads request method=POST path=/api/pending_closures6125worker1 # [ 161.145450] nix-grpc-daemon[1854]: time=2026-09-20T12:50:05.640Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6126worker1 # [ 161.147017] nix-grpc-daemon[1854]: time=2026-09-20T12:50:05.640Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"6127lb # [ 161.190570] niks3-server[1010]: 2026/09/20 12:50:05 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst6128worker1 # [ 161.183865] nix-grpc-daemon[1854]: time=2026-09-20T12:50:05.678Z level=INFO msg="Uploading 1 narinfos"6129lb # [ 161.206744] niks3-server[1010]: 2026/09/20 12:50:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6130lb # [ 161.219452] niks3-server[1010]: 2026/09/20 12:50:05 INFO Signed narinfos id=62 count=16131lb # [ 161.227041] niks3-server[1010]: 2026/09/20 12:50:05 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls6132lb # [ 161.237175] niks3-server[1010]: 2026/09/20 12:50:05 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6133worker1 # [ 161.213662] nix-grpc-daemon[1854]: time=2026-09-20T12:50:05.708Z level=INFO msg="Upload complete. (487ms)"6134lb # [ 161.242820] niks3-server[1010]: 2026/09/20 12:50:05 INFO Completed upload id=626135lb # [ 161.247070] niks3-server[1010]: 2026/09/20 12:50:05 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo6136worker1 # [ 161.220113] nix-grpc-daemon[1798]: ts=2026-09-20T12:50:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47872 duration_s=0 paths=1 nar_bytes_in=7526137worker1 # [ 161.228241] nix-grpc-daemon[1798]: ts=2026-09-20T12:50:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:478726138worker1 # [ 161.241548] nix-daemon[833]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)6139worker1 # [ 161.244406] nix-daemon[833]: reaped child process 2137, status = succeeded6140worker1 # [ 161.258362] nix-daemon[833]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)6141worker1 # [ 162.084192] nix-daemon[833]: reaped child process 2151, status = succeeded6142worker1 # [ 162.263008] nix-daemon[833]: accepted connection from pid 2166, user nix-grpc-daemon (trusted)6143worker1 # [ 162.284793] nix-daemon[833]: reaped child process 2169, status = succeeded6144lb # [ 162.330209] niks3-server[1010]: 2026/09/20 12:50:06 INFO Received uploads request method=POST path=/api/pending_closures6145worker1 # [ 162.322379] nix-grpc-daemon[1854]: time=2026-09-20T12:50:06.817Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6146worker1 # [ 162.326065] nix-grpc-daemon[1854]: time=2026-09-20T12:50:06.819Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"6147lb # [ 162.401525] niks3-server[1010]: 2026/09/20 12:50:06 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst6148lb # [ 162.412436] niks3-server[1010]: 2026/09/20 12:50:06 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv6149lb # [ 162.420605] niks3-server[1010]: 2026/09/20 12:50:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6150worker1 # [ 162.392453] nix-grpc-daemon[1854]: time=2026-09-20T12:50:06.886Z level=INFO msg="Uploading 1 narinfos"6151lb # [ 162.431126] niks3-server[1010]: 2026/09/20 12:50:06 INFO Signed narinfos id=63 count=16152lb # [ 162.436890] niks3-server[1010]: 2026/09/20 12:50:06 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls6153lb # [ 162.444951] niks3-server[1010]: 2026/09/20 12:50:06 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6154worker1 # [ 162.423255] nix-grpc-daemon[1854]: time=2026-09-20T12:50:06.918Z level=INFO msg="Upload complete. (355ms)"6155lb # [ 162.454198] niks3-server[1010]: 2026/09/20 12:50:06 INFO Completed upload id=636156lb # [ 162.458578] niks3-server[1010]: 2026/09/20 12:50:06 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo6157worker1 # [ 162.437576] nix-grpc-daemon[1798]: ts=2026-09-20T12:50:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47872 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=9 outputs=16158worker1 # [ 162.460165] nix-daemon[833]: reaped child process 2149, status = succeeded6159client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 19.74 seconds)6160worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6161worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)6162client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16163worker1 # [ 162.915611] nix-grpc-daemon[1798]: ts=2026-09-20T12:50:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:478726164worker2 # [ 162.977710] nix-grpc-daemon[1170]: ts=2026-09-20T12:50:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:391806165worker2 # [ 163.009060] nix-grpc-daemon[1170]: ts=2026-09-20T12:50:07Z level=debug event=want client=2 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=06166client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 0.39 seconds)6167(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 20.21 seconds)6168subtest: low disk drains a worker and builds go to the other6169worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6170worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.24 seconds)6171worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6172worker1 # [ 164.472176] nix-grpc-daemon[1798]: ts=2026-09-20T12:50:08Z level=info event=unhealthy reason=min_free6173worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.15 seconds)6174client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&26175client # don't know how to build these paths:6176client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6177worker1 # [ 165.694256] nix-grpc-daemon[1798]: ts=2026-09-20T12:50:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:478726178worker2 # [ 165.755096] nix-grpc-daemon[1170]: ts=2026-09-20T12:50:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:391806179worker2 # [ 165.792603] nix-grpc-daemon[1170]: ts=2026-09-20T12:50:10Z level=debug event=want client=3 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=06180worker2 # [ 165.802061] nix-grpc-daemon[1170]: ts=2026-09-20T12:50:10Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=16181worker2 # [ 165.847522] nix-grpc-daemon[1170]: ts=2026-09-20T12:50:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:391806182worker2 # [ 165.868188] nix-grpc-daemon[1170]: ts=2026-09-20T12:50:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:391806183client # copying 1 paths to 'lb:50051'...6184client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...6185worker2 # [ 165.887742] nix-grpc-daemon[1170]: ts=2026-09-20T12:50:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:391806186worker2 # [ 165.907146] nix-daemon[842]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)6187worker2 # [ 166.151802] nix-daemon[842]: accepted connection from pid 1506, user nix-grpc-daemon (trusted)6188worker2 # [ 166.177971] nix-daemon[842]: reaped child process 1509, status = succeeded6189worker2 # [ 166.379843] nix-daemon[842]: accepted connection from pid 1511, user nix-grpc-daemon (trusted)6190worker2 # [ 166.401140] nix-daemon[842]: reaped child process 1514, status = succeeded6191lb # [ 166.389784] niks3-server[1010]: 2026/09/20 12:50:10 INFO Received uploads request method=POST path=/api/pending_closures6192worker2 # [ 166.429415] nix-grpc-daemon[1308]: time=2026-09-20T12:50:10.945Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6193worker2 # [ 166.430962] nix-grpc-daemon[1308]: time=2026-09-20T12:50:10.945Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6194lb # [ 166.427740] niks3-server[1010]: 2026/09/20 12:50:10 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6195worker2 # [ 166.476973] nix-grpc-daemon[1308]: time=2026-09-20T12:50:10.993Z level=INFO msg="Uploading 1 narinfos"6196lb # [ 166.444416] niks3-server[1010]: 2026/09/20 12:50:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6197lb # [ 166.458537] niks3-server[1010]: 2026/09/20 12:50:10 INFO Signed narinfos id=64 count=16198lb # [ 166.465657] niks3-server[1010]: 2026/09/20 12:50:10 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6199lb # [ 166.476339] niks3-server[1010]: 2026/09/20 12:50:10 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6200lb # [ 166.481262] niks3-server[1010]: 2026/09/20 12:50:10 INFO Completed upload id=646201worker2 # [ 166.506420] nix-grpc-daemon[1308]: time=2026-09-20T12:50:11.023Z level=INFO msg="Upload complete. (579ms)"6202lb # [ 166.484114] niks3-server[1010]: 2026/09/20 12:50:10 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6203worker2 # [ 166.516363] nix-grpc-daemon[1170]: ts=2026-09-20T12:50:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39180 duration_s=0 paths=1 nar_bytes_in=5126204worker2 # [ 166.534092] nix-grpc-daemon[1170]: ts=2026-09-20T12:50:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:391806205worker2 # [ 166.543787] nix-daemon[842]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)6206worker2 # [ 166.550418] nix-daemon[842]: reaped child process 1504, status = succeeded6207client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6208worker2 # [ 166.565382] nix-daemon[842]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)6209client # farm-a> worker2: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6210client # farm-a> LOG-farm-a-drain6211worker2 # [ 167.821970] nix-daemon[842]: reaped child process 1518, status = succeeded6212worker2 # [ 168.025407] nix-daemon[842]: accepted connection from pid 1533, user nix-grpc-daemon (trusted)6213worker2 # [ 168.047436] nix-daemon[842]: reaped child process 1536, status = succeeded6214lb # [ 168.038470] niks3-server[1010]: 2026/09/20 12:50:12 INFO Received uploads request method=POST path=/api/pending_closures6215worker2 # [ 168.075475] nix-grpc-daemon[1308]: time=2026-09-20T12:50:12.589Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6216worker2 # [ 168.077280] nix-grpc-daemon[1308]: time=2026-09-20T12:50:12.589Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6217lb # [ 168.097441] niks3-server[1010]: 2026/09/20 12:50:12 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6218lb # [ 168.111427] niks3-server[1010]: 2026/09/20 12:50:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6219lb # [ 168.124736] niks3-server[1010]: 2026/09/20 12:50:12 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6220lb # [ 168.136326] niks3-server[1010]: 2026/09/20 12:50:12 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6221lb # [ 168.145184] niks3-server[1010]: 2026/09/20 12:50:12 INFO Signed narinfos id=65 count=16222worker2 # [ 168.171516] nix-grpc-daemon[1308]: time=2026-09-20T12:50:12.687Z level=INFO msg="Uploading 1 narinfos"6223lb # [ 168.159812] niks3-server[1010]: 2026/09/20 12:50:12 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6224lb # [ 168.168594] niks3-server[1010]: 2026/09/20 12:50:12 INFO Completed upload id=656225lb # [ 168.171149] niks3-server[1010]: 2026/09/20 12:50:12 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6226worker2 # [ 168.192311] nix-grpc-daemon[1308]: time=2026-09-20T12:50:12.709Z level=INFO msg="Upload complete. (407ms)"6227worker2 # [ 168.216804] nix-grpc-daemon[1170]: ts=2026-09-20T12:50:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39180 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=10 outputs=16228worker2 # [ 168.236176] nix-grpc-daemon[1170]: ts=2026-09-20T12:50:12Z level=debug event=want client=3 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06229worker2 # [ 168.240479] nix-grpc-daemon[1170]: ts=2026-09-20T12:50:12Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16230worker2 # [ 168.245167] nix-daemon[842]: reaped child process 1516, status = succeeded6231worker2 # [ 168.261749] nix-grpc-daemon[1170]: ts=2026-09-20T12:50:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:391806232worker2 # [ 168.280820] nix-grpc-daemon[1170]: ts=2026-09-20T12:50:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:391806233worker2 # [ 168.297405] nix-grpc-daemon[1308]: time=2026-09-20T12:50:12.814Z level=INFO msg="All 1 paths already cached"6234client # copying 1 paths to 'lb:50051'...6235client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6236worker2 # [ 168.310094] nix-grpc-daemon[1170]: ts=2026-09-20T12:50:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:391806237worker2 # [ 168.332688] nix-daemon[842]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)6238worker2 # [ 168.580411] nix-daemon[842]: accepted connection from pid 1542, user nix-grpc-daemon (trusted)6239worker2 # [ 168.606282] nix-daemon[842]: reaped child process 1545, status = succeeded6240worker2 # [ 168.812053] nix-daemon[842]: accepted connection from pid 1547, user nix-grpc-daemon (trusted)6241worker2 # [ 168.833899] nix-daemon[842]: reaped child process 1550, status = succeeded6242lb # [ 168.823361] niks3-server[1010]: 2026/09/20 12:50:13 INFO Received uploads request method=POST path=/api/pending_closures6243worker2 # [ 168.860823] nix-grpc-daemon[1308]: time=2026-09-20T12:50:13.377Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6244worker2 # [ 168.862818] nix-grpc-daemon[1308]: time=2026-09-20T12:50:13.377Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6245lb # [ 168.865763] niks3-server[1010]: 2026/09/20 12:50:13 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6246worker2 # [ 168.904744] nix-grpc-daemon[1308]: time=2026-09-20T12:50:13.421Z level=INFO msg="Uploading 1 narinfos"6247lb # [ 168.884557] niks3-server[1010]: 2026/09/20 12:50:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6248lb # [ 168.899877] niks3-server[1010]: 2026/09/20 12:50:13 INFO Signed narinfos id=66 count=16249lb # [ 168.912540] niks3-server[1010]: 2026/09/20 12:50:13 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6250lb # [ 168.920083] niks3-server[1010]: 2026/09/20 12:50:13 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6251lb # [ 168.924460] niks3-server[1010]: 2026/09/20 12:50:13 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6252lb # [ 168.927906] niks3-server[1010]: 2026/09/20 12:50:13 INFO Completed upload id=666253worker2 # [ 168.953480] nix-grpc-daemon[1308]: time=2026-09-20T12:50:13.470Z level=INFO msg="Upload complete. (599ms)"6254worker2 # [ 168.965460] nix-grpc-daemon[1170]: ts=2026-09-20T12:50:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39180 duration_s=0 paths=1 nar_bytes_in=6326255worker2 # [ 168.976546] nix-grpc-daemon[1170]: ts=2026-09-20T12:50:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:391806256worker2 # [ 168.992645] nix-daemon[842]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)6257worker2 # [ 168.995571] nix-daemon[842]: reaped child process 1540, status = succeeded6258client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6259worker2 # [ 169.010120] nix-daemon[842]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)6260client # farm-b> worker2: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6261client # farm-b> LOG-farm-b-drain6262worker2 # [ 170.262792] nix-daemon[842]: reaped child process 1554, status = succeeded6263worker2 # [ 170.489466] nix-daemon[842]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)6264worker2 # [ 170.511179] nix-daemon[842]: reaped child process 1572, status = succeeded6265lb # [ 170.502493] niks3-server[1010]: 2026/09/20 12:50:15 INFO Received uploads request method=POST path=/api/pending_closures6266worker2 # [ 170.536759] nix-grpc-daemon[1308]: time=2026-09-20T12:50:15.053Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6267worker2 # [ 170.540447] nix-grpc-daemon[1308]: time=2026-09-20T12:50:15.055Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6268lb # [ 170.548079] niks3-server[1010]: 2026/09/20 12:50:15 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6269lb # [ 170.560410] niks3-server[1010]: 2026/09/20 12:50:15 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6270lb # [ 170.571886] niks3-server[1010]: 2026/09/20 12:50:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6271worker2 # [ 170.598209] nix-grpc-daemon[1308]: time=2026-09-20T12:50:15.114Z level=INFO msg="Uploading 1 narinfos"6272lb # [ 170.580444] niks3-server[1010]: 2026/09/20 12:50:15 INFO Signed narinfos id=67 count=16273lb # [ 170.584987] niks3-server[1010]: 2026/09/20 12:50:15 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6274lb # [ 170.595438] niks3-server[1010]: 2026/09/20 12:50:15 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6275lb # [ 170.600458] niks3-server[1010]: 2026/09/20 12:50:15 INFO Completed upload id=676276worker2 # [ 170.626068] nix-grpc-daemon[1308]: time=2026-09-20T12:50:15.142Z level=INFO msg="Upload complete. (398ms)"6277lb # [ 170.602971] niks3-server[1010]: 2026/09/20 12:50:15 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6278worker2 # [ 170.648624] nix-grpc-daemon[1170]: ts=2026-09-20T12:50:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39180 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=11 outputs=16279worker2 # [ 170.664404] nix-grpc-daemon[1170]: ts=2026-09-20T12:50:15Z level=debug event=want client=3 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06280worker2 # [ 170.667960] nix-grpc-daemon[1170]: ts=2026-09-20T12:50:15Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16281worker2 # [ 170.674342] nix-daemon[842]: reaped child process 1552, status = succeeded6282worker2 # [ 170.695182] nix-grpc-daemon[1170]: ts=2026-09-20T12:50:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:391806283worker2 # [ 170.714450] nix-grpc-daemon[1170]: ts=2026-09-20T12:50:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:391806284worker2 # [ 170.731721] nix-grpc-daemon[1308]: time=2026-09-20T12:50:15.248Z level=INFO msg="All 2 paths already cached"6285client # copying 1 paths to 'lb:50051'...6286client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6287worker2 # [ 170.744806] nix-grpc-daemon[1170]: ts=2026-09-20T12:50:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:391806288worker2 # [ 170.760931] nix-daemon[842]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)6289worker2 # [ 170.990013] nix-daemon[842]: accepted connection from pid 1578, user nix-grpc-daemon (trusted)6290worker2 # [ 171.011188] nix-daemon[842]: reaped child process 1581, status = succeeded6291worker2 # [ 171.196505] nix-daemon[842]: accepted connection from pid 1583, user nix-grpc-daemon (trusted)6292worker2 # [ 171.214369] nix-daemon[842]: reaped child process 1586, status = succeeded6293lb # [ 171.201248] niks3-server[1010]: 2026/09/20 12:50:15 INFO Received uploads request method=POST path=/api/pending_closures6294worker2 # [ 171.235642] nix-grpc-daemon[1308]: time=2026-09-20T12:50:15.752Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6295worker2 # [ 171.237277] nix-grpc-daemon[1308]: time=2026-09-20T12:50:15.752Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6296lb # [ 171.228317] niks3-server[1010]: 2026/09/20 12:50:15 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6297worker2 # [ 171.267652] nix-grpc-daemon[1308]: time=2026-09-20T12:50:15.784Z level=INFO msg="Uploading 1 narinfos"6298lb # [ 171.246230] niks3-server[1010]: 2026/09/20 12:50:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6299lb # [ 171.255501] niks3-server[1010]: 2026/09/20 12:50:15 INFO Signed narinfos id=68 count=16300lb # [ 171.261161] niks3-server[1010]: 2026/09/20 12:50:15 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6301worker2 # [ 171.294624] nix-grpc-daemon[1308]: time=2026-09-20T12:50:15.811Z level=INFO msg="Upload complete. (513ms)"6302lb # [ 171.269644] niks3-server[1010]: 2026/09/20 12:50:15 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6303lb # [ 171.274490] niks3-server[1010]: 2026/09/20 12:50:15 INFO Completed upload id=686304lb # [ 171.277562] niks3-server[1010]: 2026/09/20 12:50:15 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6305worker2 # [ 171.303566] nix-grpc-daemon[1170]: ts=2026-09-20T12:50:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39180 duration_s=0 paths=1 nar_bytes_in=7606306worker2 # [ 171.314036] nix-grpc-daemon[1170]: ts=2026-09-20T12:50:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:391806307worker2 # [ 171.320126] nix-daemon[842]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)6308worker2 # [ 171.324607] nix-daemon[842]: reaped child process 1576, status = succeeded6309client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6310client # farm-top> worker2: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6311worker2 # [ 171.336711] nix-daemon[842]: accepted connection from pid 1170, user nix-grpc-daemon (trusted)6312lb # [ 172.363720] envoy[927]: conn peer=[2001:db8:1::1]:60924 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27105 tx=10678 ms=194236313lb # [ 172.368972] envoy[927]: conn peer=[2001:db8:1::1]:51522 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=880 tx=482 ms=686314client # farm-top> LOG-farm-top-drain6315worker2 # [ 172.780449] nix-daemon[842]: reaped child process 1590, status = succeeded6316worker2 # [ 172.965817] nix-daemon[842]: accepted connection from pid 1605, user nix-grpc-daemon (trusted)6317worker2 # [ 172.984145] nix-daemon[842]: reaped child process 1608, status = succeeded6318lb # [ 172.972801] niks3-server[1010]: 2026/09/20 12:50:17 INFO Received uploads request method=POST path=/api/pending_closures6319worker2 # [ 173.008418] nix-grpc-daemon[1308]: time=2026-09-20T12:50:17.523Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6320worker2 # [ 173.009896] nix-grpc-daemon[1308]: time=2026-09-20T12:50:17.523Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6321lb # [ 173.008684] niks3-server[1010]: 2026/09/20 12:50:17 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6322lb # [ 173.022162] niks3-server[1010]: 2026/09/20 12:50:17 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6323worker2 # [ 173.056861] nix-grpc-daemon[1308]: time=2026-09-20T12:50:17.573Z level=INFO msg="Uploading 1 narinfos"6324lb # [ 173.031547] niks3-server[1010]: 2026/09/20 12:50:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6325lb # [ 173.040914] niks3-server[1010]: 2026/09/20 12:50:17 INFO Signed narinfos id=69 count=16326lb # [ 173.043188] niks3-server[1010]: 2026/09/20 12:50:17 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6327lb # [ 173.048568] niks3-server[1010]: 2026/09/20 12:50:17 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6328lb # [ 173.054933] niks3-server[1010]: 2026/09/20 12:50:17 INFO Completed upload id=696329worker2 # [ 173.080389] nix-grpc-daemon[1308]: time=2026-09-20T12:50:17.597Z level=INFO msg="Upload complete. (331ms)"6330lb # [ 173.057301] niks3-server[1010]: 2026/09/20 12:50:17 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6331worker2 # [ 173.092883] nix-grpc-daemon[1170]: ts=2026-09-20T12:50:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39180 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=12 outputs=16332worker2 # [ 173.105693] nix-daemon[842]: reaped child process 1588, status = succeeded6333client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 7.71 seconds)6334client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath6335client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.24 seconds)6336worker1: must succeed: rm /nix/.rw-store/fill6337worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.17 seconds)6338worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6339worker1 # [ 174.477572] nix-grpc-daemon[1798]: ts=2026-09-20T12:50:18Z level=info event=healthy reason=min_free6340worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.13 seconds)6341(finished: subtest: low disk drains a worker and builds go to the other, in 11.74 seconds)6342(finished: run the VM test script, in 175.73 seconds)6343test script finished in 176.03s6344cleanup6345kill QemuMachine (pid 51)6346client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6347kill QemuMachine (pid 50)6348lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6349kill QemuMachine (pid 52)6350worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6351kill QemuMachine (pid 49)6352worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6353(finished: cleanup, in 1.21 seconds)6354additionally exposed symbols:6355 client, lb, worker1, worker2,6356 vlan1,6357 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh