vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #235
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12client # Disk image does not exist, creating the virtualisation disk image...13client: QEMU running (pid 49)14client # Formatting '/build/vm-state-client/tmp.SqzkENk9nC', fmt=raw size=107374182415lb # Disk image does not exist, creating the virtualisation disk image...16worker2 # Disk image does not exist, creating the virtualisation disk image...17worker1: QEMU running (pid 51)18client # mke2fs 1.47.4 (6-Mar-2025)19lb # Formatting '/build/vm-state-lb/tmp.aj1PRq22sS', fmt=raw size=107374182420worker2 # Formatting '/build/vm-state-worker2/tmp.XMyoiOA20a', fmt=raw size=107374182421worker1 # Disk image does not exist, creating the virtualisation disk image...22lb: QEMU running (pid 50)23worker2: QEMU running (pid 52)24client # Discarding device blocks: 0/262144 done25lb # mke2fs 1.47.4 (6-Mar-2025)26worker1 # Formatting '/build/vm-state-worker1/tmp.5g5NGR4aix', fmt=raw size=107374182427worker2 # mke2fs 1.47.4 (6-Mar-2025)28client # Creating filesystem with 262144 4k blocks and 65536 inodes29worker1 # mke2fs 1.47.4 (6-Mar-2025)30worker2 # Discarding device blocks: 0/262144 done31client # Filesystem UUID: 55b2542f-395a-4250-9c92-b1dcc4df926b32worker1 # Discarding device blocks: 0/262144 done33worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes34client # Superblock backups stored on blocks:35worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes36worker2 # Filesystem UUID: bd9f1d5c-789c-4629-9bf8-f6be8ed27bf737client # 32768, 98304, 163840, 22937638worker1 # Filesystem UUID: af58fb9b-8bd2-48f7-9c37-c22c4095e7c539worker2 # Superblock backups stored on blocks:40client # 41worker1 # Superblock backups stored on blocks:42worker2 # 32768, 98304, 163840, 22937643client # Allocating group tables: 0/8 done44worker1 # 32768, 98304, 163840, 22937645worker2 # 46client # Writing inode tables: 0/8 done47worker1 # 48worker2 # Allocating group tables: 0/8 done49client # Creating journal (8192 blocks): done50worker1 # Allocating group tables: 0/8 done51worker2 # Writing inode tables: 0/8 done52client # Writing superblocks and filesystem accounting information: 0/8 done53worker1 # Writing inode tables: 0/8 done54worker2 # Creating journal (8192 blocks): done55client # 56worker1 # Creating journal (8192 blocks): done57worker2 # Writing superblocks and filesystem accounting information: 0/8 done58client # Virtualisation disk image created.59worker1 # Writing superblocks and filesystem accounting information: 0/8 done60worker2 # 61lb # Discarding device blocks: 0/262144 done62(finished: start all VMs, in 0.68 seconds)63worker1 # 64worker2 # Virtualisation disk image created.65lb # Creating filesystem with 262144 4k blocks and 65536 inodes66client: waiting for unit network-addresses-eth1.service67lb # Filesystem UUID: 9003d16f-0f7a-4f25-a46b-e244b0058d7668client: waiting for the VM to finish booting69lb # Superblock backups stored on blocks:70worker1 # Virtualisation disk image created.71lb # 32768, 98304, 163840, 22937672lb # 73lb # Allocating group tables: 0/8 done74lb # Writing inode tables: 0/8 done75lb # Creating journal (8192 blocks): done76lb # Writing superblocks and filesystem accounting information: 0/8 done77lb # 78lb # Virtualisation disk image created.79client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]80client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202681client # [ 0.000000] KASLR enabled82client # [ 0.000000] random: crng init done83client # [ 0.000000] Machine model: linux,dummy-virt84client # [ 0.000000] efi: UEFI not found.85client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT86client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]87client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]88client # [ 0.000000] Zone ranges:89client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]90client # [ 0.000000] DMA32 empty91client # [ 0.000000] Normal empty92client # [ 0.000000] Device empty93client # [ 0.000000] Movable zone start for each node94client # [ 0.000000] Early memory node ranges95client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]96client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]97client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c40000098client # [ 0.000000] psci: probing for conduit method from DT.99client # [ 0.000000] psci: PSCIv1.3 detected in firmware.100client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs101client # [ 0.000000] psci: Trusted OS migration not required102client # [ 0.000000] psci: SMC Calling Convention v1.1103client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)104client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296105client # [ 0.000000] Detected PIPT I-cache on CPU0106client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)107client # [ 0.000000] CPU features: detected: GICv3 CPU interface108client # [ 0.000000] CPU features: detected: Spectre-v4109client # [ 0.000000] CPU features: detected: Spectre-BHB110client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38111client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23112client # [ 0.000000] alternatives: applying boot alternatives113client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/2jmap7m0gxs09dqzijw97xb6bxh4300i-nixos-system-client-test/init regInfo=/nix/store/73dicn7n37i2ayqhspx0lbm4yw0nma90-closure-info/registration console=ttyAMA0,115200n8 console=tty0114client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/73dicn7n37i2ayqhspx0lbm4yw0nma90-closure-info/registration", will be passed to user space.115client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes116client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)117client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)118client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB119client # [ 0.000000] software IO TLB: area num 1.120client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB121client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)122client # [ 0.000000] Fallback order for Node 0: 0123client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216124client # [ 0.000000] Policy zone: DMA125client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off126client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1127client # [ 0.000000] allocated 3145728 bytes of page_ext128client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages129client # [ 0.000000] ftrace: allocated 294 pages with 4 groups130client # [ 0.000000] rcu: Hierarchical RCU implementation.131client # [ 0.000000] rcu: RCU event tracing is enabled.132client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.133client # [ 0.000000] Trampoline variant of Tasks RCU enabled.134client # [ 0.000000] Rude variant of Tasks RCU enabled.135client # [ 0.000000] Tracing variant of Tasks RCU enabled.136client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.137client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1138client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.139client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.140client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.141client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0142client # [ 0.000000] GICv3: 256 SPIs implemented143client # [ 0.000000] GICv3: 0 Extended SPIs implemented144client # [ 0.000000] Root IRQ handler: gic_handle_irq145client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI146client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0147client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000148client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]149client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)150client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)151client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000152client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000153client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.154client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns155client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).156client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns157client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns158client # [ 0.000034] arm-pv: using stolen time PV159client # [ 0.000735] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)160client # [ 0.000923] Console: colour dummy device 80x25161client # [ 0.000930] printk: legacy console [tty0] enabled162client # [ 0.001139] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)163client # [ 0.001146] pid_max: default: 32768 minimum: 301164client # [ 0.001219] LSM: initializing lsm=capability,landlock,yama,bpf,ima165client # [ 0.001415] landlock: Up and running.166client # [ 0.001417] Yama: becoming mindful.167client # [ 0.002141] LSM support for eBPF active168client # [ 0.002318] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)169client # [ 0.002352] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)170client # [ 0.003659] cacheinfo: Unable to detect cache hierarchy for CPU 0171client # [ 0.004468] rcu: Hierarchical SRCU implementation.172client # [ 0.004474] rcu: Max phase no-delay instances is 1000.173client # [ 0.005722] fsl-mc MSI: its@8080000 domain created174client # [ 0.005814] EFI services will not be available.175client # [ 0.005886] smp: Bringing up secondary CPUs ...176client # [ 0.005895] smp: Brought up 1 node, 1 CPU177client # [ 0.005898] SMP: Total of 1 processors activated.178client # [ 0.005904] CPU: All CPU(s) started at EL1179client # [ 0.005915] CPU features: detected: Branch Target Identification180client # [ 0.005920] CPU features: detected: ARMv8.4 Translation Table Level181client # [ 0.005923] CPU features: detected: Instruction cache invalidation not required for I/D coherence182client # [ 0.005927] CPU features: detected: Data cache clean to the PoU not required for I/D coherence183client # [ 0.005930] CPU features: detected: Common not Private translations184client # [ 0.005933] CPU features: detected: CRC32 instructions185client # [ 0.005936] CPU features: detected: Data cache clean to Point of Deep Persistence186client # [ 0.005940] CPU features: detected: Data cache clean to Point of Persistence187client # [ 0.005943] CPU features: detected: Data independent timing control (DIT)188client # [ 0.005946] CPU features: detected: E0PD189client # [ 0.005948] CPU features: detected: Enhanced Counter Virtualization190client # [ 0.005952] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)191client # [ 0.005955] CPU features: detected: Enhanced Virtualization Traps192client # [ 0.005958] CPU features: detected: Fine Grained Traps193worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]194client # [ 0.005962] CPU features: detected: Generic authentication (architected QARMA5 algorithm)195worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]196client # [ 0.005966] CPU features: detected: RCpc load-acquire (LDAPR)197worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026198worker2 # [ 0.000000] KASLR enabled199client # [ 0.005969] CPU features: detected: LSE atomic instructions200worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026201worker2 # [ 0.000000] random: crng init done202client # [ 0.005972] CPU features: detected: Privileged Access Never203worker1 # [ 0.000000] KASLR enabled204worker2 # [ 0.000000] Machine model: linux,dummy-virt205worker1 # [ 0.000000] random: crng init done206client # [ 0.005975] CPU features: detected: PMUv3207worker2 # [ 0.000000] efi: UEFI not found.208worker1 # [ 0.000000] Machine model: linux,dummy-virt209client # [ 0.005978] CPU features: detected: RAS Extension Support210worker1 # [ 0.000000] efi: UEFI not found.211worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT212client # [ 0.005980] CPU features: detected: RASv1p1 Extension Support213lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]214worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT215worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]216client # [ 0.005983] CPU features: detected: Random Number Generator217worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]218worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]219client # [ 0.005985] CPU features: detected: Speculation barrier (SB)220worker2 # [ 0.000000] Zone ranges:221lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026222worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]223client # [ 0.005988] CPU features: detected: Stage-2 Force Write-Back224lb # [ 0.000000] KASLR enabled225worker1 # [ 0.000000] Zone ranges:226worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]227lb # [ 0.000000] random: crng init done228worker2 # [ 0.000000] DMA32 empty229client # [ 0.005991] CPU features: detected: TLB range maintenance instructions230lb # [ 0.000000] Machine model: linux,dummy-virt231worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]232worker2 # [ 0.000000] Normal empty233worker1 # [ 0.000000] DMA32 empty234worker2 # [ 0.000000] Device empty235lb # [ 0.000000] efi: UEFI not found.236client # [ 0.005996] CPU features: detected: Speculative Store Bypassing Safe (SSBS)237worker1 # [ 0.000000] Normal empty238worker2 # [ 0.000000] Movable zone start for each node239worker1 # [ 0.000000] Device empty240client # [ 0.006039] alternatives: applying system-wide alternatives241lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT242worker2 # [ 0.000000] Early memory node ranges243worker1 # [ 0.000000] Movable zone start for each node244worker1 # [ 0.000000] Early memory node ranges245worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]246lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]247client # [ 0.009072] CPU features: detected: BBM Level 2 without TLB conflict abort248worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]249lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]250worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]251lb # [ 0.000000] Zone ranges:252worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000253worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]254lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]255client # [ 0.009283] Memory: 1406524K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)256worker2 # [ 0.000000] psci: probing for conduit method from DT.257worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000258lb # [ 0.000000] DMA32 empty259lb # [ 0.000000] Normal empty260worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.261worker1 # [ 0.000000] psci: probing for conduit method from DT.262lb # [ 0.000000] Device empty263worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs264worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.265lb # [ 0.000000] Movable zone start for each node266worker2 # [ 0.000000] psci: Trusted OS migration not required267lb # [ 0.000000] Early memory node ranges268worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs269worker2 # [ 0.000000] psci: SMC Calling Convention v1.1270worker1 # [ 0.000000] psci: Trusted OS migration not required271lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]272worker1 # [ 0.000000] psci: SMC Calling Convention v1.1273lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]274worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)275lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000276worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)277worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296278lb # [ 0.000000] psci: probing for conduit method from DT.279worker2 # [ 0.000000] Detected PIPT I-cache on CPU0280worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296281lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.282worker1 # [ 0.000000] Detected PIPT I-cache on CPU0283worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)284lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs285worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface286lb # [ 0.000000] psci: Trusted OS migration not required287worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)288worker2 # [ 0.000000] CPU features: detected: Spectre-v4289lb # [ 0.000000] psci: SMC Calling Convention v1.1290worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface291worker2 # [ 0.000000] CPU features: detected: Spectre-BHB292worker1 # [ 0.000000] CPU features: detected: Spectre-v4293lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)294worker1 # [ 0.000000] CPU features: detected: Spectre-BHB295worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38296client # [ 0.009721] devtmpfs: initialized297lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296298worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38299worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23300lb # [ 0.000000] Detected PIPT I-cache on CPU0301client # [ 0.011676] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)302worker2 # [ 0.000000] alternatives: applying boot alternatives303worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23304lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)305worker1 # [ 0.000000] alternatives: applying boot alternatives306client # [ 0.011700] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).307lb # [ 0.000000] CPU features: detected: GICv3 CPU interface308client # [ 0.011906] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL309lb # [ 0.000000] CPU features: detected: Spectre-v4310client # [ 0.011911] 0 pages in range for non-PLT usage311lb # [ 0.000000] CPU features: detected: Spectre-BHB312client # [ 0.011912] 508288 pages in range for PLT usage313lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38314client # [ 0.012024] pinctrl core: initialized pinctrl subsystem315worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/2g5mhbvf9fs6iiwsdsjwn9a1dxd2rcf0-nixos-system-worker2-test/init regInfo=/nix/store/0mrxlavbw2bq59qzkmlgjv59qy19l5wh-closure-info/registration console=ttyAMA0,115200n8 console=tty0316lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23317client # [ 0.012816] DMI not present or invalid.318lb # [ 0.000000] alternatives: applying boot alternatives319worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/6m1k0db9w5wmmbl9c4r51z8s449nwzad-nixos-system-worker1-test/init regInfo=/nix/store/mrisf2bbh36vsfnljbp0rvk6l69lhx33-closure-info/registration console=ttyAMA0,115200n8 console=tty0320client # [ 0.017015] NET: Registered PF_NETLINK/PF_ROUTE protocol family321client # [ 0.019394] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations322worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/0mrxlavbw2bq59qzkmlgjv59qy19l5wh-closure-info/registration", will be passed to user space.323worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/mrisf2bbh36vsfnljbp0rvk6l69lhx33-closure-info/registration", will be passed to user space.324worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes325client # [ 0.019719] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations326worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes327worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)328client # [ 0.019940] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations329worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)330client # [ 0.019973] audit: initializing netlink subsys (disabled)331lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ynn2zqc2v8ljbhyrx04lvra7yrxsl31x-nixos-system-lb-test/init regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration console=ttyAMA0,115200n8 console=tty0332worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)333client # [ 0.020671] thermal_sys: Registered thermal governor 'fair_share'334worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)335worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB336client # [ 0.020673] thermal_sys: Registered thermal governor 'bang_bang'337worker2 # [ 0.000000] software IO TLB: area num 1.338worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB339lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration", will be passed to user space.340worker1 # [ 0.000000] software IO TLB: area num 1.341client # [ 0.020678] thermal_sys: Registered thermal governor 'step_wise'342worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB343lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes344worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB345client # [ 0.020684] thermal_sys: Registered thermal governor 'user_space'346worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)347lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)348worker2 # [ 0.000000] Fallback order for Node 0: 0349client # [ 0.020686] thermal_sys: Registered thermal governor 'power_allocator'350worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)351worker1 # [ 0.000000] Fallback order for Node 0: 0352worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216353lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)354client # [ 0.020716] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1355worker2 # [ 0.000000] Policy zone: DMA356worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216357client # [ 0.020726] cpuidle: using governor ladder358lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB359worker1 # [ 0.000000] Policy zone: DMA360client # [ 0.020732] cpuidle: using governor menu361worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off362lb # [ 0.000000] software IO TLB: area num 1.363worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off364worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1365client # [ 0.020952] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.366lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB367worker2 # [ 0.000000] allocated 3145728 bytes of page_ext368worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1369client # [ 0.021000] ASID allocator initialised with 65536 entries370lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)371worker1 # [ 0.000000] allocated 3145728 bytes of page_ext372worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages373client # [ 0.022325] Serial: AMBA PL011 UART driver374lb # [ 0.000000] Fallback order for Node 0: 0375worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups376worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages377client # [ 0.027903] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1378worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.379worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups380lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216381lb # [ 0.000000] Policy zone: DMA382client # [ 0.028073] printk: console [ttyAMA0] enabled383worker2 # [ 0.000000] rcu: RCU event tracing is enabled.384worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.385worker1 # [ 0.000000] rcu: RCU event tracing is enabled.386lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off387worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.388lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1389worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.390client # [ 0.153877] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages391worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.392worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.393lb # [ 0.000000] allocated 3145728 bytes of page_ext394worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.395client # [ 0.153900] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page396worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.397worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.398lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages399client # [ 0.153905] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages400worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.401lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups402worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.403client # [ 0.153909] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page404lb # [ 0.000000] rcu: Hierarchical RCU implementation.405worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.406worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1407lb # [ 0.000000] rcu: RCU event tracing is enabled.408client # [ 0.153913] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages409worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1410lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.411client # [ 0.153918] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page412worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.413lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.414worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.415client # [ 0.153922] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages416lb # [ 0.000000] Rude variant of Tasks RCU enabled.417worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.418lb # [ 0.000000] Tracing variant of Tasks RCU enabled.419client # [ 0.153926] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page420worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.421worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.422lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.423worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.424worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0425lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1426worker2 # [ 0.000000] GICv3: 256 SPIs implemented427worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0428worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented429worker1 # [ 0.000000] GICv3: 256 SPIs implemented430client # [ 0.161274] fbcon: Taking over console431lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.432worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq433worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented434client # [ 0.161288] ACPI: Interpreter disabled.435worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq436worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI437lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.438client # [ 0.163147] iommu: Default domain type: Translated439worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI440worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0441client # [ 0.163157] iommu: DMA domain TLB invalidation policy: strict mode442worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0443worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000444lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.445worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]446worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000447lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0448client # [ 0.164793] SCSI subsystem initialized449worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]450lb # [ 0.000000] GICv3: 256 SPIs implemented451worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)452lb # [ 0.000000] GICv3: 0 Extended SPIs implemented453lb # [ 0.000000] Root IRQ handler: gic_handle_irq454worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)455lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI456worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)457lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0458worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)459worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000460worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000461lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000462worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000463lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]464worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000465worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.466lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)467worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.468worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns469worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns470lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)471worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).472lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000473worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).474worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns475lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000476worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns477client # [ 0.172492] usbcore: registered new interface driver usbfs478worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns479lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.480worker2 # [ 0.000028] arm-pv: using stolen time PV481client # [ 0.172526] usbcore: registered new interface driver hub482worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns483worker1 # [ 0.000033] arm-pv: using stolen time PV484client # [ 0.172545] usbcore: registered new device driver usb485lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns486worker2 # [ 0.000452] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)487client # [ 0.172825] pps_core: LinuxPPS API ver. 1 registered488lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).489worker1 # [ 0.000443] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)490worker2 # [ 0.000624] Console: colour dummy device 80x25491worker2 # [ 0.000633] printk: legacy console [tty0] enabled492worker1 # [ 0.000654] Console: colour dummy device 80x25493client # [ 0.172832] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>494lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns495client # [ 0.172842] PTP clock support registered496worker1 # [ 0.000662] printk: legacy console [tty0] enabled497client # [ 0.172900] EDAC MC: Ver: 3.0.0498worker2 # [ 0.000835] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)499lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns500worker2 # [ 0.000841] pid_max: default: 32768 minimum: 301501lb # [ 0.000028] arm-pv: using stolen time PV502worker1 # [ 0.000866] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)503client # [ 0.177412] scmi_core: SCMI protocol bus registered504worker1 # [ 0.000873] pid_max: default: 32768 minimum: 301505worker2 # [ 0.000919] LSM: initializing lsm=capability,landlock,yama,bpf,ima506worker2 # [ 0.001064] landlock: Up and running.507lb # [ 0.000407] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)508worker1 # [ 0.000950] LSM: initializing lsm=capability,landlock,yama,bpf,ima509client # [ 0.178480] FPGA manager framework510worker2 # [ 0.001067] Yama: becoming mindful.511client # [ 0.179477] vgaarb: loaded512lb # [ 0.000626] Console: colour dummy device 80x25513worker1 # [ 0.001080] landlock: Up and running.514worker2 # [ 0.001568] LSM support for eBPF active515worker1 # [ 0.001082] Yama: becoming mindful.516lb # [ 0.000634] printk: legacy console [tty0] enabled517worker1 # [ 0.001551] LSM support for eBPF active518worker2 # [ 0.001715] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)519client # [ 0.180147] clocksource: Switched to clocksource arch_sys_counter520worker1 # [ 0.001700] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)521lb # [ 0.000835] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)522worker2 # [ 0.001748] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)523client # [ 0.180772] VFS: Disk quotas dquot_6.6.0524lb # [ 0.000842] pid_max: default: 32768 minimum: 301525worker1 # [ 0.001739] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)526worker2 # [ 0.002904] cacheinfo: Unable to detect cache hierarchy for CPU 0527lb # [ 0.000923] LSM: initializing lsm=capability,landlock,yama,bpf,ima528client # [ 0.180799] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)529worker2 # [ 0.003665] rcu: Hierarchical SRCU implementation.530worker1 # [ 0.002968] cacheinfo: Unable to detect cache hierarchy for CPU 0531lb # [ 0.001100] landlock: Up and running.532client # [ 0.183126] netfs: FS-Cache loaded533worker1 # [ 0.003730] rcu: Hierarchical SRCU implementation.534lb # [ 0.001103] Yama: becoming mindful.535worker2 # [ 0.003670] rcu: Max phase no-delay instances is 1000.536client # [ 0.183226] pnp: PnP ACPI: disabled537lb # [ 0.001612] LSM support for eBPF active538worker2 # [ 0.004907] fsl-mc MSI: its@8080000 domain created539worker1 # [ 0.003734] rcu: Max phase no-delay instances is 1000.540worker2 # [ 0.004998] EFI services will not be available.541worker1 # [ 0.005001] fsl-mc MSI: its@8080000 domain created542lb # [ 0.001764] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)543worker2 # [ 0.005123] smp: Bringing up secondary CPUs ...544worker1 # [ 0.005095] EFI services will not be available.545worker2 # [ 0.005132] smp: Brought up 1 node, 1 CPU546lb # [ 0.001799] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)547worker1 # [ 0.005183] smp: Bringing up secondary CPUs ...548worker1 # [ 0.005192] smp: Brought up 1 node, 1 CPU549worker2 # [ 0.005135] SMP: Total of 1 processors activated.550lb # [ 0.003022] cacheinfo: Unable to detect cache hierarchy for CPU 0551worker2 # [ 0.005141] CPU: All CPU(s) started at EL1552worker1 # [ 0.005195] SMP: Total of 1 processors activated.553lb # [ 0.003782] rcu: Hierarchical SRCU implementation.554worker1 # [ 0.005201] CPU: All CPU(s) started at EL1555worker2 # [ 0.005152] CPU features: detected: Branch Target Identification556lb # [ 0.003786] rcu: Max phase no-delay instances is 1000.557worker1 # [ 0.005212] CPU features: detected: Branch Target Identification558worker2 # [ 0.005157] CPU features: detected: ARMv8.4 Translation Table Level559lb # [ 0.005035] fsl-mc MSI: its@8080000 domain created560lb # [ 0.005136] EFI services will not be available.561worker1 # [ 0.005216] CPU features: detected: ARMv8.4 Translation Table Level562worker2 # [ 0.005160] CPU features: detected: Instruction cache invalidation not required for I/D coherence563lb # [ 0.005206] smp: Bringing up secondary CPUs ...564lb # [ 0.005216] smp: Brought up 1 node, 1 CPU565worker1 # [ 0.005219] CPU features: detected: Instruction cache invalidation not required for I/D coherence566worker2 # [ 0.005163] CPU features: detected: Data cache clean to the PoU not required for I/D coherence567lb # [ 0.005219] SMP: Total of 1 processors activated.568lb # [ 0.005224] CPU: All CPU(s) started at EL1569worker1 # [ 0.005223] CPU features: detected: Data cache clean to the PoU not required for I/D coherence570worker2 # [ 0.005167] CPU features: detected: Common not Private translations571lb # [ 0.005235] CPU features: detected: Branch Target Identification572worker1 # [ 0.005226] CPU features: detected: Common not Private translations573worker2 # [ 0.005170] CPU features: detected: CRC32 instructions574worker1 # [ 0.005229] CPU features: detected: CRC32 instructions575lb # [ 0.005240] CPU features: detected: ARMv8.4 Translation Table Level576worker2 # [ 0.005173] CPU features: detected: Data cache clean to Point of Deep Persistence577client # [ 0.189464] NET: Registered PF_INET protocol family578worker1 # [ 0.005232] CPU features: detected: Data cache clean to Point of Deep Persistence579lb # [ 0.005244] CPU features: detected: Instruction cache invalidation not required for I/D coherence580worker2 # [ 0.005177] CPU features: detected: Data cache clean to Point of Persistence581client # [ 0.189752] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)582worker1 # [ 0.005236] CPU features: detected: Data cache clean to Point of Persistence583lb # [ 0.005247] CPU features: detected: Data cache clean to the PoU not required for I/D coherence584worker1 # [ 0.005239] CPU features: detected: Data independent timing control (DIT)585lb # [ 0.005251] CPU features: detected: Common not Private translations586worker1 # [ 0.005242] CPU features: detected: E0PD587lb # [ 0.005254] CPU features: detected: CRC32 instructions588worker1 # [ 0.005245] CPU features: detected: Enhanced Counter Virtualization589lb # [ 0.005257] CPU features: detected: Data cache clean to Point of Deep Persistence590worker1 # [ 0.005248] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)591lb # [ 0.005261] CPU features: detected: Data cache clean to Point of Persistence592worker1 # [ 0.005251] CPU features: detected: Enhanced Virtualization Traps593lb # [ 0.005264] CPU features: detected: Data independent timing control (DIT)594worker1 # [ 0.005254] CPU features: detected: Fine Grained Traps595worker2 # [ 0.005180] CPU features: detected: Data independent timing control (DIT)596worker2 # [ 0.005183] CPU features: detected: E0PD597worker2 # [ 0.005185] CPU features: detected: Enhanced Counter Virtualization598lb # [ 0.005267] CPU features: detected: E0PD599worker2 # [ 0.005188] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)600worker2 # [ 0.005192] CPU features: detected: Enhanced Virtualization Traps601worker2 # [ 0.005194] CPU features: detected: Fine Grained Traps602worker2 # [ 0.005198] CPU features: detected: Generic authentication (architected QARMA5 algorithm)603worker1 # [ 0.005258] CPU features: detected: Generic authentication (architected QARMA5 algorithm)604worker2 # [ 0.005203] CPU features: detected: RCpc load-acquire (LDAPR)605lb # [ 0.005269] CPU features: detected: Enhanced Counter Virtualization606worker1 # [ 0.005263] CPU features: detected: RCpc load-acquire (LDAPR)607worker2 # [ 0.005207] CPU features: detected: LSE atomic instructions608lb # [ 0.005272] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)609worker1 # [ 0.005266] CPU features: detected: LSE atomic instructions610worker2 # [ 0.005209] CPU features: detected: Privileged Access Never611worker2 # [ 0.005212] CPU features: detected: PMUv3612lb # [ 0.005276] CPU features: detected: Enhanced Virtualization Traps613worker1 # [ 0.005270] CPU features: detected: Privileged Access Never614worker1 # [ 0.005272] CPU features: detected: PMUv3615worker2 # [ 0.005215] CPU features: detected: RAS Extension Support616lb # [ 0.005278] CPU features: detected: Fine Grained Traps617worker1 # [ 0.005275] CPU features: detected: RAS Extension Support618lb # [ 0.005282] CPU features: detected: Generic authentication (architected QARMA5 algorithm)619worker2 # [ 0.005217] CPU features: detected: RASv1p1 Extension Support620lb # [ 0.005287] CPU features: detected: RCpc load-acquire (LDAPR)621worker1 # [ 0.005278] CPU features: detected: RASv1p1 Extension Support622worker2 # [ 0.005220] CPU features: detected: Random Number Generator623lb # [ 0.005290] CPU features: detected: LSE atomic instructions624worker1 # [ 0.005281] CPU features: detected: Random Number Generator625worker2 # [ 0.005223] CPU features: detected: Speculation barrier (SB)626lb # [ 0.005293] CPU features: detected: Privileged Access Never627worker1 # [ 0.005283] CPU features: detected: Speculation barrier (SB)628lb # [ 0.005295] CPU features: detected: PMUv3629worker2 # [ 0.005226] CPU features: detected: Stage-2 Force Write-Back630worker1 # [ 0.005286] CPU features: detected: Stage-2 Force Write-Back631lb # [ 0.005298] CPU features: detected: RAS Extension Support632worker2 # [ 0.005228] CPU features: detected: TLB range maintenance instructions633lb # [ 0.005301] CPU features: detected: RASv1p1 Extension Support634worker1 # [ 0.005289] CPU features: detected: TLB range maintenance instructions635worker2 # [ 0.005233] CPU features: detected: Speculative Store Bypassing Safe (SSBS)636lb # [ 0.005304] CPU features: detected: Random Number Generator637worker1 # [ 0.005295] CPU features: detected: Speculative Store Bypassing Safe (SSBS)638worker2 # [ 0.005273] alternatives: applying system-wide alternatives639lb # [ 0.005306] CPU features: detected: Speculation barrier (SB)640worker1 # [ 0.005334] alternatives: applying system-wide alternatives641worker2 # [ 0.008299] CPU features: detected: BBM Level 2 without TLB conflict abort642lb # [ 0.005309] CPU features: detected: Stage-2 Force Write-Back643worker1 # [ 0.008443] CPU features: detected: BBM Level 2 without TLB conflict abort644lb # [ 0.005312] CPU features: detected: TLB range maintenance instructions645worker2 # [ 0.008478] Memory: 1406524K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)646lb # [ 0.005318] CPU features: detected: Speculative Store Bypassing Safe (SSBS)647worker2 # [ 0.008887] devtmpfs: initialized648worker1 # [ 0.008653] Memory: 1406496K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)649lb # [ 0.005356] alternatives: applying system-wide alternatives650worker1 # [ 0.009094] devtmpfs: initialized651worker2 # [ 0.010752] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)652lb # [ 0.008350] CPU features: detected: BBM Level 2 without TLB conflict abort653worker1 # [ 0.010937] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)654worker2 # [ 0.010781] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).655worker1 # [ 0.010964] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).656worker2 # [ 0.010965] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL657lb # [ 0.008555] Memory: 1406596K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)658worker1 # [ 0.011163] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL659worker2 # [ 0.010969] 0 pages in range for non-PLT usage660lb # [ 0.008950] devtmpfs: initialized661worker1 # [ 0.011168] 0 pages in range for non-PLT usage662worker2 # [ 0.010970] 508288 pages in range for PLT usage663worker1 # [ 0.011169] 508288 pages in range for PLT usage664lb # [ 0.010849] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)665worker2 # [ 0.011095] pinctrl core: initialized pinctrl subsystem666worker2 # [ 0.011868] DMI not present or invalid.667worker1 # [ 0.011285] pinctrl core: initialized pinctrl subsystem668lb # [ 0.010879] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).669worker1 # [ 0.012050] DMI not present or invalid.670worker2 # [ 0.015127] NET: Registered PF_NETLINK/PF_ROUTE protocol family671lb # [ 0.011091] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL672worker1 # [ 0.015489] NET: Registered PF_NETLINK/PF_ROUTE protocol family673worker2 # [ 0.017798] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations674lb # [ 0.011096] 0 pages in range for non-PLT usage675worker1 # [ 0.017827] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations676lb # [ 0.011096] 508288 pages in range for PLT usage677worker2 # [ 0.017983] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations678lb # [ 0.011205] pinctrl core: initialized pinctrl subsystem679worker1 # [ 0.018038] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations680lb # [ 0.011978] DMI not present or invalid.681worker2 # [ 0.018194] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations682worker1 # [ 0.018250] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations683lb # [ 0.015576] NET: Registered PF_NETLINK/PF_ROUTE protocol family684worker2 # [ 0.018217] audit: initializing netlink subsys (disabled)685worker1 # [ 0.018279] audit: initializing netlink subsys (disabled)686worker2 # [ 0.018857] thermal_sys: Registered thermal governor 'fair_share'687lb # [ 0.017836] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations688worker1 # [ 0.019296] thermal_sys: Registered thermal governor 'fair_share'689worker2 # [ 0.018860] thermal_sys: Registered thermal governor 'bang_bang'690lb # [ 0.018016] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations691worker1 # [ 0.019298] thermal_sys: Registered thermal governor 'bang_bang'692worker2 # [ 0.018863] thermal_sys: Registered thermal governor 'step_wise'693worker1 # [ 0.019302] thermal_sys: Registered thermal governor 'step_wise'694lb # [ 0.018227] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations695worker2 # [ 0.018869] thermal_sys: Registered thermal governor 'user_space'696client # [ 0.219595] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)697worker1 # [ 0.019308] thermal_sys: Registered thermal governor 'user_space'698lb # [ 0.018251] audit: initializing netlink subsys (disabled)699worker2 # [ 0.018872] thermal_sys: Registered thermal governor 'power_allocator'700client # [ 0.219656] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)701lb # [ 0.018940] thermal_sys: Registered thermal governor 'fair_share'702worker1 # [ 0.019311] thermal_sys: Registered thermal governor 'power_allocator'703worker2 # [ 0.018900] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1704client # [ 0.219690] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)705lb # [ 0.018942] thermal_sys: Registered thermal governor 'bang_bang'706worker1 # [ 0.019339] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1707worker2 # [ 0.018909] cpuidle: using governor ladder708lb # [ 0.018946] thermal_sys: Registered thermal governor 'step_wise'709worker1 # [ 0.019348] cpuidle: using governor ladder710worker2 # [ 0.018915] cpuidle: using governor menu711client # [ 0.219773] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)712worker1 # [ 0.019354] cpuidle: using governor menu713lb # [ 0.018951] thermal_sys: Registered thermal governor 'user_space'714worker2 # [ 0.019125] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.715client # [ 0.219918] TCP: Hash tables configured (established 16384 bind 16384)716worker1 # [ 0.019565] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.717lb # [ 0.018954] thermal_sys: Registered thermal governor 'power_allocator'718worker2 # [ 0.019142] ASID allocator initialised with 65536 entries719client # [ 0.220002] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)720worker1 # [ 0.019582] ASID allocator initialised with 65536 entries721worker2 # [ 0.020374] Serial: AMBA PL011 UART driver722lb # [ 0.018987] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1723worker1 # [ 0.020845] Serial: AMBA PL011 UART driver724client # [ 0.220042] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)725lb # [ 0.018995] cpuidle: using governor ladder726worker2 # [ 0.025720] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1727lb # [ 0.019001] cpuidle: using governor menu728worker1 # [ 0.026194] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1729client # [ 0.220084] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)730worker2 # [ 0.025855] printk: console [ttyAMA0] enabled731worker1 # [ 0.026340] printk: console [ttyAMA0] enabled732lb # [ 0.019204] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.733lb # [ 0.019220] ASID allocator initialised with 65536 entries734lb # [ 0.020515] Serial: AMBA PL011 UART driver735lb # [ 0.025908] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1736lb # [ 0.026046] printk: console [ttyAMA0] enabled737worker2 # [ 0.145630] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages738client # [ 0.227234] NET: Registered PF_UNIX/PF_LOCAL protocol family739worker1 # [ 0.145912] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages740lb # [ 0.141878] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages741worker2 # [ 0.145650] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page742client # [ 0.227262] NET: Registered PF_XDP protocol family743worker1 # [ 0.145936] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page744lb # [ 0.141898] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page745client # [ 0.227282] PCI: CLS 0 bytes, default 64746worker2 # [ 0.145656] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages747client # [ 0.227570] Trying to unpack rootfs image as initramfs...748worker1 # [ 0.145941] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages749lb # [ 0.141903] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages750worker2 # [ 0.145661] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page751worker1 # [ 0.145946] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page752lb # [ 0.141908] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page753worker2 # [ 0.145665] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages754worker1 # [ 0.145950] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages755lb # [ 0.141913] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages756worker2 # [ 0.145669] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page757worker1 # [ 0.145954] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page758lb # [ 0.141917] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page759worker2 # [ 0.145674] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages760worker1 # [ 0.145959] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages761lb # [ 0.141921] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages762worker2 # [ 0.145678] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page763worker1 # [ 0.145963] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page764lb # [ 0.141925] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page765worker2 # [ 0.153036] fbcon: Taking over console766worker2 # [ 0.153053] ACPI: Interpreter disabled.767worker1 # [ 0.153387] fbcon: Taking over console768lb # [ 0.149197] fbcon: Taking over console769client # [ 0.238643] kvm [1]: HYP mode not available770worker1 # [ 0.153405] ACPI: Interpreter disabled.771lb # [ 0.149215] ACPI: Interpreter disabled.772worker2 # [ 0.154932] iommu: Default domain type: Translated773worker2 # [ 0.154942] iommu: DMA domain TLB invalidation policy: strict mode774worker2 # [ 0.156613] SCSI subsystem initialized775worker2 # [ 0.161920] usbcore: registered new interface driver usbfs776worker1 # [ 0.162110] iommu: Default domain type: Translated777lb # [ 0.158261] iommu: Default domain type: Translated778worker2 # [ 0.161956] usbcore: registered new interface driver hub779worker1 # [ 0.162121] iommu: DMA domain TLB invalidation policy: strict mode780lb # [ 0.158273] iommu: DMA domain TLB invalidation policy: strict mode781worker2 # [ 0.161975] usbcore: registered new device driver usb782worker1 # [ 0.162522] SCSI subsystem initialized783lb # [ 0.158614] SCSI subsystem initialized784worker2 # [ 0.162282] pps_core: LinuxPPS API ver. 1 registered785worker1 # [ 0.164534] usbcore: registered new interface driver usbfs786worker2 # [ 0.162289] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>787lb # [ 0.160611] usbcore: registered new interface driver usbfs788worker2 # [ 0.162299] PTP clock support registered789worker1 # [ 0.164568] usbcore: registered new interface driver hub790lb # [ 0.160646] usbcore: registered new interface driver hub791worker2 # [ 0.162349] EDAC MC: Ver: 3.0.0792worker1 # [ 0.164587] usbcore: registered new device driver usb793lb # [ 0.160664] usbcore: registered new device driver usb794worker1 # [ 0.164863] pps_core: LinuxPPS API ver. 1 registered795worker2 # [ 0.166931] scmi_core: SCMI protocol bus registered796lb # [ 0.160964] pps_core: LinuxPPS API ver. 1 registered797worker1 # [ 0.164870] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>798worker2 # [ 0.167920] FPGA manager framework799lb # [ 0.160971] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>800worker1 # [ 0.164880] PTP clock support registered801worker2 # [ 0.169008] vgaarb: loaded802lb # [ 0.160981] PTP clock support registered803worker1 # [ 0.164937] EDAC MC: Ver: 3.0.0804lb # [ 0.161036] EDAC MC: Ver: 3.0.0805worker2 # [ 0.169656] clocksource: Switched to clocksource arch_sys_counter806worker1 # [ 0.169559] scmi_core: SCMI protocol bus registered807lb # [ 0.165693] scmi_core: SCMI protocol bus registered808worker1 # [ 0.170545] FPGA manager framework809lb # [ 0.166707] FPGA manager framework810worker1 # [ 0.171562] vgaarb: loaded811lb # [ 0.167683] vgaarb: loaded812worker1 # [ 0.172222] clocksource: Switched to clocksource arch_sys_counter813lb # [ 0.168365] clocksource: Switched to clocksource arch_sys_counter814worker2 # [ 0.173610] VFS: Disk quotas dquot_6.6.0815worker1 # [ 0.174156] VFS: Disk quotas dquot_6.6.0816worker1 # [ 0.174197] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)817worker2 # [ 0.176242] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)818worker2 # [ 0.177420] netfs: FS-Cache loaded819lb # [ 0.173280] VFS: Disk quotas dquot_6.6.0820worker2 # [ 0.177550] pnp: PnP ACPI: disabled821worker1 # [ 0.178156] netfs: FS-Cache loaded822lb # [ 0.173320] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)823worker1 # [ 0.178296] pnp: PnP ACPI: disabled824lb # [ 0.177189] netfs: FS-Cache loaded825lb # [ 0.177305] pnp: PnP ACPI: disabled826worker1 # [ 0.182455] NET: Registered PF_INET protocol family827worker1 # [ 0.182740] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)828worker2 # [ 0.181650] NET: Registered PF_INET protocol family829worker2 # [ 0.181969] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)830lb # [ 0.181333] NET: Registered PF_INET protocol family831lb # [ 0.181611] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)832lb # [ 0.211986] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)833lb # [ 0.212041] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)834lb # [ 0.212075] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)835lb # [ 0.212162] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)836lb # [ 0.212306] TCP: Hash tables configured (established 16384 bind 16384)837worker1 # [ 0.214012] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)838worker1 # [ 0.214072] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)839worker2 # [ 0.212652] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)840worker1 # [ 0.214109] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)841worker2 # [ 0.212709] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)842worker1 # [ 0.214202] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)843worker2 # [ 0.212741] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)844worker1 # [ 0.214346] TCP: Hash tables configured (established 16384 bind 16384)845worker2 # [ 0.212828] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)846worker1 # [ 0.214444] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)847worker2 # [ 0.212971] TCP: Hash tables configured (established 16384 bind 16384)848worker1 # [ 0.214484] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)849worker2 # [ 0.213065] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)850worker1 # [ 0.214524] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)851worker2 # [ 0.213101] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)852worker1 # [ 0.214615] NET: Registered PF_UNIX/PF_LOCAL protocol family853worker2 # [ 0.213138] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)854worker1 # [ 0.214639] NET: Registered PF_XDP protocol family855worker1 # [ 0.214659] PCI: CLS 0 bytes, default 64856worker2 # [ 0.213228] NET: Registered PF_UNIX/PF_LOCAL protocol family857lb # [ 0.217210] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)858worker1 # [ 0.214945] Trying to unpack rootfs image as initramfs...859worker2 # [ 0.213251] NET: Registered PF_XDP protocol family860lb # [ 0.217256] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)861worker2 # [ 0.213268] PCI: CLS 0 bytes, default 64862lb # [ 0.217293] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)863worker2 # [ 0.213541] Trying to unpack rootfs image as initramfs...864lb # [ 0.217411] NET: Registered PF_UNIX/PF_LOCAL protocol family865lb # [ 0.217433] NET: Registered PF_XDP protocol family866lb # [ 0.217453] PCI: CLS 0 bytes, default 64867lb # [ 0.217711] Trying to unpack rootfs image as initramfs...868worker1 # [ 0.230095] kvm [1]: HYP mode not available869worker2 # [ 0.231450] kvm [1]: HYP mode not available870lb # [ 0.229340] kvm [1]: HYP mode not available871client # [ 0.344732] Initialise system trusted keyrings872client # [ 0.345528] workingset: timestamp_bits=42 max_order=19 bucket_order=0873client # [ 0.346843] squashfs: version 4.0 (2009/01/31) Phillip Lougher874client # [ 0.347638] 9p: Installing v9fs 9p2000 file system support875client # [ 0.376387] Key type asymmetric registered876client # [ 0.376419] Asymmetric key parser 'x509' registered877client # [ 0.376494] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)878client # [ 0.378750] io scheduler mq-deadline registered879client # [ 0.378763] io scheduler kyber registered880client # [ 0.388308] pl061_gpio 9030000.pl061: PL061 GPIO chip registered881client # [ 0.389804] ledtrig-cpu: registered to indicate activity on CPUs882client # [ 0.390227] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:883client # [ 0.390244] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000884client # [ 0.390271] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000885client # [ 0.390280] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000886client # [ 0.390301] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits887client # [ 0.390334] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]888client # [ 0.390414] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00889client # [ 0.390424] pci_bus 0000:00: root bus resource [bus 00-ff]890client # [ 0.390429] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]891client # [ 0.390435] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]892client # [ 0.390440] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]893client # [ 0.390504] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint894client # [ 0.390971] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint895client # [ 0.391174] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]896client # [ 0.391193] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]897client # [ 0.391225] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]898client # [ 0.391244] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]899client # [ 0.391711] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint900client # [ 0.391895] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]901client # [ 0.391911] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]902client # [ 0.391941] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]903client # [ 0.412092] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint904client # [ 0.413332] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]905client # [ 0.413352] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]906client # [ 0.413381] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]907client # [ 0.413834] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint908client # [ 0.414019] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]909client # [ 0.414035] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]910client # [ 0.414068] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]911client # [ 0.414526] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint912client # [ 0.414704] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]913client # [ 0.414722] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]914client # [ 0.414752] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]915client # [ 0.415197] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint916client # [ 0.415383] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]917client # [ 0.415400] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]918client # [ 0.415429] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]919client # [ 0.415873] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint920client # [ 0.416057] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]921client # [ 0.416072] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]922client # [ 0.416101] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]923client # [ 0.416117] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]924worker2 # [ 0.342286] Initialise system trusted keyrings925worker2 # [ 0.343061] workingset: timestamp_bits=42 max_order=19 bucket_order=0926worker1 # [ 0.343573] Initialise system trusted keyrings927worker2 # [ 0.344372] squashfs: version 4.0 (2009/01/31) Phillip Lougher928worker2 # [ 0.345161] 9p: Installing v9fs 9p2000 file system support929lb # [ 0.345047] Initialise system trusted keyrings930lb # [ 0.345814] workingset: timestamp_bits=42 max_order=19 bucket_order=0931client # [ 0.436686] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint932client # [ 0.436894] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]933lb # [ 0.347203] squashfs: version 4.0 (2009/01/31) Phillip Lougher934client # [ 0.436925] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]935lb # [ 0.348023] 9p: Installing v9fs 9p2000 file system support936worker1 # [ 0.352344] workingset: timestamp_bits=42 max_order=19 bucket_order=0937client # [ 0.437400] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint938client # [ 0.437590] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]939client # [ 0.437620] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]940client # [ 0.438020] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint941client # [ 0.438198] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]942client # [ 0.438450] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint943client # [ 0.438747] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]944client # [ 0.438765] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]945client # [ 0.438794] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]946worker1 # [ 0.353830] squashfs: version 4.0 (2009/01/31) Phillip Lougher947client # [ 0.439263] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint948worker1 # [ 0.353892] 9p: Installing v9fs 9p2000 file system support949client # [ 0.439447] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]950client # [ 0.439462] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]951client # [ 0.439492] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]952client # [ 0.440079] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned953client # [ 0.440090] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned954client # [ 0.440096] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned955client # [ 0.440141] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned956worker2 # [ 0.373787] Key type asymmetric registered957worker1 # [ 0.373873] Key type asymmetric registered958worker2 # [ 0.373819] Asymmetric key parser 'x509' registered959client # [ 0.460226] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned960worker1 # [ 0.373904] Asymmetric key parser 'x509' registered961worker2 # [ 0.373891] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)962client # [ 0.460282] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned963worker1 # [ 0.373987] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)964worker2 # [ 0.376041] io scheduler mq-deadline registered965worker1 # [ 0.376160] io scheduler mq-deadline registered966client # [ 0.460328] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned967worker2 # [ 0.376053] io scheduler kyber registered968worker1 # [ 0.376173] io scheduler kyber registered969client # [ 0.460375] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned970client # [ 0.460425] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned971client # [ 0.460473] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned972client # [ 0.460520] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned973lb # [ 0.376711] Key type asymmetric registered974client # [ 0.460568] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned975lb # [ 0.376739] Asymmetric key parser 'x509' registered976client # [ 0.460669] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned977lb # [ 0.376812] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)978client # [ 0.460716] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned979lb # [ 0.379001] io scheduler mq-deadline registered980lb # [ 0.379013] io scheduler kyber registered981client # [ 0.460738] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned982client # [ 0.460760] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned983client # [ 0.460782] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned984worker2 # [ 0.385791] pl061_gpio 9030000.pl061: PL061 GPIO chip registered985client # [ 0.460806] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned986client # [ 0.460828] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned987client # [ 0.460849] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned988client # [ 0.460871] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned989worker2 # [ 0.387220] ledtrig-cpu: registered to indicate activity on CPUs990client # [ 0.460893] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned991worker1 # [ 0.389530] pl061_gpio 9030000.pl061: PL061 GPIO chip registered992worker2 # [ 0.387645] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:993client # [ 0.460919] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned994client # [ 0.460943] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned995worker2 # [ 0.387665] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000996client # [ 0.460981] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned997worker1 # [ 0.390843] ledtrig-cpu: registered to indicate activity on CPUs998worker2 # [ 0.387678] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000999client # [ 0.461003] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1000worker1 # [ 0.391265] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1001lb # [ 0.388532] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1002client # [ 0.461024] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1003worker2 # [ 0.387686] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001004worker1 # [ 0.391283] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001005client # [ 0.461046] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1006worker2 # [ 0.387706] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1007client # [ 0.461067] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1008worker1 # [ 0.391296] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001009client # [ 0.461088] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1010worker2 # [ 0.387733] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1011worker1 # [ 0.391304] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001012client # [ 0.461109] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1013worker2 # [ 0.387829] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001014lb # [ 0.389939] ledtrig-cpu: registered to indicate activity on CPUs1015client # [ 0.461132] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1016worker2 # [ 0.387838] pci_bus 0000:00: root bus resource [bus 00-ff]1017worker1 # [ 0.391323] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1018lb # [ 0.390358] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1019client # [ 0.461154] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1020worker2 # [ 0.387845] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1021worker1 # [ 0.391344] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1022lb # [ 0.390377] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001023client # [ 0.461177] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1024worker2 # [ 0.387850] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1025worker1 # [ 0.391417] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001026client # [ 0.461204] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1027lb # [ 0.390400] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001028worker2 # [ 0.387855] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1029worker1 # [ 0.391426] pci_bus 0000:00: root bus resource [bus 00-ff]1030client # [ 0.461214] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1031worker1 # [ 0.391432] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1032worker2 # [ 0.387913] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1033lb # [ 0.390408] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001034client # [ 0.461219] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1035worker1 # [ 0.391437] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1036client # [ 0.462379] pci 0000:00:0a.0: enabling device (0000 -> 0002)1037worker2 # [ 0.388360] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1038lb # [ 0.390429] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1039worker1 # [ 0.391443] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1040worker2 # [ 0.388552] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1041lb # [ 0.390455] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1042worker2 # [ 0.388568] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1043worker1 # [ 0.391532] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1044lb # [ 0.390545] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001045worker2 # [ 0.388599] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1046worker1 # [ 0.391977] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1047lb # [ 0.390557] pci_bus 0000:00: root bus resource [bus 00-ff]1048worker2 # [ 0.388615] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1049worker1 # [ 0.392165] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1050lb # [ 0.390563] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1051worker2 # [ 0.389089] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1052worker1 # [ 0.392182] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1053lb # [ 0.390568] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1054worker2 # [ 0.389279] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1055worker1 # [ 0.392211] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1056lb # [ 0.390573] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1057worker2 # [ 0.389295] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1058lb # [ 0.390630] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1059worker2 # [ 0.389327] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1060worker1 # [ 0.406933] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1061lb # [ 0.391094] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1062lb # [ 0.391281] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1063worker1 # [ 0.407407] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1064worker2 # [ 0.408554] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1065lb # [ 0.391297] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1066worker1 # [ 0.407591] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1067worker2 # [ 0.408744] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1068worker1 # [ 0.407606] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1069lb # [ 0.391325] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1070worker2 # [ 0.408761] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1071lb # [ 0.391341] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1072worker1 # [ 0.407636] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1073worker2 # [ 0.408791] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1074lb # [ 0.391789] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1075worker1 # [ 0.408100] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1076worker2 # [ 0.409257] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1077lb # [ 0.391972] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1078worker2 # [ 0.409443] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1079lb # [ 0.391988] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1080worker2 # [ 0.409459] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1081lb # [ 0.392018] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1082worker2 # [ 0.409491] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1083lb # [ 0.411196] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1084lb # [ 0.411385] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1085lb # [ 0.411402] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1086lb # [ 0.411431] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1087lb # [ 0.411876] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1088lb # [ 0.412055] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1089lb # [ 0.412071] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1090lb # [ 0.412102] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1091worker1 # [ 0.420337] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1092worker1 # [ 0.420366] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1093worker1 # [ 0.420396] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1094worker2 # [ 0.422046] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1095client # [ 0.519021] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1096worker2 # [ 0.422247] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1097worker1 # [ 0.420888] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1098worker2 # [ 0.422264] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1099worker1 # [ 0.421073] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1100worker2 # [ 0.422294] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1101worker1 # [ 0.421089] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1102worker2 # [ 0.422775] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1103worker1 # [ 0.421124] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1104worker2 # [ 0.422965] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1105worker1 # [ 0.421590] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1106worker2 # [ 0.422981] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1107client # [ 0.522406] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1108worker1 # [ 0.421774] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1109worker2 # [ 0.423024] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1110worker1 # [ 0.421791] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1111worker2 # [ 0.423533] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1112worker1 # [ 0.421822] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1113worker2 # [ 0.423726] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1114worker1 # [ 0.422278] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1115lb # [ 0.424643] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1116worker2 # [ 0.423743] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1117worker1 # [ 0.422463] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1118lb # [ 0.424841] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1119worker2 # [ 0.423772] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1120worker1 # [ 0.422478] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1121lb # [ 0.424858] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1122worker2 # [ 0.423788] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1123worker1 # [ 0.422509] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1124lb # [ 0.424887] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1125worker2 # [ 0.424263] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1126worker1 # [ 0.422991] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1127lb # [ 0.425349] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1128worker2 # [ 0.424454] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1129worker1 # [ 0.423177] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1130lb # [ 0.425531] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1131worker2 # [ 0.424486] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1132worker1 # [ 0.423192] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1133lb # [ 0.425548] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1134worker1 # [ 0.423221] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1135worker2 # [ 0.424954] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1136lb # [ 0.425577] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1137worker1 # [ 0.423236] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1138worker2 # [ 0.425149] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1139lb # [ 0.426041] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1140worker2 # [ 0.425179] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1141lb # [ 0.426224] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1142worker1 # [ 0.423737] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1143lb # [ 0.426239] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1144worker1 # [ 0.423924] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1145worker2 # [ 0.425592] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1146worker2 # [ 0.425796] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1147worker1 # [ 0.423956] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1148lb # [ 0.426268] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1149lb # [ 0.426284] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1150client # [ 0.532426] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1151worker2 # [ 0.426059] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1152worker1 # [ 0.424428] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1153worker2 # [ 0.426358] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1154client # [ 0.534580] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1155lb # [ 0.426789] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1156worker1 # [ 0.424616] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1157worker2 # [ 0.426376] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1158lb # [ 0.426977] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1159worker1 # [ 0.424645] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1160worker2 # [ 0.426406] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1161lb # [ 0.427006] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1162worker1 # [ 0.425048] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1163worker2 # [ 0.426896] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1164lb # [ 0.427467] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1165worker1 # [ 0.425231] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1166worker2 # [ 0.427095] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1167lb # [ 0.427658] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1168worker1 # [ 0.425485] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1169worker2 # [ 0.427111] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1170lb # [ 0.427688] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1171worker1 # [ 0.425806] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1172worker2 # [ 0.427141] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1173worker1 # [ 0.425824] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1174lb # [ 0.428086] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1175worker2 # [ 0.427741] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1176lb # [ 0.428268] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1177worker1 # [ 0.425853] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1178worker2 # [ 0.427752] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1179worker1 # [ 0.426314] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1180lb # [ 0.428532] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1181worker2 # [ 0.427758] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1182lb # [ 0.428815] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1183worker1 # [ 0.426500] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1184lb # [ 0.428831] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1185worker1 # [ 0.426517] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1186worker2 # [ 0.427805] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1187lb # [ 0.428860] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1188worker1 # [ 0.426547] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1189worker2 # [ 0.427853] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1190worker1 # [ 0.427145] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1191lb # [ 0.429321] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1192worker2 # [ 0.427901] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1193lb # [ 0.429514] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1194worker1 # [ 0.427156] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1195worker2 # [ 0.427950] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1196lb # [ 0.429530] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1197worker1 # [ 0.427161] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1198lb # [ 0.429559] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1199worker2 # [ 0.427998] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1200worker1 # [ 0.427208] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1201lb # [ 0.430151] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1202worker2 # [ 0.428047] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1203worker1 # [ 0.427255] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1204lb # [ 0.430163] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1205worker2 # [ 0.428093] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1206worker1 # [ 0.427301] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1207lb # [ 0.430169] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1208worker2 # [ 0.428144] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1209worker1 # [ 0.427345] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1210lb # [ 0.430213] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1211client # [ 0.544377] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1212worker2 # [ 0.428193] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1213worker1 # [ 0.427391] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1214lb # [ 0.430261] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1215client # [ 0.547673] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1216worker2 # [ 0.428264] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1217client # [ 0.549833] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1218worker1 # [ 0.427437] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1219lb # [ 0.430310] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1220worker2 # [ 0.428312] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1221lb # [ 0.430358] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1222worker1 # [ 0.427483] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1223worker2 # [ 0.428334] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1224worker2 # [ 0.428356] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1225lb # [ 0.430405] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1226worker1 # [ 0.427528] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1227client # [ 0.552124] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1228worker2 # [ 0.428378] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1229lb # [ 0.430451] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1230worker1 # [ 0.427575] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1231worker2 # [ 0.428402] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1232lb # [ 0.430499] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1233worker1 # [ 0.427645] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1234worker2 # [ 0.428424] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1235worker1 # [ 0.427691] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1236lb # [ 0.430546] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1237worker2 # [ 0.428446] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1238worker1 # [ 0.427713] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1239lb # [ 0.430592] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1240worker2 # [ 0.428468] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1241worker1 # [ 0.427735] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1242lb # [ 0.430663] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1243worker2 # [ 0.428491] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1244worker1 # [ 0.427756] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1245worker2 # [ 0.428513] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1246lb # [ 0.430719] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1247worker1 # [ 0.427781] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1248worker2 # [ 0.428536] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1249lb # [ 0.430741] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1250worker1 # [ 0.427804] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1251worker2 # [ 0.428559] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1252lb # [ 0.430762] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1253worker1 # [ 0.427827] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1254worker2 # [ 0.428580] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1255lb # [ 0.430784] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1256worker1 # [ 0.427849] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1257worker2 # [ 0.428602] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1258client # [ 0.561927] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1259lb # [ 0.430808] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1260worker1 # [ 0.427872] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1261worker2 # [ 0.428624] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1262client # [ 0.563836] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1263lb # [ 0.430830] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1264worker1 # [ 0.427894] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1265worker2 # [ 0.428646] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1266lb # [ 0.430853] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1267worker2 # [ 0.428668] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1268worker1 # [ 0.427917] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1269lb # [ 0.430875] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1270worker2 # [ 0.428689] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1271worker1 # [ 0.427944] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1272lb # [ 0.430901] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1273worker2 # [ 0.428711] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1274worker1 # [ 0.427966] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1275lb # [ 0.430923] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1276worker2 # [ 0.428735] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1277worker1 # [ 0.427990] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1278lb # [ 0.430946] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1279worker2 # [ 0.428757] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1280worker1 # [ 0.428014] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1281worker2 # [ 0.428784] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1282lb # [ 0.430968] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1283worker1 # [ 0.428035] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1284worker2 # [ 0.428797] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1285lb # [ 0.430989] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1286worker1 # [ 0.428056] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1287worker2 # [ 0.428806] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1288lb # [ 0.431010] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1289worker1 # [ 0.428078] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1290lb # [ 0.431031] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1291worker1 # [ 0.428099] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1292lb # [ 0.431053] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1293worker1 # [ 0.428121] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1294lb # [ 0.431074] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1295worker1 # [ 0.428143] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1296worker1 # [ 0.428169] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1297lb # [ 0.431095] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1298worker1 # [ 0.428179] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1299lb # [ 0.431116] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1300client # [ 0.574941] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1301lb # [ 0.431139] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1302worker1 # [ 0.428184] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1303lb # [ 0.431160] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1304lb # [ 0.431187] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1305worker2 # [ 0.486100] pci 0000:00:0a.0: enabling device (0000 -> 0002)1306lb # [ 0.431196] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1307lb # [ 0.431201] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1308lb # [ 0.432354] pci 0000:00:0a.0: enabling device (0000 -> 0002)1309worker1 # [ 0.493409] pci 0000:00:0a.0: enabling device (0000 -> 0002)1310lb # [ 0.492520] pci 0000:00:0a.0: quirk_usb_early_handoff+0x0/0xa60 took 58760 usecs1311client # [ 0.589510] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1312client # [ 0.592306] msm_serial: driver initialized1313client # [ 0.592454] SuperH (H)SCI(F) driver initialized1314client # [ 0.592512] STM32 USART driver initialized1315worker2 # [ 0.512693] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1316worker1 # [ 0.514915] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1317lb # [ 0.514015] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1318lb # [ 0.516326] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1319worker2 # [ 0.519197] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1320worker2 # [ 0.521325] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1321worker1 # [ 0.525408] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1322worker2 # [ 0.535177] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1323worker2 # [ 0.537247] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1324client # [ 0.629586] loop: module loaded1325lb # [ 0.533906] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1326client # [ 0.629776] virtio_blk virtio5: 1/0/0 default/read/poll queues1327worker2 # [ 0.541132] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1328lb # [ 0.536093] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1329client # [ 0.630592] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1330worker1 # [ 0.536914] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1331lb # [ 0.539949] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1332worker1 # [ 0.539464] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1333worker1 # [ 0.541658] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1334worker1 # [ 0.543846] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1335lb # [ 0.543397] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1336worker2 # [ 0.547515] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1337client # [ 0.640920] megasas: 07.734.00.00-rc11338client # [ 0.641785] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1339client # [ 0.643930] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001340worker1 # [ 0.553705] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1341client # [ 0.643961] Intel/Sharp Extended Query Table at 0x00311342worker1 # [ 0.555970] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1343lb # [ 0.553960] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1344lb # [ 0.556236] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1345worker2 # [ 0.557922] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1346client # [ 0.653686] Using buffer write method1347worker2 # [ 0.560647] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1348client # [ 0.653772] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1349worker2 # [ 0.562556] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1350worker1 # [ 0.567178] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1351client # [ 0.655372] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001352client # [ 0.655407] Intel/Sharp Extended Query Table at 0x00311353worker2 # [ 0.564939] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1354lb # [ 0.567163] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1355client # [ 0.665348] Using buffer write method1356client # [ 0.665407] Concatenating MTD devices:1357client # [ 0.665411] (0): "0.flash"1358client # [ 0.665415] (1): "0.flash"1359client # [ 0.665418] into device "0.flash"1360worker1 # [ 0.573350] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1361worker1 # [ 0.575781] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1362lb # [ 0.570169] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1363lb # [ 0.572481] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1364worker2 # [ 0.586019] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1365worker2 # [ 0.588758] msm_serial: driver initialized1366worker2 # [ 0.588918] SuperH (H)SCI(F) driver initialized1367worker2 # [ 0.588973] STM32 USART driver initialized1368worker1 # [ 0.593611] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1369lb # [ 0.593674] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1370worker1 # [ 0.596444] msm_serial: driver initialized1371worker1 # [ 0.596608] SuperH (H)SCI(F) driver initialized1372worker1 # [ 0.596662] STM32 USART driver initialized1373lb # [ 0.596613] msm_serial: driver initialized1374lb # [ 0.596825] SuperH (H)SCI(F) driver initialized1375lb # [ 0.596889] STM32 USART driver initialized1376worker2 # [ 0.622814] loop: module loaded1377worker2 # [ 0.623213] virtio_blk virtio5: 1/0/0 default/read/poll queues1378worker2 # [ 0.624030] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1379worker1 # [ 0.631294] loop: module loaded1380lb # [ 0.627597] loop: module loaded1381worker1 # [ 0.631507] virtio_blk virtio5: 1/0/0 default/read/poll queues1382lb # [ 0.627811] virtio_blk virtio5: 1/0/0 default/read/poll queues1383worker1 # [ 0.633575] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1384lb # [ 0.629747] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1385worker2 # [ 0.638423] megasas: 07.734.00.00-rc11386worker2 # [ 0.639260] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1387worker2 # [ 0.641246] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001388lb # [ 0.636475] megasas: 07.734.00.00-rc11389worker2 # [ 0.641298] Intel/Sharp Extended Query Table at 0x00311390lb # [ 0.637368] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1391worker2 # [ 0.643176] Using buffer write method1392lb # [ 0.640657] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001393worker2 # [ 0.643256] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1394lb # [ 0.640682] Intel/Sharp Extended Query Table at 0x00311395lb # [ 0.642445] Using buffer write method1396worker2 # [ 0.645205] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001397worker2 # [ 0.645240] Intel/Sharp Extended Query Table at 0x00311398worker1 # [ 0.645038] megasas: 07.734.00.00-rc11399lb # [ 0.642528] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1400worker1 # [ 0.645817] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1401worker1 # [ 0.648038] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001402worker1 # [ 0.648068] Intel/Sharp Extended Query Table at 0x00311403worker1 # [ 0.650096] Using buffer write method1404worker1 # [ 0.650182] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1405worker1 # [ 0.652138] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001406worker1 # [ 0.652171] Intel/Sharp Extended Query Table at 0x00311407worker2 # [ 0.665691] Using buffer write method1408worker2 # [ 0.665744] Concatenating MTD devices:1409worker2 # [ 0.665749] (0): "0.flash"1410worker2 # [ 0.665753] (1): "0.flash"1411worker2 # [ 0.665757] into device "0.flash"1412lb # [ 0.660436] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001413lb # [ 0.660490] Intel/Sharp Extended Query Table at 0x00311414lb # [ 0.662690] Using buffer write method1415lb # [ 0.662719] Concatenating MTD devices:1416lb # [ 0.662724] (0): "0.flash"1417lb # [ 0.662729] (1): "0.flash"1418lb # [ 0.662732] into device "0.flash"1419worker1 # [ 0.672357] Using buffer write method1420worker1 # [ 0.672414] Concatenating MTD devices:1421worker1 # [ 0.672419] (0): "0.flash"1422worker1 # [ 0.672423] (1): "0.flash"1423worker1 # [ 0.672426] into device "0.flash"1424client # [ 0.939826] Freeing initrd memory: 26160K1425client # [ 0.946204] tun: Universal TUN/TAP device driver, 1.61426client # [ 0.950291] thunder_xcv, ver 1.01427client # [ 0.950341] thunder_bgx, ver 1.01428client # [ 0.950365] nicpf, ver 1.01429client # [ 0.950929] e1000: Intel(R) PRO/1000 Network Driver1430client # [ 0.950936] e1000: Copyright (c) 1999-2006 Intel Corporation.1431client # [ 0.950960] e1000e: Intel(R) PRO/1000 Network Driver1432client # [ 0.950968] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1433client # [ 0.950999] igb: Intel(R) Gigabit Ethernet Network Driver1434client # [ 0.951005] igb: Copyright (c) 2007-2014 Intel Corporation.1435client # [ 0.951030] igbvf: Intel(R) Gigabit Virtual Function Network Driver1436client # [ 0.951037] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1437client # [ 0.951173] sky2: driver version 1.301438client # [ 0.961218] usbcore: registered new interface driver usb-storage1439client # [ 0.961285] usbcore: registered new interface driver usbserial_generic1440client # [ 0.961300] usbserial: USB Serial support registered for generic1441client # [ 0.961915] hv_vmbus: registering driver hyperv_keyboard1442client # [ 0.963325] ehci-pci 0000:00:0a.0: EHCI Host Controller1443client # [ 0.963354] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11444client # [ 0.963660] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001445client # [ 0.969731] rtc-pl031 9010000.pl031: registered as rtc01446client # [ 0.969769] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:16:25 UTC (1789892185)1447client # [ 0.970163] i2c_dev: i2c /dev entries driver1448client # [ 0.973389] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001449client # [ 0.973726] hub 1-0:1.0: USB hub found1450client # [ 0.973748] hub 1-0:1.0: 6 ports detected1451client # [ 0.977893] sdhci: Secure Digital Host Controller Interface driver1452client # [ 0.977905] sdhci: Copyright(c) Pierre Ossman1453client # [ 0.978185] Synopsys Designware Multimedia Card Interface Driver1454client # [ 0.978562] sdhci-pltfm: SDHCI platform and OF driver helper1455client # [ 0.983186] hid: raw HID events driver (C) Jiri Kosina1456client # [ 0.983469] usbcore: registered new interface driver usbhid1457client # [ 0.983475] usbhid: USB HID core driver1458client # [ 0.986482] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1459client # [ 0.988059] drop_monitor: Initializing network drop monitor service1460client # [ 0.990239] NET: Registered PF_INET6 protocol family1461client # [ 0.991436] Segment Routing with IPv61462client # [ 0.991469] In-situ OAM (IOAM) with IPv61463client # [ 0.991499] NET: Registered PF_PACKET protocol family1464client # [ 0.993380] 9pnet: Installing 9P2000 support1465client # [ 0.995706] Key type dns_resolver registered1466client # [ 1.002817] registered taskstats version 11467client # [ 1.002972] Loading compiled-in X.509 certificates1468client # [ 1.011860] Demotion targets for Node 0: null1469client # [ 1.011982] Key type .fscrypt registered1470client # [ 1.011989] Key type fscrypt-provisioning registered1471client # [ 1.012097] ima: No TPM chip found, activating TPM-bypass!1472client # [ 1.012117] ima: Allocated hash algorithm: sha11473client # [ 1.012140] ima: No architecture policies found1474client # [ 1.016771] input: gpio-keys as /devices/platform/gpio-keys/input/input01475worker2 # [ 0.938671] Freeing initrd memory: 26148K1476lb # [ 0.935774] Freeing initrd memory: 26140K1477worker2 # [ 0.945016] tun: Universal TUN/TAP device driver, 1.61478client # [ 1.035637] clk: Disabling unused clocks1479lb # [ 0.942109] tun: Universal TUN/TAP device driver, 1.61480client # [ 1.035679] PM: genpd: Disabling unused power domains1481worker2 # [ 0.949013] thunder_xcv, ver 1.01482worker2 # [ 0.949075] thunder_bgx, ver 1.01483worker2 # [ 0.949098] nicpf, ver 1.01484client # [ 1.040212] Freeing unused kernel memory: 4736K1485client # [ 1.040435] Run /init as init process1486lb # [ 0.946075] thunder_xcv, ver 1.01487lb # [ 0.946118] thunder_bgx, ver 1.01488lb # [ 0.946142] nicpf, ver 1.01489worker2 # [ 0.950914] e1000: Intel(R) PRO/1000 Network Driver1490lb # [ 0.946741] e1000: Intel(R) PRO/1000 Network Driver1491worker2 # [ 0.950925] e1000: Copyright (c) 1999-2006 Intel Corporation.1492lb # [ 0.946750] e1000: Copyright (c) 1999-2006 Intel Corporation.1493worker1 # [ 0.956011] Freeing initrd memory: 26148K1494worker2 # [ 0.950959] e1000e: Intel(R) PRO/1000 Network Driver1495lb # [ 0.946774] e1000e: Intel(R) PRO/1000 Network Driver1496worker2 # [ 0.950968] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1497lb # [ 0.946782] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1498worker2 # [ 0.951018] igb: Intel(R) Gigabit Ethernet Network Driver1499lb # [ 0.946811] igb: Intel(R) Gigabit Ethernet Network Driver1500worker2 # [ 0.951023] igb: Copyright (c) 2007-2014 Intel Corporation.1501lb # [ 0.946817] igb: Copyright (c) 2007-2014 Intel Corporation.1502worker2 # [ 0.951048] igbvf: Intel(R) Gigabit Virtual Function Network Driver1503lb # [ 0.946841] igbvf: Intel(R) Gigabit Virtual Function Network Driver1504worker2 # [ 0.951053] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1505lb # [ 0.946847] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1506worker2 # [ 0.951195] sky2: driver version 1.301507lb # [ 0.946990] sky2: driver version 1.301508worker2 # [ 0.952866] usbcore: registered new interface driver usb-storage1509lb # [ 0.949133] ehci-pci 0000:00:0a.0: EHCI Host Controller1510worker2 # [ 0.952992] usbcore: registered new interface driver usbserial_generic1511lb # [ 0.949182] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11512worker2 # [ 0.953007] usbserial: USB Serial support registered for generic1513worker1 # [ 0.962388] tun: Universal TUN/TAP device driver, 1.61514lb # [ 0.949468] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001515worker2 # [ 0.953617] hv_vmbus: registering driver hyperv_keyboard1516worker2 # [ 0.954448] ehci-pci 0000:00:0a.0: EHCI Host Controller1517worker2 # [ 0.954476] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11518worker2 # [ 0.954729] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001519lb # [ 0.959505] usbcore: registered new interface driver usb-storage1520lb # [ 0.959610] usbcore: registered new interface driver usbserial_generic1521worker2 # [ 0.966111] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001522lb # [ 0.959624] usbserial: USB Serial support registered for generic1523worker2 # [ 0.966478] hub 1-0:1.0: USB hub found1524lb # [ 0.960255] hv_vmbus: registering driver hyperv_keyboard1525worker2 # [ 0.966499] hub 1-0:1.0: 6 ports detected1526worker1 # [ 0.966246] thunder_xcv, ver 1.01527lb # [ 0.960438] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001528worker1 # [ 0.966296] thunder_bgx, ver 1.01529client # [ 1.058767] systemd[1]: Successfully made /usr/ read-only.1530worker1 # [ 0.966328] nicpf, ver 1.01531lb # [ 0.960785] hub 1-0:1.0: USB hub found1532lb # [ 0.960813] hub 1-0:1.0: 6 ports detected1533worker1 # [ 0.966940] e1000: Intel(R) PRO/1000 Network Driver1534worker2 # [ 0.969486] rtc-pl031 9010000.pl031: registered as rtc01535worker1 # [ 0.966950] e1000: Copyright (c) 1999-2006 Intel Corporation.1536worker2 # [ 0.969515] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:16:26 UTC (1789892186)1537worker1 # [ 0.966974] e1000e: Intel(R) PRO/1000 Network Driver1538worker1 # [ 0.966981] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1539lb # [ 0.966609] rtc-pl031 9010000.pl031: registered as rtc01540worker1 # [ 0.967011] igb: Intel(R) Gigabit Ethernet Network Driver1541worker2 # [ 0.971657] i2c_dev: i2c /dev entries driver1542worker1 # [ 0.967017] igb: Copyright (c) 2007-2014 Intel Corporation.1543lb # [ 0.966642] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:16:26 UTC (1789892186)1544lb # [ 0.967021] i2c_dev: i2c /dev entries driver1545worker1 # [ 0.967041] igbvf: Intel(R) Gigabit Virtual Function Network Driver1546worker1 # [ 0.967046] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1547worker1 # [ 0.967186] sky2: driver version 1.301548lb # [ 0.972204] sdhci: Secure Digital Host Controller Interface driver1549lb # [ 0.972217] sdhci: Copyright(c) Pierre Ossman1550worker1 # [ 0.976225] usbcore: registered new interface driver usb-storage1551worker2 # [ 0.975016] sdhci: Secure Digital Host Controller Interface driver1552worker2 # [ 0.975025] sdhci: Copyright(c) Pierre Ossman1553worker1 # [ 0.976991] ehci-pci 0000:00:0a.0: EHCI Host Controller1554worker2 # [ 0.975290] Synopsys Designware Multimedia Card Interface Driver1555worker1 # [ 0.977021] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11556worker2 # [ 0.975667] sdhci-pltfm: SDHCI platform and OF driver helper1557worker1 # [ 0.977326] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001558worker2 # [ 0.977370] hid: raw HID events driver (C) Jiri Kosina1559lb # [ 0.973869] Synopsys Designware Multimedia Card Interface Driver1560worker2 # [ 0.977649] usbcore: registered new interface driver usbhid1561lb # [ 0.974265] sdhci-pltfm: SDHCI platform and OF driver helper1562lb # [ 0.976096] hid: raw HID events driver (C) Jiri Kosina1563worker1 # [ 0.980640] usbcore: registered new interface driver usbserial_generic1564worker2 # [ 0.981794] usbhid: USB HID core driver1565worker1 # [ 0.980659] usbserial: USB Serial support registered for generic1566worker1 # [ 0.981319] hv_vmbus: registering driver hyperv_keyboard1567lb # [ 0.978512] usbcore: registered new interface driver usbhid1568lb # [ 0.978523] usbhid: USB HID core driver1569worker1 # [ 0.984505] rtc-pl031 9010000.pl031: registered as rtc01570worker2 # [ 0.983536] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1571worker2 # [ 0.985100] drop_monitor: Initializing network drop monitor service1572worker1 # [ 0.984540] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:16:26 UTC (1789892186)1573worker2 # [ 0.985294] NET: Registered PF_INET6 protocol family1574worker1 # [ 0.984853] i2c_dev: i2c /dev entries driver1575lb # [ 0.980963] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1576worker2 # [ 0.988447] Segment Routing with IPv61577lb # [ 0.982575] drop_monitor: Initializing network drop monitor service1578worker2 # [ 0.988467] In-situ OAM (IOAM) with IPv61579lb # [ 0.982773] NET: Registered PF_INET6 protocol family1580worker2 # [ 0.988497] NET: Registered PF_PACKET protocol family1581lb # [ 0.986064] Segment Routing with IPv61582lb # [ 0.986089] In-situ OAM (IOAM) with IPv61583lb # [ 0.986122] NET: Registered PF_PACKET protocol family1584worker1 # [ 0.989918] sdhci: Secure Digital Host Controller Interface driver1585lb # [ 0.987816] 9pnet: Installing 9P2000 support1586worker1 # [ 0.989934] sdhci: Copyright(c) Pierre Ossman1587worker2 # [ 0.990438] 9pnet: Installing 9P2000 support1588worker1 # [ 0.990202] Synopsys Designware Multimedia Card Interface Driver1589worker2 # [ 0.992712] Key type dns_resolver registered1590worker1 # [ 0.990576] sdhci-pltfm: SDHCI platform and OF driver helper1591worker1 # [ 0.995068] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001592worker1 # [ 0.996206] hub 1-0:1.0: USB hub found1593lb # [ 0.990627] Key type dns_resolver registered1594worker1 # [ 0.996247] hub 1-0:1.0: 6 ports detected1595worker1 # [ 0.997707] hid: raw HID events driver (C) Jiri Kosina1596worker1 # [ 0.997994] usbcore: registered new interface driver usbhid1597worker1 # [ 0.998002] usbhid: USB HID core driver1598worker2 # [ 0.999819] registered taskstats version 11599worker2 # [ 0.999979] Loading compiled-in X.509 certificates1600worker1 # [ 1.000977] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1601worker1 # [ 1.002586] drop_monitor: Initializing network drop monitor service1602worker1 # [ 1.002759] NET: Registered PF_INET6 protocol family1603lb # [ 0.997241] registered taskstats version 11604lb # [ 0.997382] Loading compiled-in X.509 certificates1605worker1 # [ 1.005881] Segment Routing with IPv61606worker1 # [ 1.005902] In-situ OAM (IOAM) with IPv61607worker1 # [ 1.005960] NET: Registered PF_PACKET protocol family1608worker1 # [ 1.007666] 9pnet: Installing 9P2000 support1609worker2 # [ 1.008690] Demotion targets for Node 0: null1610worker2 # [ 1.008808] Key type .fscrypt registered1611worker2 # [ 1.008816] Key type fscrypt-provisioning registered1612worker2 # [ 1.008914] ima: No TPM chip found, activating TPM-bypass!1613lb # [ 1.006142] Demotion targets for Node 0: null1614lb # [ 1.006266] Key type .fscrypt registered1615worker2 # [ 1.008932] ima: Allocated hash algorithm: sha11616worker2 # [ 1.008955] ima: No architecture policies found1617lb # [ 1.006273] Key type fscrypt-provisioning registered1618worker1 # [ 1.010493] Key type dns_resolver registered1619lb # [ 1.006382] ima: No TPM chip found, activating TPM-bypass!1620lb # [ 1.006401] ima: Allocated hash algorithm: sha11621worker2 # [ 1.013179] input: gpio-keys as /devices/platform/gpio-keys/input/input01622lb # [ 1.006430] ima: No architecture policies found1623lb # [ 1.010765] input: gpio-keys as /devices/platform/gpio-keys/input/input01624worker1 # [ 1.016943] registered taskstats version 11625worker1 # [ 1.017106] Loading compiled-in X.509 certificates1626worker1 # [ 1.026175] Demotion targets for Node 0: null1627worker1 # [ 1.026317] Key type .fscrypt registered1628worker1 # [ 1.026324] Key type fscrypt-provisioning registered1629worker1 # [ 1.026422] ima: No TPM chip found, activating TPM-bypass!1630worker1 # [ 1.026442] ima: Allocated hash algorithm: sha11631worker1 # [ 1.026468] ima: No architecture policies found1632worker1 # [ 1.030769] input: gpio-keys as /devices/platform/gpio-keys/input/input01633worker2 # [ 1.030993] clk: Disabling unused clocks1634worker2 # [ 1.031068] PM: genpd: Disabling unused power domains1635lb # [ 1.028864] clk: Disabling unused clocks1636worker2 # [ 1.035412] Freeing unused kernel memory: 4736K1637lb # [ 1.028895] PM: genpd: Disabling unused power domains1638worker2 # [ 1.035610] Run /init as init process1639lb # [ 1.033339] Freeing unused kernel memory: 4736K1640lb # [ 1.033521] Run /init as init process1641worker1 # [ 1.049753] clk: Disabling unused clocks1642worker2 # [ 1.052527] systemd[1]: Successfully made /usr/ read-only.1643worker1 # [ 1.049800] PM: genpd: Disabling unused power domains1644worker1 # [ 1.054281] Freeing unused kernel memory: 4736K1645lb # [ 1.050808] systemd[1]: Successfully made /usr/ read-only.1646worker1 # [ 1.054479] Run /init as init process1647worker1 # [ 1.070622] systemd[1]: Successfully made /usr/ read-only.1648client # [ 1.220303] usb 1-1: new high-speed USB device number 2 using ehci-pci1649lb # [ 1.208431] usb 1-1: new high-speed USB device number 2 using ehci-pci1650worker2 # [ 1.213712] usb 1-1: new high-speed USB device number 2 using ehci-pci1651worker1 # [ 1.244317] usb 1-1: new high-speed USB device number 2 using ehci-pci1652client # [ 1.370039] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11653client # [ 1.393693] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1654client # [ 1.400200] systemd[1]: Detected virtualization qemu.1655client # [ 1.401355] systemd[1]: Detected architecture arm64.1656client # [ 1.402346] systemd[1]: Running in initrd.1657client # [ 1.403744] systemd[1]: Initializing machine ID from random generator.1658client # [ 1.405226] systemd[1]: Hostname set to <client>.1659client # [ 1.456430] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01660worker2 # [ 1.369061] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11661lb # [ 1.365144] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11662worker1 # [ 1.396135] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11663worker2 # [ 1.387622] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1664worker2 # [ 1.400152] systemd[1]: Detected virtualization qemu.1665lb # [ 1.385927] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1666worker2 # [ 1.402349] systemd[1]: Detected architecture arm64.1667worker2 # [ 1.404287] systemd[1]: Running in initrd.1668lb # [ 1.398455] systemd[1]: Detected virtualization qemu.1669lb # [ 1.398581] systemd[1]: Detected architecture arm64.1670worker2 # [ 1.407035] systemd[1]: Initializing machine ID from random generator.1671lb # [ 1.398607] systemd[1]: Running in initrd.1672worker2 # [ 1.409984] systemd[1]: Hostname set to <worker2>.1673lb # [ 1.399727] systemd[1]: Initializing machine ID from random generator.1674lb # [ 1.400054] systemd[1]: Hostname set to <lb>.1675worker1 # [ 1.405530] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1676worker1 # [ 1.418202] systemd[1]: Detected virtualization qemu.1677worker1 # [ 1.420390] systemd[1]: Detected architecture arm64.1678worker1 # [ 1.422350] systemd[1]: Running in initrd.1679worker1 # [ 1.425081] systemd[1]: Initializing machine ID from random generator.1680worker1 # [ 1.428030] systemd[1]: Hostname set to <worker1>.1681worker2 # [ 1.453902] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01682lb # [ 1.452794] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01683worker1 # [ 1.484582] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01684client # [ 1.577623] usb 1-2: new high-speed USB device number 3 using ehci-pci1685client # [ 1.656217] systemd[1]: bpf-restrict-fs: LSM BPF program attached1686worker2 # [ 1.573750] usb 1-2: new high-speed USB device number 3 using ehci-pci1687lb # [ 1.576479] usb 1-2: new high-speed USB device number 3 using ehci-pci1688worker1 # [ 1.604365] usb 1-2: new high-speed USB device number 3 using ehci-pci1689client # [ 1.730345] systemd[1]: Queued start job for default target Initrd Default Target.1690client # [ 1.733961] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21691client # [ 1.736098] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01692client # [ 1.740542] systemd[1]: Created slice Slice /system/modprobe.1693client # [ 1.741679] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1694client # [ 1.742858] systemd[1]: Expecting device /dev/disk/by-label/nixos...1695client # [ 1.744045] systemd[1]: Reached target Path Units.1696client # [ 1.744825] systemd[1]: Reached target Slice Units.1697client # [ 1.745635] systemd[1]: Reached target Swaps.1698client # [ 1.746269] systemd[1]: Reached target Timer Units.1699client # [ 1.747241] systemd[1]: Listening on D-Bus System Message Bus Socket.1700client # [ 1.748456] systemd[1]: Listening on Journal Socket (/dev/log).1701client # [ 1.749474] systemd[1]: Listening on Journal Sockets.1702client # [ 1.750437] systemd[1]: Listening on udev Control Socket.1703client # [ 1.751327] systemd[1]: Listening on udev Kernel Socket.1704client # [ 1.752138] systemd[1]: Reached target Socket Units.1705client # [ 1.754485] systemd[1]: Starting Create List of Static Device Nodes...1706client # [ 1.761235] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1707client # [ 1.762287] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1708worker2 # [ 1.676047] systemd[1]: bpf-restrict-fs: LSM BPF program attached1709client # [ 1.772421] systemd[1]: Mounting Kernel Configuration File System...1710client # [ 1.780980] systemd[1]: Starting Journal Service...1711client # [ 1.806655] systemd[1]: Starting Load Kernel Modules...1712client # [ 1.807579] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1713lb # [ 1.725889] systemd[1]: bpf-restrict-fs: LSM BPF program attached1714worker2 # [ 1.736683] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21715worker2 # [ 1.736847] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01716client # [ 1.831071] systemd-journald[73]: Collecting audit messages is disabled.1717worker1 # [ 1.740068] systemd[1]: bpf-restrict-fs: LSM BPF program attached1718client # [ 1.832274] systemd[1]: Starting Coldplug All udev Devices...1719lb # [ 1.738987] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21720lb # [ 1.744885] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01721client # [ 1.844350] systemd[1]: Finished Create List of Static Device Nodes.1722client # [ 1.845265] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1723worker2 # [ 1.760539] systemd[1]: Queued start job for default target Initrd Default Target.1724worker1 # [ 1.765077] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21725client # [ 1.860337] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1726worker2 # [ 1.772189] systemd[1]: Created slice Slice /system/modprobe.1727client # [ 1.860923] systemd[1]: Mounted Kernel Configuration File System.1728worker2 # [ 1.773449] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1729client # [ 1.864018] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1730worker2 # [ 1.774809] systemd[1]: Expecting device /dev/disk/by-label/nixos...1731worker2 # [ 1.775839] systemd[1]: Reached target Path Units.1732worker1 # [ 1.772542] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01733worker2 # [ 1.776623] systemd[1]: Reached target Slice Units.1734worker2 # [ 1.777391] systemd[1]: Reached target Swaps.1735worker2 # [ 1.778226] systemd[1]: Reached target Timer Units.1736worker2 # [ 1.779404] systemd[1]: Listening on D-Bus System Message Bus Socket.1737worker2 # [ 1.780550] systemd[1]: Listening on Journal Socket (/dev/log).1738worker2 # [ 1.781618] systemd[1]: Listening on Journal Sockets.1739worker2 # [ 1.782624] systemd[1]: Listening on udev Control Socket.1740worker2 # [ 1.782747] systemd[1]: Listening on udev Kernel Socket.1741worker2 # [ 1.782771] systemd[1]: Reached target Socket Units.1742worker2 # [ 1.786892] systemd[1]: Starting Create List of Static Device Nodes...1743worker2 # [ 1.797899] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1744worker2 # [ 1.798976] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1745worker2 # [ 1.802187] systemd[1]: Mounting Kernel Configuration File System...1746client # [ 1.894777] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1747worker2 # [ 1.813171] systemd[1]: Starting Journal Service...1748client # [ 1.910820] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1749worker2 # [ 1.824033] systemd[1]: Starting Load Kernel Modules...1750worker2 # [ 1.824145] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1751worker2 # [ 1.837916] systemd[1]: Starting Coldplug All udev Devices...1752client # [ 1.924281] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01753client # [ 1.924535] [drm] features: -virgl +edid -resource_blob -host_visible1754client # [ 1.924546] [drm] features: -context_init1755client # [ 1.925298] [drm] number of scanouts: 11756client # [ 1.925316] [drm] number of cap sets: 01757lb # [ 1.836354] systemd[1]: Queued start job for default target Initrd Default Target.1758worker1 # [ 1.850365] systemd[1]: Queued start job for default target Initrd Default Target.1759client # [ 1.941464] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1760lb # [ 1.847722] systemd[1]: Created slice Slice /system/modprobe.1761client # [ 1.942817] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1762client # [ 1.942834] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01763lb # [ 1.848982] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1764lb # [ 1.849026] systemd[1]: Expecting device /dev/disk/by-label/nixos...1765lb # [ 1.849054] systemd[1]: Reached target Path Units.1766lb # [ 1.849073] systemd[1]: Reached target Slice Units.1767lb # [ 1.849094] systemd[1]: Reached target Swaps.1768worker1 # [ 1.858716] systemd[1]: Created slice Slice /system/modprobe.1769lb # [ 1.849114] systemd[1]: Reached target Timer Units.1770worker1 # [ 1.859918] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1771lb # [ 1.849295] systemd[1]: Listening on D-Bus System Message Bus Socket.1772lb # [ 1.849439] systemd[1]: Listening on Journal Socket (/dev/log).1773worker1 # [ 1.861446] systemd[1]: Expecting device /dev/disk/by-label/nixos...1774lb # [ 1.849575] systemd[1]: Listening on Journal Sockets.1775worker1 # [ 1.862545] systemd[1]: Reached target Path Units.1776client # [ 1.952737] systemd[1]: Starting Create Static Device Nodes in /dev...1777worker1 # [ 1.863316] systemd[1]: Reached target Slice Units.1778worker1 # [ 1.864104] systemd[1]: Reached target Swaps.1779lb # [ 1.849698] systemd[1]: Listening on udev Control Socket.1780worker1 # [ 1.864880] systemd[1]: Reached target Timer Units.1781worker1 # [ 1.865865] systemd[1]: Listening on D-Bus System Message Bus Socket.1782lb # [ 1.849811] systemd[1]: Listening on udev Kernel Socket.1783lb # [ 1.849833] systemd[1]: Reached target Socket Units.1784worker1 # [ 1.867060] systemd[1]: Listening on Journal Socket (/dev/log).1785worker1 # [ 1.868155] systemd[1]: Listening on Journal Sockets.1786lb # [ 1.864167] systemd[1]: Starting Create List of Static Device Nodes...1787worker1 # [ 1.869189] systemd[1]: Listening on udev Control Socket.1788worker1 # [ 1.869316] systemd[1]: Listening on udev Kernel Socket.1789worker1 # [ 1.869340] systemd[1]: Reached target Socket Units.1790worker1 # [ 1.873514] systemd[1]: Starting Create List of Static Device Nodes...1791lb # [ 1.872792] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1792worker2 # [ 1.874468] systemd[1]: Finished Create List of Static Device Nodes.1793worker2 # [ 1.875792] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1794lb # [ 1.874020] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1795worker2 # [ 1.879757] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1796worker2 # [ 1.880986] systemd[1]: Mounted Kernel Configuration File System.1797worker1 # [ 1.884175] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1798lb # [ 1.880529] systemd[1]: Mounting Kernel Configuration File System...1799worker1 # [ 1.885524] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1800client # [ 1.976462] Console: switching to colour frame buffer device 160x501801worker2 # [ 1.890217] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1802worker2 # [ 1.896526] systemd-journald[73]: Collecting audit messages is disabled.1803worker1 # [ 1.897772] systemd[1]: Mounting Kernel Configuration File System...1804lb # [ 1.905982] systemd[1]: Starting Journal Service...1805worker1 # [ 1.916536] systemd[1]: Starting Journal Service...1806client # [ 2.008897] systemd[1]: Finished Create Static Device Nodes in /dev.1807lb # [ 1.916708] systemd[1]: Starting Load Kernel Modules...1808client # [ 2.009333] systemd[1]: Reached target Preparation for Local File Systems.1809client # [ 2.009360] systemd[1]: Reached target Local File Systems.1810lb # [ 1.917619] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1811worker1 # [ 1.923243] systemd[1]: Starting Load Kernel Modules...1812client # [ 2.013448] systemd[1]: Starting Rule-based Manager for Device Events and Files...1813worker1 # [ 1.924133] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1814client # [ 2.016900] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1815worker2 # [ 1.924262] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1816lb # [ 1.929620] systemd[1]: Starting Coldplug All udev Devices...1817worker2 # [ 1.945858] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1818worker1 # [ 1.949113] systemd[1]: Starting Coldplug All udev Devices...1819worker2 # [ 1.950381] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1820worker1 # [ 1.951825] systemd[1]: Finished Create List of Static Device Nodes.1821client # [ 2.024557] systemd-modules-load[75]: Inserted module 'dm_mod'1822client # [ 2.025753] systemd-modules-load[75]: Module 'virtio_balloon' is built in1823worker1 # [ 1.953630] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1824client # [ 2.026887] systemd-modules-load[75]: Module 'virtio_console' is built in1825worker2 # [ 1.957779] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01826worker2 # [ 1.958026] [drm] features: -virgl +edid -resource_blob -host_visible1827worker2 # [ 1.958037] [drm] features: -context_init1828lb # [ 1.952623] systemd[1]: Finished Create List of Static Device Nodes.1829worker2 # [ 1.958770] [drm] number of scanouts: 11830client # [ 2.048418] systemd[1]: Finished Load Kernel Modules.1831worker2 # [ 1.958789] [drm] number of cap sets: 01832lb # [ 1.954000] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1833client # [ 2.048745] systemd[1]: Started Journal Service.1834lb # [ 1.954353] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1835worker2 # [ 1.962536] systemd[1]: Starting Create Static Device Nodes in /dev...1836lb # [ 1.954648] systemd[1]: Mounted Kernel Configuration File System.1837client # [ 2.027990] systemd-modules-load[75]: Inserted module 'virtio_gpu'1838worker1 # [ 1.964839] systemd-journald[73]: Collecting audit messages is disabled.1839client # [ 2.036398] systemd-modules-load[75]: Module 'virtio_rng' is built in1840worker1 # [ 1.968549] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1841client # [ 2.044348] systemd[1]: Starting Apply Kernel Variables...1842lb # [ 1.964791] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1843worker2 # [ 1.982130] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1844worker1 # [ 1.985738] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1845worker2 # [ 1.982159] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01846worker1 # [ 1.986088] systemd[1]: Mounted Kernel Configuration File System.1847lb # [ 1.996859] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1848client # [ 2.073468] systemd[1]: Starting Create System Files and Directories...1849lb # [ 2.002013] systemd-journald[73]: Collecting audit messages is disabled.1850worker1 # [ 2.007418] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1851lb # [ 2.012479] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1852client # [ 2.089689] systemd-udevd[80]: Using default interface naming scheme 'v261'.1853worker1 # [ 2.024648] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1854lb # [ 2.024470] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01855lb # [ 2.024716] [drm] features: -virgl +edid -resource_blob -host_visible1856lb # [ 2.024726] [drm] features: -context_init1857lb # [ 2.025442] [drm] number of scanouts: 11858lb # [ 2.025461] [drm] number of cap sets: 01859worker1 # [ 2.032463] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01860worker2 # [ 2.034421] systemd[1]: Finished Create Static Device Nodes in /dev.1861worker1 # [ 2.032712] [drm] features: -virgl +edid -resource_blob -host_visible1862worker1 # [ 2.032724] [drm] features: -context_init1863worker1 # [ 2.033459] [drm] number of scanouts: 11864worker2 # [ 2.035562] systemd[1]: Reached target Preparation for Local File Systems.1865worker1 # [ 2.033479] [drm] number of cap sets: 01866worker2 # [ 2.036466] systemd[1]: Reached target Local File Systems.1867worker2 # [ 2.042683] Console: switching to colour frame buffer device 160x501868worker2 # [ 2.043422] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1869lb # [ 2.041461] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1870lb # [ 2.041493] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01871worker2 # [ 2.050111] systemd[1]: Starting Rule-based Manager for Device Events and Files...1872lb # [ 2.048530] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1873worker1 # [ 2.052992] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1874lb # [ 2.052795] systemd[1]: Starting Create Static Device Nodes in /dev...1875client # [ 2.127028] systemd[1]: Finished Create System Files and Directories.1876worker1 # [ 2.056688] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1877worker1 # [ 2.056717] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01878worker1 # [ 2.062500] systemd[1]: Starting Create Static Device Nodes in /dev...1879client # [ 2.134270] systemd[1]: Finished Apply Kernel Variables.1880worker2 # [ 2.065974] systemd[1]: Finished Load Kernel Modules.1881worker2 # [ 2.070057] systemd[1]: Starting Apply Kernel Variables...1882client # [ 2.146427] systemd[1]: Started Rule-based Manager for Device Events and Files.1883worker2 # [ 2.073726] systemd-modules-load[74]: Inserted module 'dm_mod'1884lb # [ 2.076773] Console: switching to colour frame buffer device 160x501885worker2 # [ 2.076293] systemd-modules-load[74]: Module 'virtio_balloon' is built in1886worker2 # [ 2.091274] systemd[1]: Started Journal Service.1887worker1 # [ 2.093005] Console: switching to colour frame buffer device 160x501888worker2 # [ 2.089514] systemd-modules-load[74]: Module 'virtio_console' is built in1889worker2 # [ 2.091787] systemd-modules-load[74]: Inserted module 'virtio_gpu'1890worker2 # [ 2.100574] systemd-modules-load[74]: Module 'virtio_rng' is built in1891worker2 # [ 2.101750] systemd[1]: Starting Create System Files and Directories...1892lb # [ 2.109042] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1893lb # [ 2.113087] systemd[1]: Finished Create Static Device Nodes in /dev.1894worker1 # [ 2.117335] systemd[1]: Finished Create Static Device Nodes in /dev.1895lb # [ 2.113326] systemd[1]: Reached target Preparation for Local File Systems.1896worker1 # [ 2.117560] systemd[1]: Reached target Preparation for Local File Systems.1897worker1 # [ 2.117585] systemd[1]: Reached target Local File Systems.1898lb # [ 2.113361] systemd[1]: Reached target Local File Systems.1899lb # [ 2.119440] systemd[1]: Starting Rule-based Manager for Device Events and Files...1900worker1 # [ 2.124759] systemd[1]: Starting Rule-based Manager for Device Events and Files...1901worker1 # [ 2.132954] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1902client # [ 2.205906] systemd[1]: Starting Virtual Console Setup...1903lb # [ 2.140583] systemd[1]: Finished Load Kernel Modules.1904worker1 # [ 2.147522] systemd[1]: Finished Load Kernel Modules.1905worker2 # [ 2.137729] systemd[1]: Finished Apply Kernel Variables.1906worker1 # [ 2.151444] systemd[1]: Starting Apply Kernel Variables...1907lb # [ 2.148788] systemd[1]: Starting Apply Kernel Variables...1908worker1 # [ 2.157187] systemd-modules-load[74]: Inserted module 'dm_mod'1909worker1 # [ 2.158337] systemd-modules-load[74]: Module 'virtio_balloon' is built in1910worker1 # [ 2.171687] systemd[1]: Started Journal Service.1911worker2 # [ 2.161504] systemd-udevd[79]: Using default interface naming scheme 'v261'.1912worker1 # [ 2.168378] systemd-modules-load[74]: Module 'virtio_console' is built in1913worker2 # [ 2.173979] systemd[1]: Finished Create System Files and Directories.1914worker1 # [ 2.176392] systemd-modules-load[74]: Inserted module 'virtio_gpu'1915worker1 # [ 2.180469] systemd-modules-load[74]: Module 'virtio_rng' is built in1916lb # [ 2.189485] systemd[1]: Finished Apply Kernel Variables.1917lb # [ 2.195041] systemd[1]: Started Journal Service.1918client # [ 2.272565] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1919worker1 # [ 2.192396] systemd[1]: Starting Create System Files and Directories...1920client # [ 2.276229] systemd[1]: Finished Virtual Console Setup.1921lb # [ 2.192395] systemd-modules-load[74]: Inserted module 'dm_mod'1922worker2 # [ 2.198320] systemd[1]: Started Rule-based Manager for Device Events and Files.1923lb # [ 2.196502] systemd-modules-load[74]: Module 'virtio_balloon' is built in1924lb # [ 2.197627] systemd-modules-load[74]: Module 'virtio_console' is built in1925lb # [ 2.198707] systemd-modules-load[74]: Inserted module 'virtio_gpu'1926lb # [ 2.199688] systemd-modules-load[74]: Module 'virtio_rng' is built in1927worker1 # [ 2.216312] systemd[1]: Finished Apply Kernel Variables.1928lb # [ 2.213415] systemd[1]: Starting Create System Files and Directories...1929worker1 # [ 2.233692] systemd-udevd[80]: Using default interface naming scheme 'v261'.1930lb # [ 2.249397] systemd-udevd[79]: Using default interface naming scheme 'v261'.1931worker1 # [ 2.254162] systemd[1]: Finished Create System Files and Directories.1932lb # [ 2.252817] systemd[1]: Finished Create System Files and Directories.1933worker2 # [ 2.260288] systemd[1]: Starting Virtual Console Setup...1934worker1 # [ 2.279029] systemd[1]: Started Rule-based Manager for Device Events and Files.1935lb # [ 2.282996] systemd[1]: Started Rule-based Manager for Device Events and Files.1936worker2 # [ 2.316592] systemd-vconsole-setup[104]: Configuration of first virtual console was skipped, ignoring remaining ones.1937worker2 # [ 2.320449] systemd[1]: Finished Virtual Console Setup.1938worker1 # [ 2.340506] systemd[1]: Starting Virtual Console Setup...1939lb # [ 2.356460] systemd[1]: Starting Virtual Console Setup...1940worker1 # [ 2.396633] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1941worker1 # [ 2.400414] systemd[1]: Finished Virtual Console Setup.1942lb # [ 2.408562] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones.1943lb # [ 2.412305] systemd[1]: Finished Virtual Console Setup.1944client # [ 2.889174] systemd[1]: Finished Coldplug All udev Devices.1945client # [ 2.890808] systemd[1]: Reached target System Initialization.1946client # [ 2.891677] systemd[1]: Reached target Basic System.1947worker2 # [ 2.922429] systemd[1]: Finished Coldplug All udev Devices.1948worker2 # [ 2.923464] systemd[1]: Reached target System Initialization.1949worker2 # [ 2.924373] systemd[1]: Reached target Basic System.1950client # [ 3.051584] (udev-worker)[101]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1951client # [ 3.075992] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line.1952client # [ 3.086076] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line.1953lb # [ 3.013831] systemd[1]: Finished Coldplug All udev Devices.1954lb # [ 3.016149] systemd[1]: Reached target System Initialization.1955lb # [ 3.020150] systemd[1]: Reached target Basic System.1956worker1 # [ 3.045717] systemd[1]: Finished Coldplug All udev Devices.1957worker1 # [ 3.046692] systemd[1]: Reached target System Initialization.1958worker1 # [ 3.052155] systemd[1]: Reached target Basic System.1959client # [ 3.161530] systemd[1]: Found device /dev/disk/by-label/nixos.1960client # [ 3.172711] systemd[1]: Reached target Initrd Root Device.1961client # [ 3.177453] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1962worker2 # [ 3.115062] (udev-worker)[99]: Network interface NamePolicy= disabled on kernel command line.1963worker2 # [ 3.129673] (udev-worker)[94]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1964worker2 # [ 3.136217] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line.1965client # [ 3.224598] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1966lb # [ 3.144332] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line.1967client # [ 3.232209] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1968client # [ 3.235046] systemd[1]: Mounting /sysroot...1969client # [ 3.293062] EXT4-fs (vda): mounted filesystem 55b2542f-395a-4250-9c92-b1dcc4df926b r/w with ordered data mode. Quota mode: none.1970client # [ 3.279181] systemd[1]: Mounted /sysroot.1971worker2 # [ 3.196221] systemd[1]: Found device /dev/disk/by-label/nixos.1972client # [ 3.282402] systemd[1]: Reached target Initrd Root File System.1973worker2 # [ 3.201123] systemd[1]: Reached target Initrd Root Device.1974client # [ 3.286895] systemd[1]: Starting Mountpoints Configured in the Real Root...1975lb # [ 3.203821] (udev-worker)[97]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1976worker2 # [ 3.210544] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1977lb # [ 3.208927] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line.1978worker1 # [ 3.218800] (udev-worker)[106]: Network interface NamePolicy= disabled on kernel command line.1979worker1 # [ 3.234784] (udev-worker)[102]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1980client # [ 3.319271] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload.1981client # [ 3.324878] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)...1982worker1 # [ 3.243268] (udev-worker)[102]: Network interface NamePolicy= disabled on kernel command line.1983client # [ 3.328624] systemd[1]: Reloading...1984worker2 # [ 3.261912] systemd-fsck[113]: nixos: clean, 12/65536 files, 13019/262144 blocks1985worker2 # [ 3.270693] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1986worker2 # [ 3.279692] systemd[1]: Mounting /sysroot...1987lb # [ 3.282093] systemd[1]: Found device /dev/disk/by-label/nixos.1988lb # [ 3.294275] systemd[1]: Reached target Initrd Root Device.1989lb # [ 3.301952] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1990worker1 # [ 3.308140] systemd[1]: Found device /dev/disk/by-label/nixos.1991worker2 # [ 3.325024] EXT4-fs (vda): mounted filesystem bd9f1d5c-789c-4629-9bf8-f6be8ed27bf7 r/w with ordered data mode. Quota mode: none.1992worker2 # [ 3.319065] systemd[1]: Mounted /sysroot.1993worker1 # [ 3.321080] systemd[1]: Reached target Initrd Root Device.1994worker2 # [ 3.321226] systemd[1]: Reached target Initrd Root File System.1995worker2 # [ 3.326479] systemd[1]: Starting Mountpoints Configured in the Real Root...1996worker1 # [ 3.328090] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1997lb # [ 3.351090] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks1998worker2 # [ 3.356443] systemd-sysroot-fstab-check[121]: /sysroot should be mounted in the initrd, will request daemon-reload.1999lb # [ 3.357329] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.2000worker2 # [ 3.363621] systemd[1]: Reload requested from client PID 121 ('systemd-sysroot') (unit initrd-parse-etc.service)...
loading 1,419 hidden lines…
3420lb # [ 19.747155] postgresql-pre-start[711]: Success. You can now start the database server using:3421lb # [ 19.748546] postgresql-pre-start[711]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3422worker2 # [ 19.788431] systemd[1]: Started DHCP Client.3423worker2 # [ 19.791033] systemd[1]: Reached target Multi-User System.3424worker2 # [ 19.791956] systemd[1]: Startup finished in 1.026s (kernel) + 5.485s (initrd) + 13.278s (userspace) = 19.790s.3425lb # [ 19.910454] postgres[819]: [819] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit3426lb # [ 19.915762] postgres[819]: [819] LOG: listening on IPv6 address "::1", port 54323427lb # [ 19.917297] postgres[819]: [819] LOG: listening on IPv4 address "127.0.0.1", port 54323428lb # [ 19.919184] postgres[819]: [819] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3429lb # [ 19.936571] postgres[828]: [828] LOG: database system was shut down at 2026-09-20 08:16:45 GMT3430lb # [ 19.943972] postgres[819]: [819] LOG: database system is ready to accept connections3431lb # [ 19.950712] systemd[1]: Started PostgreSQL Server.3432lb # [ 19.963284] systemd[1]: Starting PostgreSQL Setup Scripts...3433worker1 # [ 20.053918] dhcpcd[646]: eth0: leased 10.0.2.15 for 86400 seconds3434worker1 # [ 20.057116] dhcpcd[646]: eth0: adding route to 10.0.2.0/243435worker1 # [ 20.058734] dhcpcd[646]: eth0: adding default route via 10.0.2.23436worker1 # [ 20.190955] systemd[1]: Started DHCP Client.3437worker1 # [ 20.193645] systemd[1]: Reached target Multi-User System.3438worker1 # [ 20.194688] systemd[1]: Startup finished in 1.047s (kernel) + 5.581s (initrd) + 13.564s (userspace) = 20.193s.3439lb # [ 20.215930] postgresql-setup-start[839]: CREATE DATABASE3440lb # [ 20.279898] postgresql-setup-start[844]: CREATE ROLE3441lb # [ 20.310281] postgresql-setup-start[846]: ALTER DATABASE3442lb # [ 20.319155] systemd[1]: Finished PostgreSQL Setup Scripts.3443lb # [ 20.321284] systemd[1]: Reached target PostgreSQL.3444client # [ 20.621675] dhcpcd[553]: eth0: leased 10.0.2.15 for 86400 seconds3445client # [ 20.626242] dhcpcd[553]: eth0: adding route to 10.0.2.0/243446client # [ 20.626462] dhcpcd[553]: eth0: adding default route via 10.0.2.23447client # [ 20.789602] systemd[1]: Started DHCP Client.3448client # [ 20.793622] systemd[1]: Reached target Multi-User System.3449client # [ 20.794492] systemd[1]: Startup finished in 1.025s (kernel) + 5.486s (initrd) + 14.281s (userspace) = 20.793s.3450lb # [ 21.132997] dhcpcd[667]: eth0: leased 10.0.2.15 for 86400 seconds3451lb # [ 21.138531] dhcpcd[667]: eth0: adding route to 10.0.2.0/243452lb # [ 21.138758] dhcpcd[667]: eth0: adding default route via 10.0.2.23453lb # [ 21.315662] systemd[1]: Started DHCP Client.3454lb # [ 21.321951] systemd[1]: Reached target Network is Online.3455lb # [ 21.324953] systemd[1]: Started Envoy reverse proxy.3456lb # [ 21.330178] systemd[1]: Started mock-oidc.service.3457lb # [ 21.441659] mock-oidc-server[915]: Mock OIDC Server running3458lb # [ 21.442771] mock-oidc-server[915]: OIDC Address: 192.168.1.2:80803459lb # [ 21.444332] mock-oidc-server[915]: Issue Address: 0.0.0.0:80813460lb # [ 21.446621] mock-oidc-server[915]: Issuer: http://192.168.1.2:8080/oidc3461lb # [ 21.448109] mock-oidc-server[915]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3462lb # [ 21.449540] mock-oidc-server[915]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3463lb # [ 21.451196] mock-oidc-server[915]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3464lb # [ 22.105399] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120)3465lb # [ 22.105568] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:469] statically linked extensions:3466lb # [ 22.105627] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3467lb # [ 22.105741] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3468lb # [ 22.155267] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector3469lb # [ 22.163044] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13470lb # [ 22.165540] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3471lb # [ 22.167862] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3472lb # [ 22.170614] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple3473lb # [ 22.173103] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift3474lb # [ 22.177009] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3475lb # [ 22.179517] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3476lb # [ 22.182159] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3477lb # [ 22.186386] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind3478lb # [ 22.188404] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3479lb # [ 22.191887] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3480lb # [ 22.194385] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy3481lb # [ 22.197274] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid3482lb # [ 22.199083] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83483lb # [ 22.201204] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3484lb # [ 22.204680] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3485lb # [ 22.206618] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo3486lb # [ 22.208446] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3487lb # [ 22.212100] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3488lb # [ 22.214079] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3489lb # [ 22.218603] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter3490lb # [ 22.220852] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3491lb # [ 22.223428] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3492lb # [ 22.225857] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator3493lb # [ 22.232275] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3494lb # [ 22.237038] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3495lb # [ 22.240949] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3496lb # [ 22.243528] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based3497lb # [ 22.248280] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case3498lb # [ 22.251483] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3499lb # [ 22.257028] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3500lb # [ 22.262204] envoy[914]: [2026-09-20 08:16:47.649][914][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3501lb # [ 22.265430] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3502lb # [ 22.268734] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3503lb # [ 22.276143] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3504lb # [ 22.278426] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3505lb # [ 22.280377] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3506lb # [ 22.287898] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3507lb # [ 22.289937] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3508lb # [ 22.291816] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3509lb # [ 22.295129] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3510lb # [ 22.298552] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth23511lb # [ 22.301176] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3512lb # [ 22.303864] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction3513lb # [ 22.308900] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23514lb # [ 22.310724] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3515lb # [ 22.321374] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3516lb # [ 22.323354] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3517lb # [ 22.327230] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3518lb # [ 22.330664] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3519lb # [ 22.333449] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats3520lb # [ 22.336391] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic3521lb # [ 22.338336] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3522lb # [ 22.340129] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3523lb # [ 22.342339] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3524lb # [ 22.345595] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override3525lb # [ 22.348654] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert3526lb # [ 22.350573] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3527lb # [ 22.352959] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3528lb # [ 22.355978] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable3529lb # [ 22.358296] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3530lb # [ 22.360340] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3531lb # [ 22.362502] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23532lb # [ 22.364582] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3533lb # [ 22.368410] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3534lb # [ 22.370392] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3535lb # [ 22.378555] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3536lb # [ 22.386120] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3537lb # [ 22.389298] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection3538lb # [ 22.394760] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua3539lb # [ 22.396611] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3540lb # [ 22.399095] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso3541lb # [ 22.401465] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3542lb # [ 22.403545] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3543lb # [ 22.406069] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params3544lb # [ 22.417880] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor3545lb # [ 22.420893] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3546lb # [ 22.425730] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3547lb # [ 22.432087] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3548lb # [ 22.435337] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3549lb # [ 22.438396] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3550lb # [ 22.441239] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3551lb # [ 22.442965] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3552lb # [ 22.450337] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3553lb # [ 22.452447] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3554lb # [ 22.457598] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3555lb # [ 22.469450] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3556lb # [ 22.472292] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy3557lb # [ 22.475238] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy3558lb # [ 22.489655] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3559lb # [ 22.491658] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection3560lb # [ 22.493797] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default3561lb # [ 22.495724] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3562lb # [ 22.498407] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default3563lb # [ 22.500345] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3564lb # [ 22.502417] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default3565lb # [ 22.505082] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default3566lb # [ 22.506990] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default3567lb # [ 22.509227] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3568lb # [ 22.511613] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3569lb # [ 22.517386] envoy[914]: [2026-09-20 08:16:47.650][914][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3570lb # [ 22.519258] envoy[914]: [2026-09-20 08:16:47.700][914][info][main] [source/server/server.cc:531] HTTP header map info:3571lb # [ 22.520980] envoy[914]: [2026-09-20 08:16:47.715][914][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id3572lb # [ 22.537647] envoy[914]: [2026-09-20 08:16:47.715][914][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:3573lb # [ 22.539342] envoy[914]: [2026-09-20 08:16:47.715][914][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id3574lb # [ 22.549530] envoy[914]: [2026-09-20 08:16:47.715][914][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status3575lb # [ 22.551520] envoy[914]: [2026-09-20 08:16:47.977][914][info][main] [source/server/server.cc:968] runtime: {}3576lb # [ 22.553698] envoy[914]: [2026-09-20 08:16:48.014][914][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.3577lb # [ 22.555607] envoy[914]: [2026-09-20 08:16:48.014][914][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99013578lb # [ 22.557636] envoy[914]: [2026-09-20 08:16:48.014][914][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99013579lb # [ 22.559381] envoy[914]: [2026-09-20 08:16:48.035][914][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration3580lb # [ 22.561763] envoy[914]: [2026-09-20 08:16:48.035][914][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)3581lb # [ 22.563504] envoy[914]: [2026-09-20 08:16:48.035][914][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)3582lb # [ 22.592960] envoy[914]: [2026-09-20 08:16:48.137][914][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)3583worker1 # [ 22.602907] systemd[1]: Starting Nix worker-protocol over gRPC...3584lb # [ 22.602945] envoy[914]: [2026-09-20 08:16:48.148][914][info][config] [source/server/configuration_impl.cc:164] loading stats configuration3585lb # [ 22.605907] envoy[914]: [2026-09-20 08:16:48.151][914][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.3586lb # [ 22.609512] envoy[914]: [2026-09-20 08:16:48.151][914][info][main] [source/server/server.cc:1077] starting main dispatch loop3587worker2 # [ 22.615352] systemd[1]: Starting Nix worker-protocol over gRPC...3588worker1 # [ 22.894587] nix-grpc-daemon[773]: ts=2026-09-20T08:16:48Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3589worker2 # [ 22.903856] nix-grpc-daemon[776]: ts=2026-09-20T08:16:48Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3590worker1 # [ 22.907916] nix-grpc-daemon[773]: ts=2026-09-20T08:16:48Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=13591worker2 # [ 22.917623] nix-grpc-daemon[776]: ts=2026-09-20T08:16:48Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=13592worker1 # [ 22.957930] nix-grpc-daemon[773]: ts=2026-09-20T08:16:48Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3593worker1 # [ 22.959860] systemd[1]: Started Nix worker-protocol over gRPC.3594worker2 # [ 22.965722] nix-grpc-daemon[776]: ts=2026-09-20T08:16:48Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3595worker2 # [ 22.974353] systemd[1]: Started Nix worker-protocol over gRPC.3596lb # [ 23.002196] envoy[914]: [2026-09-20 08:16:48.547][914][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization3597lb # [ 23.005525] envoy[914]: [2026-09-20 08:16:48.547][914][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized3598lb # [ 23.007962] envoy[914]: [2026-09-20 08:16:48.547][914][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager3599lb # [ 23.010887] envoy[914]: [2026-09-20 08:16:48.547][914][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers3600worker1 # [ 23.031788] nix-grpc-daemon[773]: ts=2026-09-20T08:16:48Z level=info event=scheduler_connected addr=lb:500513601worker2 # [ 23.040591] nix-grpc-daemon[776]: ts=2026-09-20T08:16:48Z level=info event=scheduler_connected addr=lb:500513602worker1 # [ 23.044608] nix-grpc-daemon[773]: ts=2026-09-20T08:16:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3603worker2 # [ 23.054367] nix-grpc-daemon[776]: ts=2026-09-20T08:16:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3604worker1 # [ 23.246597] nix-grpc-daemon[773]: ts=2026-09-20T08:16:48Z level=info event=scheduler_connected addr=lb:500513605worker1 # [ 23.252488] nix-grpc-daemon[773]: ts=2026-09-20T08:16:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3606worker2 # [ 23.255846] nix-grpc-daemon[776]: ts=2026-09-20T08:16:48Z level=info event=scheduler_connected addr=lb:500513607worker2 # [ 23.261762] nix-grpc-daemon[776]: ts=2026-09-20T08:16:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3608worker1 # [ 23.453571] nix-grpc-daemon[773]: ts=2026-09-20T08:16:48Z level=info event=scheduler_connected addr=lb:500513609worker1 # [ 23.459530] nix-grpc-daemon[773]: ts=2026-09-20T08:16:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3610worker2 # [ 23.462513] nix-grpc-daemon[776]: ts=2026-09-20T08:16:49Z level=info event=scheduler_connected addr=lb:500513611worker2 # [ 23.468386] nix-grpc-daemon[776]: ts=2026-09-20T08:16:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3612worker1 # [ 23.660785] nix-grpc-daemon[773]: ts=2026-09-20T08:16:49Z level=info event=scheduler_connected addr=lb:500513613worker2 # [ 23.668646] nix-grpc-daemon[776]: ts=2026-09-20T08:16:49Z level=info event=scheduler_connected addr=lb:500513614worker1 # [ 23.666482] nix-grpc-daemon[773]: ts=2026-09-20T08:16:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3615worker2 # [ 23.673420] nix-grpc-daemon[776]: ts=2026-09-20T08:16:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3616worker1 # [ 23.866963] nix-grpc-daemon[773]: ts=2026-09-20T08:16:49Z level=info event=scheduler_connected addr=lb:500513617worker1 # [ 23.871013] nix-grpc-daemon[773]: ts=2026-09-20T08:16:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3618worker2 # [ 23.874508] nix-grpc-daemon[776]: ts=2026-09-20T08:16:49Z level=info event=scheduler_connected addr=lb:500513619worker2 # [ 23.880269] nix-grpc-daemon[776]: ts=2026-09-20T08:16:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3620worker1 # [ 24.073988] nix-grpc-daemon[773]: ts=2026-09-20T08:16:49Z level=info event=scheduler_connected addr=lb:500513621worker2 # [ 24.081989] nix-grpc-daemon[776]: ts=2026-09-20T08:16:49Z level=info event=scheduler_connected addr=lb:500513622worker1 # [ 24.080190] nix-grpc-daemon[773]: ts=2026-09-20T08:16:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3623worker2 # [ 24.087733] nix-grpc-daemon[776]: ts=2026-09-20T08:16:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3624worker1 # [ 24.281272] nix-grpc-daemon[773]: ts=2026-09-20T08:16:49Z level=info event=scheduler_connected addr=lb:500513625worker1 # [ 24.287260] nix-grpc-daemon[773]: ts=2026-09-20T08:16:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3626worker2 # [ 24.288880] nix-grpc-daemon[776]: ts=2026-09-20T08:16:49Z level=info event=scheduler_connected addr=lb:500513627worker2 # [ 24.295277] nix-grpc-daemon[776]: ts=2026-09-20T08:16:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3628worker1 # [ 24.488793] nix-grpc-daemon[773]: ts=2026-09-20T08:16:50Z level=info event=scheduler_connected addr=lb:500513629worker1 # [ 24.494833] nix-grpc-daemon[773]: ts=2026-09-20T08:16:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3630worker2 # [ 24.496366] nix-grpc-daemon[776]: ts=2026-09-20T08:16:50Z level=info event=scheduler_connected addr=lb:500513631worker2 # [ 24.502934] nix-grpc-daemon[776]: ts=2026-09-20T08:16:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3632worker1 # [ 24.695899] nix-grpc-daemon[773]: ts=2026-09-20T08:16:50Z level=info event=scheduler_connected addr=lb:500513633worker1 # [ 24.701721] nix-grpc-daemon[773]: ts=2026-09-20T08:16:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3634worker2 # [ 24.703969] nix-grpc-daemon[776]: ts=2026-09-20T08:16:50Z level=info event=scheduler_connected addr=lb:500513635worker2 # [ 24.709652] nix-grpc-daemon[776]: ts=2026-09-20T08:16:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3636worker1 # [ 24.902999] nix-grpc-daemon[773]: ts=2026-09-20T08:16:50Z level=info event=scheduler_connected addr=lb:500513637worker1 # [ 24.908848] nix-grpc-daemon[773]: ts=2026-09-20T08:16:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3638worker2 # [ 24.910650] nix-grpc-daemon[776]: ts=2026-09-20T08:16:50Z level=info event=scheduler_connected addr=lb:500513639worker2 # [ 24.917530] nix-grpc-daemon[776]: ts=2026-09-20T08:16:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3640worker1 # [ 25.111042] nix-grpc-daemon[773]: ts=2026-09-20T08:16:50Z level=info event=scheduler_connected addr=lb:500513641worker1 # [ 25.116687] nix-grpc-daemon[773]: ts=2026-09-20T08:16:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3642worker2 # [ 25.120535] nix-grpc-daemon[776]: ts=2026-09-20T08:16:50Z level=info event=scheduler_connected addr=lb:500513643worker2 # [ 25.126053] nix-grpc-daemon[776]: ts=2026-09-20T08:16:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3644worker1 # [ 25.317793] nix-grpc-daemon[773]: ts=2026-09-20T08:16:50Z level=info event=scheduler_connected addr=lb:500513645worker1 # [ 25.323410] nix-grpc-daemon[773]: ts=2026-09-20T08:16:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3646worker2 # [ 25.326540] nix-grpc-daemon[776]: ts=2026-09-20T08:16:50Z level=info event=scheduler_connected addr=lb:500513647worker2 # [ 25.332228] nix-grpc-daemon[776]: ts=2026-09-20T08:16:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3648worker1 # [ 25.524540] nix-grpc-daemon[773]: ts=2026-09-20T08:16:51Z level=info event=scheduler_connected addr=lb:500513649worker1 # [ 25.529160] nix-grpc-daemon[773]: ts=2026-09-20T08:16:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3650worker2 # [ 25.533285] nix-grpc-daemon[776]: ts=2026-09-20T08:16:51Z level=info event=scheduler_connected addr=lb:500513651worker2 # [ 25.539073] nix-grpc-daemon[776]: ts=2026-09-20T08:16:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3652worker1 # [ 25.729905] nix-grpc-daemon[773]: ts=2026-09-20T08:16:51Z level=info event=scheduler_connected addr=lb:500513653worker1 # [ 25.735746] nix-grpc-daemon[773]: ts=2026-09-20T08:16:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3654worker2 # [ 25.740109] nix-grpc-daemon[776]: ts=2026-09-20T08:16:51Z level=info event=scheduler_connected addr=lb:500513655worker2 # [ 25.746643] nix-grpc-daemon[776]: ts=2026-09-20T08:16:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3656worker1 # [ 25.937224] nix-grpc-daemon[773]: ts=2026-09-20T08:16:51Z level=info event=scheduler_connected addr=lb:500513657worker1 # [ 25.943039] nix-grpc-daemon[773]: ts=2026-09-20T08:16:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3658worker2 # [ 25.947576] nix-grpc-daemon[776]: ts=2026-09-20T08:16:51Z level=info event=scheduler_connected addr=lb:500513659worker2 # [ 25.953813] nix-grpc-daemon[776]: ts=2026-09-20T08:16:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3660worker1 # [ 26.145807] nix-grpc-daemon[773]: ts=2026-09-20T08:16:51Z level=info event=scheduler_connected addr=lb:500513661worker1 # [ 26.151519] nix-grpc-daemon[773]: ts=2026-09-20T08:16:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3662worker2 # [ 26.155466] nix-grpc-daemon[776]: ts=2026-09-20T08:16:51Z level=info event=scheduler_connected addr=lb:500513663worker2 # [ 26.161211] nix-grpc-daemon[776]: ts=2026-09-20T08:16:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3664worker1 # [ 26.352535] nix-grpc-daemon[773]: ts=2026-09-20T08:16:51Z level=info event=scheduler_connected addr=lb:500513665worker1 # [ 26.358412] nix-grpc-daemon[773]: ts=2026-09-20T08:16:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3666worker2 # [ 26.361855] nix-grpc-daemon[776]: ts=2026-09-20T08:16:51Z level=info event=scheduler_connected addr=lb:500513667worker2 # [ 26.367580] nix-grpc-daemon[776]: ts=2026-09-20T08:16:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3668worker1 # [ 26.559612] nix-grpc-daemon[773]: ts=2026-09-20T08:16:52Z level=info event=scheduler_connected addr=lb:500513669worker1 # [ 26.565445] nix-grpc-daemon[773]: ts=2026-09-20T08:16:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3670worker2 # [ 26.568989] nix-grpc-daemon[776]: ts=2026-09-20T08:16:52Z level=info event=scheduler_connected addr=lb:500513671worker2 # [ 26.574563] nix-grpc-daemon[776]: ts=2026-09-20T08:16:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3672worker1 # [ 26.766148] nix-grpc-daemon[773]: ts=2026-09-20T08:16:52Z level=info event=scheduler_connected addr=lb:500513673worker1 # [ 26.771812] nix-grpc-daemon[773]: ts=2026-09-20T08:16:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3674worker2 # [ 26.775197] nix-grpc-daemon[776]: ts=2026-09-20T08:16:52Z level=info event=scheduler_connected addr=lb:500513675worker2 # [ 26.780877] nix-grpc-daemon[776]: ts=2026-09-20T08:16:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3676worker1 # [ 26.972816] nix-grpc-daemon[773]: ts=2026-09-20T08:16:52Z level=info event=scheduler_connected addr=lb:500513677worker1 # [ 26.978470] nix-grpc-daemon[773]: ts=2026-09-20T08:16:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3678worker2 # [ 26.981498] nix-grpc-daemon[776]: ts=2026-09-20T08:16:52Z level=info event=scheduler_connected addr=lb:500513679worker2 # [ 26.986224] nix-grpc-daemon[776]: ts=2026-09-20T08:16:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3680worker1 # [ 27.181383] nix-grpc-daemon[773]: ts=2026-09-20T08:16:52Z level=info event=scheduler_connected addr=lb:500513681worker1 # [ 27.186677] nix-grpc-daemon[773]: ts=2026-09-20T08:16:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3682worker2 # [ 27.188649] nix-grpc-daemon[776]: ts=2026-09-20T08:16:52Z level=info event=scheduler_connected addr=lb:500513683worker2 # [ 27.194140] nix-grpc-daemon[776]: ts=2026-09-20T08:16:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3684worker1 # [ 27.387474] nix-grpc-daemon[773]: ts=2026-09-20T08:16:52Z level=info event=scheduler_connected addr=lb:500513685worker2 # [ 27.395134] nix-grpc-daemon[776]: ts=2026-09-20T08:16:52Z level=info event=scheduler_connected addr=lb:500513686worker1 # [ 27.394318] nix-grpc-daemon[773]: ts=2026-09-20T08:16:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3687worker2 # [ 27.401695] nix-grpc-daemon[776]: ts=2026-09-20T08:16:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3688worker1 # [ 27.595507] nix-grpc-daemon[773]: ts=2026-09-20T08:16:53Z level=info event=scheduler_connected addr=lb:500513689worker2 # [ 27.602783] nix-grpc-daemon[776]: ts=2026-09-20T08:16:53Z level=info event=scheduler_connected addr=lb:500513690worker1 # [ 27.602156] nix-grpc-daemon[773]: ts=2026-09-20T08:16:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3691worker2 # [ 27.609561] nix-grpc-daemon[776]: ts=2026-09-20T08:16:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3692worker1 # [ 27.802669] nix-grpc-daemon[773]: ts=2026-09-20T08:16:53Z level=info event=scheduler_connected addr=lb:500513693worker1 # [ 27.808857] nix-grpc-daemon[773]: ts=2026-09-20T08:16:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3694worker2 # [ 27.810841] nix-grpc-daemon[776]: ts=2026-09-20T08:16:53Z level=info event=scheduler_connected addr=lb:500513695worker2 # [ 27.816299] nix-grpc-daemon[776]: ts=2026-09-20T08:16:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3696worker1 # [ 28.009838] nix-grpc-daemon[773]: ts=2026-09-20T08:16:53Z level=info event=scheduler_connected addr=lb:500513697worker2 # [ 28.017394] nix-grpc-daemon[776]: ts=2026-09-20T08:16:53Z level=info event=scheduler_connected addr=lb:500513698worker1 # [ 28.017483] nix-grpc-daemon[773]: ts=2026-09-20T08:16:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3699worker2 # [ 28.025182] nix-grpc-daemon[776]: ts=2026-09-20T08:16:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3700worker1 # [ 28.219924] nix-grpc-daemon[773]: ts=2026-09-20T08:16:53Z level=info event=scheduler_connected addr=lb:500513701worker2 # [ 28.227556] nix-grpc-daemon[776]: ts=2026-09-20T08:16:53Z level=info event=scheduler_connected addr=lb:500513702worker1 # [ 28.225615] nix-grpc-daemon[773]: ts=2026-09-20T08:16:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3703worker2 # [ 28.233533] nix-grpc-daemon[776]: ts=2026-09-20T08:16:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3704worker1 # [ 28.427050] nix-grpc-daemon[773]: ts=2026-09-20T08:16:53Z level=info event=scheduler_connected addr=lb:500513705worker1 # [ 28.433728] nix-grpc-daemon[773]: ts=2026-09-20T08:16:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3706worker2 # [ 28.434995] nix-grpc-daemon[776]: ts=2026-09-20T08:16:53Z level=info event=scheduler_connected addr=lb:500513707worker2 # [ 28.442046] nix-grpc-daemon[776]: ts=2026-09-20T08:16:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3708worker1 # [ 28.634838] nix-grpc-daemon[773]: ts=2026-09-20T08:16:54Z level=info event=scheduler_connected addr=lb:500513709worker1 # [ 28.641515] nix-grpc-daemon[773]: ts=2026-09-20T08:16:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3710worker2 # [ 28.643337] nix-grpc-daemon[776]: ts=2026-09-20T08:16:54Z level=info event=scheduler_connected addr=lb:500513711worker2 # [ 28.650086] nix-grpc-daemon[776]: ts=2026-09-20T08:16:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3712worker1 # [ 28.842455] nix-grpc-daemon[773]: ts=2026-09-20T08:16:54Z level=info event=scheduler_connected addr=lb:500513713worker1 # [ 28.848381] nix-grpc-daemon[773]: ts=2026-09-20T08:16:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3714worker2 # [ 28.850643] nix-grpc-daemon[776]: ts=2026-09-20T08:16:54Z level=info event=scheduler_connected addr=lb:500513715worker2 # [ 28.856254] nix-grpc-daemon[776]: ts=2026-09-20T08:16:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3716worker1 # [ 29.048941] nix-grpc-daemon[773]: ts=2026-09-20T08:16:54Z level=info event=scheduler_connected addr=lb:500513717worker1 # [ 29.051908] nix-grpc-daemon[773]: ts=2026-09-20T08:16:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3718worker2 # [ 29.057623] nix-grpc-daemon[776]: ts=2026-09-20T08:16:54Z level=info event=scheduler_connected addr=lb:500513719worker2 # [ 29.063080] nix-grpc-daemon[776]: ts=2026-09-20T08:16:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3720worker1 # [ 29.254742] nix-grpc-daemon[773]: ts=2026-09-20T08:16:54Z level=info event=scheduler_connected addr=lb:500513721worker1 # [ 29.260713] nix-grpc-daemon[773]: ts=2026-09-20T08:16:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3722worker2 # [ 29.265349] nix-grpc-daemon[776]: ts=2026-09-20T08:16:54Z level=info event=scheduler_connected addr=lb:500513723worker2 # [ 29.271025] nix-grpc-daemon[776]: ts=2026-09-20T08:16:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3724worker1 # [ 29.461869] nix-grpc-daemon[773]: ts=2026-09-20T08:16:54Z level=info event=scheduler_connected addr=lb:500513725worker1 # [ 29.467705] nix-grpc-daemon[773]: ts=2026-09-20T08:16:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3726worker2 # [ 29.471952] nix-grpc-daemon[776]: ts=2026-09-20T08:16:55Z level=info event=scheduler_connected addr=lb:500513727worker2 # [ 29.479643] nix-grpc-daemon[776]: ts=2026-09-20T08:16:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3728worker1 # [ 29.669129] nix-grpc-daemon[773]: ts=2026-09-20T08:16:55Z level=info event=scheduler_connected addr=lb:500513729worker1 # [ 29.674958] nix-grpc-daemon[773]: ts=2026-09-20T08:16:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3730worker2 # [ 29.680977] nix-grpc-daemon[776]: ts=2026-09-20T08:16:55Z level=info event=scheduler_connected addr=lb:500513731worker2 # [ 29.687499] nix-grpc-daemon[776]: ts=2026-09-20T08:16:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3732worker1 # [ 29.876295] nix-grpc-daemon[773]: ts=2026-09-20T08:16:55Z level=info event=scheduler_connected addr=lb:500513733worker1 # [ 29.882532] nix-grpc-daemon[773]: ts=2026-09-20T08:16:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3734worker2 # [ 29.888459] nix-grpc-daemon[776]: ts=2026-09-20T08:16:55Z level=info event=scheduler_connected addr=lb:500513735worker2 # [ 29.894268] nix-grpc-daemon[776]: ts=2026-09-20T08:16:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3736worker1 # [ 30.083155] nix-grpc-daemon[773]: ts=2026-09-20T08:16:55Z level=info event=scheduler_connected addr=lb:500513737worker1 # [ 30.088900] nix-grpc-daemon[773]: ts=2026-09-20T08:16:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3738worker2 # [ 30.095026] nix-grpc-daemon[776]: ts=2026-09-20T08:16:55Z level=info event=scheduler_connected addr=lb:500513739worker2 # [ 30.101021] nix-grpc-daemon[776]: ts=2026-09-20T08:16:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3740worker1 # [ 30.291410] nix-grpc-daemon[773]: ts=2026-09-20T08:16:55Z level=info event=scheduler_connected addr=lb:500513741worker1 # [ 30.297108] nix-grpc-daemon[773]: ts=2026-09-20T08:16:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3742worker2 # [ 30.303109] nix-grpc-daemon[776]: ts=2026-09-20T08:16:55Z level=info event=scheduler_connected addr=lb:500513743worker2 # [ 30.308203] nix-grpc-daemon[776]: ts=2026-09-20T08:16:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3744worker1 # [ 30.497648] nix-grpc-daemon[773]: ts=2026-09-20T08:16:56Z level=info event=scheduler_connected addr=lb:500513745worker1 # [ 30.501743] nix-grpc-daemon[773]: ts=2026-09-20T08:16:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3746worker2 # [ 30.508957] nix-grpc-daemon[776]: ts=2026-09-20T08:16:56Z level=info event=scheduler_connected addr=lb:500513747worker2 # [ 30.514557] nix-grpc-daemon[776]: ts=2026-09-20T08:16:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3748worker1 # [ 30.703288] nix-grpc-daemon[773]: ts=2026-09-20T08:16:56Z level=info event=scheduler_connected addr=lb:500513749worker1 # [ 30.708759] nix-grpc-daemon[773]: ts=2026-09-20T08:16:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3750worker2 # [ 30.715259] nix-grpc-daemon[776]: ts=2026-09-20T08:16:56Z level=info event=scheduler_connected addr=lb:500513751worker2 # [ 30.721129] nix-grpc-daemon[776]: ts=2026-09-20T08:16:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3752worker1 # [ 30.909538] nix-grpc-daemon[773]: ts=2026-09-20T08:16:56Z level=info event=scheduler_connected addr=lb:500513753worker1 # [ 30.915602] nix-grpc-daemon[773]: ts=2026-09-20T08:16:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3754worker2 # [ 30.921839] nix-grpc-daemon[776]: ts=2026-09-20T08:16:56Z level=info event=scheduler_connected addr=lb:500513755worker2 # [ 30.927606] nix-grpc-daemon[776]: ts=2026-09-20T08:16:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3756worker1 # [ 31.116614] nix-grpc-daemon[773]: ts=2026-09-20T08:16:56Z level=info event=scheduler_connected addr=lb:500513757worker1 # [ 31.122407] nix-grpc-daemon[773]: ts=2026-09-20T08:16:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3758worker2 # [ 31.128366] nix-grpc-daemon[776]: ts=2026-09-20T08:16:56Z level=info event=scheduler_connected addr=lb:500513759worker2 # [ 31.134100] nix-grpc-daemon[776]: ts=2026-09-20T08:16:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3760worker1 # [ 31.324561] nix-grpc-daemon[773]: ts=2026-09-20T08:16:56Z level=info event=scheduler_connected addr=lb:500513761worker1 # [ 31.330030] nix-grpc-daemon[773]: ts=2026-09-20T08:16:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3762worker2 # [ 31.336173] nix-grpc-daemon[776]: ts=2026-09-20T08:16:56Z level=info event=scheduler_connected addr=lb:500513763worker2 # [ 31.341642] nix-grpc-daemon[776]: ts=2026-09-20T08:16:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3764worker1 # [ 31.531018] nix-grpc-daemon[773]: ts=2026-09-20T08:16:57Z level=info event=scheduler_connected addr=lb:500513765worker1 # [ 31.535265] nix-grpc-daemon[773]: ts=2026-09-20T08:16:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3766worker2 # [ 31.542464] nix-grpc-daemon[776]: ts=2026-09-20T08:16:57Z level=info event=scheduler_connected addr=lb:500513767worker2 # [ 31.548443] nix-grpc-daemon[776]: ts=2026-09-20T08:16:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3768worker1 # [ 31.736264] nix-grpc-daemon[773]: ts=2026-09-20T08:16:57Z level=info event=scheduler_connected addr=lb:500513769worker1 # [ 31.741836] nix-grpc-daemon[773]: ts=2026-09-20T08:16:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3770worker2 # [ 31.748873] nix-grpc-daemon[776]: ts=2026-09-20T08:16:57Z level=info event=scheduler_connected addr=lb:500513771worker2 # [ 31.755187] nix-grpc-daemon[776]: ts=2026-09-20T08:16:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3772worker1 # [ 31.943390] nix-grpc-daemon[773]: ts=2026-09-20T08:16:57Z level=info event=scheduler_connected addr=lb:500513773worker1 # [ 31.949227] nix-grpc-daemon[773]: ts=2026-09-20T08:16:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3774worker2 # [ 31.956196] nix-grpc-daemon[776]: ts=2026-09-20T08:16:57Z level=info event=scheduler_connected addr=lb:500513775worker2 # [ 31.961858] nix-grpc-daemon[776]: ts=2026-09-20T08:16:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3776worker1 # [ 32.150019] nix-grpc-daemon[773]: ts=2026-09-20T08:16:57Z level=info event=scheduler_connected addr=lb:500513777worker1 # [ 32.156144] nix-grpc-daemon[773]: ts=2026-09-20T08:16:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3778worker2 # [ 32.162635] nix-grpc-daemon[776]: ts=2026-09-20T08:16:57Z level=info event=scheduler_connected addr=lb:500513779worker2 # [ 32.168292] nix-grpc-daemon[776]: ts=2026-09-20T08:16:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3780worker1 # [ 32.358354] nix-grpc-daemon[773]: ts=2026-09-20T08:16:57Z level=info event=scheduler_connected addr=lb:500513781worker1 # [ 32.364093] nix-grpc-daemon[773]: ts=2026-09-20T08:16:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3782worker2 # [ 32.370403] nix-grpc-daemon[776]: ts=2026-09-20T08:16:57Z level=info event=scheduler_connected addr=lb:500513783worker2 # [ 32.375853] nix-grpc-daemon[776]: ts=2026-09-20T08:16:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3784worker1 # [ 32.564928] nix-grpc-daemon[773]: ts=2026-09-20T08:16:58Z level=info event=scheduler_connected addr=lb:500513785worker1 # [ 32.570888] nix-grpc-daemon[773]: ts=2026-09-20T08:16:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3786worker2 # [ 32.576603] nix-grpc-daemon[776]: ts=2026-09-20T08:16:58Z level=info event=scheduler_connected addr=lb:500513787worker2 # [ 32.582219] nix-grpc-daemon[776]: ts=2026-09-20T08:16:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3788worker1 # [ 32.771866] nix-grpc-daemon[773]: ts=2026-09-20T08:16:58Z level=info event=scheduler_connected addr=lb:500513789worker1 # [ 32.777592] nix-grpc-daemon[773]: ts=2026-09-20T08:16:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3790worker2 # [ 32.783049] nix-grpc-daemon[776]: ts=2026-09-20T08:16:58Z level=info event=scheduler_connected addr=lb:500513791worker2 # [ 32.788711] nix-grpc-daemon[776]: ts=2026-09-20T08:16:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3792worker1 # [ 32.978589] nix-grpc-daemon[773]: ts=2026-09-20T08:16:58Z level=info event=scheduler_connected addr=lb:500513793worker1 # [ 32.984551] nix-grpc-daemon[773]: ts=2026-09-20T08:16:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3794worker2 # [ 32.989493] nix-grpc-daemon[776]: ts=2026-09-20T08:16:58Z level=info event=scheduler_connected addr=lb:500513795worker2 # [ 32.995134] nix-grpc-daemon[776]: ts=2026-09-20T08:16:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3796worker1 # [ 33.185470] nix-grpc-daemon[773]: ts=2026-09-20T08:16:58Z level=info event=scheduler_connected addr=lb:500513797worker1 # [ 33.191340] nix-grpc-daemon[773]: ts=2026-09-20T08:16:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3798worker2 # [ 33.195848] nix-grpc-daemon[776]: ts=2026-09-20T08:16:58Z level=info event=scheduler_connected addr=lb:500513799worker2 # [ 33.201607] nix-grpc-daemon[776]: ts=2026-09-20T08:16:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3800worker1 # [ 33.393452] nix-grpc-daemon[773]: ts=2026-09-20T08:16:58Z level=info event=scheduler_connected addr=lb:500513801worker1 # [ 33.399022] nix-grpc-daemon[773]: ts=2026-09-20T08:16:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3802worker2 # [ 33.403304] nix-grpc-daemon[776]: ts=2026-09-20T08:16:58Z level=info event=scheduler_connected addr=lb:500513803worker2 # [ 33.408826] nix-grpc-daemon[776]: ts=2026-09-20T08:16:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3804worker1 # [ 33.600310] nix-grpc-daemon[773]: ts=2026-09-20T08:16:59Z level=info event=scheduler_connected addr=lb:500513805worker1 # [ 33.605898] nix-grpc-daemon[773]: ts=2026-09-20T08:16:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3806worker2 # [ 33.609674] nix-grpc-daemon[776]: ts=2026-09-20T08:16:59Z level=info event=scheduler_connected addr=lb:500513807worker2 # [ 33.613425] nix-grpc-daemon[776]: ts=2026-09-20T08:16:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3808worker1 # [ 33.808264] nix-grpc-daemon[773]: ts=2026-09-20T08:16:59Z level=info event=scheduler_connected addr=lb:500513809worker2 # [ 33.814339] nix-grpc-daemon[776]: ts=2026-09-20T08:16:59Z level=info event=scheduler_connected addr=lb:500513810worker1 # [ 33.818924] nix-grpc-daemon[773]: ts=2026-09-20T08:16:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3811worker2 # [ 33.819974] nix-grpc-daemon[776]: ts=2026-09-20T08:16:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3812worker1 # [ 34.018888] nix-grpc-daemon[773]: ts=2026-09-20T08:16:59Z level=info event=scheduler_connected addr=lb:500513813worker2 # [ 34.020535] nix-grpc-daemon[776]: ts=2026-09-20T08:16:59Z level=info event=scheduler_connected addr=lb:500513814worker1 # [ 34.026468] nix-grpc-daemon[773]: ts=2026-09-20T08:16:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3815worker2 # [ 34.026756] nix-grpc-daemon[776]: ts=2026-09-20T08:16:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3816worker1 # [ 34.227338] nix-grpc-daemon[773]: ts=2026-09-20T08:16:59Z level=info event=scheduler_connected addr=lb:500513817worker2 # [ 34.228332] nix-grpc-daemon[776]: ts=2026-09-20T08:16:59Z level=info event=scheduler_connected addr=lb:500513818worker1 # [ 34.236180] nix-grpc-daemon[773]: ts=2026-09-20T08:16:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3819worker2 # [ 34.234527] nix-grpc-daemon[776]: ts=2026-09-20T08:16:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3820worker2 # [ 34.436658] nix-grpc-daemon[776]: ts=2026-09-20T08:16:59Z level=info event=scheduler_connected addr=lb:500513821worker1 # [ 34.446935] nix-grpc-daemon[773]: ts=2026-09-20T08:16:59Z level=info event=scheduler_connected addr=lb:500513822worker2 # [ 34.443818] nix-grpc-daemon[776]: ts=2026-09-20T08:16:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3823worker1 # [ 34.451804] nix-grpc-daemon[773]: ts=2026-09-20T08:16:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3824worker2 # [ 34.645264] nix-grpc-daemon[776]: ts=2026-09-20T08:17:00Z level=info event=scheduler_connected addr=lb:500513825worker1 # [ 34.647904] nix-grpc-daemon[773]: ts=2026-09-20T08:17:00Z level=info event=scheduler_connected addr=lb:500513826worker2 # [ 34.653650] nix-grpc-daemon[776]: ts=2026-09-20T08:17:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3827worker1 # [ 34.656396] nix-grpc-daemon[773]: ts=2026-09-20T08:17:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3828worker2 # [ 34.855042] nix-grpc-daemon[776]: ts=2026-09-20T08:17:00Z level=info event=scheduler_connected addr=lb:500513829worker1 # [ 34.857514] nix-grpc-daemon[773]: ts=2026-09-20T08:17:00Z level=info event=scheduler_connected addr=lb:500513830worker2 # [ 34.863037] nix-grpc-daemon[776]: ts=2026-09-20T08:17:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3831worker1 # [ 34.864699] nix-grpc-daemon[773]: ts=2026-09-20T08:17:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3832worker2 # [ 35.064471] nix-grpc-daemon[776]: ts=2026-09-20T08:17:00Z level=info event=scheduler_connected addr=lb:500513833worker1 # [ 35.066053] nix-grpc-daemon[773]: ts=2026-09-20T08:17:00Z level=info event=scheduler_connected addr=lb:500513834worker1 # [ 35.074355] nix-grpc-daemon[773]: ts=2026-09-20T08:17:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3835worker2 # [ 35.072802] nix-grpc-daemon[776]: ts=2026-09-20T08:17:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3836worker1 # [ 35.275248] nix-grpc-daemon[773]: ts=2026-09-20T08:17:00Z level=info event=scheduler_connected addr=lb:500513837worker2 # [ 35.273782] nix-grpc-daemon[776]: ts=2026-09-20T08:17:00Z level=info event=scheduler_connected addr=lb:500513838worker1 # [ 35.279671] nix-grpc-daemon[773]: ts=2026-09-20T08:17:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3839worker2 # [ 35.279289] nix-grpc-daemon[776]: ts=2026-09-20T08:17:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3840worker2 # [ 35.481274] nix-grpc-daemon[776]: ts=2026-09-20T08:17:01Z level=info event=scheduler_connected addr=lb:500513841worker1 # [ 35.482397] nix-grpc-daemon[773]: ts=2026-09-20T08:17:01Z level=info event=scheduler_connected addr=lb:500513842worker2 # [ 35.488547] nix-grpc-daemon[776]: ts=2026-09-20T08:17:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3843worker1 # [ 35.488679] nix-grpc-daemon[773]: ts=2026-09-20T08:17:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3844worker1 # [ 35.689562] nix-grpc-daemon[773]: ts=2026-09-20T08:17:01Z level=info event=scheduler_connected addr=lb:500513845worker2 # [ 35.690015] nix-grpc-daemon[776]: ts=2026-09-20T08:17:01Z level=info event=scheduler_connected addr=lb:500513846worker2 # [ 35.696500] nix-grpc-daemon[776]: ts=2026-09-20T08:17:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3847worker1 # [ 35.698089] nix-grpc-daemon[773]: ts=2026-09-20T08:17:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3848worker2 # [ 35.896654] nix-grpc-daemon[776]: ts=2026-09-20T08:17:01Z level=info event=scheduler_connected addr=lb:500513849worker1 # [ 35.899310] nix-grpc-daemon[773]: ts=2026-09-20T08:17:01Z level=info event=scheduler_connected addr=lb:500513850worker2 # [ 35.901288] nix-grpc-daemon[776]: ts=2026-09-20T08:17:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3851worker1 # [ 35.906491] nix-grpc-daemon[773]: ts=2026-09-20T08:17:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3852worker2 # [ 36.102387] nix-grpc-daemon[776]: ts=2026-09-20T08:17:01Z level=info event=scheduler_connected addr=lb:500513853worker1 # [ 36.107763] nix-grpc-daemon[773]: ts=2026-09-20T08:17:01Z level=info event=scheduler_connected addr=lb:500513854worker2 # [ 36.109598] nix-grpc-daemon[776]: ts=2026-09-20T08:17:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3855worker1 # [ 36.115047] nix-grpc-daemon[773]: ts=2026-09-20T08:17:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3856worker2 # [ 36.310925] nix-grpc-daemon[776]: ts=2026-09-20T08:17:01Z level=info event=scheduler_connected addr=lb:500513857worker1 # [ 36.316392] nix-grpc-daemon[773]: ts=2026-09-20T08:17:01Z level=info event=scheduler_connected addr=lb:500513858worker2 # [ 36.318814] nix-grpc-daemon[776]: ts=2026-09-20T08:17:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3859worker1 # [ 36.323146] nix-grpc-daemon[773]: ts=2026-09-20T08:17:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3860worker2 # [ 36.522271] nix-grpc-daemon[776]: ts=2026-09-20T08:17:02Z level=info event=scheduler_connected addr=lb:500513861worker1 # [ 36.527392] nix-grpc-daemon[773]: ts=2026-09-20T08:17:02Z level=info event=scheduler_connected addr=lb:500513862worker2 # [ 36.527976] nix-grpc-daemon[776]: ts=2026-09-20T08:17:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3863worker1 # [ 36.531769] nix-grpc-daemon[773]: ts=2026-09-20T08:17:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3864worker1 # [ 36.728335] nix-grpc-daemon[773]: ts=2026-09-20T08:17:02Z level=info event=scheduler_connected addr=lb:500513865worker2 # [ 36.729192] nix-grpc-daemon[776]: ts=2026-09-20T08:17:02Z level=info event=scheduler_connected addr=lb:500513866worker2 # [ 36.735830] nix-grpc-daemon[776]: ts=2026-09-20T08:17:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3867worker1 # [ 36.737459] nix-grpc-daemon[773]: ts=2026-09-20T08:17:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3868worker2 # [ 36.935991] nix-grpc-daemon[776]: ts=2026-09-20T08:17:02Z level=info event=scheduler_connected addr=lb:500513869worker1 # [ 36.938814] nix-grpc-daemon[773]: ts=2026-09-20T08:17:02Z level=info event=scheduler_connected addr=lb:500513870worker2 # [ 36.940177] nix-grpc-daemon[776]: ts=2026-09-20T08:17:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3871worker1 # [ 36.946661] nix-grpc-daemon[773]: ts=2026-09-20T08:17:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3872worker2 # [ 37.141358] nix-grpc-daemon[776]: ts=2026-09-20T08:17:02Z level=info event=scheduler_connected addr=lb:500513873worker1 # [ 37.147838] nix-grpc-daemon[773]: ts=2026-09-20T08:17:02Z level=info event=scheduler_connected addr=lb:500513874worker2 # [ 37.148795] nix-grpc-daemon[776]: ts=2026-09-20T08:17:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3875worker1 # [ 37.162140] nix-grpc-daemon[773]: ts=2026-09-20T08:17:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3876worker2 # [ 37.349695] nix-grpc-daemon[776]: ts=2026-09-20T08:17:02Z level=info event=scheduler_connected addr=lb:500513877worker2 # [ 37.353973] nix-grpc-daemon[776]: ts=2026-09-20T08:17:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3878worker1 # [ 37.357790] nix-grpc-daemon[773]: ts=2026-09-20T08:17:02Z level=info event=scheduler_connected addr=lb:500513879worker1 # [ 37.366187] nix-grpc-daemon[773]: ts=2026-09-20T08:17:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3880worker2 # [ 37.556776] nix-grpc-daemon[776]: ts=2026-09-20T08:17:03Z level=info event=scheduler_connected addr=lb:500513881worker2 # [ 37.563746] nix-grpc-daemon[776]: ts=2026-09-20T08:17:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3882worker1 # [ 37.569489] nix-grpc-daemon[773]: ts=2026-09-20T08:17:03Z level=info event=scheduler_connected addr=lb:500513883worker1 # [ 37.576628] nix-grpc-daemon[773]: ts=2026-09-20T08:17:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3884worker2 # [ 37.764915] nix-grpc-daemon[776]: ts=2026-09-20T08:17:03Z level=info event=scheduler_connected addr=lb:500513885worker2 # [ 37.771655] nix-grpc-daemon[776]: ts=2026-09-20T08:17:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3886worker1 # [ 37.778358] nix-grpc-daemon[773]: ts=2026-09-20T08:17:03Z level=info event=scheduler_connected addr=lb:500513887worker1 # [ 37.785810] nix-grpc-daemon[773]: ts=2026-09-20T08:17:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3888worker2 # [ 37.973063] nix-grpc-daemon[776]: ts=2026-09-20T08:17:03Z level=info event=scheduler_connected addr=lb:500513889worker2 # [ 37.980941] nix-grpc-daemon[776]: ts=2026-09-20T08:17:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3890worker1 # [ 37.986727] nix-grpc-daemon[773]: ts=2026-09-20T08:17:03Z level=info event=scheduler_connected addr=lb:500513891worker1 # [ 37.993621] nix-grpc-daemon[773]: ts=2026-09-20T08:17:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3892worker2 # [ 38.182216] nix-grpc-daemon[776]: ts=2026-09-20T08:17:03Z level=info event=scheduler_connected addr=lb:500513893worker2 # [ 38.189391] nix-grpc-daemon[776]: ts=2026-09-20T08:17:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3894worker1 # [ 38.194859] nix-grpc-daemon[773]: ts=2026-09-20T08:17:03Z level=info event=scheduler_connected addr=lb:500513895worker1 # [ 38.200745] nix-grpc-daemon[773]: ts=2026-09-20T08:17:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3896worker2 # [ 38.390512] nix-grpc-daemon[776]: ts=2026-09-20T08:17:03Z level=info event=scheduler_connected addr=lb:500513897worker2 # [ 38.397718] nix-grpc-daemon[776]: ts=2026-09-20T08:17:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3898worker1 # [ 38.402042] nix-grpc-daemon[773]: ts=2026-09-20T08:17:03Z level=info event=scheduler_connected addr=lb:500513899worker1 # [ 38.409155] nix-grpc-daemon[773]: ts=2026-09-20T08:17:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3900worker2 # [ 38.602236] nix-grpc-daemon[776]: ts=2026-09-20T08:17:04Z level=info event=scheduler_connected addr=lb:500513901worker2 # [ 38.606630] nix-grpc-daemon[776]: ts=2026-09-20T08:17:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3902worker1 # [ 38.613682] nix-grpc-daemon[773]: ts=2026-09-20T08:17:04Z level=info event=scheduler_connected addr=lb:500513903worker1 # [ 38.618310] nix-grpc-daemon[773]: ts=2026-09-20T08:17:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3904worker2 # [ 38.803772] nix-grpc-daemon[776]: ts=2026-09-20T08:17:04Z level=info event=scheduler_connected addr=lb:500513905worker1 # [ 38.814927] nix-grpc-daemon[773]: ts=2026-09-20T08:17:04Z level=info event=scheduler_connected addr=lb:500513906worker2 # [ 38.812636] nix-grpc-daemon[776]: ts=2026-09-20T08:17:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3907worker1 # [ 38.824249] nix-grpc-daemon[773]: ts=2026-09-20T08:17:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3908worker2 # [ 39.013970] nix-grpc-daemon[776]: ts=2026-09-20T08:17:04Z level=info event=scheduler_connected addr=lb:500513909worker2 # [ 39.021800] nix-grpc-daemon[776]: ts=2026-09-20T08:17:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3910worker1 # [ 39.032239] nix-grpc-daemon[773]: ts=2026-09-20T08:17:04Z level=info event=scheduler_connected addr=lb:500513911worker1 # [ 39.039478] nix-grpc-daemon[773]: ts=2026-09-20T08:17:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3912worker2 # [ 39.223067] nix-grpc-daemon[776]: ts=2026-09-20T08:17:04Z level=info event=scheduler_connected addr=lb:500513913worker2 # [ 39.230571] nix-grpc-daemon[776]: ts=2026-09-20T08:17:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3914worker1 # [ 39.240740] nix-grpc-daemon[773]: ts=2026-09-20T08:17:04Z level=info event=scheduler_connected addr=lb:500513915worker1 # [ 39.248117] nix-grpc-daemon[773]: ts=2026-09-20T08:17:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3916worker2 # [ 39.431740] nix-grpc-daemon[776]: ts=2026-09-20T08:17:04Z level=info event=scheduler_connected addr=lb:500513917worker2 # [ 39.438773] nix-grpc-daemon[776]: ts=2026-09-20T08:17:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3918worker1 # [ 39.449156] nix-grpc-daemon[773]: ts=2026-09-20T08:17:04Z level=info event=scheduler_connected addr=lb:500513919worker1 # [ 39.456107] nix-grpc-daemon[773]: ts=2026-09-20T08:17:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3920worker2 # [ 39.642273] nix-grpc-daemon[776]: ts=2026-09-20T08:17:05Z level=info event=scheduler_connected addr=lb:500513921worker2 # [ 39.647862] nix-grpc-daemon[776]: ts=2026-09-20T08:17:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3922worker1 # [ 39.660362] nix-grpc-daemon[773]: ts=2026-09-20T08:17:05Z level=info event=scheduler_connected addr=lb:500513923worker1 # [ 39.664656] nix-grpc-daemon[773]: ts=2026-09-20T08:17:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3924worker2 # [ 39.848561] nix-grpc-daemon[776]: ts=2026-09-20T08:17:05Z level=info event=scheduler_connected addr=lb:500513925worker2 # [ 39.855475] nix-grpc-daemon[776]: ts=2026-09-20T08:17:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3926worker1 # [ 39.861703] nix-grpc-daemon[773]: ts=2026-09-20T08:17:05Z level=info event=scheduler_connected addr=lb:500513927worker1 # [ 39.868682] nix-grpc-daemon[773]: ts=2026-09-20T08:17:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3928worker2 # [ 40.056448] nix-grpc-daemon[776]: ts=2026-09-20T08:17:05Z level=info event=scheduler_connected addr=lb:500513929worker2 # [ 40.063444] nix-grpc-daemon[776]: ts=2026-09-20T08:17:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3930worker1 # [ 40.069771] nix-grpc-daemon[773]: ts=2026-09-20T08:17:05Z level=info event=scheduler_connected addr=lb:500513931worker1 # [ 40.076739] nix-grpc-daemon[773]: ts=2026-09-20T08:17:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3932worker1 # [ 40.209552] nix-grpc-daemon[773]: ts=2026-09-20T08:17:05Z level=info event=scheduler_lock_lost error="error: http://lb:5751/api/farm/lead: Timeout was reached"3933worker2 # [ 40.210289] nix-grpc-daemon[776]: ts=2026-09-20T08:17:05Z level=info event=scheduler_lock_lost error="error: http://lb:5751/api/farm/lead: Timeout was reached"3934worker2 # [ 40.264729] nix-grpc-daemon[776]: ts=2026-09-20T08:17:05Z level=info event=scheduler_connected addr=lb:500513935worker2 # [ 40.270607] nix-grpc-daemon[776]: ts=2026-09-20T08:17:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3936worker1 # [ 40.278059] nix-grpc-daemon[773]: ts=2026-09-20T08:17:05Z level=info event=scheduler_connected addr=lb:500513937worker1 # [ 40.285202] nix-grpc-daemon[773]: ts=2026-09-20T08:17:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3938worker2 # [ 40.471938] nix-grpc-daemon[776]: ts=2026-09-20T08:17:06Z level=info event=scheduler_connected addr=lb:500513939worker2 # [ 40.479076] nix-grpc-daemon[776]: ts=2026-09-20T08:17:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3940worker1 # [ 40.486329] nix-grpc-daemon[773]: ts=2026-09-20T08:17:06Z level=info event=scheduler_connected addr=lb:500513941worker1 # [ 40.490895] nix-grpc-daemon[773]: ts=2026-09-20T08:17:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3942worker2 # [ 40.682287] nix-grpc-daemon[776]: ts=2026-09-20T08:17:06Z level=info event=scheduler_connected addr=lb:500513943worker2 # [ 40.686702] nix-grpc-daemon[776]: ts=2026-09-20T08:17:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3944worker1 # [ 40.695382] nix-grpc-daemon[773]: ts=2026-09-20T08:17:06Z level=info event=scheduler_connected addr=lb:500513945worker1 # [ 40.699754] nix-grpc-daemon[773]: ts=2026-09-20T08:17:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3946worker2 # [ 40.887301] nix-grpc-daemon[776]: ts=2026-09-20T08:17:06Z level=info event=scheduler_connected addr=lb:500513947worker2 # [ 40.894342] nix-grpc-daemon[776]: ts=2026-09-20T08:17:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3948worker1 # [ 40.896513] nix-grpc-daemon[773]: ts=2026-09-20T08:17:06Z level=info event=scheduler_connected addr=lb:500513949worker1 # [ 40.903892] nix-grpc-daemon[773]: ts=2026-09-20T08:17:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3950worker2 # [ 41.095242] nix-grpc-daemon[776]: ts=2026-09-20T08:17:06Z level=info event=scheduler_connected addr=lb:500513951worker2 # [ 41.102324] nix-grpc-daemon[776]: ts=2026-09-20T08:17:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3952worker1 # [ 41.105080] nix-grpc-daemon[773]: ts=2026-09-20T08:17:06Z level=info event=scheduler_connected addr=lb:500513953worker1 # [ 41.112765] nix-grpc-daemon[773]: ts=2026-09-20T08:17:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3954worker2 # [ 41.303636] nix-grpc-daemon[776]: ts=2026-09-20T08:17:06Z level=info event=scheduler_connected addr=lb:500513955worker2 # [ 41.310436] nix-grpc-daemon[776]: ts=2026-09-20T08:17:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3956worker1 # [ 41.314355] nix-grpc-daemon[773]: ts=2026-09-20T08:17:06Z level=info event=scheduler_connected addr=lb:500513957worker1 # [ 41.321402] nix-grpc-daemon[773]: ts=2026-09-20T08:17:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3958worker2 # [ 41.511563] nix-grpc-daemon[776]: ts=2026-09-20T08:17:07Z level=info event=scheduler_connected addr=lb:500513959worker2 # [ 41.518891] nix-grpc-daemon[776]: ts=2026-09-20T08:17:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3960worker1 # [ 41.522761] nix-grpc-daemon[773]: ts=2026-09-20T08:17:07Z level=info event=scheduler_connected addr=lb:500513961worker1 # [ 41.530054] nix-grpc-daemon[773]: ts=2026-09-20T08:17:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3962worker2 # [ 41.722386] nix-grpc-daemon[776]: ts=2026-09-20T08:17:07Z level=info event=scheduler_connected addr=lb:500513963worker2 # [ 41.727874] nix-grpc-daemon[776]: ts=2026-09-20T08:17:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3964worker1 # [ 41.732763] nix-grpc-daemon[773]: ts=2026-09-20T08:17:07Z level=info event=scheduler_connected addr=lb:500513965worker1 # [ 41.739423] nix-grpc-daemon[773]: ts=2026-09-20T08:17:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3966worker2 # [ 41.928966] nix-grpc-daemon[776]: ts=2026-09-20T08:17:07Z level=info event=scheduler_connected addr=lb:500513967worker2 # [ 41.935742] nix-grpc-daemon[776]: ts=2026-09-20T08:17:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3968worker1 # [ 41.940639] nix-grpc-daemon[773]: ts=2026-09-20T08:17:07Z level=info event=scheduler_connected addr=lb:500513969worker1 # [ 41.948190] nix-grpc-daemon[773]: ts=2026-09-20T08:17:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3970worker2 # [ 42.136990] nix-grpc-daemon[776]: ts=2026-09-20T08:17:07Z level=info event=scheduler_connected addr=lb:500513971worker2 # [ 42.143915] nix-grpc-daemon[776]: ts=2026-09-20T08:17:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3972worker1 # [ 42.149409] nix-grpc-daemon[773]: ts=2026-09-20T08:17:07Z level=info event=scheduler_connected addr=lb:500513973worker1 # [ 42.156447] nix-grpc-daemon[773]: ts=2026-09-20T08:17:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3974worker2 # [ 42.345154] nix-grpc-daemon[776]: ts=2026-09-20T08:17:07Z level=info event=scheduler_connected addr=lb:500513975worker2 # [ 42.352372] nix-grpc-daemon[776]: ts=2026-09-20T08:17:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3976worker1 # [ 42.357680] nix-grpc-daemon[773]: ts=2026-09-20T08:17:07Z level=info event=scheduler_connected addr=lb:500513977worker1 # [ 42.364539] nix-grpc-daemon[773]: ts=2026-09-20T08:17:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3978lb # [ 42.550834] rustfs-bucket-start[1108]: mb s3://farm3979worker2 # [ 42.553781] nix-grpc-daemon[776]: ts=2026-09-20T08:17:08Z level=info event=scheduler_connected addr=lb:500513980worker2 # [ 42.560747] nix-grpc-daemon[776]: ts=2026-09-20T08:17:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3981lb # [ 42.564862] systemd[1]: Finished rustfs-bucket.service.3982worker1 # [ 42.565981] nix-grpc-daemon[773]: ts=2026-09-20T08:17:08Z level=info event=scheduler_connected addr=lb:500513983worker1 # [ 42.573930] nix-grpc-daemon[773]: ts=2026-09-20T08:17:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3984lb # [ 42.575373] systemd[1]: Starting niks3 server...3985worker2 # [ 42.765305] nix-grpc-daemon[776]: ts=2026-09-20T08:17:08Z level=info event=scheduler_connected addr=lb:500513986worker2 # [ 42.769516] nix-grpc-daemon[776]: ts=2026-09-20T08:17:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3987worker1 # [ 42.778317] nix-grpc-daemon[773]: ts=2026-09-20T08:17:08Z level=info event=scheduler_connected addr=lb:500513988worker1 # [ 42.782686] nix-grpc-daemon[773]: ts=2026-09-20T08:17:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3989lb # [ 42.787989] postgres[1124]: [1124] ERROR: relation "goose_db_version" does not exist at character 363990lb # [ 42.790286] postgres[1124]: [1124] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC3991lb # [ 42.822839] niks3-server[1118]: 2026/09/20 08:17:08 OK 20241026095416_initial_model.sql (19.95ms)3992lb # [ 42.826716] niks3-server[1118]: 2026/09/20 08:17:08 OK 20251210153512_drop_unused_gin_index.sql (2.21ms)3993lb # [ 42.832609] niks3-server[1118]: 2026/09/20 08:17:08 OK 20251218171726_add_pins.sql (4.3ms)3994lb # [ 42.837745] niks3-server[1118]: 2026/09/20 08:17:08 OK 20260628120000_add_object_size_and_stats.sql (5.1ms)3995lb # [ 42.842866] niks3-server[1118]: 2026/09/20 08:17:08 OK 20260905000000_add_claims.sql (5.08ms)3996lb # [ 42.847799] niks3-server[1118]: 2026/09/20 08:17:08 OK 20260920000000_drop_claims.sql (4.79ms)3997lb # [ 42.849980] niks3-server[1118]: 2026/09/20 08:17:08 goose: successfully migrated database to version: 202609200000003998lb # [ 42.854645] niks3-server[1118]: 2026/09/20 08:17:08 OK 1_commit_pending_closure.sql (6.83ms)3999lb # [ 42.857553] niks3-server[1118]: 2026/09/20 08:17:08 OK 2_object_stats_trigger.sql (2.76ms)4000lb # [ 42.859023] niks3-server[1118]: 2026/09/20 08:17:08 goose: up to current file version: 24001lb # [ 42.862590] niks3-server[1118]: 2026/09/20 08:17:08 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key4002lb # [ 42.911246] niks3-server[1118]: 2026/09/20 08:17:08 INFO Read proxy enabled — serving cache objects from S34003lb # [ 42.913940] niks3-server[1118]: 2026/09/20 08:17:08 INFO Using socket-activated listener address=0.0.0.0:57514004lb # [ 42.919342] niks3-server[1118]: 2026/09/20 08:17:08 INFO systemd watchdog enabled interval=15s4005lb # [ 42.924249] niks3-server[1118]: 2026/09/20 08:17:08 INFO Starting HTTP server address=0.0.0.0:57514006lb # [ 42.926437] systemd[1]: Started niks3 server.4007lb # [ 42.927104] niks3-server[1118]: 2026/09/20 08:17:08 INFO lead: acquired remote=192.168.1.4:483544008worker2 # [ 42.928436] nix-grpc-daemon[776]: ts=2026-09-20T08:17:08Z level=info event=scheduler_take_over4009lb # [ 42.940705] systemd[1]: Reached target Multi-User System.4010lb # [ 42.941590] systemd[1]: Startup finished in 1.025s (kernel) + 5.634s (initrd) + 36.258s (userspace) = 42.918s.4011worker2 # [ 42.966138] nix-grpc-daemon[776]: ts=2026-09-20T08:17:08Z level=info event=scheduler_connected addr=lb:500514012worker2 # [ 42.973292] nix-grpc-daemon[776]: ts=2026-09-20T08:17:08Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04013worker1 # [ 42.978835] nix-grpc-daemon[773]: ts=2026-09-20T08:17:08Z level=info event=scheduler_connected addr=lb:500514014worker1 # [ 42.986603] nix-grpc-daemon[773]: ts=2026-09-20T08:17:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4015lb: (finished: waiting for unit niks3.service, in 27.29 seconds)4016lb: waiting for TCP port 5751 on localhost4017lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4018lb: (finished: waiting for TCP port 5751 on localhost, in 0.06 seconds)4019lb: waiting for unit envoy.service4020lb: (finished: waiting for unit envoy.service, in 0.05 seconds)4021lb: waiting for TCP port 50051 on localhost4022worker1 # [ 43.187876] nix-grpc-daemon[773]: ts=2026-09-20T08:17:08Z level=info event=scheduler_connected addr=lb:500514023worker2 # [ 43.188740] nix-grpc-daemon[776]: ts=2026-09-20T08:17:08Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04024lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4025lb # [ 43.214640] envoy[914]: conn peer=[::1]:41816 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=34026lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds)4027lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4028??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.4029 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1284030lb: must succeed: curl -sf localhost:9901/clusters4031lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4032lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4033subtest: one node schedules and both builders hold a WorkerSession on it4034lb: must succeed: curl -sf localhost:9901/clusters4035lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4036worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4037worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.11 seconds)4038(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.16 seconds)4039subtest: balancer auth: client cert, bearer token, nothing, unknown CN4040worker2 # [ 44.032984] nix-grpc-daemon[776]: ts=2026-09-20T08:17:09Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:441144041worker2 # [ 44.053411] systemd[1]: Started Nix Daemon.4042worker2 # [ 44.366957] nix-daemon[844]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4043worker2 # [ 44.410818] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 82 ms (attempt 1/5)4044worker2 # [ 44.498826] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 129 ms (attempt 2/5)4045worker2 # [ 44.628522] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 346 ms (attempt 3/5)4046worker2 # [ 44.974988] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 49 ms (attempt 4/5)4047worker2 # [ 45.035209] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4048worker2 # [ 45.059080] nix-grpc-daemon[776]: ts=2026-09-20T08:17:10Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:441144049worker2 # [ 45.075508] nix-grpc-daemon[776]: ts=2026-09-20T08:17:10Z level=debug event=path_info_miss path=2jmap7m0gxs09dqzijw97xb6bxh4300i-nixos-system-client-test error="error: path '/nix/store/2jmap7m0gxs09dqzijw97xb6bxh4300i-nixos-system-client-test' is required, but there is no substituter that can build it"4050worker2 # [ 45.088517] nix-grpc-daemon[776]: ts=2026-09-20T08:17:10Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:441144051worker2 # [ 45.099825] nix-grpc-daemon[776]: ts=2026-09-20T08:17:10Z level=debug event=path_info_miss path=2jmap7m0gxs09dqzijw97xb6bxh4300i-nixos-system-client-test error="error: path '/nix/store/2jmap7m0gxs09dqzijw97xb6bxh4300i-nixos-system-client-test' is required, but there is no substituter that can build it"4052client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4053client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.11 seconds)4054client: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4055client: (finished: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.06 seconds)4056worker1 # [ 45.587550] nix-grpc-daemon[773]: ts=2026-09-20T08:17:11Z level=info event=oidc_jwks provider=mock keys=14057worker1 # [ 45.592396] nix-grpc-daemon[773]: ts=2026-09-20T08:17:11Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:505124058worker1 # [ 45.608898] systemd[1]: Started Nix Daemon.4059worker1 # [ 45.925942] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4060worker1 # [ 45.953963] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 55 ms (attempt 1/5)4061worker1 # [ 46.012225] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 122 ms (attempt 2/5)4062worker1 # [ 46.141118] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 42 ms (attempt 3/5)4063worker1 # [ 46.183638] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 56 ms (attempt 4/5)4064worker1 # [ 46.242034] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4065worker1 # [ 46.265343] nix-grpc-daemon[773]: ts=2026-09-20T08:17:11Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:505124066worker1 # [ 46.280137] nix-grpc-daemon[773]: ts=2026-09-20T08:17:11Z level=debug event=path_info_miss path=2jmap7m0gxs09dqzijw97xb6bxh4300i-nixos-system-client-test error="error: path '/nix/store/2jmap7m0gxs09dqzijw97xb6bxh4300i-nixos-system-client-test' is required, but there is no substituter that can build it"4067worker2 # [ 46.309369] nix-grpc-daemon[776]: ts=2026-09-20T08:17:11Z level=info event=oidc_jwks provider=mock keys=14068worker2 # [ 46.315884] nix-grpc-daemon[776]: ts=2026-09-20T08:17:11Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:441144069worker2 # [ 46.324631] nix-grpc-daemon[776]: ts=2026-09-20T08:17:11Z level=debug event=path_info_miss path=2jmap7m0gxs09dqzijw97xb6bxh4300i-nixos-system-client-test error="error: path '/nix/store/2jmap7m0gxs09dqzijw97xb6bxh4300i-nixos-system-client-test' is required, but there is no substituter that can build it"4070client: must succeed: rm -r /var/lib/nix-grpc-store4071client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.06 seconds)4072worker1 # [ 46.663387] nix-grpc-daemon[773]: ts=2026-09-20T08:17:12Z level=info event=denied method=QueryMissing cn=- role=none4073worker1 # [ 46.923755] nix-grpc-daemon[773]: ts=2026-09-20T08:17:12Z level=info event=denied method=QueryMissing cn=stranger role=none4074(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.29 seconds)4075subtest: DAG build is scheduled across workers and lands in the cache4076client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&24077worker1 # [ 47.206139] nix-grpc-daemon[773]: ts=2026-09-20T08:17:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:505124078client # don't know how to build these paths:4079client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4080worker2 # [ 47.233123] nix-grpc-daemon[776]: ts=2026-09-20T08:17:12Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=04081worker2 # [ 47.233565] nix-grpc-daemon[776]: ts=2026-09-20T08:17:12Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.4:50051 clients=14082worker2 # [ 47.283263] nix-grpc-daemon[776]: ts=2026-09-20T08:17:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:441144083worker2 # [ 47.303883] nix-grpc-daemon[776]: ts=2026-09-20T08:17:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:441144084client # copying 1 paths to 'lb:50051'...4085client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...4086worker2 # [ 47.320734] nix-grpc-daemon[776]: ts=2026-09-20T08:17:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:441144087worker2 # [ 47.333655] nix-daemon[844]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4088worker2 # [ 47.372135] nix-grpc-daemon[776]: ts=2026-09-20T08:17:12Z level=info event=niks3_push_started pid=8564089worker2 # [ 47.858344] nix-daemon[844]: accepted connection from pid 869, user nix-grpc-daemon (trusted)4090worker2 # [ 47.878999] nix-daemon[844]: reaped child process 872, status = succeeded4091worker2 # [ 48.063545] nix-daemon[844]: accepted connection from pid 874, user nix-grpc-daemon (trusted)4092worker2 # [ 48.083247] nix-daemon[844]: reaped child process 877, status = succeeded4093lb # [ 48.094267] niks3-server[1118]: 2026/09/20 08:17:13 INFO Received uploads request method=POST path=/api/pending_closures4094worker2 # [ 48.125394] nix-grpc-daemon[856]: time=2026-09-20T08:17:13.667Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4095worker2 # [ 48.127108] nix-grpc-daemon[856]: time=2026-09-20T08:17:13.667Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"4096lb # [ 48.173948] niks3-server[1118]: 2026/09/20 08:17:13 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst4097lb # [ 48.183704] niks3-server[1118]: 2026/09/20 08:17:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4098lb # [ 48.195848] niks3-server[1118]: 2026/09/20 08:17:13 INFO Signed narinfos id=1 count=14099worker2 # [ 48.202825] nix-grpc-daemon[856]: time=2026-09-20T08:17:13.746Z level=INFO msg="Uploading 1 narinfos"4100lb # [ 48.214911] niks3-server[1118]: 2026/09/20 08:17:13 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4101lb # [ 48.228508] niks3-server[1118]: 2026/09/20 08:17:13 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls4102lb # [ 48.235455] niks3-server[1118]: 2026/09/20 08:17:13 INFO Completed upload id=14103worker2 # [ 48.239076] nix-grpc-daemon[856]: time=2026-09-20T08:17:13.783Z level=INFO msg="Upload complete. (575ms)"4104lb # [ 48.242777] niks3-server[1118]: 2026/09/20 08:17:13 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo4105worker2 # [ 48.251946] nix-grpc-daemon[776]: ts=2026-09-20T08:17:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44114 duration_s=0 paths=1 nar_bytes_in=5044106worker2 # [ 48.265159] nix-grpc-daemon[776]: ts=2026-09-20T08:17:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:441144107worker2 # [ 48.278453] nix-daemon[844]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4108worker2 # [ 48.286052] nix-daemon[844]: reaped child process 854, status = succeeded4109client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...4110worker2 # [ 48.298901] nix-daemon[844]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4111client # farm-a> worker2: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv4112client # farm-a> LOG-farm-a-t14113worker2 # [ 49.551043] nix-daemon[844]: reaped child process 881, status = succeeded4114worker2 # [ 49.729296] nix-daemon[844]: accepted connection from pid 896, user nix-grpc-daemon (trusted)4115worker2 # [ 49.748831] nix-daemon[844]: reaped child process 899, status = succeeded4116lb # [ 49.759464] niks3-server[1118]: 2026/09/20 08:17:15 INFO Received uploads request method=POST path=/api/pending_closures4117worker2 # [ 49.775240] nix-grpc-daemon[856]: time=2026-09-20T08:17:15.317Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4118worker2 # [ 49.777923] nix-grpc-daemon[856]: time=2026-09-20T08:17:15.317Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"4119worker2 # [ 49.844268] nix-grpc-daemon[856]: time=2026-09-20T08:17:15.387Z level=INFO msg="Uploading 1 narinfos"4120lb # [ 49.829865] niks3-server[1118]: 2026/09/20 08:17:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4121lb # [ 49.847008] niks3-server[1118]: 2026/09/20 08:17:15 INFO Signed narinfos id=2 count=14122lb # [ 49.854864] niks3-server[1118]: 2026/09/20 08:17:15 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4123lb # [ 49.863862] niks3-server[1118]: 2026/09/20 08:17:15 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv4124lb # [ 49.873116] niks3-server[1118]: 2026/09/20 08:17:15 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls4125lb # [ 49.880001] niks3-server[1118]: 2026/09/20 08:17:15 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4126lb # [ 49.884606] niks3-server[1118]: 2026/09/20 08:17:15 INFO Completed upload id=24127worker2 # [ 49.888136] nix-grpc-daemon[856]: time=2026-09-20T08:17:15.432Z level=INFO msg="Upload complete. (372ms)"4128lb # [ 49.887083] niks3-server[1118]: 2026/09/20 08:17:15 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo4129worker2 # [ 49.916684] nix-grpc-daemon[776]: ts=2026-09-20T08:17:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44114 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=14130worker2 # [ 49.928602] nix-grpc-daemon[776]: ts=2026-09-20T08:17:15Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=04131worker2 # [ 49.934456] nix-grpc-daemon[776]: ts=2026-09-20T08:17:15Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.4:50051 clients=14132worker2 # [ 49.938479] nix-daemon[844]: reaped child process 879, status = succeeded4133worker2 # [ 49.962290] nix-grpc-daemon[776]: ts=2026-09-20T08:17:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:441144134worker2 # [ 49.978841] nix-grpc-daemon[776]: ts=2026-09-20T08:17:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:441144135worker2 # [ 49.994992] nix-grpc-daemon[856]: time=2026-09-20T08:17:15.538Z level=INFO msg="All 1 paths already cached"4136client # copying 1 paths to 'lb:50051'...4137worker2 # [ 50.005797] nix-grpc-daemon[776]: ts=2026-09-20T08:17:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:441144138client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...4139worker2 # [ 50.030347] nix-daemon[844]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4140worker2 # [ 50.251808] nix-daemon[844]: accepted connection from pid 905, user nix-grpc-daemon (trusted)4141worker2 # [ 50.270696] nix-daemon[844]: reaped child process 908, status = succeeded4142worker2 # [ 50.456154] nix-daemon[844]: accepted connection from pid 910, user nix-grpc-daemon (trusted)4143worker2 # [ 50.474454] nix-daemon[844]: reaped child process 913, status = succeeded4144lb # [ 50.483951] niks3-server[1118]: 2026/09/20 08:17:16 INFO Received uploads request method=POST path=/api/pending_closures4145worker2 # [ 50.496798] nix-grpc-daemon[856]: time=2026-09-20T08:17:16.040Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4146worker2 # [ 50.498349] nix-grpc-daemon[856]: time=2026-09-20T08:17:16.040Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"4147lb # [ 50.512451] niks3-server[1118]: 2026/09/20 08:17:16 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst4148lb # [ 50.527291] niks3-server[1118]: 2026/09/20 08:17:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4149worker2 # [ 50.536819] nix-grpc-daemon[856]: time=2026-09-20T08:17:16.080Z level=INFO msg="Uploading 1 narinfos"4150lb # [ 50.540683] niks3-server[1118]: 2026/09/20 08:17:16 INFO Signed narinfos id=3 count=14151lb # [ 50.548245] niks3-server[1118]: 2026/09/20 08:17:16 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls4152lb # [ 50.559691] niks3-server[1118]: 2026/09/20 08:17:16 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4153lb # [ 50.566262] niks3-server[1118]: 2026/09/20 08:17:16 INFO Completed upload id=34154worker2 # [ 50.569796] nix-grpc-daemon[856]: time=2026-09-20T08:17:16.113Z level=INFO msg="Upload complete. (521ms)"4155lb # [ 50.570249] niks3-server[1118]: 2026/09/20 08:17:16 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo4156worker2 # [ 50.580386] nix-grpc-daemon[776]: ts=2026-09-20T08:17:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44114 duration_s=0 paths=1 nar_bytes_in=6244157worker2 # [ 50.596926] nix-grpc-daemon[776]: ts=2026-09-20T08:17:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:441144158worker2 # [ 50.607780] nix-daemon[844]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4159worker2 # [ 50.610945] nix-daemon[844]: reaped child process 903, status = succeeded4160client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...4161client # farm-b> worker2: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv4162worker2 # [ 50.629704] nix-daemon[844]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4163client # farm-b> LOG-farm-b-t14164worker2 # [ 51.259786] nix-daemon[844]: reaped child process 917, status = succeeded4165worker2 # [ 51.432124] nix-daemon[844]: accepted connection from pid 932, user nix-grpc-daemon (trusted)4166worker2 # [ 51.453263] nix-daemon[844]: reaped child process 935, status = succeeded4167lb # [ 51.462267] niks3-server[1118]: 2026/09/20 08:17:17 INFO Received uploads request method=POST path=/api/pending_closures4168worker2 # [ 51.478589] nix-grpc-daemon[856]: time=2026-09-20T08:17:17.021Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4169worker2 # [ 51.480210] nix-grpc-daemon[856]: time=2026-09-20T08:17:17.021Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"4170lb # [ 51.497207] niks3-server[1118]: 2026/09/20 08:17:17 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv4171lb # [ 51.515472] niks3-server[1118]: 2026/09/20 08:17:17 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst4172lb # [ 51.526275] niks3-server[1118]: 2026/09/20 08:17:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4173worker2 # [ 51.535585] nix-grpc-daemon[856]: time=2026-09-20T08:17:17.079Z level=INFO msg="Uploading 1 narinfos"4174lb # [ 51.534011] niks3-server[1118]: 2026/09/20 08:17:17 INFO Signed narinfos id=4 count=14175lb # [ 51.540301] niks3-server[1118]: 2026/09/20 08:17:17 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls4176lb # [ 51.548211] niks3-server[1118]: 2026/09/20 08:17:17 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4177lb # [ 51.558910] niks3-server[1118]: 2026/09/20 08:17:17 INFO Completed upload id=44178worker2 # [ 51.562309] nix-grpc-daemon[856]: time=2026-09-20T08:17:17.106Z level=INFO msg="Upload complete. (322ms)"4179lb # [ 51.562202] niks3-server[1118]: 2026/09/20 08:17:17 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo4180worker2 # [ 51.579985] nix-grpc-daemon[776]: ts=2026-09-20T08:17:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44114 duration_s=0 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=14181worker2 # [ 51.599853] nix-grpc-daemon[776]: ts=2026-09-20T08:17:17Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=04182worker2 # [ 51.606008] nix-grpc-daemon[776]: ts=2026-09-20T08:17:17Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.4:50051 clients=14183worker2 # [ 51.613010] nix-grpc-daemon[776]: ts=2026-09-20T08:17:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:441144184worker2 # [ 51.617809] nix-daemon[844]: reaped child process 915, status = succeeded4185worker2 # [ 51.622126] nix-grpc-daemon[776]: ts=2026-09-20T08:17:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:441144186worker2 # [ 51.635481] nix-grpc-daemon[856]: time=2026-09-20T08:17:17.179Z level=INFO msg="All 2 paths already cached"4187client # copying 1 paths to 'lb:50051'...4188worker2 # [ 51.646888] nix-grpc-daemon[776]: ts=2026-09-20T08:17:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:441144189client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...4190worker2 # [ 51.668989] nix-daemon[844]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4191worker2 # [ 51.872124] nix-daemon[844]: accepted connection from pid 941, user nix-grpc-daemon (trusted)4192worker2 # [ 51.893080] nix-daemon[844]: reaped child process 944, status = succeeded4193worker2 # [ 52.070323] nix-daemon[844]: accepted connection from pid 946, user nix-grpc-daemon (trusted)4194worker2 # [ 52.089979] nix-daemon[844]: reaped child process 949, status = succeeded4195lb # [ 52.097770] niks3-server[1118]: 2026/09/20 08:17:17 INFO Received uploads request method=POST path=/api/pending_closures4196worker2 # [ 52.110903] nix-grpc-daemon[856]: time=2026-09-20T08:17:17.654Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4197worker2 # [ 52.112988] nix-grpc-daemon[856]: time=2026-09-20T08:17:17.656Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"4198lb # [ 52.129670] niks3-server[1118]: 2026/09/20 08:17:17 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst4199worker2 # [ 52.145707] nix-grpc-daemon[856]: time=2026-09-20T08:17:17.689Z level=INFO msg="Uploading 1 narinfos"4200lb # [ 52.144906] niks3-server[1118]: 2026/09/20 08:17:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4201lb # [ 52.156355] niks3-server[1118]: 2026/09/20 08:17:17 INFO Signed narinfos id=5 count=14202lb # [ 52.161826] niks3-server[1118]: 2026/09/20 08:17:17 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls4203lb # [ 52.170381] niks3-server[1118]: 2026/09/20 08:17:17 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4204lb # [ 52.175589] niks3-server[1118]: 2026/09/20 08:17:17 INFO Completed upload id=54205worker2 # [ 52.178923] nix-grpc-daemon[856]: time=2026-09-20T08:17:17.722Z level=INFO msg="Upload complete. (493ms)"4206lb # [ 52.178570] niks3-server[1118]: 2026/09/20 08:17:17 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo4207worker2 # [ 52.188262] nix-grpc-daemon[776]: ts=2026-09-20T08:17:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44114 duration_s=0 paths=1 nar_bytes_in=7524208worker2 # [ 52.200001] nix-grpc-daemon[776]: ts=2026-09-20T08:17:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:441144209worker2 # [ 52.208437] nix-daemon[844]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4210worker2 # [ 52.213737] nix-daemon[844]: reaped child process 939, status = succeeded4211client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...4212client # farm-top> worker2: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4213worker2 # [ 52.228188] nix-daemon[844]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4214lb # [ 52.596781] envoy[914]: conn peer=[2001:db8:1::1]:39358 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=715 tx=362 ms=11124215lb # [ 52.601964] envoy[914]: conn peer=[2001:db8:1::1]:39364 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=365 ms=7834216lb # [ 52.606601] envoy[914]: conn peer=[2001:db8:1::1]:39374 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=134217lb # [ 52.612522] envoy[914]: conn peer=[2001:db8:1::1]:39390 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=144218client # farm-top> LOG-farm-top-t14219worker2 # [ 53.275042] nix-daemon[844]: reaped child process 953, status = succeeded4220worker2 # [ 53.451654] nix-daemon[844]: accepted connection from pid 968, user nix-grpc-daemon (trusted)4221worker2 # [ 53.473650] nix-daemon[844]: reaped child process 971, status = succeeded4222lb # [ 53.483031] niks3-server[1118]: 2026/09/20 08:17:19 INFO Received uploads request method=POST path=/api/pending_closures4223worker2 # [ 53.506311] nix-grpc-daemon[856]: time=2026-09-20T08:17:19.048Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4224worker2 # [ 53.508303] nix-grpc-daemon[856]: time=2026-09-20T08:17:19.048Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"4225lb # [ 53.529636] niks3-server[1118]: 2026/09/20 08:17:19 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4226lb # [ 53.540434] niks3-server[1118]: 2026/09/20 08:17:19 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst4227lb # [ 53.550326] niks3-server[1118]: 2026/09/20 08:17:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4228worker2 # [ 53.554133] nix-grpc-daemon[856]: time=2026-09-20T08:17:19.097Z level=INFO msg="Uploading 1 narinfos"4229lb # [ 53.556250] niks3-server[1118]: 2026/09/20 08:17:19 INFO Signed narinfos id=6 count=14230lb # [ 53.562403] niks3-server[1118]: 2026/09/20 08:17:19 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls4231lb # [ 53.572328] niks3-server[1118]: 2026/09/20 08:17:19 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4232lb # [ 53.579633] niks3-server[1118]: 2026/09/20 08:17:19 INFO Completed upload id=64233worker2 # [ 53.583067] nix-grpc-daemon[856]: time=2026-09-20T08:17:19.127Z level=INFO msg="Upload complete. (343ms)"4234lb # [ 53.586735] niks3-server[1118]: 2026/09/20 08:17:19 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo4235worker2 # [ 53.595590] nix-grpc-daemon[776]: ts=2026-09-20T08:17:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44114 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=14236worker2 # [ 53.616434] nix-daemon[844]: reaped child process 951, status = succeeded4237client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&2, in 6.70 seconds)4238client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath4239client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath, in 0.25 seconds)4240client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4241client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.03 seconds)4242client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4243client # copying 3 paths...4244client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...4245client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...4246client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...4247client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.32 seconds)4248(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 7.41 seconds)4249subtest: repeat is answered Cached by the scheduler without building4250worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4251worker1 # finding garbage collector roots...4252worker1 # deleting specified paths...4253worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4254worker1 # deleting unused links...4255worker1 # note: hard linking is currently saving 0.0 KiB4256worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.29 seconds)4257worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4258worker2 # finding garbage collector roots...4259worker2 # deleting specified paths...4260worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4261worker2 # deleting unused links...4262worker2 # note: hard linking is currently saving 0.0 KiB4263worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.28 seconds)4264client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&24265worker2 # [ 55.178124] nix-grpc-daemon[776]: ts=2026-09-20T08:17:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:441144266client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):4267client # /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4268worker2 # [ 55.210996] nix-grpc-daemon[776]: ts=2026-09-20T08:17:20Z level=debug event=want client=2 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=14269worker2 # [ 55.225697] nix-grpc-daemon[776]: ts=2026-09-20T08:17:20Z level=debug event=want client=2 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=14270worker2 # [ 55.239864] nix-grpc-daemon[776]: ts=2026-09-20T08:17:20Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=14271client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&2, in 0.35 seconds)4272client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath4273client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath, in 0.22 seconds)4274lb: must succeed: curl -sf localhost:9901/clusters4275lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)4276lb: must succeed: curl -sf localhost:9901/clusters4277lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4278worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true4279worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.09 seconds)4280(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.53 seconds)4281subtest: two clients wanting the same drv build it once4282client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4283client # [ 56.048846] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4284client # Running as unit: dedup1.service; invocation ID: a304ade212f44726a4ee4db2fd40b98d4285client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.10 seconds)4286client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4287client # [ 56.306410] nix[864]: don't know how to build these paths:4288client # [ 56.307423] nix[864]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4289worker1 # [ 56.223865] nix-grpc-daemon[773]: ts=2026-09-20T08:17:21Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:505124290worker2 # [ 56.235698] nix-grpc-daemon[776]: ts=2026-09-20T08:17:21Z level=debug event=want client=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04291worker2 # [ 56.239561] nix-grpc-daemon[776]: ts=2026-09-20T08:17:21Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.3:50051 clients=14292worker1 # [ 56.281421] nix-grpc-daemon[773]: ts=2026-09-20T08:17:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:505124293worker1 # [ 56.302822] nix-grpc-daemon[773]: ts=2026-09-20T08:17:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:505124294client # [ 56.400234] nix[864]: copying 1 paths to 'lb:50051'...4295worker1 # [ 56.317961] nix-grpc-daemon[773]: ts=2026-09-20T08:17:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:505124296client # [ 56.402752] nix[864]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4297worker1 # [ 56.337254] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4298worker1 # [ 56.368981] nix-grpc-daemon[773]: ts=2026-09-20T08:17:21Z level=info event=niks3_push_started pid=8594299worker1 # [ 56.817185] nix-daemon[836]: accepted connection from pid 872, user nix-grpc-daemon (trusted)4300worker1 # [ 56.838997] nix-daemon[836]: reaped child process 875, status = succeeded4301worker1 # [ 57.021860] nix-daemon[836]: accepted connection from pid 877, user nix-grpc-daemon (trusted)4302worker1 # [ 57.042280] nix-daemon[836]: reaped child process 880, status = succeeded4303lb # [ 57.052809] niks3-server[1118]: 2026/09/20 08:17:22 INFO Received uploads request method=POST path=/api/pending_closures4304worker1 # [ 57.074534] nix-grpc-daemon[859]: time=2026-09-20T08:17:22.599Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4305worker1 # [ 57.076516] nix-grpc-daemon[859]: time=2026-09-20T08:17:22.600Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4306client # [ 57.166496] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4307client # Running as unit: dedup2.service; invocation ID: 3c225a0b8528430eb9253e85bb9a78a04308lb # [ 57.101427] niks3-server[1118]: 2026/09/20 08:17:22 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4309lb # [ 57.118708] niks3-server[1118]: 2026/09/20 08:17:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4310client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.14 seconds)4311worker1 # [ 57.130160] nix-grpc-daemon[859]: time=2026-09-20T08:17:22.657Z level=INFO msg="Uploading 1 narinfos"4312lb # [ 57.129621] niks3-server[1118]: 2026/09/20 08:17:22 INFO Signed narinfos id=7 count=14313lb # [ 57.142102] niks3-server[1118]: 2026/09/20 08:17:22 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4314lb # [ 57.152952] niks3-server[1118]: 2026/09/20 08:17:22 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4315worker1 # [ 57.166817] nix-grpc-daemon[859]: time=2026-09-20T08:17:22.694Z level=INFO msg="Upload complete. (543ms)"4316lb # [ 57.162820] niks3-server[1118]: 2026/09/20 08:17:22 INFO Completed upload id=74317worker1 # [ 57.172140] nix-grpc-daemon[773]: ts=2026-09-20T08:17:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50512 duration_s=0 paths=1 nar_bytes_in=4324318lb # [ 57.167116] niks3-server[1118]: 2026/09/20 08:17:22 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4319worker1 # [ 57.177777] nix-grpc-daemon[773]: ts=2026-09-20T08:17:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:505124320worker1 # [ 57.187733] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4321worker1 # [ 57.192508] nix-daemon[836]: reaped child process 857, status = succeeded4322client # [ 57.288098] nix[864]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4323worker1 # [ 57.211939] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4324worker1 # [ 57.501871] nix-grpc-daemon[773]: ts=2026-09-20T08:17:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:505124325client # [ 57.600725] nix[880]: this derivation will be built:4326worker1 # [ 57.522844] nix-grpc-daemon[773]: ts=2026-09-20T08:17:23Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:505124327client # [ 57.613392] nix[880]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4328worker2 # [ 57.545570] nix-grpc-daemon[776]: ts=2026-09-20T08:17:23Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04329worker1 # [ 57.556323] nix-grpc-daemon[773]: ts=2026-09-20T08:17:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:505124330client # [ 57.639763] nix[880]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4331client: must succeed: sleep 24332client: (finished: must succeed: sleep 2, in 2.07 seconds)4333??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4334 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394335client: waiting for success: ! systemctl is-active dedup1 dedup24336??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4337 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394338worker1 # [ 60.861370] nix-daemon[836]: reaped child process 888, status = succeeded4339worker1 # [ 61.041940] nix-daemon[836]: accepted connection from pid 913, user nix-grpc-daemon (trusted)4340worker1 # [ 61.063176] nix-daemon[836]: reaped child process 916, status = succeeded4341lb # [ 61.073751] niks3-server[1118]: 2026/09/20 08:17:26 INFO Received uploads request method=POST path=/api/pending_closures4342worker1 # [ 61.089721] nix-grpc-daemon[859]: time=2026-09-20T08:17:26.616Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4343worker1 # [ 61.092169] nix-grpc-daemon[859]: time=2026-09-20T08:17:26.619Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4344lb # [ 61.119004] niks3-server[1118]: 2026/09/20 08:17:26 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4345lb # [ 61.135046] niks3-server[1118]: 2026/09/20 08:17:26 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4346lb # [ 61.151616] niks3-server[1118]: 2026/09/20 08:17:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4347worker1 # [ 61.163105] nix-grpc-daemon[859]: time=2026-09-20T08:17:26.689Z level=INFO msg="Uploading 1 narinfos"4348lb # [ 61.159921] niks3-server[1118]: 2026/09/20 08:17:26 INFO Signed narinfos id=8 count=14349lb # [ 61.165665] niks3-server[1118]: 2026/09/20 08:17:26 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4350lb # [ 61.179084] niks3-server[1118]: 2026/09/20 08:17:26 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4351lb # [ 61.187915] niks3-server[1118]: 2026/09/20 08:17:26 INFO Completed upload id=84352worker1 # [ 61.190778] nix-grpc-daemon[859]: time=2026-09-20T08:17:26.718Z level=INFO msg="Upload complete. (362ms)"4353lb # [ 61.190836] niks3-server[1118]: 2026/09/20 08:17:26 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4354worker1 # [ 61.205328] nix-grpc-daemon[773]: ts=2026-09-20T08:17:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50512 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=4 outputs=14355worker1 # [ 61.221597] nix-grpc-daemon[773]: ts=2026-09-20T08:17:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50512 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=4 outputs=14356worker1 # [ 61.227510] nix-daemon[836]: reaped child process 886, status = succeeded4357client # [ 61.340759] systemd[1]: dedup2.service: Deactivated successfully.4358client # [ 61.349027] systemd[1]: dedup2.service: Consumed 232ms CPU time over 4.179s wall clock time, 33M memory peak, 7.6K incoming IP traffic, 6.6K outgoing IP traffic.4359client # [ 61.388415] systemd[1]: dedup1.service: Deactivated successfully.4360client # [ 61.390815] systemd[1]: dedup1.service: Consumed 167ms CPU time over 5.342s wall clock time, 39.2M memory peak, 8.5K incoming IP traffic, 9.1K outgoing IP traffic.4361client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.15 seconds)4362client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4363client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds)4364worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4365worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds)4366worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4367worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds)4368worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4369worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.10 seconds)4370worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4371worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.09 seconds)4372(finished: subtest: two clients wanting the same drv build it once, in 6.40 seconds)4373subtest: build hook: nix-daemon with builders = grpc://lb4374client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag hook 2>/tmp/hook.log4375client # [ 62.620441] systemd[1]: Started Nix Daemon.4376lb # [ 62.597306] envoy[914]: conn peer=[2001:db8:1::1]:39404 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9367 tx=3782 ms=64224377lb # [ 62.602706] envoy[914]: conn peer=[2001:db8:1::1]:54914 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1162 tx=481 ms=854378lb # [ 62.607784] envoy[914]: conn peer=[2001:db8:1::1]:54928 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1592 tx=1374 ms=37324379lb # [ 62.612931] envoy[914]: conn peer=[2001:db8:1::1]:54924 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2979 tx=1372 ms=50464380client # [ 62.828725] nix-daemon[921]: accepted connection from pid 918, user root (trusted)4381worker1 # [ 62.972698] nix-grpc-daemon[773]: ts=2026-09-20T08:17:28Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:505124382worker2 # [ 62.978369] nix-grpc-daemon[776]: ts=2026-09-20T08:17:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:441144383worker2 # [ 62.999878] nix-grpc-daemon[776]: ts=2026-09-20T08:17:28Z level=debug event=want client=5 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04384worker2 # [ 63.007508] nix-grpc-daemon[776]: ts=2026-09-20T08:17:28Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.4:50051 clients=14385worker2 # [ 63.017655] nix-grpc-daemon[776]: ts=2026-09-20T08:17:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:441144386worker2 # [ 63.029555] nix-grpc-daemon[776]: ts=2026-09-20T08:17:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:441144387worker2 # [ 63.046322] nix-grpc-daemon[776]: ts=2026-09-20T08:17:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:441144388worker2 # [ 63.066869] nix-daemon[844]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4389worker2 # [ 63.278960] nix-daemon[844]: accepted connection from pid 1028, user nix-grpc-daemon (trusted)4390worker2 # [ 63.303903] nix-daemon[844]: reaped child process 1031, status = succeeded4391worker2 # [ 63.505559] nix-daemon[844]: accepted connection from pid 1033, user nix-grpc-daemon (trusted)4392worker2 # [ 63.530700] nix-daemon[844]: reaped child process 1036, status = succeeded4393lb # [ 63.538891] niks3-server[1118]: 2026/09/20 08:17:29 INFO Received uploads request method=POST path=/api/pending_closures4394worker2 # [ 63.555217] nix-grpc-daemon[856]: time=2026-09-20T08:17:29.098Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4395worker2 # [ 63.556944] nix-grpc-daemon[856]: time=2026-09-20T08:17:29.098Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4396lb # [ 63.574450] niks3-server[1118]: 2026/09/20 08:17:29 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4397lb # [ 63.592565] niks3-server[1118]: 2026/09/20 08:17:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4398worker2 # [ 63.602575] nix-grpc-daemon[856]: time=2026-09-20T08:17:29.146Z level=INFO msg="Uploading 1 narinfos"4399lb # [ 63.605502] niks3-server[1118]: 2026/09/20 08:17:29 INFO Signed narinfos id=9 count=14400lb # [ 63.611303] niks3-server[1118]: 2026/09/20 08:17:29 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4401lb # [ 63.625455] niks3-server[1118]: 2026/09/20 08:17:29 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4402lb # [ 63.630563] niks3-server[1118]: 2026/09/20 08:17:29 INFO Completed upload id=94403worker2 # [ 63.633524] nix-grpc-daemon[856]: time=2026-09-20T08:17:29.177Z level=INFO msg="Upload complete. (548ms)"4404lb # [ 63.633348] niks3-server[1118]: 2026/09/20 08:17:29 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4405worker2 # [ 63.645583] nix-grpc-daemon[776]: ts=2026-09-20T08:17:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44114 duration_s=0 paths=1 nar_bytes_in=5124406worker2 # [ 63.657213] nix-grpc-daemon[776]: ts=2026-09-20T08:17:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:441144407worker2 # [ 63.669062] nix-daemon[844]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4408worker2 # [ 63.675538] nix-daemon[844]: reaped child process 1026, status = succeeded4409worker2 # [ 63.688661] nix-daemon[844]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4410worker2 # [ 64.731178] nix-daemon[844]: reaped child process 1040, status = succeeded4411worker2 # [ 64.909583] nix-daemon[844]: accepted connection from pid 1055, user nix-grpc-daemon (trusted)4412worker2 # [ 64.930471] nix-daemon[844]: reaped child process 1058, status = succeeded4413lb # [ 64.942091] niks3-server[1118]: 2026/09/20 08:17:30 INFO Received uploads request method=POST path=/api/pending_closures4414worker2 # [ 64.958348] nix-grpc-daemon[856]: time=2026-09-20T08:17:30.502Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4415worker2 # [ 64.963651] nix-grpc-daemon[856]: time=2026-09-20T08:17:30.504Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4416lb # [ 64.990069] niks3-server[1118]: 2026/09/20 08:17:30 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4417lb # [ 65.009040] niks3-server[1118]: 2026/09/20 08:17:30 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4418lb # [ 65.027414] niks3-server[1118]: 2026/09/20 08:17:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4419worker2 # [ 65.037889] nix-grpc-daemon[856]: time=2026-09-20T08:17:30.580Z level=INFO msg="Uploading 1 narinfos"4420lb # [ 65.040223] niks3-server[1118]: 2026/09/20 08:17:30 INFO Signed narinfos id=10 count=14421lb # [ 65.042835] niks3-server[1118]: 2026/09/20 08:17:30 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4422lb # [ 65.055917] niks3-server[1118]: 2026/09/20 08:17:30 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4423lb # [ 65.063969] niks3-server[1118]: 2026/09/20 08:17:30 INFO Completed upload id=104424worker2 # [ 65.065597] nix-grpc-daemon[856]: time=2026-09-20T08:17:30.609Z level=INFO msg="Upload complete. (361ms)"4425lb # [ 65.066936] niks3-server[1118]: 2026/09/20 08:17:30 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4426worker2 # [ 65.080935] nix-grpc-daemon[776]: ts=2026-09-20T08:17:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44114 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=5 outputs=14427worker1 # [ 65.085506] nix-grpc-daemon[773]: ts=2026-09-20T08:17:30Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:505124428worker2 # [ 65.100668] nix-daemon[844]: reaped child process 1038, status = succeeded4429worker1 # [ 65.104217] nix-grpc-daemon[773]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4430worker1 # [ 65.158976] nix-grpc-daemon[773]: ts=2026-09-20T08:17:30Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:505124431worker1 # [ 65.166178] nix-grpc-daemon[773]: ts=2026-09-20T08:17:30Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:50512 duration_s=0 paths=1 nar_bytes_out=1284432worker2 # [ 65.485583] nix-grpc-daemon[776]: ts=2026-09-20T08:17:31Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:441144433worker2 # [ 65.495962] nix-grpc-daemon[776]: ts=2026-09-20T08:17:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:441144434worker2 # [ 65.506616] nix-grpc-daemon[856]: time=2026-09-20T08:17:31.050Z level=INFO msg="All 1 paths already cached"4435worker2 # [ 65.526745] nix-grpc-daemon[776]: ts=2026-09-20T08:17:31Z level=debug event=want client=6 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04436worker2 # [ 65.536693] nix-grpc-daemon[776]: ts=2026-09-20T08:17:31Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.4:50051 clients=14437worker2 # [ 65.545881] nix-grpc-daemon[776]: ts=2026-09-20T08:17:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:441144438worker2 # [ 65.554690] nix-grpc-daemon[776]: ts=2026-09-20T08:17:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:441144439worker2 # [ 65.565730] nix-grpc-daemon[856]: time=2026-09-20T08:17:31.109Z level=INFO msg="All 1 paths already cached"4440worker2 # [ 65.576143] nix-grpc-daemon[776]: ts=2026-09-20T08:17:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:441144441worker2 # [ 65.595546] nix-daemon[844]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4442worker2 # [ 65.818035] nix-daemon[844]: accepted connection from pid 1064, user nix-grpc-daemon (trusted)4443worker2 # [ 65.840990] nix-daemon[844]: reaped child process 1067, status = succeeded4444worker2 # [ 66.023298] nix-daemon[844]: accepted connection from pid 1069, user nix-grpc-daemon (trusted)4445worker2 # [ 66.042302] nix-daemon[844]: reaped child process 1072, status = succeeded4446lb # [ 66.051791] niks3-server[1118]: 2026/09/20 08:17:31 INFO Received uploads request method=POST path=/api/pending_closures4447worker2 # [ 66.065776] nix-grpc-daemon[856]: time=2026-09-20T08:17:31.609Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4448worker2 # [ 66.067300] nix-grpc-daemon[856]: time=2026-09-20T08:17:31.609Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4449lb # [ 66.081011] niks3-server[1118]: 2026/09/20 08:17:31 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4450worker2 # [ 66.108684] nix-grpc-daemon[856]: time=2026-09-20T08:17:31.652Z level=INFO msg="Uploading 1 narinfos"4451lb # [ 66.099156] niks3-server[1118]: 2026/09/20 08:17:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4452lb # [ 66.115278] niks3-server[1118]: 2026/09/20 08:17:31 INFO Signed narinfos id=11 count=14453lb # [ 66.119125] niks3-server[1118]: 2026/09/20 08:17:31 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4454lb # [ 66.130833] niks3-server[1118]: 2026/09/20 08:17:31 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4455lb # [ 66.138757] niks3-server[1118]: 2026/09/20 08:17:31 INFO Completed upload id=114456worker2 # [ 66.142115] nix-grpc-daemon[856]: time=2026-09-20T08:17:31.686Z level=INFO msg="Upload complete. (528ms)"4457lb # [ 66.141938] niks3-server[1118]: 2026/09/20 08:17:31 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4458worker2 # [ 66.154340] nix-grpc-daemon[776]: ts=2026-09-20T08:17:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44114 duration_s=0 paths=1 nar_bytes_in=6244459worker2 # [ 66.170301] nix-grpc-daemon[776]: ts=2026-09-20T08:17:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:441144460worker2 # [ 66.177986] nix-daemon[844]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4461worker2 # [ 66.183620] nix-daemon[844]: reaped child process 1062, status = succeeded4462worker2 # [ 66.200608] nix-daemon[844]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4463worker2 # [ 67.849732] nix-daemon[844]: reaped child process 1076, status = succeeded4464worker2 # [ 68.036365] nix-daemon[844]: accepted connection from pid 1091, user nix-grpc-daemon (trusted)4465worker2 # [ 68.057015] nix-daemon[844]: reaped child process 1094, status = succeeded4466lb # [ 68.066104] niks3-server[1118]: 2026/09/20 08:17:33 INFO Received uploads request method=POST path=/api/pending_closures4467worker2 # [ 68.079722] nix-grpc-daemon[856]: time=2026-09-20T08:17:33.623Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4468worker2 # [ 68.087052] nix-grpc-daemon[856]: time=2026-09-20T08:17:33.625Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4469lb # [ 68.114904] niks3-server[1118]: 2026/09/20 08:17:33 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4470lb # [ 68.126848] niks3-server[1118]: 2026/09/20 08:17:33 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4471worker2 # [ 68.137623] nix-grpc-daemon[856]: time=2026-09-20T08:17:33.681Z level=INFO msg="Uploading 1 narinfos"4472lb # [ 68.137281] niks3-server[1118]: 2026/09/20 08:17:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4473lb # [ 68.145612] niks3-server[1118]: 2026/09/20 08:17:33 INFO Signed narinfos id=12 count=14474lb # [ 68.150812] niks3-server[1118]: 2026/09/20 08:17:33 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4475lb # [ 68.159808] niks3-server[1118]: 2026/09/20 08:17:33 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4476lb # [ 68.166816] niks3-server[1118]: 2026/09/20 08:17:33 INFO Completed upload id=124477lb # [ 68.169346] niks3-server[1118]: 2026/09/20 08:17:33 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4478worker2 # [ 68.169444] nix-grpc-daemon[856]: time=2026-09-20T08:17:33.713Z level=INFO msg="Upload complete. (355ms)"4479worker1 # [ 68.187896] nix-grpc-daemon[773]: ts=2026-09-20T08:17:33Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:505124480worker2 # [ 68.185467] nix-grpc-daemon[776]: ts=2026-09-20T08:17:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44114 duration_s=2 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=6 outputs=14481worker2 # [ 68.201823] nix-daemon[844]: reaped child process 1074, status = succeeded4482worker1 # [ 68.201266] nix-grpc-daemon[773]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4483worker2 # [ 68.245969] nix-grpc-daemon[776]: ts=2026-09-20T08:17:33Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:441144484worker2 # [ 68.252883] nix-grpc-daemon[776]: ts=2026-09-20T08:17:33Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:44114 duration_s=0 paths=1 nar_bytes_out=1764485worker1 # [ 68.571794] nix-grpc-daemon[773]: ts=2026-09-20T08:17:34Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:505124486worker2 # [ 68.575152] nix-grpc-daemon[776]: ts=2026-09-20T08:17:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:441144487worker2 # [ 68.585608] nix-grpc-daemon[856]: time=2026-09-20T08:17:34.129Z level=INFO msg="All 2 paths already cached"4488worker2 # [ 68.605433] nix-grpc-daemon[776]: ts=2026-09-20T08:17:34Z level=debug event=want client=7 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04489worker2 # [ 68.612771] nix-grpc-daemon[776]: ts=2026-09-20T08:17:34Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.4:50051 clients=14490worker2 # [ 68.652242] nix-grpc-daemon[776]: ts=2026-09-20T08:17:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:441144491worker2 # [ 68.668593] nix-grpc-daemon[776]: ts=2026-09-20T08:17:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:441144492worker2 # [ 68.683306] nix-grpc-daemon[856]: time=2026-09-20T08:17:34.227Z level=INFO msg="All 2 paths already cached"4493worker2 # [ 68.689945] nix-grpc-daemon[776]: ts=2026-09-20T08:17:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:441144494worker2 # [ 68.704900] nix-daemon[844]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4495worker2 # [ 68.912573] nix-daemon[844]: accepted connection from pid 1100, user nix-grpc-daemon (trusted)4496worker2 # [ 68.932341] nix-daemon[844]: reaped child process 1103, status = succeeded4497worker2 # [ 69.105549] nix-daemon[844]: accepted connection from pid 1105, user nix-grpc-daemon (trusted)4498worker2 # [ 69.124475] nix-daemon[844]: reaped child process 1108, status = succeeded4499lb # [ 69.134415] niks3-server[1118]: 2026/09/20 08:17:34 INFO Received uploads request method=POST path=/api/pending_closures4500worker2 # [ 69.148428] nix-grpc-daemon[856]: time=2026-09-20T08:17:34.691Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4501worker2 # [ 69.149912] nix-grpc-daemon[856]: time=2026-09-20T08:17:34.691Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4502lb # [ 69.162585] niks3-server[1118]: 2026/09/20 08:17:34 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4503lb # [ 69.176280] niks3-server[1118]: 2026/09/20 08:17:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4504worker2 # [ 69.186501] nix-grpc-daemon[856]: time=2026-09-20T08:17:34.730Z level=INFO msg="Uploading 1 narinfos"4505lb # [ 69.187630] niks3-server[1118]: 2026/09/20 08:17:34 INFO Signed narinfos id=13 count=14506lb # [ 69.195524] niks3-server[1118]: 2026/09/20 08:17:34 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4507lb # [ 69.204401] niks3-server[1118]: 2026/09/20 08:17:34 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4508lb # [ 69.211218] niks3-server[1118]: 2026/09/20 08:17:34 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4509lb # [ 69.216567] niks3-server[1118]: 2026/09/20 08:17:34 INFO Completed upload id=134510worker2 # [ 69.219957] nix-grpc-daemon[856]: time=2026-09-20T08:17:34.763Z level=INFO msg="Upload complete. (497ms)"4511worker2 # [ 69.230003] nix-grpc-daemon[776]: ts=2026-09-20T08:17:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44114 duration_s=0 paths=1 nar_bytes_in=7524512worker2 # [ 69.244466] nix-grpc-daemon[776]: ts=2026-09-20T08:17:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:441144513worker2 # [ 69.250443] nix-daemon[844]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4514worker2 # [ 69.255075] nix-daemon[844]: reaped child process 1098, status = succeeded4515worker2 # [ 69.266795] nix-daemon[844]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4516worker2 # [ 70.692983] nix-daemon[844]: reaped child process 1112, status = succeeded4517worker2 # [ 70.859140] nix-daemon[844]: accepted connection from pid 1127, user nix-grpc-daemon (trusted)4518worker2 # [ 70.880138] nix-daemon[844]: reaped child process 1130, status = succeeded4519lb # [ 70.888740] niks3-server[1118]: 2026/09/20 08:17:36 INFO Received uploads request method=POST path=/api/pending_closures4520worker2 # [ 70.902728] nix-grpc-daemon[856]: time=2026-09-20T08:17:36.445Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4521worker2 # [ 70.904326] nix-grpc-daemon[856]: time=2026-09-20T08:17:36.445Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4522lb # [ 70.925795] niks3-server[1118]: 2026/09/20 08:17:36 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4523lb # [ 70.938227] niks3-server[1118]: 2026/09/20 08:17:36 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4524worker2 # [ 70.952323] nix-grpc-daemon[856]: time=2026-09-20T08:17:36.496Z level=INFO msg="Uploading 1 narinfos"4525lb # [ 70.948905] niks3-server[1118]: 2026/09/20 08:17:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4526lb # [ 70.956213] niks3-server[1118]: 2026/09/20 08:17:36 INFO Signed narinfos id=14 count=14527lb # [ 70.961943] niks3-server[1118]: 2026/09/20 08:17:36 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4528lb # [ 70.969907] niks3-server[1118]: 2026/09/20 08:17:36 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4529lb # [ 70.976678] niks3-server[1118]: 2026/09/20 08:17:36 INFO Completed upload id=144530worker2 # [ 70.980050] nix-grpc-daemon[856]: time=2026-09-20T08:17:36.524Z level=INFO msg="Upload complete. (300ms)"4531lb # [ 70.979489] niks3-server[1118]: 2026/09/20 08:17:36 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4532worker2 # [ 70.992980] nix-grpc-daemon[776]: ts=2026-09-20T08:17:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44114 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=7 outputs=14533worker2 # [ 71.008897] nix-grpc-daemon[776]: ts=2026-09-20T08:17:36Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:441144534worker2 # [ 71.015133] nix-daemon[844]: reaped child process 1110, status = succeeded4535worker1 # [ 71.022896] nix-grpc-daemon[773]: ts=2026-09-20T08:17:36Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:505124536worker1 # [ 71.036939] nix-grpc-daemon[773]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...4537worker1 # [ 71.055137] nix-grpc-daemon[773]: ts=2026-09-20T08:17:36Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:50512 duration_s=0 paths=1 nar_bytes_out=2324538client # [ 71.276692] nix-daemon[921]: reaped child process 923, status = succeeded4539client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.93 seconds)4540client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4541client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds)4542client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4543client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds)4544client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4545client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4546(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 9.05 seconds)4547subtest: an input only one worker has still reaches the builder4548client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4549client # this derivation will be built:4550client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4551client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4552client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.46 seconds)4553client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4554client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.21 seconds)4555worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4556worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.26 seconds)4557worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4558worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds)4559client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24560client # [ 72.604834] nix-daemon[921]: accepted connection from pid 1004, user root (trusted)4561client # this derivation will be built:4562client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4563lb # [ 72.592135] envoy[914]: conn peer=[2001:db8:1::1]:35334 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=333 ms=734564lb # [ 72.592572] envoy[914]: conn peer=[2001:db8:1::1]:35318 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3427 tx=1777 ms=22564565lb # [ 72.592686] envoy[914]: conn peer=[2001:db8:1::1]:35346 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3888 tx=1991 ms=28274566lb # [ 72.592786] envoy[914]: conn peer=[2001:db8:1::1]:35362 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=375 ms=744567lb # [ 72.592883] envoy[914]: conn peer=[2001:db8:1::1]:60006 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=407 ms=974568lb # [ 72.593008] envoy[914]: conn peer=[2001:db8:1::1]:35378 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4313 tx=2107 ms=25444569worker1 # [ 72.730653] nix-grpc-daemon[773]: ts=2026-09-20T08:17:38Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:505124570client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4571worker2 # [ 72.734295] nix-grpc-daemon[776]: ts=2026-09-20T08:17:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:441144572client # copying 1 paths...4573client # copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' to 'grpc://lb:50051'...4574worker1 # [ 72.753043] nix-grpc-daemon[773]: ts=2026-09-20T08:17:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:505124575worker1 # [ 72.768673] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4576worker1 # [ 72.978534] nix-daemon[836]: accepted connection from pid 939, user nix-grpc-daemon (trusted)4577worker1 # [ 73.000106] nix-daemon[836]: reaped child process 942, status = succeeded4578lb # [ 73.010006] niks3-server[1118]: 2026/09/20 08:17:38 INFO Received uploads request method=POST path=/api/pending_closures4579worker1 # [ 73.022704] nix-grpc-daemon[859]: time=2026-09-20T08:17:38.549Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4580worker1 # [ 73.024326] nix-grpc-daemon[859]: time=2026-09-20T08:17:38.549Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4581lb # [ 73.039032] niks3-server[1118]: 2026/09/20 08:17:38 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4582worker1 # [ 73.056225] nix-grpc-daemon[859]: time=2026-09-20T08:17:38.582Z level=INFO msg="Uploading 1 narinfos"4583lb # [ 73.054436] niks3-server[1118]: 2026/09/20 08:17:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4584lb # [ 73.065892] niks3-server[1118]: 2026/09/20 08:17:38 INFO Signed narinfos id=15 count=14585lb # [ 73.072135] niks3-server[1118]: 2026/09/20 08:17:38 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4586lb # [ 73.281381] niks3-server[1118]: 2026/09/20 08:17:38 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4587lb # [ 73.310998] niks3-server[1118]: 2026/09/20 08:17:38 INFO Completed upload id=154588worker1 # [ 73.316085] nix-grpc-daemon[859]: time=2026-09-20T08:17:38.843Z level=INFO msg="Upload complete. (532ms)"4589lb # [ 73.321863] niks3-server[1118]: 2026/09/20 08:17:38 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4590worker1 # [ 73.326901] nix-grpc-daemon[773]: ts=2026-09-20T08:17:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50512 duration_s=0 paths=1 nar_bytes_in=1204591worker2 # [ 73.342058] nix-grpc-daemon[776]: ts=2026-09-20T08:17:38Z level=debug event=want client=8 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04592worker1 # [ 73.347919] nix-daemon[836]: reaped child process 937, status = succeeded4593worker2 # [ 73.348792] nix-grpc-daemon[776]: ts=2026-09-20T08:17:38Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=14594worker1 # [ 73.389613] nix-grpc-daemon[773]: ts=2026-09-20T08:17:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:505124595worker1 # [ 73.406085] nix-grpc-daemon[773]: ts=2026-09-20T08:17:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:505124596client # copying 2 paths to 'lb:50051'...4597client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4598worker1 # [ 73.427435] nix-grpc-daemon[773]: ts=2026-09-20T08:17:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:505124599client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4600worker1 # [ 73.442155] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4601worker1 # [ 73.652699] nix-daemon[836]: accepted connection from pid 946, user nix-grpc-daemon (trusted)4602worker1 # [ 73.673187] nix-daemon[836]: reaped child process 949, status = succeeded4603worker1 # [ 73.850076] nix-daemon[836]: accepted connection from pid 951, user nix-grpc-daemon (trusted)4604worker1 # [ 73.868487] nix-daemon[836]: reaped child process 954, status = succeeded4605lb # [ 73.874256] niks3-server[1118]: 2026/09/20 08:17:39 INFO Received uploads request method=POST path=/api/pending_closures4606lb # [ 73.889051] niks3-server[1118]: 2026/09/20 08:17:39 INFO Received uploads request method=POST path=/api/pending_closures4607worker1 # [ 73.904412] nix-grpc-daemon[859]: time=2026-09-20T08:17:39.431Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4608worker1 # [ 73.906982] nix-grpc-daemon[859]: time=2026-09-20T08:17:39.433Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4609worker1 # [ 73.909024] nix-grpc-daemon[859]: time=2026-09-20T08:17:39.433Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4610lb # [ 73.933810] niks3-server[1118]: 2026/09/20 08:17:39 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4611lb # [ 73.945422] niks3-server[1118]: 2026/09/20 08:17:39 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4612lb # [ 73.957386] niks3-server[1118]: 2026/09/20 08:17:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4613worker1 # [ 73.966479] nix-grpc-daemon[859]: time=2026-09-20T08:17:39.492Z level=INFO msg="Uploading 3 narinfos"4614lb # [ 73.966338] niks3-server[1118]: 2026/09/20 08:17:39 INFO Signed narinfos id=16 count=14615lb # [ 73.970868] niks3-server[1118]: 2026/09/20 08:17:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4616lb # [ 73.977301] niks3-server[1118]: 2026/09/20 08:17:39 INFO Signed narinfos id=17 count=24617lb # [ 73.979095] niks3-server[1118]: 2026/09/20 08:17:39 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4618lb # [ 73.987603] niks3-server[1118]: 2026/09/20 08:17:39 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4619lb # [ 73.994610] niks3-server[1118]: 2026/09/20 08:17:39 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4620lb # [ 74.003131] niks3-server[1118]: 2026/09/20 08:17:39 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4621lb # [ 74.008153] niks3-server[1118]: 2026/09/20 08:17:39 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4622lb # [ 74.011792] niks3-server[1118]: 2026/09/20 08:17:39 INFO Completed upload id=164623lb # [ 74.014979] niks3-server[1118]: 2026/09/20 08:17:39 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4624lb # [ 74.017699] niks3-server[1118]: 2026/09/20 08:17:39 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4625lb # [ 74.020773] niks3-server[1118]: 2026/09/20 08:17:39 INFO Completed upload id=174626worker1 # [ 74.026314] nix-grpc-daemon[859]: time=2026-09-20T08:17:39.552Z level=INFO msg="Upload complete. (563ms)"4627worker1 # [ 74.038775] nix-grpc-daemon[773]: ts=2026-09-20T08:17:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50512 duration_s=0 paths=2 nar_bytes_in=9844628worker1 # [ 74.056537] nix-grpc-daemon[773]: ts=2026-09-20T08:17:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:505124629worker1 # [ 74.067398] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4630worker1 # [ 74.076259] nix-daemon[836]: reaped child process 944, status = succeeded4631client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4632client # uses-input-w1onlya> node-a: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4633worker1 # [ 74.087873] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4634worker1 # [ 75.334941] nix-daemon[836]: reaped child process 958, status = succeeded4635worker1 # [ 75.504762] nix-daemon[836]: accepted connection from pid 973, user nix-grpc-daemon (trusted)4636worker1 # [ 75.525760] nix-daemon[836]: reaped child process 976, status = succeeded4637lb # [ 75.533089] niks3-server[1118]: 2026/09/20 08:17:41 INFO Received uploads request method=POST path=/api/pending_closures4638worker1 # [ 75.548763] nix-grpc-daemon[859]: time=2026-09-20T08:17:41.074Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4639lb # [ 75.564450] niks3-server[1118]: 2026/09/20 08:17:41 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4640worker1 # [ 75.582371] nix-grpc-daemon[859]: time=2026-09-20T08:17:41.109Z level=INFO msg="Uploading 1 narinfos"4641lb # [ 75.577782] niks3-server[1118]: 2026/09/20 08:17:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4642lb # [ 75.589412] niks3-server[1118]: 2026/09/20 08:17:41 INFO Signed narinfos id=18 count=14643lb # [ 75.596165] niks3-server[1118]: 2026/09/20 08:17:41 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4644lb # [ 75.608736] niks3-server[1118]: 2026/09/20 08:17:41 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4645lb # [ 75.614934] niks3-server[1118]: 2026/09/20 08:17:41 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4646lb # [ 75.619081] niks3-server[1118]: 2026/09/20 08:17:41 INFO Completed upload id=184647worker1 # [ 75.623832] nix-grpc-daemon[859]: time=2026-09-20T08:17:41.151Z level=INFO msg="Upload complete. (322ms)"4648worker1 # [ 75.637303] nix-grpc-daemon[773]: ts=2026-09-20T08:17:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50512 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=8 outputs=14649worker1 # [ 75.654617] nix-daemon[836]: reaped child process 956, status = succeeded4650client # copying 1 paths...4651worker1 # [ 75.682221] nix-grpc-daemon[773]: ts=2026-09-20T08:17:41Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:505124652client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4653worker1 # [ 75.712001] nix-grpc-daemon[773]: ts=2026-09-20T08:17:41Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:505124654worker1 # [ 75.717247] nix-grpc-daemon[773]: ts=2026-09-20T08:17:41Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:50512 duration_s=0 paths=1 nar_bytes_out=1204655client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.54 seconds)4656client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24657client # [ 76.007010] nix-daemon[921]: reaped child process 1007, status = succeeded4658client # [ 76.144750] nix-daemon[921]: accepted connection from pid 1026, user root (trusted)4659client # this derivation will be built:4660client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4661worker1 # [ 76.259903] nix-grpc-daemon[773]: ts=2026-09-20T08:17:41Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:505124662client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4663worker2 # [ 76.264833] nix-grpc-daemon[776]: ts=2026-09-20T08:17:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:441144664worker2 # [ 76.293558] nix-grpc-daemon[776]: ts=2026-09-20T08:17:41Z level=debug event=want client=9 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04665worker2 # [ 76.301411] nix-grpc-daemon[776]: ts=2026-09-20T08:17:41Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=14666worker2 # [ 76.310978] nix-grpc-daemon[776]: ts=2026-09-20T08:17:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:441144667worker2 # [ 76.322383] nix-grpc-daemon[776]: ts=2026-09-20T08:17:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:441144668client # copying 1 paths to 'lb:50051'...4669client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4670worker2 # [ 76.345367] nix-grpc-daemon[776]: ts=2026-09-20T08:17:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:441144671worker2 # [ 76.361199] nix-daemon[844]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4672worker2 # [ 76.382262] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 47 ms (attempt 1/5)4673worker2 # [ 76.435513] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 6 ms (attempt 2/5)4674worker2 # [ 76.449108] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 307 ms (attempt 3/5)4675worker2 # [ 76.763749] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 12 ms (attempt 4/5)4676worker2 # [ 76.777325] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4677worker2 # [ 76.786213] nix-grpc-daemon[776]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4678worker2 # [ 77.014495] nix-daemon[844]: accepted connection from pid 1145, user nix-grpc-daemon (trusted)4679worker2 # [ 77.033483] nix-daemon[844]: reaped child process 1148, status = succeeded4680worker2 # [ 77.209657] nix-daemon[844]: accepted connection from pid 1150, user nix-grpc-daemon (trusted)4681worker2 # [ 77.227572] nix-daemon[844]: reaped child process 1153, status = succeeded4682lb # [ 77.236774] niks3-server[1118]: 2026/09/20 08:17:42 INFO Received uploads request method=POST path=/api/pending_closures4683worker2 # [ 77.257905] nix-grpc-daemon[856]: time=2026-09-20T08:17:42.801Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4684worker2 # [ 77.259413] nix-grpc-daemon[856]: time=2026-09-20T08:17:42.801Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4685lb # [ 77.275339] niks3-server[1118]: 2026/09/20 08:17:42 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4686lb # [ 77.287812] niks3-server[1118]: 2026/09/20 08:17:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4687worker2 # [ 77.299119] nix-grpc-daemon[856]: time=2026-09-20T08:17:42.842Z level=INFO msg="Uploading 1 narinfos"4688lb # [ 77.295989] niks3-server[1118]: 2026/09/20 08:17:42 INFO Signed narinfos id=19 count=14689lb # [ 77.302537] niks3-server[1118]: 2026/09/20 08:17:42 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4690lb # [ 77.311381] niks3-server[1118]: 2026/09/20 08:17:42 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4691lb # [ 77.318867] niks3-server[1118]: 2026/09/20 08:17:42 INFO Completed upload id=194692worker2 # [ 77.321393] nix-grpc-daemon[856]: time=2026-09-20T08:17:42.865Z level=INFO msg="Upload complete. (508ms)"4693lb # [ 77.321361] niks3-server[1118]: 2026/09/20 08:17:42 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4694worker2 # [ 77.333252] nix-grpc-daemon[776]: ts=2026-09-20T08:17:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44114 duration_s=0 paths=1 nar_bytes_in=5684695worker2 # [ 77.341352] nix-grpc-daemon[776]: ts=2026-09-20T08:17:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:441144696worker2 # [ 77.352486] nix-daemon[844]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4697worker2 # [ 77.357460] nix-daemon[844]: reaped child process 1139, status = succeeded4698worker2 # [ 77.368775] nix-grpc-daemon[776]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...4699client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4700worker2 # [ 77.388874] nix-daemon[844]: accepted connection from pid 776, user nix-grpc-daemon (trusted)4701client # uses-input-w1onlyb> worker2: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4702worker2 # [ 78.231086] nix-daemon[844]: reaped child process 1158, status = succeeded4703worker2 # [ 78.424515] nix-daemon[844]: accepted connection from pid 1173, user nix-grpc-daemon (trusted)4704worker2 # [ 78.444828] nix-daemon[844]: reaped child process 1176, status = succeeded4705lb # [ 78.453342] niks3-server[1118]: 2026/09/20 08:17:43 INFO Received uploads request method=POST path=/api/pending_closures4706worker2 # [ 78.495818] nix-grpc-daemon[856]: time=2026-09-20T08:17:44.035Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4707lb # [ 78.508470] niks3-server[1118]: 2026/09/20 08:17:44 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4708lb # [ 78.518098] niks3-server[1118]: 2026/09/20 08:17:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4709worker2 # [ 78.528538] nix-grpc-daemon[856]: time=2026-09-20T08:17:44.072Z level=INFO msg="Uploading 1 narinfos"4710lb # [ 78.529182] niks3-server[1118]: 2026/09/20 08:17:44 INFO Signed narinfos id=20 count=14711lb # [ 78.536165] niks3-server[1118]: 2026/09/20 08:17:44 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4712lb # [ 78.548229] niks3-server[1118]: 2026/09/20 08:17:44 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4713lb # [ 78.554635] niks3-server[1118]: 2026/09/20 08:17:44 INFO Completed upload id=204714worker2 # [ 78.558004] nix-grpc-daemon[856]: time=2026-09-20T08:17:44.101Z level=INFO msg="Upload complete. (356ms)"4715lb # [ 78.558456] niks3-server[1118]: 2026/09/20 08:17:44 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4716client # copying 1 paths...4717worker2 # [ 78.571187] nix-grpc-daemon[776]: ts=2026-09-20T08:17:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44114 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=9 outputs=14718client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4719worker2 # [ 78.592498] nix-grpc-daemon[776]: ts=2026-09-20T08:17:44Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:441144720worker2 # [ 78.597901] nix-daemon[844]: reaped child process 1155, status = succeeded4721worker2 # [ 78.616081] nix-grpc-daemon[776]: ts=2026-09-20T08:17:44Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:441144722worker2 # [ 78.618162] nix-grpc-daemon[776]: ts=2026-09-20T08:17:44Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:44114 duration_s=0 paths=1 nar_bytes_out=1204723client # [ 78.843037] nix-daemon[921]: reaped child process 1029, status = succeeded4724client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 2.92 seconds)4725client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24726client # [ 79.059973] nix-daemon[921]: accepted connection from pid 1048, user root (trusted)4727client # this derivation will be built:4728client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4729worker1 # [ 79.182884] nix-grpc-daemon[773]: ts=2026-09-20T08:17:44Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:505124730client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4731worker1 # [ 79.189479] nix-grpc-daemon[773]: ts=2026-09-20T08:17:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:505124732worker1 # [ 79.202849] nix-grpc-daemon[859]: time=2026-09-20T08:17:44.729Z level=INFO msg="All 1 paths already cached"4733worker2 # [ 79.220384] nix-grpc-daemon[776]: ts=2026-09-20T08:17:44Z level=debug event=want client=10 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04734worker1 # [ 79.224503] nix-grpc-daemon[773]: ts=2026-09-20T08:17:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:505124735worker2 # [ 79.226513] nix-grpc-daemon[776]: ts=2026-09-20T08:17:44Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=14736worker1 # [ 79.240172] nix-grpc-daemon[773]: ts=2026-09-20T08:17:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:505124737worker1 # [ 79.255268] nix-grpc-daemon[859]: time=2026-09-20T08:17:44.782Z level=INFO msg="All 1 paths already cached"4738client # copying 1 paths to 'lb:50051'...4739client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4740worker1 # [ 79.265981] nix-grpc-daemon[773]: ts=2026-09-20T08:17:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:505124741worker1 # [ 79.281383] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4742worker1 # [ 79.486968] nix-daemon[836]: accepted connection from pid 980, user nix-grpc-daemon (trusted)4743worker1 # [ 79.505742] nix-daemon[836]: reaped child process 983, status = succeeded4744worker1 # [ 79.687008] nix-daemon[836]: accepted connection from pid 985, user nix-grpc-daemon (trusted)4745worker1 # [ 79.705444] nix-daemon[836]: reaped child process 988, status = succeeded4746lb # [ 79.714245] niks3-server[1118]: 2026/09/20 08:17:45 INFO Received uploads request method=POST path=/api/pending_closures4747worker1 # [ 79.730239] nix-grpc-daemon[859]: time=2026-09-20T08:17:45.257Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4748worker1 # [ 79.731720] nix-grpc-daemon[859]: time=2026-09-20T08:17:45.257Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4749lb # [ 79.751810] niks3-server[1118]: 2026/09/20 08:17:45 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4750lb # [ 79.766548] niks3-server[1118]: 2026/09/20 08:17:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4751worker1 # [ 79.776774] nix-grpc-daemon[859]: time=2026-09-20T08:17:45.304Z level=INFO msg="Uploading 1 narinfos"4752lb # [ 79.775211] niks3-server[1118]: 2026/09/20 08:17:45 INFO Signed narinfos id=21 count=14753lb # [ 79.783081] niks3-server[1118]: 2026/09/20 08:17:45 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4754lb # [ 79.796912] niks3-server[1118]: 2026/09/20 08:17:45 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4755lb # [ 79.802460] niks3-server[1118]: 2026/09/20 08:17:45 INFO Completed upload id=214756worker1 # [ 79.806932] nix-grpc-daemon[859]: time=2026-09-20T08:17:45.334Z level=INFO msg="Upload complete. (507ms)"4757lb # [ 79.809166] niks3-server[1118]: 2026/09/20 08:17:45 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4758worker1 # [ 79.816340] nix-grpc-daemon[773]: ts=2026-09-20T08:17:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50512 duration_s=0 paths=1 nar_bytes_in=5684759worker1 # [ 79.831150] nix-grpc-daemon[773]: ts=2026-09-20T08:17:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:505124760worker1 # [ 79.839629] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4761worker1 # [ 79.846065] nix-daemon[836]: reaped child process 978, status = succeeded4762client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4763worker1 # [ 79.860220] nix-daemon[836]: accepted connection from pid 773, user nix-grpc-daemon (trusted)4764client # uses-input-w1onlyc> node-a: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4765worker1 # [ 81.084637] nix-daemon[836]: reaped child process 992, status = succeeded4766worker1 # [ 81.244778] nix-daemon[836]: accepted connection from pid 1007, user nix-grpc-daemon (trusted)4767worker1 # [ 81.266004] nix-daemon[836]: reaped child process 1010, status = succeeded4768lb # [ 81.274630] niks3-server[1118]: 2026/09/20 08:17:46 INFO Received uploads request method=POST path=/api/pending_closures4769worker1 # [ 81.290613] nix-grpc-daemon[859]: time=2026-09-20T08:17:46.816Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4770lb # [ 81.306230] niks3-server[1118]: 2026/09/20 08:17:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4771worker1 # [ 81.320692] nix-grpc-daemon[859]: time=2026-09-20T08:17:46.848Z level=INFO msg="Uploading 1 narinfos"4772lb # [ 81.322785] niks3-server[1118]: 2026/09/20 08:17:46 INFO Signed narinfos id=22 count=14773lb # [ 81.329827] niks3-server[1118]: 2026/09/20 08:17:46 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4774lb # [ 81.341319] niks3-server[1118]: 2026/09/20 08:17:46 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4775lb # [ 81.345749] niks3-server[1118]: 2026/09/20 08:17:46 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4776lb # [ 81.350095] niks3-server[1118]: 2026/09/20 08:17:46 INFO Completed upload id=224777worker1 # [ 81.354173] nix-grpc-daemon[859]: time=2026-09-20T08:17:46.881Z level=INFO msg="Upload complete. (282ms)"4778worker1 # [ 81.365086] nix-grpc-daemon[773]: ts=2026-09-20T08:17:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50512 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=10 outputs=14779worker1 # [ 81.377343] nix-daemon[836]: reaped child process 990, status = succeeded4780client # copying 1 paths...4781worker1 # [ 81.410312] nix-grpc-daemon[773]: ts=2026-09-20T08:17:46Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:505124782client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4783lb # [ 81.435223] niks3-server[1118]: 2026/09/20 08:17:46 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4784worker1 # [ 81.450844] nix-grpc-daemon[773]: ts=2026-09-20T08:17:46Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:505124785worker1 # [ 81.456319] nix-grpc-daemon[773]: ts=2026-09-20T08:17:46Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:50512 duration_s=0 paths=1 nar_bytes_out=1204786client # [ 81.664690] nix-daemon[921]: reaped child process 1051, status = succeeded4787client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.82 seconds)4788(finished: subtest: an input only one worker has still reaches the builder, in 10.26 seconds)4789subtest: upload whose reference the worker lacks is completed from the cache4790client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4791client # this derivation will be built:4792client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4793client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4794client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.46 seconds)4795client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4796client # this derivation will be built:4797client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4798client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4799client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.44 seconds)4800client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4801lb # [ 82.593618] envoy[914]: conn peer=[2001:db8:1::1]:60014 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4219 tx=1769 ms=30414802lb # [ 82.598652] envoy[914]: conn peer=[2001:db8:1::1]:60030 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=654803lb # [ 82.603419] envoy[914]: conn peer=[2001:db8:1::1]:60034 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3697 tx=1807 ms=24174804lb # [ 82.608330] envoy[914]: conn peer=[2001:db8:1::1]:60036 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=654805lb # [ 82.613225] envoy[914]: conn peer=[2001:db8:1::1]:60046 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3711 tx=1803 ms=23274806lb # [ 82.618008] envoy[914]: conn peer=[2001:db8:1::1]:47654 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=684807client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.21 seconds)4808worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4809worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.25 seconds)4810worker2 # [ 83.020810] systemd[1]: Stopping Nix worker-protocol over gRPC...4811worker2 # [ 84.015503] nix-grpc-daemon[776]: ts=2026-09-20T08:17:49Z level=info event=signal_exit4812worker2 # [ 84.472141] nix-grpc-daemon[776]: ts=2026-09-20T08:17:50Z level=info event=scheduler_yield4813lb # [ 84.481814] niks3-server[1118]: 2026/09/20 08:17:50 INFO lead: released remote=192.168.1.4:483544814worker1 # [ 84.486244] nix-grpc-daemon[773]: ts=2026-09-20T08:17:50Z level=info event=scheduler_restarting addr=lb:500514815worker2 # [ 84.484767] nix-grpc-daemon[776]: ts=2026-09-20T08:17:50Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:595644816worker2 # [ 84.492324] nix-grpc-daemon[776]: ts=2026-09-20T08:17:50Z level=info event=worker_gone addr=192.168.1.3:500514817worker2 # [ 84.496880] nix-grpc-daemon[776]: ts=2026-09-20T08:17:50Z level=info event=scheduler_restarting addr=lb:500514818worker2 # [ 84.500911] nix-grpc-daemon[776]: ts=2026-09-20T08:17:50Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:595644819worker2 # [ 84.505271] nix-grpc-daemon[776]: ts=2026-09-20T08:17:50Z level=info event=worker_gone addr=192.168.1.4:500514820worker1 # [ 84.686012] nix-grpc-daemon[773]: ts=2026-09-20T08:17:50Z level=info event=scheduler_connected addr=lb:500514821worker2 # [ 84.691802] nix-grpc-daemon[776]: ts=2026-09-20T08:17:50Z level=info event=scheduler_connected addr=lb:500514822worker2 # [ 84.699199] nix-grpc-daemon[776]: ts=2026-09-20T08:17:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4823worker1 # [ 84.712089] nix-grpc-daemon[773]: ts=2026-09-20T08:17:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4824worker2 # [ 84.899992] nix-grpc-daemon[776]: ts=2026-09-20T08:17:50Z level=info event=scheduler_connected addr=lb:500514825worker2 # [ 84.907377] nix-grpc-daemon[776]: ts=2026-09-20T08:17:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4826worker1 # [ 84.913145] nix-grpc-daemon[773]: ts=2026-09-20T08:17:50Z level=info event=scheduler_connected addr=lb:500514827worker1 # [ 84.919932] nix-grpc-daemon[773]: ts=2026-09-20T08:17:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4828worker2 # [ 85.110604] nix-grpc-daemon[776]: ts=2026-09-20T08:17:50Z level=info event=scheduler_connected addr=lb:500514829worker2 # [ 85.115877] nix-grpc-daemon[776]: ts=2026-09-20T08:17:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4830worker1 # [ 85.121035] nix-grpc-daemon[773]: ts=2026-09-20T08:17:50Z level=info event=scheduler_connected addr=lb:500514831worker1 # [ 85.127767] nix-grpc-daemon[773]: ts=2026-09-20T08:17:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4832worker2 # [ 85.316803] nix-grpc-daemon[776]: ts=2026-09-20T08:17:50Z level=info event=scheduler_connected addr=lb:500514833worker2 # [ 85.323481] nix-grpc-daemon[776]: ts=2026-09-20T08:17:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4834worker1 # [ 85.329110] nix-grpc-daemon[773]: ts=2026-09-20T08:17:50Z level=info event=scheduler_connected addr=lb:500514835worker1 # [ 85.335718] nix-grpc-daemon[773]: ts=2026-09-20T08:17:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4836worker2 # [ 85.477851] nix-grpc-daemon[776]: ts=2026-09-20T08:17:51Z level=info event=scheduler_restarting4837worker1 # [ 85.538163] nix-grpc-daemon[773]: ts=2026-09-20T08:17:51Z level=info event=scheduler_connected addr=lb:500514838worker2 # [ 85.538623] nix-grpc-daemon[776]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4839worker2 # [ 85.557182] nix-grpc-daemon[776]: E0000 00:00:1789892271.082444 819 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 12, started true, shutdown true4840worker2 # [ 85.563895] nix-grpc-daemon[776]: ts=2026-09-20T08:17:51Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4841worker2 # [ 85.755218] nix-daemon[844]: reaped child process 846, status = succeeded4842worker2 # [ 86.158010] nix-grpc-daemon[776]: E0000 00:00:1789892271.700815 819 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4843worker2 # [ 86.164754] nix-grpc-daemon[776]: E0000 00:00:1789892271.701021 819 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true4844worker1 # [ 86.327802] nix-grpc-daemon[773]: ts=2026-09-20T08:17:51Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4845worker2 # [ 86.345697] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4846worker2 # [ 86.353568] systemd[1]: Stopped Nix worker-protocol over gRPC.4847worker2 # [ 86.361241] systemd[1]: nix-grpc-daemon.service: Consumed 3.617s CPU time over 1min 3.733s wall clock time, 62.3M memory peak, 93.1K incoming IP traffic, 178.2K outgoing IP traffic.4848worker2 # [ 86.377721] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4849worker2 # [ 86.380960] systemd[1]: Closed Nix worker-protocol over gRPC.4850worker2 # [ 86.382619] systemd[1]: nix-grpc-daemon.socket: Consumed 750us CPU time over 1min 14.128s wall clock time, 256K memory peak, 128.3K incoming IP traffic, 101.3K outgoing IP traffic.4851lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4852lb: must succeed: curl -sf localhost:9901/clusters4853lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4854lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.10 seconds)4855client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24856worker1 # [ 86.528826] nix-grpc-daemon[773]: ts=2026-09-20T08:17:52Z level=info event=scheduler_connected addr=lb:500514857worker1 # [ 86.535547] nix-grpc-daemon[773]: ts=2026-09-20T08:17:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4858worker1 # [ 86.738019] nix-grpc-daemon[773]: ts=2026-09-20T08:17:52Z level=info event=scheduler_connected addr=lb:500514859worker1 # [ 86.744992] nix-grpc-daemon[773]: ts=2026-09-20T08:17:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:505124860worker1 # [ 86.751460] nix-grpc-daemon[773]: ts=2026-09-20T08:17:52Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4861client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4862worker1 # [ 86.761680] nix-grpc-daemon[773]: ts=2026-09-20T08:17:52Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:505124863client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.31 seconds)4864worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4865worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)4866worker2 # [ 86.903280] systemd[1]: Listening on Nix worker-protocol over gRPC.4867worker1 # [ 86.945928] nix-grpc-daemon[773]: ts=2026-09-20T08:17:52Z level=info event=scheduler_connected addr=lb:500514868worker1 # [ 86.954038] nix-grpc-daemon[773]: ts=2026-09-20T08:17:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4869worker1 # [ 87.001572] nix-grpc-daemon[773]: ts=2026-09-20T08:17:52Z level=info event=signal_exit4870worker1 # [ 87.015064] systemd[1]: Stopping Nix worker-protocol over gRPC...4871worker1 # [ 87.155008] nix-grpc-daemon[773]: ts=2026-09-20T08:17:52Z level=info event=scheduler_connected addr=lb:500514872worker2 # [ 87.167070] systemd[1]: Starting Nix worker-protocol over gRPC...4873worker2 # [ 87.384184] nix-grpc-daemon[1199]: ts=2026-09-20T08:17:52Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4874worker2 # [ 87.387015] nix-grpc-daemon[1199]: ts=2026-09-20T08:17:52Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14875worker2 # [ 87.395189] nix-grpc-daemon[1199]: ts=2026-09-20T08:17:52Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4876worker2 # [ 87.407496] systemd[1]: Started Nix worker-protocol over gRPC.4877lb # [ 87.410401] niks3-server[1118]: 2026/09/20 08:17:52 INFO lead: acquired remote=192.168.1.4:585244878worker2 # [ 87.415972] nix-grpc-daemon[1199]: ts=2026-09-20T08:17:52Z level=info event=scheduler_take_over4879worker2 # [ 87.428107] nix-grpc-daemon[1199]: ts=2026-09-20T08:17:52Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04880worker2 # [ 87.444309] nix-grpc-daemon[1199]: ts=2026-09-20T08:17:52Z level=info event=scheduler_connected addr=lb:500514881worker2 # [ 87.446212] nix-grpc-daemon[1199]: ts=2026-09-20T08:17:52Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04882worker1 # [ 88.478329] nix-grpc-daemon[773]: ts=2026-09-20T08:17:54Z level=info event=scheduler_restarting4883worker2 # [ 88.486218] nix-grpc-daemon[1199]: ts=2026-09-20T08:17:54Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:412984884worker2 # [ 88.490961] nix-grpc-daemon[1199]: ts=2026-09-20T08:17:54Z level=info event=worker_gone addr=192.168.1.3:500514885worker1 # [ 88.512008] nix-grpc-daemon[773]: ts=2026-09-20T08:17:54Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4886worker1 # [ 88.531488] nix-daemon[836]: reaped child process 838, status = succeeded4887worker1 # [ 89.142866] nix-grpc-daemon[773]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4888worker1 # [ 89.143133] nix-grpc-daemon[773]: E0000 00:00:1789892274.670225 816 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true4889worker1 # [ 89.164539] nix-grpc-daemon[773]: E0000 00:00:1789892274.691937 816 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4890worker1 # [ 90.262864] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4891worker1 # [ 90.269829] systemd[1]: Stopped Nix worker-protocol over gRPC.4892worker1 # [ 90.275459] systemd[1]: nix-grpc-daemon.service: Consumed 2.200s CPU time over 1min 7.658s wall clock time, 51.6M memory peak, 62.6K incoming IP traffic, 111.3K outgoing IP traffic.4893worker1 # [ 90.290510] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4894worker1 # [ 90.295420] systemd[1]: Closed Nix worker-protocol over gRPC.4895worker1 # [ 90.298055] systemd[1]: nix-grpc-daemon.socket: Consumed 764us CPU time over 1min 17.804s wall clock time, 256K memory peak, 108.1K incoming IP traffic, 93.4K outgoing IP traffic.4896lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4897lb: must succeed: curl -sf localhost:9901/clusters4898lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4899lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.08 seconds)4900client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24901worker2 # [ 90.631812] nix-grpc-daemon[1199]: ts=2026-09-20T08:17:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:413344902worker2 # [ 90.647334] nix-daemon[844]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)4903worker2 # [ 90.672102] nix-grpc-daemon[1199]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 54 ms (attempt 1/5)4904worker2 # [ 90.733709] nix-grpc-daemon[1199]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 13 ms (attempt 2/5)4905worker2 # [ 90.754301] nix-grpc-daemon[1199]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 201 ms (attempt 3/5)4906worker2 # [ 90.963330] nix-grpc-daemon[1199]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 409 ms (attempt 4/5)4907worker2 # [ 91.373080] nix-grpc-daemon[1199]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4908client # copying 2 paths...4909client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...4910worker2 # [ 91.401155] nix-grpc-daemon[1199]: ts=2026-09-20T08:17:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:413344911client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...4912worker2 # [ 91.419090] nix-daemon[844]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)4913worker2 # [ 91.451144] nix-grpc-daemon[1199]: ts=2026-09-20T08:17:56Z level=info event=niks3_push_started pid=12554914worker2 # [ 91.850278] nix-daemon[844]: accepted connection from pid 1268, user nix-grpc-daemon (trusted)4915worker2 # [ 91.868005] nix-daemon[844]: reaped child process 1271, status = succeeded4916lb # [ 91.878428] niks3-server[1118]: 2026/09/20 08:17:57 INFO Received uploads request method=POST path=/api/pending_closures4917lb # [ 91.888488] niks3-server[1118]: 2026/09/20 08:17:57 INFO Received uploads request method=POST path=/api/pending_closures4918worker2 # [ 91.903637] nix-grpc-daemon[1255]: time=2026-09-20T08:17:57.445Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4919worker2 # [ 91.906417] nix-grpc-daemon[1255]: time=2026-09-20T08:17:57.445Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"4920worker2 # [ 91.908503] nix-grpc-daemon[1255]: time=2026-09-20T08:17:57.445Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"4921lb # [ 91.928753] niks3-server[1118]: 2026/09/20 08:17:57 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst4922lb # [ 91.955208] niks3-server[1118]: 2026/09/20 08:17:57 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls4923lb # [ 91.974106] niks3-server[1118]: 2026/09/20 08:17:57 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst4924lb # [ 91.982266] niks3-server[1118]: 2026/09/20 08:17:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4925lb # [ 91.989552] niks3-server[1118]: 2026/09/20 08:17:57 INFO Signed narinfos id=24 count=24926lb # [ 91.991938] niks3-server[1118]: 2026/09/20 08:17:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4927worker2 # [ 91.995034] nix-grpc-daemon[1255]: time=2026-09-20T08:17:57.536Z level=INFO msg="Uploading 3 narinfos"4928lb # [ 92.002603] niks3-server[1118]: 2026/09/20 08:17:57 INFO Signed narinfos id=23 count=14929lb # [ 92.007156] niks3-server[1118]: 2026/09/20 08:17:57 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls4930lb # [ 92.022471] niks3-server[1118]: 2026/09/20 08:17:57 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4931lb # [ 92.026219] niks3-server[1118]: 2026/09/20 08:17:57 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4932lb # [ 92.032330] niks3-server[1118]: 2026/09/20 08:17:57 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4933lb # [ 92.035161] niks3-server[1118]: 2026/09/20 08:17:57 INFO Completed upload id=234934lb # [ 92.040353] niks3-server[1118]: 2026/09/20 08:17:57 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4935lb # [ 92.043199] niks3-server[1118]: 2026/09/20 08:17:57 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo4936lb # [ 92.045519] niks3-server[1118]: 2026/09/20 08:17:57 INFO Completed upload id=244937worker2 # [ 92.044335] nix-grpc-daemon[1255]: time=2026-09-20T08:17:57.588Z level=INFO msg="Upload complete. (370ms)"4938worker2 # [ 92.057386] nix-grpc-daemon[1199]: ts=2026-09-20T08:17:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41334 duration_s=0 paths=2 nar_bytes_in=3124939worker2 # [ 92.073110] nix-daemon[844]: reaped child process 1253, status = succeeded4940client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.71 seconds)4941worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache4942worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.04 seconds)4943worker1 # [ 92.214425] systemd[1]: Listening on Nix worker-protocol over gRPC.4944worker1 # [ 92.223889] systemd[1]: Starting Nix worker-protocol over gRPC...4945worker1 # [ 92.418573] nix-grpc-daemon[1033]: ts=2026-09-20T08:17:57Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4946worker1 # [ 92.421072] nix-grpc-daemon[1033]: ts=2026-09-20T08:17:57Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14947worker1 # [ 92.428880] nix-grpc-daemon[1033]: ts=2026-09-20T08:17:57Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4948worker1 # [ 92.430770] systemd[1]: Started Nix worker-protocol over gRPC.4949lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4950lb: must succeed: curl -sf localhost:9901/clusters4951worker1 # [ 92.486014] nix-grpc-daemon[1033]: ts=2026-09-20T08:17:58Z level=info event=scheduler_connected addr=lb:500514952worker2 # [ 92.486566] nix-grpc-daemon[1199]: ts=2026-09-20T08:17:58Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04953lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)4954lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.11 seconds)4955(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.98 seconds)4956subtest: scheduler down: the other node takes the lock and keeps it4957lb: must succeed: curl -sf localhost:9901/clusters4958lb # [ 92.592931] envoy[914]: conn peer=[2001:db8:1::4]:54552 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=14852 tx=4146 ms=624974959lb # [ 92.595188] envoy[914]: conn peer=[2001:db8:1::1]:47666 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=523 ms=334960lb # [ 92.597650] envoy[914]: conn peer=[2001:db8:1::3]:55820 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=15439 tx=4063 ms=654654961lb # [ 92.599580] envoy[914]: conn peer=[2001:db8:1::1]:47676 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1007 tx=305 ms=14414962lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4963lb: must succeed: curl -sf localhost:9901/clusters4964lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4965lb: must succeed: curl -sf localhost:9901/clusters4966lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4967lb: must succeed: curl -sf localhost:9901/clusters4968lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4969worker2 # [ 92.846285] systemd[1]: Stopping Nix worker-protocol over gRPC...4970worker2 # [ 93.410303] nix-grpc-daemon[1199]: ts=2026-09-20T08:17:58Z level=info event=signal_exit4971worker2 # [ 93.613580] nix-grpc-daemon[1199]: ts=2026-09-20T08:17:59Z level=info event=scheduler_yield4972lb # [ 93.613363] niks3-server[1118]: 2026/09/20 08:17:59 INFO lead: released remote=192.168.1.4:585244973worker1 # [ 93.621147] nix-grpc-daemon[1033]: ts=2026-09-20T08:17:59Z level=info event=scheduler_restarting addr=lb:500514974worker2 # [ 93.624615] nix-grpc-daemon[1199]: ts=2026-09-20T08:17:59Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:412984975worker2 # [ 93.632578] nix-grpc-daemon[1199]: ts=2026-09-20T08:17:59Z level=info event=worker_gone addr=192.168.1.3:500514976worker2 # [ 93.636710] nix-grpc-daemon[1199]: ts=2026-09-20T08:17:59Z level=info event=scheduler_restarting addr=lb:500514977worker2 # [ 93.640683] nix-grpc-daemon[1199]: ts=2026-09-20T08:17:59Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:412984978worker2 # [ 93.645053] nix-grpc-daemon[1199]: ts=2026-09-20T08:17:59Z level=info event=worker_gone addr=192.168.1.4:500514979worker1 # [ 93.821181] nix-grpc-daemon[1033]: ts=2026-09-20T08:17:59Z level=info event=scheduler_connected addr=lb:500514980worker2 # [ 93.832224] nix-grpc-daemon[1199]: ts=2026-09-20T08:17:59Z level=info event=scheduler_connected addr=lb:500514981worker1 # [ 93.832615] nix-grpc-daemon[1033]: ts=2026-09-20T08:17:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4982worker2 # [ 93.851318] nix-grpc-daemon[1199]: ts=2026-09-20T08:17:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4983worker1 # [ 94.033830] nix-grpc-daemon[1033]: ts=2026-09-20T08:17:59Z level=info event=scheduler_connected addr=lb:500514984worker1 # [ 94.040715] nix-grpc-daemon[1033]: ts=2026-09-20T08:17:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4985worker2 # [ 94.052449] nix-grpc-daemon[1199]: ts=2026-09-20T08:17:59Z level=info event=scheduler_connected addr=lb:500514986worker2 # [ 94.059525] nix-grpc-daemon[1199]: ts=2026-09-20T08:17:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4987worker1 # [ 94.241847] nix-grpc-daemon[1033]: ts=2026-09-20T08:17:59Z level=info event=scheduler_connected addr=lb:500514988worker1 # [ 94.248699] nix-grpc-daemon[1033]: ts=2026-09-20T08:17:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4989worker2 # [ 94.260498] nix-grpc-daemon[1199]: ts=2026-09-20T08:17:59Z level=info event=scheduler_connected addr=lb:500514990worker2 # [ 94.267254] nix-grpc-daemon[1199]: ts=2026-09-20T08:17:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4991worker1 # [ 94.449961] nix-grpc-daemon[1033]: ts=2026-09-20T08:17:59Z level=info event=scheduler_connected addr=lb:500514992worker1 # [ 94.457966] nix-grpc-daemon[1033]: ts=2026-09-20T08:17:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4993worker2 # [ 94.471276] nix-grpc-daemon[1199]: ts=2026-09-20T08:18:00Z level=info event=scheduler_connected addr=lb:500514994worker2 # [ 94.475556] nix-grpc-daemon[1199]: ts=2026-09-20T08:18:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4995worker2 # [ 94.618725] nix-grpc-daemon[1199]: ts=2026-09-20T08:18:00Z level=info event=scheduler_restarting4996worker2 # [ 94.649124] nix-daemon[844]: reaped child process 1248, status = succeeded4997worker1 # [ 94.661267] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:00Z level=info event=scheduler_connected addr=lb:500514998worker1 # [ 94.666355] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4999worker2 # [ 94.693085] nix-grpc-daemon[1199]: ts=2026-09-20T08:18:00Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5000worker1 # [ 94.863208] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:00Z level=info event=scheduler_connected addr=lb:500515001worker2 # [ 94.864322] nix-grpc-daemon[1199]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5002worker2 # [ 94.869028] nix-grpc-daemon[1199]: E0000 00:00:1789892280.408104 1242 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5003worker1 # [ 95.410490] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:00Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5004worker2 # [ 95.433273] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5005worker2 # [ 95.440871] systemd[1]: Stopped Nix worker-protocol over gRPC.5006worker2 # [ 95.443370] systemd[1]: nix-grpc-daemon.service: Consumed 503ms CPU time over 8.262s wall clock time, 33.3M memory peak, 17.3K incoming IP traffic, 21.6K outgoing IP traffic.5007worker2 # [ 95.462403] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5008worker2 # [ 95.466918] systemd[1]: Closed Nix worker-protocol over gRPC.5009worker2 # [ 95.469042] systemd[1]: nix-grpc-daemon.socket: Consumed 1ms CPU time over 8.568s wall clock time, 256K memory peak, 26.9K incoming IP traffic, 23.3K outgoing IP traffic.5010worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5011worker1 # [ 95.611756] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:01Z level=info event=scheduler_connected addr=lb:500515012worker1 # [ 95.619105] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5013worker1 # [ 95.821678] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:01Z level=info event=scheduler_connected addr=lb:500515014worker1 # [ 95.826996] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:01Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5015worker1 # [ 96.027830] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:01Z level=info event=scheduler_connected addr=lb:500515016worker1 # [ 96.034693] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5017worker1 # [ 96.235839] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:01Z level=info event=scheduler_connected addr=lb:500515018worker1 # [ 96.242203] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:01Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5019worker1 # [ 96.442250] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:01Z level=info event=scheduler_connected addr=lb:500515020worker1 # [ 96.449240] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5021worker1 # [ 96.650024] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:02Z level=info event=scheduler_connected addr=lb:500515022worker1 # [ 96.653421] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:02Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5023worker1 # [ 96.856935] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:02Z level=info event=scheduler_connected addr=lb:500515024worker1 # [ 96.862661] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5025worker1 # [ 97.063371] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:02Z level=info event=scheduler_connected addr=lb:500515026worker1 # [ 97.068873] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:02Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5027worker1 # [ 97.269730] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:02Z level=info event=scheduler_connected addr=lb:500515028worker1 # [ 97.276760] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5029worker1 # [ 97.450442] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:02Z level=info event=scheduler_take_over5030lb # [ 97.446750] niks3-server[1118]: 2026/09/20 08:18:02 INFO lead: acquired remote=192.168.1.3:348165031worker1 # [ 97.477737] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:03Z level=info event=scheduler_connected addr=lb:500515032worker1 # [ 97.483255] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:03Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05033worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 2.25 seconds)5034worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5035worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds)5036client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby >&25037worker1 # [ 98.039187] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:03Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:417045038worker1 # [ 98.057898] nix-daemon[836]: accepted connection from pid 1033, user nix-grpc-daemon (trusted)5039client # don't know how to build these paths:5040client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5041worker1 # [ 98.083970] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:03Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=05042worker1 # [ 98.090811] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:03Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=15043worker1 # [ 98.138259] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417045044worker1 # [ 98.156122] nix-grpc-daemon[1033]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 75 ms (attempt 1/5)5045worker1 # [ 98.238723] nix-grpc-daemon[1033]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 51 ms (attempt 2/5)5046worker1 # [ 98.297527] nix-grpc-daemon[1033]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 56 ms (attempt 3/5)5047worker1 # [ 98.361071] nix-grpc-daemon[1033]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 489 ms (attempt 4/5)5048worker1 # [ 98.858148] nix-grpc-daemon[1033]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5049worker1 # [ 98.879851] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417045050client # copying 1 paths to 'lb:50051'...5051client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...5052worker1 # [ 98.895621] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417045053worker1 # [ 98.910122] nix-daemon[836]: accepted connection from pid 1033, user nix-grpc-daemon (trusted)5054worker1 # [ 98.940864] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:04Z level=info event=niks3_push_started pid=11145055worker1 # [ 99.331583] nix-daemon[836]: accepted connection from pid 1127, user nix-grpc-daemon (trusted)5056worker1 # [ 99.353058] nix-daemon[836]: reaped child process 1130, status = succeeded5057worker1 # [ 99.530440] nix-daemon[836]: accepted connection from pid 1132, user nix-grpc-daemon (trusted)5058worker1 # [ 99.549046] nix-daemon[836]: reaped child process 1135, status = succeeded5059lb # [ 99.556957] niks3-server[1118]: 2026/09/20 08:18:05 INFO Received uploads request method=POST path=/api/pending_closures5060worker1 # [ 99.572451] nix-grpc-daemon[1114]: time=2026-09-20T08:18:05.098Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5061worker1 # [ 99.574009] nix-grpc-daemon[1114]: time=2026-09-20T08:18:05.098Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"5062lb # [ 99.593665] niks3-server[1118]: 2026/09/20 08:18:05 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst5063lb # [ 99.609529] niks3-server[1118]: 2026/09/20 08:18:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5064worker1 # [ 99.620290] nix-grpc-daemon[1114]: time=2026-09-20T08:18:05.147Z level=INFO msg="Uploading 1 narinfos"5065lb # [ 99.621091] niks3-server[1118]: 2026/09/20 08:18:05 INFO Signed narinfos id=25 count=15066lb # [ 99.627329] niks3-server[1118]: 2026/09/20 08:18:05 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls5067lb # [ 99.639576] niks3-server[1118]: 2026/09/20 08:18:05 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5068lb # [ 99.650535] niks3-server[1118]: 2026/09/20 08:18:05 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo5069lb # [ 99.669301] niks3-server[1118]: 2026/09/20 08:18:05 INFO Completed upload id=255070worker1 # [ 99.673738] nix-grpc-daemon[1114]: time=2026-09-20T08:18:05.201Z level=INFO msg="Upload complete. (508ms)"5071worker1 # [ 99.688495] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41704 duration_s=0 paths=1 nar_bytes_in=5205072worker1 # [ 99.700548] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417045073worker1 # [ 99.709027] nix-daemon[836]: accepted connection from pid 1033, user nix-grpc-daemon (trusted)5074worker1 # [ 99.714890] nix-daemon[836]: reaped child process 1112, status = succeeded5075client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...5076client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5077worker1 # [ 99.728250] nix-daemon[836]: accepted connection from pid 1033, user nix-grpc-daemon (trusted)5078client # farm-a> LOG-farm-a-on-standby5079worker1 # [ 100.564315] nix-daemon[836]: reaped child process 1139, status = succeeded5080worker1 # [ 100.746915] nix-daemon[836]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)5081worker1 # [ 100.766789] nix-daemon[836]: reaped child process 1157, status = succeeded5082lb # [ 100.774396] niks3-server[1118]: 2026/09/20 08:18:06 INFO Received uploads request method=POST path=/api/pending_closures5083worker1 # [ 100.796635] nix-grpc-daemon[1114]: time=2026-09-20T08:18:06.319Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5084worker1 # [ 100.798300] nix-grpc-daemon[1114]: time=2026-09-20T08:18:06.320Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"5085lb # [ 100.818006] niks3-server[1118]: 2026/09/20 08:18:06 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5086lb # [ 100.832310] niks3-server[1118]: 2026/09/20 08:18:06 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5087lb # [ 100.845304] niks3-server[1118]: 2026/09/20 08:18:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5088worker1 # [ 100.855376] nix-grpc-daemon[1114]: time=2026-09-20T08:18:06.382Z level=INFO msg="Uploading 1 narinfos"5089lb # [ 100.851393] niks3-server[1118]: 2026/09/20 08:18:06 INFO Signed narinfos id=26 count=15090lb # [ 100.854546] niks3-server[1118]: 2026/09/20 08:18:06 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls5091lb # [ 100.865153] niks3-server[1118]: 2026/09/20 08:18:06 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5092lb # [ 100.875243] niks3-server[1118]: 2026/09/20 08:18:06 INFO Completed upload id=265093worker1 # [ 100.878763] nix-grpc-daemon[1114]: time=2026-09-20T08:18:06.406Z level=INFO msg="Upload complete. (339ms)"5094lb # [ 100.878165] niks3-server[1118]: 2026/09/20 08:18:06 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo5095worker1 # [ 100.905155] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41704 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=15096worker1 # [ 100.920244] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:06Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=05097worker1 # [ 100.923152] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:06Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=15098worker1 # [ 100.926807] nix-daemon[836]: reaped child process 1137, status = succeeded5099worker1 # [ 100.950592] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417045100worker1 # [ 100.960278] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417045101client # copying 1 paths to 'lb:50051'...5102worker1 # [ 100.975793] nix-grpc-daemon[1114]: time=2026-09-20T08:18:06.502Z level=INFO msg="All 1 paths already cached"5103client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...5104worker1 # [ 100.982184] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417045105worker1 # [ 100.995931] nix-daemon[836]: accepted connection from pid 1033, user nix-grpc-daemon (trusted)5106worker1 # [ 101.206722] nix-daemon[836]: accepted connection from pid 1163, user nix-grpc-daemon (trusted)5107worker1 # [ 101.226760] nix-daemon[836]: reaped child process 1166, status = succeeded5108worker1 # [ 101.408983] nix-daemon[836]: accepted connection from pid 1168, user nix-grpc-daemon (trusted)5109worker1 # [ 101.429700] nix-daemon[836]: reaped child process 1171, status = succeeded5110lb # [ 101.436285] niks3-server[1118]: 2026/09/20 08:18:06 INFO Received uploads request method=POST path=/api/pending_closures5111worker1 # [ 101.451900] nix-grpc-daemon[1114]: time=2026-09-20T08:18:06.978Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5112worker1 # [ 101.453674] nix-grpc-daemon[1114]: time=2026-09-20T08:18:06.979Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"5113lb # [ 101.478768] niks3-server[1118]: 2026/09/20 08:18:07 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst5114worker1 # [ 101.495863] nix-grpc-daemon[1114]: time=2026-09-20T08:18:07.022Z level=INFO msg="Uploading 1 narinfos"5115lb # [ 101.495584] niks3-server[1118]: 2026/09/20 08:18:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5116lb # [ 101.503815] niks3-server[1118]: 2026/09/20 08:18:07 INFO Signed narinfos id=27 count=15117lb # [ 101.508321] niks3-server[1118]: 2026/09/20 08:18:07 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5118lb # [ 101.696999] niks3-server[1118]: 2026/09/20 08:18:07 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls5119lb # [ 101.705176] niks3-server[1118]: 2026/09/20 08:18:07 INFO Completed upload id=275120worker1 # [ 101.710043] nix-grpc-daemon[1114]: time=2026-09-20T08:18:07.237Z level=INFO msg="Upload complete. (698ms)"5121worker1 # [ 101.721224] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41704 duration_s=0 paths=1 nar_bytes_in=6405122lb # [ 101.721957] niks3-server[1118]: 2026/09/20 08:18:07 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo5123worker1 # [ 101.736870] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417045124worker1 # [ 101.754353] nix-daemon[836]: accepted connection from pid 1033, user nix-grpc-daemon (trusted)5125worker1 # [ 101.764286] nix-daemon[836]: reaped child process 1161, status = succeeded5126client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...5127client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5128worker1 # [ 101.784272] nix-daemon[836]: accepted connection from pid 1033, user nix-grpc-daemon (trusted)5129lb # [ 102.595765] envoy[914]: conn peer=[2001:db8:1::4]:47170 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1003 tx=362 ms=72385130client # farm-b> LOG-farm-b-on-standby5131worker1 # [ 102.841032] nix-daemon[836]: reaped child process 1175, status = succeeded5132worker1 # [ 103.035437] nix-daemon[836]: accepted connection from pid 1190, user nix-grpc-daemon (trusted)5133worker1 # [ 103.057984] nix-daemon[836]: reaped child process 1193, status = succeeded5134lb # [ 103.065163] niks3-server[1118]: 2026/09/20 08:18:08 INFO Received uploads request method=POST path=/api/pending_closures5135worker1 # [ 103.081654] nix-grpc-daemon[1114]: time=2026-09-20T08:18:08.608Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5136worker1 # [ 103.084359] nix-grpc-daemon[1114]: time=2026-09-20T08:18:08.611Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"5137lb # [ 103.116290] niks3-server[1118]: 2026/09/20 08:18:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5138worker1 # [ 103.133148] nix-grpc-daemon[1114]: time=2026-09-20T08:18:08.660Z level=INFO msg="Uploading 1 narinfos"5139lb # [ 103.134632] niks3-server[1118]: 2026/09/20 08:18:08 INFO Signed narinfos id=28 count=15140lb # [ 103.143521] niks3-server[1118]: 2026/09/20 08:18:08 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst5141lb # [ 103.154884] niks3-server[1118]: 2026/09/20 08:18:08 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5142lb # [ 103.167580] niks3-server[1118]: 2026/09/20 08:18:08 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls5143lb # [ 103.173486] niks3-server[1118]: 2026/09/20 08:18:08 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5144lb # [ 103.177681] niks3-server[1118]: 2026/09/20 08:18:08 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo5145worker1 # [ 103.182177] nix-grpc-daemon[1114]: time=2026-09-20T08:18:08.709Z level=INFO msg="Upload complete. (380ms)"5146lb # [ 103.181082] niks3-server[1118]: 2026/09/20 08:18:08 INFO Completed upload id=285147worker1 # [ 103.202011] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41704 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=15148worker1 # [ 103.221792] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:08Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=05149worker1 # [ 103.226244] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:08Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=15150worker1 # [ 103.230813] nix-daemon[836]: reaped child process 1173, status = succeeded5151worker1 # [ 103.245662] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417045152worker1 # [ 103.263894] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417045153worker1 # [ 103.280962] nix-grpc-daemon[1114]: time=2026-09-20T08:18:08.808Z level=INFO msg="All 2 paths already cached"5154client # copying 1 paths to 'lb:50051'...5155client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...5156worker1 # [ 103.294990] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417045157worker1 # [ 103.310313] nix-daemon[836]: accepted connection from pid 1033, user nix-grpc-daemon (trusted)5158worker1 # [ 103.525888] nix-daemon[836]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5159worker1 # [ 103.547512] nix-daemon[836]: reaped child process 1202, status = succeeded5160worker1 # [ 103.731064] nix-daemon[836]: accepted connection from pid 1204, user nix-grpc-daemon (trusted)5161worker1 # [ 103.750747] nix-daemon[836]: reaped child process 1207, status = succeeded5162lb # [ 103.759669] niks3-server[1118]: 2026/09/20 08:18:09 INFO Received uploads request method=POST path=/api/pending_closures5163worker1 # [ 103.778204] nix-grpc-daemon[1114]: time=2026-09-20T08:18:09.305Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5164worker1 # [ 103.779768] nix-grpc-daemon[1114]: time=2026-09-20T08:18:09.305Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"5165lb # [ 103.798256] niks3-server[1118]: 2026/09/20 08:18:09 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst5166worker1 # [ 103.816825] nix-grpc-daemon[1114]: time=2026-09-20T08:18:09.344Z level=INFO msg="Uploading 1 narinfos"5167lb # [ 103.815839] niks3-server[1118]: 2026/09/20 08:18:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5168lb # [ 103.827075] niks3-server[1118]: 2026/09/20 08:18:09 INFO Signed narinfos id=29 count=15169lb # [ 103.832269] niks3-server[1118]: 2026/09/20 08:18:09 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls5170lb # [ 103.840584] niks3-server[1118]: 2026/09/20 08:18:09 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5171lb # [ 103.845604] niks3-server[1118]: 2026/09/20 08:18:09 INFO Completed upload id=295172worker1 # [ 103.850419] nix-grpc-daemon[1114]: time=2026-09-20T08:18:09.377Z level=INFO msg="Upload complete. (522ms)"5173lb # [ 103.848218] niks3-server[1118]: 2026/09/20 08:18:09 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo5174worker1 # [ 103.860687] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41704 duration_s=0 paths=1 nar_bytes_in=7685175worker1 # [ 103.872793] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417045176worker1 # [ 103.885285] nix-daemon[836]: accepted connection from pid 1033, user nix-grpc-daemon (trusted)5177worker1 # [ 103.895803] nix-daemon[836]: reaped child process 1197, status = succeeded5178client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...5179worker1 # [ 103.903812] nix-daemon[836]: accepted connection from pid 1033, user nix-grpc-daemon (trusted)5180client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5181client # farm-top> LOG-farm-top-on-standby5182worker1 # [ 104.747359] nix-daemon[836]: reaped child process 1211, status = succeeded5183worker1 # [ 104.933168] nix-daemon[836]: accepted connection from pid 1226, user nix-grpc-daemon (trusted)5184worker1 # [ 104.952912] nix-daemon[836]: reaped child process 1229, status = succeeded5185lb # [ 104.963581] niks3-server[1118]: 2026/09/20 08:18:10 INFO Received uploads request method=POST path=/api/pending_closures5186worker1 # [ 104.981871] nix-grpc-daemon[1114]: time=2026-09-20T08:18:10.507Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5187worker1 # [ 104.983465] nix-grpc-daemon[1114]: time=2026-09-20T08:18:10.507Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"5188lb # [ 104.998683] niks3-server[1118]: 2026/09/20 08:18:10 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst5189worker1 # [ 105.021733] nix-grpc-daemon[1114]: time=2026-09-20T08:18:10.548Z level=INFO msg="Uploading 1 narinfos"5190lb # [ 105.017723] niks3-server[1118]: 2026/09/20 08:18:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5191lb # [ 105.027575] niks3-server[1118]: 2026/09/20 08:18:10 INFO Signed narinfos id=30 count=15192lb # [ 105.035153] niks3-server[1118]: 2026/09/20 08:18:10 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5193lb # [ 105.040866] niks3-server[1118]: 2026/09/20 08:18:10 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls5194lb # [ 105.048860] niks3-server[1118]: 2026/09/20 08:18:10 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5195worker1 # [ 105.053046] nix-grpc-daemon[1114]: time=2026-09-20T08:18:10.580Z level=INFO msg="Upload complete. (334ms)"5196lb # [ 105.052449] niks3-server[1118]: 2026/09/20 08:18:10 INFO Completed upload id=305197lb # [ 105.055332] niks3-server[1118]: 2026/09/20 08:18:10 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo5198worker1 # [ 105.065086] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41704 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=15199worker1 # [ 105.082118] nix-daemon[836]: reaped child process 1209, status = succeeded5200client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby >&2, in 7.33 seconds)5201client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby outPath5202client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby outPath, in 0.24 seconds)5203worker2 # [ 105.441004] systemd[1]: Listening on Nix worker-protocol over gRPC.5204worker2 # [ 105.448230] systemd[1]: Starting Nix worker-protocol over gRPC...5205worker2 # [ 105.645016] nix-grpc-daemon[1292]: ts=2026-09-20T08:18:11Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5206worker2 # [ 105.647736] nix-grpc-daemon[1292]: ts=2026-09-20T08:18:11Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15207worker2 # [ 105.656233] nix-grpc-daemon[1292]: ts=2026-09-20T08:18:11Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5208worker2 # [ 105.658039] systemd[1]: Started Nix worker-protocol over gRPC.5209lb: must succeed: curl -sf localhost:9901/clusters5210worker2 # [ 105.712953] nix-grpc-daemon[1292]: ts=2026-09-20T08:18:11Z level=info event=scheduler_connected addr=lb:500515211worker1 # [ 105.716976] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:11Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05212lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)5213worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5214worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5215lb: must succeed: curl -sf localhost:9901/clusters5216lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5217lb: must succeed: curl -sf localhost:9901/clusters5218lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5219worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5220worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5221(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 13.55 seconds)5222subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5223client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs5224client # [ 106.274084] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.5225client # Running as unit: rs.service; invocation ID: 32b5d535e6114730a9eae25a7c6ccae25226client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.09 seconds)5227worker2 # [ 106.434266] nix-grpc-daemon[1292]: ts=2026-09-20T08:18:11Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:456885228worker2 # [ 106.446928] nix-daemon[844]: accepted connection from pid 1292, user nix-grpc-daemon (trusted)5229client # [ 106.551665] nix[1151]: don't know how to build these paths:5230client # [ 106.553806] nix[1151]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5231worker1 # [ 106.483007] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:12Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=05232worker1 # [ 106.490905] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:12Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=15233worker1 # [ 106.531078] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417045234worker1 # [ 106.547019] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417045235client # [ 106.644643] nix[1151]: copying 1 paths to 'lb:50051'...5236worker1 # [ 106.562503] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417045237client # [ 106.647454] nix[1151]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...5238worker1 # [ 106.581730] nix-daemon[836]: accepted connection from pid 1033, user nix-grpc-daemon (trusted)5239worker1 # [ 106.791054] nix-daemon[836]: accepted connection from pid 1244, user nix-grpc-daemon (trusted)5240worker1 # [ 106.811292] nix-daemon[836]: reaped child process 1247, status = succeeded5241worker1 # [ 106.983860] nix-daemon[836]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)5242worker1 # [ 107.000387] nix-daemon[836]: reaped child process 1252, status = succeeded5243lb # [ 107.012707] niks3-server[1118]: 2026/09/20 08:18:12 INFO Received uploads request method=POST path=/api/pending_closures5244worker1 # [ 107.026245] nix-grpc-daemon[1114]: time=2026-09-20T08:18:12.553Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5245worker1 # [ 107.027725] nix-grpc-daemon[1114]: time=2026-09-20T08:18:12.553Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"5246lb # [ 107.048983] niks3-server[1118]: 2026/09/20 08:18:12 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst5247worker1 # [ 107.067585] nix-grpc-daemon[1114]: time=2026-09-20T08:18:12.594Z level=INFO msg="Uploading 1 narinfos"5248lb # [ 107.066167] niks3-server[1118]: 2026/09/20 08:18:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5249lb # [ 107.074260] niks3-server[1118]: 2026/09/20 08:18:12 INFO Signed narinfos id=31 count=15250lb # [ 107.079230] niks3-server[1118]: 2026/09/20 08:18:12 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls5251lb # [ 107.084664] niks3-server[1118]: 2026/09/20 08:18:12 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5252lb # [ 107.091375] niks3-server[1118]: 2026/09/20 08:18:12 INFO Completed upload id=315253worker1 # [ 107.095863] nix-grpc-daemon[1114]: time=2026-09-20T08:18:12.623Z level=INFO msg="Upload complete. (496ms)"5254lb # [ 107.094101] niks3-server[1118]: 2026/09/20 08:18:12 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5255worker1 # [ 107.104404] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41704 duration_s=0 paths=1 nar_bytes_in=4165256worker1 # [ 107.119153] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417045257worker1 # [ 107.128235] nix-daemon[836]: accepted connection from pid 1033, user nix-grpc-daemon (trusted)5258worker1 # [ 107.131615] nix-daemon[836]: reaped child process 1242, status = succeeded5259worker1 # [ 107.143153] nix-daemon[836]: accepted connection from pid 1033, user nix-grpc-daemon (trusted)5260client # [ 107.224063] nix[1151]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5261lb: must succeed: curl -sf localhost:9901/clusters5262lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5263lb: must succeed: curl -sf localhost:9901/clusters5264lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5265lb: must succeed: curl -sf localhost:9901/clusters5266lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5267lb: must succeed: curl -sf localhost:9901/clusters5268lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5269worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5270worker2 # [ 109.140891] systemd-journald[275]: Received client request to rotate journal, rotating.5271worker2 # [ 109.166577] systemd-journald[275]: Vacuuming done, freed 0B of archived journals from /var/log/journal/9096ee6e3fad4553b939be3d4c56b6af.5272worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.10 seconds)5273worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5274worker1 # [ 109.221970] systemd[1]: Stopping Nix worker-protocol over gRPC...5275worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.05 seconds)5276??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5277 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735278client: must succeed: sleep 5.05279worker1 # [ 109.437812] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:14Z level=info event=draining5280lb # [ 112.601428] envoy[914]: conn peer=[2001:db8:1::1]:41228 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9467 tx=3823 ms=70465281client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5282worker1 # [ 114.582161] nix-daemon[836]: reaped child process 1256, status = succeeded5283worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5284worker1 # [ 114.746313] nix-daemon[836]: accepted connection from pid 1296, user nix-grpc-daemon (trusted)5285worker1 # [ 114.766780] nix-daemon[836]: reaped child process 1299, status = succeeded5286lb # [ 114.774681] niks3-server[1118]: 2026/09/20 08:18:20 INFO Received uploads request method=POST path=/api/pending_closures5287worker1 # [ 114.789188] nix-grpc-daemon[1114]: time=2026-09-20T08:18:20.316Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5288worker1 # [ 114.793626] nix-grpc-daemon[1114]: time=2026-09-20T08:18:20.318Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5289lb # [ 114.814453] niks3-server[1118]: 2026/09/20 08:18:20 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5290lb # [ 114.829289] niks3-server[1118]: 2026/09/20 08:18:20 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5291worker1 # [ 114.846016] nix-grpc-daemon[1114]: time=2026-09-20T08:18:20.373Z level=INFO msg="Uploading 1 narinfos"5292lb # [ 114.841123] niks3-server[1118]: 2026/09/20 08:18:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5293lb # [ 114.849353] niks3-server[1118]: 2026/09/20 08:18:20 INFO Signed narinfos id=32 count=15294lb # [ 114.854900] niks3-server[1118]: 2026/09/20 08:18:20 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5295worker1 # [ 114.869876] nix-grpc-daemon[1114]: time=2026-09-20T08:18:20.397Z level=INFO msg="Upload complete. (304ms)"5296lb # [ 114.865412] niks3-server[1118]: 2026/09/20 08:18:20 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5297lb # [ 114.872488] niks3-server[1118]: 2026/09/20 08:18:20 INFO Completed upload id=325298lb # [ 114.877364] niks3-server[1118]: 2026/09/20 08:18:20 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5299worker1 # [ 114.881088] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41704 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15300worker1 # [ 114.898879] nix-daemon[836]: reaped child process 1254, status = succeeded5301client # [ 115.006245] systemd[1]: rs.service: Deactivated successfully.5302client # [ 115.010626] systemd[1]: rs.service: Consumed 161ms CPU time over 8.736s wall clock time, 37M memory peak, 8.3K incoming IP traffic, 8.9K outgoing IP traffic.5303worker1 # [ 115.438835] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:20Z level=info event=signal_exit5304worker1 # [ 115.670012] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:21Z level=info event=scheduler_yield5305lb # [ 115.668252] niks3-server[1118]: 2026/09/20 08:18:21 INFO lead: released remote=192.168.1.3:348165306worker1 # [ 115.678801] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:21Z level=info event=scheduler_restarting addr=lb:500515307worker2 # [ 115.679262] nix-grpc-daemon[1292]: ts=2026-09-20T08:18:21Z level=info event=scheduler_take_over5308worker1 # [ 115.684424] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:21Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:416905309worker2 # [ 115.684558] nix-grpc-daemon[1292]: ts=2026-09-20T08:18:21Z level=info event=scheduler_restarting addr=lb:500515310worker1 # [ 115.690696] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:21Z level=info event=worker_gone addr=192.168.1.3:500515311worker1 # [ 115.694968] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:21Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:416905312worker1 # [ 115.699544] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:21Z level=info event=worker_gone addr=192.168.1.4:500515313worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 1.15 seconds)5314client: waiting for success: ! systemctl is-active rs5315client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds)5316client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5317client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds)5318client: must fail: journalctl -u rs | grep -q 'reconnecting'5319worker1 # [ 115.880005] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:21Z level=info event=scheduler_connected addr=lb:500515320client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5321lb: must succeed: curl -sf localhost:9901/clusters5322worker2 # [ 115.885155] nix-grpc-daemon[1292]: ts=2026-09-20T08:18:21Z level=info event=scheduler_connected addr=lb:500515323worker2 # [ 115.890990] nix-grpc-daemon[1292]: ts=2026-09-20T08:18:21Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=0 running=05324worker2 # [ 115.908881] nix-grpc-daemon[1292]: ts=2026-09-20T08:18:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5325lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5326worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5327worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5328worker2 # [ 116.110072] nix-grpc-daemon[1292]: ts=2026-09-20T08:18:21Z level=info event=scheduler_connected addr=lb:500515329worker2 # [ 116.116488] nix-grpc-daemon[1292]: ts=2026-09-20T08:18:21Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05330lb # [ 115.680464] niks3-server[1118]: 2026/09/20 08:18:21 INFO lead: acquired remote=192.168.1.4:593985331worker2 # [ 116.681728] nix-grpc-daemon[1292]: ts=2026-09-20T08:18:22Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:590845332worker2 # [ 116.686502] nix-grpc-daemon[1292]: ts=2026-09-20T08:18:22Z level=info event=worker_gone addr=192.168.1.3:500515333worker1 # [ 116.693912] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:22Z level=info event=scheduler_restarting5334worker1 # [ 116.711306] nix-grpc-daemon[1033]: ts=2026-09-20T08:18:22Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5335worker1 # [ 116.738589] nix-daemon[836]: reaped child process 1105, status = succeeded5336lb: must succeed: curl -sf localhost:9901/clusters5337lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5338worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5339worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5340worker1 # [ 117.508481] nix-grpc-daemon[1033]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5341worker1 # [ 117.508855] nix-grpc-daemon[1033]: E0000 00:00:1789892303.035655 1076 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5342worker1 # [ 117.509025] nix-grpc-daemon[1033]: E0000 00:00:1789892303.035995 1076 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5343worker1 # [ 117.929497] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5344worker1 # [ 117.935458] systemd[1]: Stopped Nix worker-protocol over gRPC.5345worker1 # [ 117.944483] systemd[1]: nix-grpc-daemon.service: Consumed 1.912s CPU time over 25.703s wall clock time, 36.9M memory peak, 46.5K incoming IP traffic, 85K outgoing IP traffic.5346worker1 # [ 117.957121] systemd[1]: Starting Nix worker-protocol over gRPC...5347worker1 # [ 118.157073] nix-grpc-daemon[1306]: ts=2026-09-20T08:18:23Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5348worker1 # [ 118.159618] nix-grpc-daemon[1306]: ts=2026-09-20T08:18:23Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15349worker1 # [ 118.167912] nix-grpc-daemon[1306]: ts=2026-09-20T08:18:23Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5350worker1 # [ 118.171982] systemd[1]: Started Nix worker-protocol over gRPC.5351worker1 # [ 118.206180] nix-grpc-daemon[1306]: ts=2026-09-20T08:18:23Z level=info event=scheduler_connected addr=lb:500515352worker2 # [ 118.208110] nix-grpc-daemon[1292]: ts=2026-09-20T08:18:23Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05353lb: must succeed: curl -sf localhost:9901/clusters5354lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5355worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5356worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5357(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.27 seconds)5358subtest: scheduler restart mid-build: build finishes, no double build5359client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5360client # [ 118.540900] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5361client # Running as unit: mid.service; invocation ID: adf53dc73c7d4ca687ec8e86bb0f81035362client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.09 seconds)5363worker2 # [ 118.690829] nix-grpc-daemon[1292]: ts=2026-09-20T08:18:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:456885364client # [ 118.782567] nix[1187]: don't know how to build these paths:5365client # [ 118.783691] nix[1187]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5366worker2 # [ 118.711948] nix-grpc-daemon[1292]: ts=2026-09-20T08:18:24Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05367worker2 # [ 118.721407] nix-grpc-daemon[1292]: ts=2026-09-20T08:18:24Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=15368worker2 # [ 118.759578] nix-grpc-daemon[1292]: ts=2026-09-20T08:18:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456885369worker2 # [ 118.776095] nix-grpc-daemon[1292]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 0 ms (attempt 1/5)5370worker2 # [ 118.783746] nix-grpc-daemon[1292]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 2/5)5371worker2 # [ 118.820245] nix-grpc-daemon[1292]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 133 ms (attempt 3/5)5372worker2 # [ 118.960955] nix-grpc-daemon[1292]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 636 ms (attempt 4/5)5373worker2 # [ 119.606144] nix-grpc-daemon[1292]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5374worker2 # [ 119.627379] nix-grpc-daemon[1292]: ts=2026-09-20T08:18:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:456885375client # [ 119.727319] nix[1187]: copying 1 paths to 'lb:50051'...5376worker2 # [ 119.643646] nix-grpc-daemon[1292]: ts=2026-09-20T08:18:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:456885377client # [ 119.727762] nix[1187]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5378worker2 # [ 119.659386] nix-daemon[844]: accepted connection from pid 1292, user nix-grpc-daemon (trusted)5379worker2 # [ 119.688196] nix-grpc-daemon[1292]: ts=2026-09-20T08:18:25Z level=info event=niks3_push_started pid=14155380worker2 # [ 120.096573] nix-daemon[844]: accepted connection from pid 1432, user nix-grpc-daemon (trusted)5381worker2 # [ 120.116381] nix-daemon[844]: reaped child process 1435, status = succeeded5382worker2 # [ 120.295405] nix-daemon[844]: accepted connection from pid 1437, user nix-grpc-daemon (trusted)5383worker2 # [ 120.313197] nix-daemon[844]: reaped child process 1440, status = succeeded5384lb # [ 120.325387] niks3-server[1118]: 2026/09/20 08:18:25 INFO Received uploads request method=POST path=/api/pending_closures5385worker2 # [ 120.339739] nix-grpc-daemon[1415]: time=2026-09-20T08:18:25.882Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5386worker2 # [ 120.341756] nix-grpc-daemon[1415]: time=2026-09-20T08:18:25.882Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5387lb # [ 120.364407] niks3-server[1118]: 2026/09/20 08:18:25 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5388worker2 # [ 120.378234] nix-grpc-daemon[1415]: time=2026-09-20T08:18:25.921Z level=INFO msg="Uploading 1 narinfos"5389lb # [ 120.374581] niks3-server[1118]: 2026/09/20 08:18:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5390lb # [ 120.384628] niks3-server[1118]: 2026/09/20 08:18:25 INFO Signed narinfos id=33 count=15391lb # [ 120.394156] niks3-server[1118]: 2026/09/20 08:18:25 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5392lb # [ 120.408423] niks3-server[1118]: 2026/09/20 08:18:25 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5393worker2 # [ 120.417987] nix-grpc-daemon[1415]: time=2026-09-20T08:18:25.961Z level=INFO msg="Upload complete. (494ms)"5394lb # [ 120.415553] niks3-server[1118]: 2026/09/20 08:18:25 INFO Completed upload id=335395lb # [ 120.418611] niks3-server[1118]: 2026/09/20 08:18:25 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo5396worker2 # [ 120.428370] nix-grpc-daemon[1292]: ts=2026-09-20T08:18:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45688 duration_s=0 paths=1 nar_bytes_in=4245397worker2 # [ 120.439100] nix-grpc-daemon[1292]: ts=2026-09-20T08:18:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:456885398worker2 # [ 120.446342] nix-daemon[844]: accepted connection from pid 1292, user nix-grpc-daemon (trusted)5399worker2 # [ 120.451260] nix-daemon[844]: reaped child process 1413, status = succeeded5400client # [ 120.545923] nix[1187]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5401worker2 # [ 120.464925] nix-daemon[844]: accepted connection from pid 1292, user nix-grpc-daemon (trusted)5402lb: must succeed: curl -sf localhost:9901/clusters5403lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5404lb: must succeed: curl -sf localhost:9901/clusters5405lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5406worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5407worker2 # [ 122.478537] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1292 (nix-grpc-daemon) on client request.5408worker2 # [ 122.480468] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5409lb # [ 122.496833] niks3-server[1118]: 2026/09/20 08:18:28 INFO lead: released remote=192.168.1.4:593985410client # [ 122.587244] nix[1187]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5411worker1 # [ 122.505249] nix-grpc-daemon[1306]: ts=2026-09-20T08:18:28Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5412client # [ 122.592592] nix[1187]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5413worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.09 seconds)5414client: must succeed: sleep 5.05415worker2 # [ 122.522823] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5416worker2 # [ 122.525796] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5417worker2 # [ 122.527047] systemd[1]: nix-grpc-daemon.service: Consumed 571ms CPU time over 17.072s wall clock time, 33.9M memory peak, 13.8K incoming IP traffic, 21.3K outgoing IP traffic.5418worker2 # [ 122.540619] nix-daemon[844]: reaped child process 1350, status = succeeded5419worker2 # [ 122.542530] nix-daemon[844]: reaped child process 1442, status = succeeded5420worker2 # [ 122.552396] nix-daemon[1444]: unexpected Nix daemon error: error: interrupted by the user5421worker2 # [ 122.556616] nix-daemon[844]: reaped child process 1444, status = failed with exit code 15422lb # [ 122.603340] envoy[914]: conn peer=[2001:db8:1::1]:41190 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2936 tx=1333 ms=84605423lb # [ 122.608516] envoy[914]: conn peer=[2001:db8:1::3]:57652 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3639 tx=1212 ms=242155424lb # [ 122.613436] envoy[914]: conn peer=[2001:db8:1::4]:54208 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=786 tx=412 ms=168025425worker1 # [ 122.705369] nix-grpc-daemon[1306]: ts=2026-09-20T08:18:28Z level=info event=scheduler_connected addr=lb:500515426worker2 # [ 122.708352] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5427worker2 # [ 122.721958] systemd[1]: Starting Nix worker-protocol over gRPC...5428worker2 # [ 122.933071] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:28Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5429worker2 # [ 122.935486] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:28Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15430worker2 # [ 122.943511] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:28Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5431worker2 # [ 122.954515] systemd[1]: Started Nix worker-protocol over gRPC.5432worker2 # [ 122.960841] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:28Z level=info event=scheduler_take_over5433lb # [ 122.957698] niks3-server[1118]: 2026/09/20 08:18:28 INFO lead: acquired remote=192.168.1.4:392105434worker2 # [ 122.976054] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:28Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05435worker2 # [ 122.991637] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:28Z level=info event=scheduler_connected addr=lb:500515436worker2 # [ 122.993577] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:28Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05437worker2 # [ 123.015778] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:28Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05438worker2 # [ 123.018612] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:28Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=15439worker1 # [ 123.080141] nix-grpc-daemon[1306]: ts=2026-09-20T08:18:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:428625440worker1 # [ 123.096529] nix-daemon[836]: accepted connection from pid 1306, user nix-grpc-daemon (trusted)5441worker1 # [ 123.121371] nix-grpc-daemon[1306]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 1 ms (attempt 1/5)5442worker1 # [ 123.129629] nix-grpc-daemon[1306]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 86 ms (attempt 2/5)5443worker1 # [ 123.215706] nix-grpc-daemon[1306]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 137 ms (attempt 3/5)5444worker1 # [ 123.360468] nix-grpc-daemon[1306]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 304 ms (attempt 4/5)5445worker1 # [ 123.673751] nix-grpc-daemon[1306]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5446worker1 # [ 123.692571] nix-grpc-daemon[1306]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' from 'http://lb:5751'...5447worker1 # [ 123.722196] nix-daemon[836]: accepted connection from pid 1306, user nix-grpc-daemon (trusted)5448client # [ 123.822474] nix[1187]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5449worker1 # [ 123.744180] nix-daemon[836]: accepted connection from pid 1306, user nix-grpc-daemon (trusted)5450client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5451client: waiting for success: ! systemctl is-active mid5452worker1 # [ 127.970852] nix-grpc-daemon[1306]: ts=2026-09-20T08:18:33Z level=info event=niks3_push_started pid=14075453worker1 # [ 128.013538] nix-daemon[836]: reaped child process 1383, status = succeeded5454worker1 # [ 128.372897] nix-daemon[836]: accepted connection from pid 1420, user nix-grpc-daemon (trusted)5455worker1 # [ 128.391316] nix-daemon[836]: reaped child process 1423, status = succeeded5456lb # [ 128.401333] niks3-server[1118]: 2026/09/20 08:18:33 INFO Received uploads request method=POST path=/api/pending_closures5457worker1 # [ 128.416443] nix-grpc-daemon[1407]: time=2026-09-20T08:18:33.943Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5458worker1 # [ 128.417956] nix-grpc-daemon[1407]: time=2026-09-20T08:18:33.943Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5459lb # [ 128.447648] niks3-server[1118]: 2026/09/20 08:18:33 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5460lb # [ 128.462423] niks3-server[1118]: 2026/09/20 08:18:34 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5461lb # [ 128.475448] niks3-server[1118]: 2026/09/20 08:18:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5462worker1 # [ 128.488121] nix-grpc-daemon[1407]: time=2026-09-20T08:18:34.014Z level=INFO msg="Uploading 1 narinfos"5463lb # [ 128.485184] niks3-server[1118]: 2026/09/20 08:18:34 INFO Signed narinfos id=34 count=15464lb # [ 128.507500] niks3-server[1118]: 2026/09/20 08:18:34 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5465worker1 # [ 128.520716] nix-grpc-daemon[1407]: time=2026-09-20T08:18:34.048Z level=INFO msg="Upload complete. (316ms)"5466lb # [ 128.520486] niks3-server[1118]: 2026/09/20 08:18:34 INFO Completed upload id=345467worker1 # [ 128.532432] nix-grpc-daemon[1306]: ts=2026-09-20T08:18:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42862 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15468lb # [ 128.539840] niks3-server[1118]: 2026/09/20 08:18:34 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls5469worker1 # [ 128.550353] nix-grpc-daemon[1407]: time=2026-09-20T08:18:34.077Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo error="server returned 404: object is not pending upload\n"5470worker1 # [ 128.557007] nix-daemon[836]: reaped child process 1381, status = succeeded5471client # [ 128.662299] systemd[1]: mid.service: Deactivated successfully.5472client # [ 128.666550] systemd[1]: mid.service: Consumed 163ms CPU time over 10.125s wall clock time, 39.2M memory peak, 9.7K incoming IP traffic, 10.7K outgoing IP traffic.5473client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds)5474client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5475client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.05 seconds)5476(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.69 seconds)5477subtest: interrupting the client stops the build on the worker5478client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5479client # [ 129.199754] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5480client # Running as unit: intr.service; invocation ID: b2f4c739e04b4f86b5259908e8562a0c5481client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds)5482worker2 # [ 129.356918] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:34Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:346305483worker2 # [ 129.371096] nix-daemon[844]: accepted connection from pid 1480, user nix-grpc-daemon (trusted)5484client # [ 129.472208] nix[1223]: don't know how to build these paths:5485client # [ 129.474763] nix[1223]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5486worker2 # [ 129.402801] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:34Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05487worker2 # [ 129.409944] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:34Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.4:50051 clients=15488worker2 # [ 129.447575] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346305489worker2 # [ 129.463937] nix-grpc-daemon[1480]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 96 ms (attempt 1/5)5490worker2 # [ 129.568289] nix-grpc-daemon[1480]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 13 ms (attempt 2/5)5491worker2 # [ 129.588635] nix-grpc-daemon[1480]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 34 ms (attempt 3/5)5492worker2 # [ 129.629994] nix-grpc-daemon[1480]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 208 ms (attempt 4/5)5493worker2 # [ 129.845991] nix-grpc-daemon[1480]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5494worker2 # [ 129.866255] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346305495client # [ 129.966299] nix[1223]: copying 1 paths to 'lb:50051'...5496worker2 # [ 129.881865] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346305497client # [ 129.969468] nix[1223]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5498worker2 # [ 129.901320] nix-daemon[844]: accepted connection from pid 1480, user nix-grpc-daemon (trusted)5499worker2 # [ 129.928893] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:35Z level=info event=niks3_push_started pid=15525500worker2 # [ 130.314575] nix-daemon[844]: accepted connection from pid 1565, user nix-grpc-daemon (trusted)5501worker2 # [ 130.332239] nix-daemon[844]: reaped child process 1568, status = succeeded5502worker2 # [ 130.522985] nix-daemon[844]: accepted connection from pid 1570, user nix-grpc-daemon (trusted)5503worker2 # [ 130.540136] nix-daemon[844]: reaped child process 1577, status = succeeded5504lb # [ 130.550699] niks3-server[1118]: 2026/09/20 08:18:36 INFO Received uploads request method=POST path=/api/pending_closures5505worker2 # [ 130.568484] nix-grpc-daemon[1552]: time=2026-09-20T08:18:36.111Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5506worker2 # [ 130.569920] nix-grpc-daemon[1552]: time=2026-09-20T08:18:36.111Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5507lb # [ 130.603415] niks3-server[1118]: 2026/09/20 08:18:36 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5508worker2 # [ 130.617988] nix-grpc-daemon[1552]: time=2026-09-20T08:18:36.161Z level=INFO msg="Uploading 1 narinfos"5509lb # [ 130.620301] niks3-server[1118]: 2026/09/20 08:18:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5510lb # [ 130.630184] niks3-server[1118]: 2026/09/20 08:18:36 INFO Signed narinfos id=35 count=15511lb # [ 130.635627] niks3-server[1118]: 2026/09/20 08:18:36 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5512lb # [ 130.646695] niks3-server[1118]: 2026/09/20 08:18:36 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5513lb # [ 130.651598] niks3-server[1118]: 2026/09/20 08:18:36 INFO Completed upload id=355514worker2 # [ 130.654717] nix-grpc-daemon[1552]: time=2026-09-20T08:18:36.198Z level=INFO msg="Upload complete. (511ms)"5515lb # [ 130.654659] niks3-server[1118]: 2026/09/20 08:18:36 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5516worker2 # [ 130.666151] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=0 paths=1 nar_bytes_in=4245517worker2 # [ 130.678695] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346305518worker2 # [ 130.685030] nix-daemon[844]: accepted connection from pid 1480, user nix-grpc-daemon (trusted)5519worker2 # [ 130.690077] nix-daemon[844]: reaped child process 1550, status = succeeded5520worker2 # [ 130.701317] nix-daemon[844]: accepted connection from pid 1480, user nix-grpc-daemon (trusted)5521client # [ 130.784221] nix[1223]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5522lb # [ 132.602265] envoy[914]: conn peer=[2001:db8:1::1]:55372 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3871 tx=1678 ms=98555523client: must succeed: systemctl kill -s INT intr5524client # [ 132.946195] systemd[1]: intr.service: Sent signal SIGINT to main process 1223 (nix) on client request.5525worker2 # [ 132.871749] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:38Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5526client # [ 132.954209] nix[1223]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5527client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds)5528client # [ 132.967056] nix[1223]: error: interrupted by the user5529client # [ 133.002097] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5530client # [ 133.006793] systemd[1]: intr.service: Failed with result 'exit-code'.5531client # [ 133.008941] systemd[1]: intr.service: Consumed 148ms CPU time over 3.805s wall clock time, 39.2M memory peak, 7.7K incoming IP traffic, 8.7K outgoing IP traffic.5532worker2 # [ 132.931112] nix-daemon[1581]: unexpected Nix daemon error:5533worker2 # [ 132.935832] nix-daemon[844]: reaped child process 1579, status = succeeded5534worker2 # [ 132.936978] nix-daemon[1581]: error: interrupted by the user5535worker2 # [ 132.940895] nix-daemon[844]: reaped child process 1581, status = failed with exit code 15536(finished: subtest: interrupting the client stops the build on the worker, in 3.93 seconds)5537subtest: a deploy mid-build drains: the build finishes, the new generation takes over5538client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5539client # [ 133.162490] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5540client # Running as unit: sw.service; invocation ID: 8b6e9e5c0ca941769f17dca1a037307a5541client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.10 seconds)5542worker2 # [ 133.325403] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:38Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:346305543client # [ 133.416559] nix[1244]: don't know how to build these paths:5544client # [ 133.417475] nix[1244]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5545worker2 # [ 133.346141] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:38Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05546worker2 # [ 133.352114] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:38Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.3:50051 clients=15547worker1 # [ 133.394000] nix-grpc-daemon[1306]: ts=2026-09-20T08:18:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:428625548worker1 # [ 133.410817] nix-grpc-daemon[1306]: ts=2026-09-20T08:18:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:428625549client # [ 133.508199] nix[1244]: copying 1 paths to 'lb:50051'...5550worker1 # [ 133.426294] nix-grpc-daemon[1306]: ts=2026-09-20T08:18:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:428625551client # [ 133.510563] nix[1244]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5552worker1 # [ 133.443618] nix-daemon[836]: accepted connection from pid 1306, user nix-grpc-daemon (trusted)5553worker1 # [ 133.656055] nix-daemon[836]: accepted connection from pid 1451, user nix-grpc-daemon (trusted)5554worker1 # [ 133.675286] nix-daemon[836]: reaped child process 1454, status = succeeded5555worker1 # [ 133.852380] nix-daemon[836]: accepted connection from pid 1456, user nix-grpc-daemon (trusted)5556worker1 # [ 133.868345] nix-daemon[836]: reaped child process 1459, status = succeeded5557lb # [ 133.878545] niks3-server[1118]: 2026/09/20 08:18:39 INFO Received uploads request method=POST path=/api/pending_closures5558worker1 # [ 133.898378] nix-grpc-daemon[1407]: time=2026-09-20T08:18:39.425Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5559worker1 # [ 133.899856] nix-grpc-daemon[1407]: time=2026-09-20T08:18:39.425Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5560lb # [ 133.911268] niks3-server[1118]: 2026/09/20 08:18:39 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5561worker1 # [ 133.929839] nix-grpc-daemon[1407]: time=2026-09-20T08:18:39.457Z level=INFO msg="Uploading 1 narinfos"5562lb # [ 133.925260] niks3-server[1118]: 2026/09/20 08:18:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5563lb # [ 133.937380] niks3-server[1118]: 2026/09/20 08:18:39 INFO Signed narinfos id=36 count=15564lb # [ 133.948814] niks3-server[1118]: 2026/09/20 08:18:39 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5565lb # [ 133.958582] niks3-server[1118]: 2026/09/20 08:18:39 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5566lb # [ 133.964591] niks3-server[1118]: 2026/09/20 08:18:39 INFO Completed upload id=365567worker1 # [ 133.968975] nix-grpc-daemon[1407]: time=2026-09-20T08:18:39.496Z level=INFO msg="Upload complete. (507ms)"5568lb # [ 133.967929] niks3-server[1118]: 2026/09/20 08:18:39 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5569worker1 # [ 133.980289] nix-grpc-daemon[1306]: ts=2026-09-20T08:18:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42862 duration_s=0 paths=1 nar_bytes_in=4165570worker1 # [ 133.991743] nix-grpc-daemon[1306]: ts=2026-09-20T08:18:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:428625571worker1 # [ 134.001950] nix-daemon[836]: accepted connection from pid 1306, user nix-grpc-daemon (trusted)5572worker1 # [ 134.005271] nix-daemon[836]: reaped child process 1449, status = succeeded5573client # [ 134.097335] nix[1244]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5574worker1 # [ 134.018742] nix-daemon[836]: accepted connection from pid 1306, user nix-grpc-daemon (trusted)5575worker1: must succeed: systemctl reload nix-grpc-daemon.service5576worker1 # [ 135.763987] systemd[1]: Reloading Nix worker-protocol over gRPC...5577worker1 # [ 135.812963] systemd[1]: Reloaded Nix worker-protocol over gRPC.5578worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.10 seconds)5579worker1: must succeed: pgrep -f 'read -t [9]0 x'5580worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds)5581client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain >&25582worker2 # [ 136.123547] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:346305583client # don't know how to build these paths:5584client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5585worker2 # [ 136.145384] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:41Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05586worker2 # [ 136.152453] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:41Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.4:50051 clients=15587worker1 # [ 136.180577] nix-grpc-daemon[1306]: ts=2026-09-20T08:18:41Z level=info event=draining5588worker2 # [ 136.186188] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346305589worker2 # [ 136.201844] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346305590client # copying 1 paths to 'lb:50051'...5591worker2 # [ 136.217774] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346305592client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5593worker2 # [ 136.242075] nix-daemon[844]: accepted connection from pid 1480, user nix-grpc-daemon (trusted)5594worker2 # [ 136.446604] nix-daemon[844]: accepted connection from pid 1631, user nix-grpc-daemon (trusted)5595worker2 # [ 136.465769] nix-daemon[844]: reaped child process 1634, status = succeeded5596worker2 # [ 136.644229] nix-daemon[844]: accepted connection from pid 1636, user nix-grpc-daemon (trusted)5597worker2 # [ 136.660628] nix-daemon[844]: reaped child process 1639, status = succeeded5598lb # [ 136.673345] niks3-server[1118]: 2026/09/20 08:18:42 INFO Received uploads request method=POST path=/api/pending_closures5599worker2 # [ 136.688570] nix-grpc-daemon[1552]: time=2026-09-20T08:18:42.231Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5600worker2 # [ 136.690022] nix-grpc-daemon[1552]: time=2026-09-20T08:18:42.231Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5601lb # [ 136.714280] niks3-server[1118]: 2026/09/20 08:18:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5602worker2 # [ 136.726124] nix-grpc-daemon[1552]: time=2026-09-20T08:18:42.269Z level=INFO msg="Uploading 1 narinfos"5603lb # [ 136.728672] niks3-server[1118]: 2026/09/20 08:18:42 INFO Signed narinfos id=37 count=15604lb # [ 136.731877] niks3-server[1118]: 2026/09/20 08:18:42 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5605worker2 # [ 136.757164] nix-grpc-daemon[1552]: time=2026-09-20T08:18:42.301Z level=INFO msg="Upload complete. (496ms)"5606lb # [ 136.754337] niks3-server[1118]: 2026/09/20 08:18:42 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5607lb # [ 136.759530] niks3-server[1118]: 2026/09/20 08:18:42 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5608worker2 # [ 136.764140] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=0 paths=1 nar_bytes_in=5285609lb # [ 136.764889] niks3-server[1118]: 2026/09/20 08:18:42 INFO Completed upload id=375610lb # [ 136.767492] niks3-server[1118]: 2026/09/20 08:18:42 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5611worker2 # [ 136.779574] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346305612worker2 # [ 136.785721] nix-daemon[844]: accepted connection from pid 1480, user nix-grpc-daemon (trusted)5613worker2 # [ 136.790627] nix-daemon[844]: reaped child process 1629, status = succeeded5614client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5615client # farm-a> worker2: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5616worker2 # [ 136.803520] nix-daemon[844]: accepted connection from pid 1480, user nix-grpc-daemon (trusted)5617client # farm-a> LOG-farm-a-during-drain5618worker2 # [ 138.244673] nix-daemon[844]: reaped child process 1643, status = succeeded5619worker2 # [ 138.420410] nix-daemon[844]: accepted connection from pid 1658, user nix-grpc-daemon (trusted)5620worker2 # [ 138.439099] nix-daemon[844]: reaped child process 1661, status = succeeded5621lb # [ 138.449175] niks3-server[1118]: 2026/09/20 08:18:43 INFO Received uploads request method=POST path=/api/pending_closures5622worker2 # [ 138.464438] nix-grpc-daemon[1552]: time=2026-09-20T08:18:44.006Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5623worker2 # [ 138.465939] nix-grpc-daemon[1552]: time=2026-09-20T08:18:44.006Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5624lb # [ 138.493655] niks3-server[1118]: 2026/09/20 08:18:44 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5625lb # [ 138.507893] niks3-server[1118]: 2026/09/20 08:18:44 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5626lb # [ 138.518695] niks3-server[1118]: 2026/09/20 08:18:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5627worker2 # [ 138.528199] nix-grpc-daemon[1552]: time=2026-09-20T08:18:44.071Z level=INFO msg="Uploading 1 narinfos"5628lb # [ 138.528353] niks3-server[1118]: 2026/09/20 08:18:44 INFO Signed narinfos id=38 count=15629lb # [ 138.534019] niks3-server[1118]: 2026/09/20 08:18:44 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5630lb # [ 138.541470] niks3-server[1118]: 2026/09/20 08:18:44 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5631lb # [ 138.550610] niks3-server[1118]: 2026/09/20 08:18:44 INFO Completed upload id=385632worker2 # [ 138.553674] nix-grpc-daemon[1552]: time=2026-09-20T08:18:44.097Z level=INFO msg="Upload complete. (339ms)"5633lb # [ 138.553120] niks3-server[1118]: 2026/09/20 08:18:44 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo5634worker2 # [ 138.573157] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=15635worker2 # [ 138.588459] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:44Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05636worker2 # [ 138.591751] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:44Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.4:50051 clients=15637worker2 # [ 138.596887] nix-daemon[844]: reaped child process 1641, status = succeeded5638worker2 # [ 138.618191] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346305639worker2 # [ 138.635464] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346305640worker2 # [ 138.652355] nix-grpc-daemon[1552]: time=2026-09-20T08:18:44.196Z level=INFO msg="All 1 paths already cached"5641client # copying 1 paths to 'lb:50051'...5642worker2 # [ 138.663543] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346305643client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5644worker2 # [ 138.683838] nix-daemon[844]: accepted connection from pid 1480, user nix-grpc-daemon (trusted)5645worker2 # [ 138.900623] nix-daemon[844]: accepted connection from pid 1667, user nix-grpc-daemon (trusted)5646worker2 # [ 138.922030] nix-daemon[844]: reaped child process 1670, status = succeeded5647worker2 # [ 139.100511] nix-daemon[844]: accepted connection from pid 1672, user nix-grpc-daemon (trusted)5648worker2 # [ 139.120817] nix-daemon[844]: reaped child process 1675, status = succeeded5649lb # [ 139.129305] niks3-server[1118]: 2026/09/20 08:18:44 INFO Received uploads request method=POST path=/api/pending_closures5650worker2 # [ 139.145550] nix-grpc-daemon[1552]: time=2026-09-20T08:18:44.689Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5651worker2 # [ 139.147042] nix-grpc-daemon[1552]: time=2026-09-20T08:18:44.689Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"5652lb # [ 139.166260] niks3-server[1118]: 2026/09/20 08:18:44 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst5653worker2 # [ 139.183656] nix-grpc-daemon[1552]: time=2026-09-20T08:18:44.727Z level=INFO msg="Uploading 1 narinfos"5654lb # [ 139.184455] niks3-server[1118]: 2026/09/20 08:18:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5655lb # [ 139.193799] niks3-server[1118]: 2026/09/20 08:18:44 INFO Signed narinfos id=39 count=15656lb # [ 139.197602] niks3-server[1118]: 2026/09/20 08:18:44 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls5657lb # [ 139.206355] niks3-server[1118]: 2026/09/20 08:18:44 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5658lb # [ 139.210599] niks3-server[1118]: 2026/09/20 08:18:44 INFO Completed upload id=395659worker2 # [ 139.213241] nix-grpc-daemon[1552]: time=2026-09-20T08:18:44.757Z level=INFO msg="Upload complete. (506ms)"5660lb # [ 139.213202] niks3-server[1118]: 2026/09/20 08:18:44 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo5661worker2 # [ 139.224210] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=0 paths=1 nar_bytes_in=6405662worker2 # [ 139.232286] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346305663worker2 # [ 139.247008] nix-daemon[844]: accepted connection from pid 1480, user nix-grpc-daemon (trusted)5664worker2 # [ 139.250104] nix-daemon[844]: reaped child process 1665, status = succeeded5665client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...5666client # farm-b> worker2: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5667worker2 # [ 139.263410] nix-daemon[844]: accepted connection from pid 1480, user nix-grpc-daemon (trusted)5668client # farm-b> LOG-farm-b-during-drain5669worker2 # [ 140.529325] nix-daemon[844]: reaped child process 1679, status = succeeded5670worker2 # [ 140.714416] nix-daemon[844]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)5671worker2 # [ 140.735573] nix-daemon[844]: reaped child process 1697, status = succeeded5672lb # [ 140.747166] niks3-server[1118]: 2026/09/20 08:18:46 INFO Received uploads request method=POST path=/api/pending_closures5673worker2 # [ 140.761504] nix-grpc-daemon[1552]: time=2026-09-20T08:18:46.304Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5674worker2 # [ 140.763046] nix-grpc-daemon[1552]: time=2026-09-20T08:18:46.304Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"5675lb # [ 140.785300] niks3-server[1118]: 2026/09/20 08:18:46 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5676lb # [ 140.805791] niks3-server[1118]: 2026/09/20 08:18:46 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst5677worker2 # [ 140.818940] nix-grpc-daemon[1552]: time=2026-09-20T08:18:46.362Z level=INFO msg="Uploading 1 narinfos"5678lb # [ 140.819761] niks3-server[1118]: 2026/09/20 08:18:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5679lb # [ 140.826233] niks3-server[1118]: 2026/09/20 08:18:46 INFO Signed narinfos id=40 count=15680lb # [ 140.829773] niks3-server[1118]: 2026/09/20 08:18:46 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls5681lb # [ 140.836443] niks3-server[1118]: 2026/09/20 08:18:46 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5682worker2 # [ 140.839205] nix-grpc-daemon[1552]: time=2026-09-20T08:18:46.383Z level=INFO msg="Upload complete. (361ms)"5683lb # [ 140.839127] niks3-server[1118]: 2026/09/20 08:18:46 INFO Completed upload id=405684lb # [ 140.842212] niks3-server[1118]: 2026/09/20 08:18:46 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo5685worker2 # [ 140.862891] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=15686worker2 # [ 140.883237] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:46Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=05687worker2 # [ 140.886899] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:46Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.4:50051 clients=15688worker2 # [ 140.891105] nix-daemon[844]: reaped child process 1677, status = succeeded5689worker2 # [ 140.908927] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346305690worker2 # [ 140.926040] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346305691worker2 # [ 140.941296] nix-grpc-daemon[1552]: time=2026-09-20T08:18:46.485Z level=INFO msg="All 2 paths already cached"5692client # copying 1 paths to 'lb:50051'...5693client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...5694worker2 # [ 140.953632] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346305695worker2 # [ 140.968672] nix-daemon[844]: accepted connection from pid 1480, user nix-grpc-daemon (trusted)5696worker2 # [ 141.182658] nix-daemon[844]: accepted connection from pid 1703, user nix-grpc-daemon (trusted)5697worker2 # [ 141.203118] nix-daemon[844]: reaped child process 1706, status = succeeded5698worker2 # [ 141.386632] nix-daemon[844]: accepted connection from pid 1708, user nix-grpc-daemon (trusted)5699worker2 # [ 141.405520] nix-daemon[844]: reaped child process 1711, status = succeeded5700lb # [ 141.413229] niks3-server[1118]: 2026/09/20 08:18:46 INFO Received uploads request method=POST path=/api/pending_closures5701worker2 # [ 141.426369] nix-grpc-daemon[1552]: time=2026-09-20T08:18:46.970Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5702worker2 # [ 141.427914] nix-grpc-daemon[1552]: time=2026-09-20T08:18:46.970Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"5703lb # [ 141.442172] niks3-server[1118]: 2026/09/20 08:18:46 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst5704worker2 # [ 141.459368] nix-grpc-daemon[1552]: time=2026-09-20T08:18:47.003Z level=INFO msg="Uploading 1 narinfos"5705lb # [ 141.456906] niks3-server[1118]: 2026/09/20 08:18:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5706lb # [ 141.468994] niks3-server[1118]: 2026/09/20 08:18:47 INFO Signed narinfos id=41 count=15707lb # [ 141.475029] niks3-server[1118]: 2026/09/20 08:18:47 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls5708lb # [ 141.481714] niks3-server[1118]: 2026/09/20 08:18:47 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5709lb # [ 141.488883] niks3-server[1118]: 2026/09/20 08:18:47 INFO Completed upload id=415710worker2 # [ 141.492247] nix-grpc-daemon[1552]: time=2026-09-20T08:18:47.036Z level=INFO msg="Upload complete. (506ms)"5711lb # [ 141.491250] niks3-server[1118]: 2026/09/20 08:18:47 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo5712worker2 # [ 141.500281] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=0 paths=1 nar_bytes_in=7685713worker2 # [ 141.511696] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346305714worker2 # [ 141.517416] nix-daemon[844]: accepted connection from pid 1480, user nix-grpc-daemon (trusted)5715worker2 # [ 141.522159] nix-daemon[844]: reaped child process 1701, status = succeeded5716client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...5717client # farm-top> worker2: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5718worker2 # [ 141.536776] nix-daemon[844]: accepted connection from pid 1480, user nix-grpc-daemon (trusted)5719lb # [ 142.604215] envoy[914]: conn peer=[2001:db8:1::1]:60634 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=733 ms=35525720worker2 # [ 142.757189] nix-daemon[844]: reaped child process 1715, status = succeeded5721client # farm-top> LOG-farm-top-during-drain5722worker2 # [ 142.920790] nix-daemon[844]: accepted connection from pid 1730, user nix-grpc-daemon (trusted)5723worker2 # [ 142.940483] nix-daemon[844]: reaped child process 1733, status = succeeded5724lb # [ 142.950011] niks3-server[1118]: 2026/09/20 08:18:48 INFO Received uploads request method=POST path=/api/pending_closures5725worker2 # [ 142.968401] nix-grpc-daemon[1552]: time=2026-09-20T08:18:48.510Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5726worker2 # [ 142.969875] nix-grpc-daemon[1552]: time=2026-09-20T08:18:48.510Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"5727worker2 # [ 143.011453] nix-grpc-daemon[1552]: time=2026-09-20T08:18:48.555Z level=INFO msg="Uploading 1 narinfos"5728lb # [ 143.007658] niks3-server[1118]: 2026/09/20 08:18:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5729lb # [ 143.020672] niks3-server[1118]: 2026/09/20 08:18:48 INFO Signed narinfos id=42 count=15730lb # [ 143.026593] niks3-server[1118]: 2026/09/20 08:18:48 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5731lb # [ 143.036492] niks3-server[1118]: 2026/09/20 08:18:48 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst5732worker2 # [ 143.046707] nix-grpc-daemon[1552]: time=2026-09-20T08:18:48.590Z level=INFO msg="Upload complete. (300ms)"5733lb # [ 143.044992] niks3-server[1118]: 2026/09/20 08:18:48 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5734lb # [ 143.050723] niks3-server[1118]: 2026/09/20 08:18:48 INFO Completed upload id=425735lb # [ 143.054226] niks3-server[1118]: 2026/09/20 08:18:48 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls5736worker2 # [ 143.057607] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=15737lb # [ 143.058530] niks3-server[1118]: 2026/09/20 08:18:48 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo5738worker2 # [ 143.073282] nix-daemon[844]: reaped child process 1713, status = succeeded5739client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain >&2, in 7.24 seconds)5740client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain outPath5741client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain outPath, in 0.23 seconds)5742worker1: must succeed: pkill -f 'read -t [9]0 x'5743worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds)5744client: waiting for success: ! systemctl is-active sw5745worker1 # [ 143.447744] nix-daemon[836]: reaped child process 1463, status = succeeded5746worker1 # [ 143.608701] nix-daemon[836]: accepted connection from pid 1503, user nix-grpc-daemon (trusted)5747worker1 # [ 143.626334] nix-daemon[836]: reaped child process 1506, status = succeeded5748lb # [ 143.634355] niks3-server[1118]: 2026/09/20 08:18:49 INFO Received uploads request method=POST path=/api/pending_closures5749worker1 # [ 143.650012] nix-grpc-daemon[1407]: time=2026-09-20T08:18:49.176Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5750worker1 # [ 143.651543] nix-grpc-daemon[1407]: time=2026-09-20T08:18:49.176Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"5751lb # [ 143.674532] niks3-server[1118]: 2026/09/20 08:18:49 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5752worker1 # [ 143.698304] nix-grpc-daemon[1407]: time=2026-09-20T08:18:49.225Z level=INFO msg="Uploading 1 narinfos"5753lb # [ 143.686008] niks3-server[1118]: 2026/09/20 08:18:49 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5754lb # [ 143.697708] niks3-server[1118]: 2026/09/20 08:18:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5755lb # [ 143.707029] niks3-server[1118]: 2026/09/20 08:18:49 INFO Signed narinfos id=43 count=15756lb # [ 143.711247] niks3-server[1118]: 2026/09/20 08:18:49 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls5757worker1 # [ 143.725549] nix-grpc-daemon[1407]: time=2026-09-20T08:18:49.253Z level=INFO msg="Upload complete. (290ms)"5758lb # [ 143.721295] niks3-server[1118]: 2026/09/20 08:18:49 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5759lb # [ 143.727402] niks3-server[1118]: 2026/09/20 08:18:49 INFO Completed upload id=435760lb # [ 143.730714] niks3-server[1118]: 2026/09/20 08:18:49 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo5761worker1 # [ 143.736668] nix-grpc-daemon[1306]: ts=2026-09-20T08:18:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42862 duration_s=9 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=15762worker1 # [ 143.746249] nix-daemon[836]: reaped child process 1461, status = succeeded5763client # [ 143.866179] systemd[1]: sw.service: Deactivated successfully.5764client # [ 143.871514] systemd[1]: sw.service: Consumed 161ms CPU time over 10.707s wall clock time, 39.2M memory peak, 8.3K incoming IP traffic, 8.9K outgoing IP traffic.5765worker1 # [ 144.183835] nix-grpc-daemon[1306]: ts=2026-09-20T08:18:49Z level=info event=signal_exit5766client: (finished: waiting for success: ! systemctl is-active sw, in 1.12 seconds)5767client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5768client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.05 seconds)5769worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5770worker2 # [ 145.406552] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:50Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:345985771worker1 # [ 145.410119] nix-grpc-daemon[1306]: ts=2026-09-20T08:18:50Z level=info event=scheduler_restarting5772worker2 # [ 145.406816] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:50Z level=info event=worker_gone addr=192.168.1.3:500515773worker1 # [ 145.431492] nix-grpc-daemon[1306]: ts=2026-09-20T08:18:50Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5774worker1 # [ 145.455836] nix-daemon[836]: reaped child process 1375, status = succeeded5775worker1 # [ 145.980662] nix-grpc-daemon[1306]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5776worker1 # [ 145.985293] nix-grpc-daemon[1306]: E0000 00:00:1789892331.508028 1349 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true5777worker1 # [ 145.997670] nix-grpc-daemon[1306]: E0000 00:00:1789892331.525106 1349 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5778worker1 # [ 146.223946] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5779worker1 # [ 146.230458] systemd[1]: nix-grpc-daemon.service: Consumed 865ms CPU time over 28.268s wall clock time, 33.3M memory peak, 21.1K incoming IP traffic, 27.2K outgoing IP traffic.5780worker1 # [ 146.252669] systemd[1]: Starting Nix worker-protocol over gRPC...5781worker1 # [ 146.456833] nix-grpc-daemon[1520]: ts=2026-09-20T08:18:51Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5782worker1 # [ 146.459330] nix-grpc-daemon[1520]: ts=2026-09-20T08:18:51Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15783worker1 # [ 146.467035] nix-grpc-daemon[1520]: ts=2026-09-20T08:18:51Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5784worker1 # [ 146.474853] systemd[1]: Started Nix worker-protocol over gRPC.5785worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 1.90 seconds)5786lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5787lb: must succeed: curl -sf localhost:9901/clusters5788worker1 # [ 146.511311] nix-grpc-daemon[1520]: ts=2026-09-20T08:18:52Z level=info event=scheduler_connected addr=lb:500515789worker2 # [ 146.513782] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:52Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05790lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5791lb: must succeed: curl -sf localhost:9901/clusters5792lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5793lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.17 seconds)5794lb: must succeed: curl -sf localhost:9901/clusters5795lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5796worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5797worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5798(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 14.79 seconds)5799subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5800client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15801worker1 # [ 148.056823] nix-grpc-daemon[1520]: ts=2026-09-20T08:18:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:359645802worker1 # [ 148.072227] nix-daemon[836]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)5803worker2 # [ 148.101256] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:53Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=05804worker2 # [ 148.107372] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:53Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=15805worker2 # [ 148.113540] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:53Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=05806worker2 # [ 148.118778] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:53Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=05807worker1 # [ 148.154023] nix-grpc-daemon[1520]: ts=2026-09-20T08:18:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359645808worker1 # [ 148.173197] nix-grpc-daemon[1520]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 18 ms (attempt 1/5)5809worker1 # [ 148.199061] nix-grpc-daemon[1520]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 57 ms (attempt 2/5)5810worker1 # [ 148.263669] nix-grpc-daemon[1520]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 400 ms (attempt 3/5)5811worker1 # [ 148.671498] nix-grpc-daemon[1520]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 619 ms (attempt 4/5)5812worker1 # [ 149.292576] nix-grpc-daemon[1520]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5813worker1 # [ 149.314317] nix-grpc-daemon[1520]: ts=2026-09-20T08:18:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:359645814worker1 # [ 149.329969] nix-grpc-daemon[1520]: ts=2026-09-20T08:18:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:359645815worker1 # [ 149.345387] nix-daemon[836]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)5816worker1 # [ 149.374339] nix-grpc-daemon[1520]: ts=2026-09-20T08:18:54Z level=info event=niks3_push_started pid=15765817worker1 # [ 149.766330] nix-daemon[836]: accepted connection from pid 1589, user nix-grpc-daemon (trusted)5818worker1 # [ 149.783917] nix-daemon[836]: reaped child process 1592, status = succeeded5819worker1 # [ 149.963152] nix-daemon[836]: accepted connection from pid 1594, user nix-grpc-daemon (trusted)5820worker1 # [ 149.980532] nix-daemon[836]: reaped child process 1597, status = succeeded5821lb # [ 149.990196] niks3-server[1118]: 2026/09/20 08:18:55 INFO Received uploads request method=POST path=/api/pending_closures5822worker1 # [ 150.003992] nix-grpc-daemon[1576]: time=2026-09-20T08:18:55.529Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5823worker1 # [ 150.005965] nix-grpc-daemon[1576]: time=2026-09-20T08:18:55.529Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"5824lb # [ 150.023139] niks3-server[1118]: 2026/09/20 08:18:55 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst5825lb # [ 150.035551] niks3-server[1118]: 2026/09/20 08:18:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5826worker1 # [ 150.047715] nix-grpc-daemon[1576]: time=2026-09-20T08:18:55.574Z level=INFO msg="Uploading 1 narinfos"5827lb # [ 150.048534] niks3-server[1118]: 2026/09/20 08:18:55 INFO Signed narinfos id=44 count=15828lb # [ 150.056212] niks3-server[1118]: 2026/09/20 08:18:55 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls5829lb # [ 150.071377] niks3-server[1118]: 2026/09/20 08:18:55 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5830lb # [ 150.077684] niks3-server[1118]: 2026/09/20 08:18:55 INFO Completed upload id=445831worker1 # [ 150.082393] nix-grpc-daemon[1576]: time=2026-09-20T08:18:55.609Z level=INFO msg="Upload complete. (490ms)"5832lb # [ 150.081032] niks3-server[1118]: 2026/09/20 08:18:55 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo5833worker1 # [ 150.092274] nix-grpc-daemon[1520]: ts=2026-09-20T08:18:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35964 duration_s=0 paths=1 nar_bytes_in=5125834worker1 # [ 150.106805] nix-grpc-daemon[1520]: ts=2026-09-20T08:18:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359645835worker1 # [ 150.113654] nix-daemon[836]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)5836worker1 # [ 150.118944] nix-daemon[836]: reaped child process 1574, status = succeeded5837worker1 # [ 150.133081] nix-daemon[836]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)5838worker1 # [ 150.761010] nix-daemon[836]: reaped child process 1601, status = succeeded5839worker1 # [ 150.927269] nix-daemon[836]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)5840worker1 # [ 150.944608] nix-daemon[836]: reaped child process 1619, status = succeeded5841lb # [ 150.954075] niks3-server[1118]: 2026/09/20 08:18:56 INFO Received uploads request method=POST path=/api/pending_closures5842worker1 # [ 150.968064] nix-grpc-daemon[1576]: time=2026-09-20T08:18:56.495Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5843worker1 # [ 150.969569] nix-grpc-daemon[1576]: time=2026-09-20T08:18:56.495Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"5844lb # [ 150.998350] niks3-server[1118]: 2026/09/20 08:18:56 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv5845lb # [ 151.010429] niks3-server[1118]: 2026/09/20 08:18:56 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5846lb # [ 151.021380] niks3-server[1118]: 2026/09/20 08:18:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5847worker1 # [ 151.027657] nix-grpc-daemon[1576]: time=2026-09-20T08:18:56.553Z level=INFO msg="Uploading 1 narinfos"5848lb # [ 151.030149] niks3-server[1118]: 2026/09/20 08:18:56 INFO Signed narinfos id=45 count=15849lb # [ 151.035548] niks3-server[1118]: 2026/09/20 08:18:56 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls5850lb # [ 151.045758] niks3-server[1118]: 2026/09/20 08:18:56 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5851lb # [ 151.053022] niks3-server[1118]: 2026/09/20 08:18:56 INFO Completed upload id=455852worker1 # [ 151.057195] nix-grpc-daemon[1576]: time=2026-09-20T08:18:56.584Z level=INFO msg="Upload complete. (314ms)"5853lb # [ 151.056107] niks3-server[1118]: 2026/09/20 08:18:56 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo5854worker2 # [ 151.065801] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:56Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=15855worker1 # [ 151.068999] nix-grpc-daemon[1520]: ts=2026-09-20T08:18:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35964 duration_s=0 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=7 outputs=15856worker2 # [ 151.080189] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:56Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=05857worker1 # [ 151.084542] nix-grpc-daemon[1520]: ts=2026-09-20T08:18:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359645858worker1 # [ 151.090131] nix-daemon[836]: reaped child process 1599, status = succeeded5859worker1 # [ 151.101399] nix-grpc-daemon[1520]: ts=2026-09-20T08:18:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:359645860worker1 # [ 151.114740] nix-grpc-daemon[1520]: ts=2026-09-20T08:18:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:359645861worker1 # [ 151.126776] nix-daemon[836]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)5862worker1 # [ 151.328404] nix-daemon[836]: accepted connection from pid 1623, user nix-grpc-daemon (trusted)5863worker1 # [ 151.346392] nix-daemon[836]: reaped child process 1626, status = succeeded5864worker1 # [ 151.520606] nix-daemon[836]: accepted connection from pid 1628, user nix-grpc-daemon (trusted)5865worker1 # [ 151.537889] nix-daemon[836]: reaped child process 1631, status = succeeded5866lb # [ 151.546271] niks3-server[1118]: 2026/09/20 08:18:57 INFO Received uploads request method=POST path=/api/pending_closures5867worker1 # [ 151.560266] nix-grpc-daemon[1576]: time=2026-09-20T08:18:57.087Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5868worker1 # [ 151.561788] nix-grpc-daemon[1576]: time=2026-09-20T08:18:57.087Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"5869lb # [ 151.574451] niks3-server[1118]: 2026/09/20 08:18:57 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst5870worker1 # [ 151.593005] nix-grpc-daemon[1576]: time=2026-09-20T08:18:57.120Z level=INFO msg="Uploading 1 narinfos"5871lb # [ 151.592195] niks3-server[1118]: 2026/09/20 08:18:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5872lb # [ 151.601960] niks3-server[1118]: 2026/09/20 08:18:57 INFO Signed narinfos id=46 count=15873lb # [ 151.607836] niks3-server[1118]: 2026/09/20 08:18:57 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls5874worker1 # [ 151.623624] nix-grpc-daemon[1576]: time=2026-09-20T08:18:57.151Z level=INFO msg="Upload complete. (483ms)"5875lb # [ 151.619619] niks3-server[1118]: 2026/09/20 08:18:57 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5876lb # [ 151.624727] niks3-server[1118]: 2026/09/20 08:18:57 INFO Completed upload id=465877worker1 # [ 151.632231] nix-grpc-daemon[1520]: ts=2026-09-20T08:18:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35964 duration_s=0 paths=1 nar_bytes_in=5125878lb # [ 151.628123] niks3-server[1118]: 2026/09/20 08:18:57 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo5879worker1 # [ 151.642245] nix-grpc-daemon[1520]: ts=2026-09-20T08:18:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359645880worker1 # [ 151.650429] nix-daemon[836]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)5881worker1 # [ 151.655148] nix-daemon[836]: reaped child process 1621, status = succeeded5882worker1 # [ 151.666392] nix-daemon[836]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)5883lb # [ 152.603478] envoy[914]: conn peer=[2001:db8:1::1]:55022 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9538 tx=3833 ms=69545884lb # [ 152.608572] envoy[914]: conn peer=[2001:db8:1::1]:55012 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2935 tx=1333 ms=104275885lb # [ 152.613361] envoy[914]: conn peer=[2001:db8:1::3]:32934 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=986 tx=448 ms=272115886worker1 # [ 152.913556] nix-daemon[836]: reaped child process 1635, status = succeeded5887worker1 # [ 153.086704] nix-daemon[836]: accepted connection from pid 1650, user nix-grpc-daemon (trusted)5888worker1 # [ 153.103644] nix-daemon[836]: reaped child process 1653, status = succeeded5889lb # [ 153.111879] niks3-server[1118]: 2026/09/20 08:18:58 INFO Received uploads request method=POST path=/api/pending_closures5890worker1 # [ 153.127359] nix-grpc-daemon[1576]: time=2026-09-20T08:18:58.654Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5891worker1 # [ 153.129009] nix-grpc-daemon[1576]: time=2026-09-20T08:18:58.654Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"5892lb # [ 153.147735] niks3-server[1118]: 2026/09/20 08:18:58 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5893lb # [ 153.162917] niks3-server[1118]: 2026/09/20 08:18:58 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv5894lb # [ 153.171942] niks3-server[1118]: 2026/09/20 08:18:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5895worker1 # [ 153.182269] nix-grpc-daemon[1576]: time=2026-09-20T08:18:58.709Z level=INFO msg="Uploading 1 narinfos"5896lb # [ 153.180706] niks3-server[1118]: 2026/09/20 08:18:58 INFO Signed narinfos id=47 count=15897lb # [ 153.183261] niks3-server[1118]: 2026/09/20 08:18:58 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls5898lb # [ 153.198244] niks3-server[1118]: 2026/09/20 08:18:58 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5899lb # [ 153.203595] niks3-server[1118]: 2026/09/20 08:18:58 INFO Completed upload id=475900worker1 # [ 153.207480] nix-grpc-daemon[1576]: time=2026-09-20T08:18:58.735Z level=INFO msg="Upload complete. (328ms)"5901lb # [ 153.205730] niks3-server[1118]: 2026/09/20 08:18:58 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo5902worker2 # [ 153.214655] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:58Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=15903worker1 # [ 153.221228] nix-grpc-daemon[1520]: ts=2026-09-20T08:18:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35964 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=8 outputs=15904worker2 # [ 153.227806] nix-grpc-daemon[1480]: ts=2026-09-20T08:18:58Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=05905worker1 # [ 153.240373] nix-grpc-daemon[1520]: ts=2026-09-20T08:18:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359645906worker1 # [ 153.253508] nix-grpc-daemon[1520]: ts=2026-09-20T08:18:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:359645907worker1 # [ 153.259300] nix-grpc-daemon[1520]: ts=2026-09-20T08:18:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:359645908worker1 # [ 153.269056] nix-daemon[836]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)5909worker1 # [ 153.273504] nix-daemon[836]: reaped child process 1633, status = succeeded5910worker1 # [ 153.461340] nix-daemon[836]: accepted connection from pid 1657, user nix-grpc-daemon (trusted)5911worker1 # [ 153.479246] nix-daemon[836]: reaped child process 1660, status = succeeded5912worker1 # [ 153.653845] nix-daemon[836]: accepted connection from pid 1662, user nix-grpc-daemon (trusted)5913worker1 # [ 153.671358] nix-daemon[836]: reaped child process 1665, status = succeeded5914lb # [ 153.678354] niks3-server[1118]: 2026/09/20 08:18:59 INFO Received uploads request method=POST path=/api/pending_closures5915worker1 # [ 153.692559] nix-grpc-daemon[1576]: time=2026-09-20T08:18:59.219Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5916worker1 # [ 153.694115] nix-grpc-daemon[1576]: time=2026-09-20T08:18:59.219Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"5917lb # [ 153.710513] niks3-server[1118]: 2026/09/20 08:18:59 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst5918worker1 # [ 153.725415] nix-grpc-daemon[1576]: time=2026-09-20T08:18:59.252Z level=INFO msg="Uploading 1 narinfos"5919lb # [ 153.726314] niks3-server[1118]: 2026/09/20 08:18:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5920lb # [ 153.735574] niks3-server[1118]: 2026/09/20 08:18:59 INFO Signed narinfos id=48 count=15921lb # [ 153.741922] niks3-server[1118]: 2026/09/20 08:18:59 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls5922worker1 # [ 153.751661] nix-grpc-daemon[1576]: time=2026-09-20T08:18:59.279Z level=INFO msg="Upload complete. (467ms)"5923lb # [ 153.747719] niks3-server[1118]: 2026/09/20 08:18:59 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5924lb # [ 153.753974] niks3-server[1118]: 2026/09/20 08:18:59 INFO Completed upload id=485925lb # [ 153.757500] niks3-server[1118]: 2026/09/20 08:18:59 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo5926worker1 # [ 153.758174] nix-grpc-daemon[1520]: ts=2026-09-20T08:18:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35964 duration_s=0 paths=1 nar_bytes_in=5125927worker1 # [ 153.770270] nix-grpc-daemon[1520]: ts=2026-09-20T08:18:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359645928worker1 # [ 153.775854] nix-daemon[836]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)5929worker1 # [ 153.780912] nix-daemon[836]: reaped child process 1655, status = succeeded5930worker1 # [ 153.792196] nix-daemon[836]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)5931worker1 # [ 155.219031] nix-daemon[836]: reaped child process 1669, status = succeeded5932worker1 # [ 155.386632] nix-daemon[836]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)5933worker1 # [ 155.404183] nix-daemon[836]: reaped child process 1687, status = succeeded5934lb # [ 155.413839] niks3-server[1118]: 2026/09/20 08:19:00 INFO Received uploads request method=POST path=/api/pending_closures5935worker1 # [ 155.427685] nix-grpc-daemon[1576]: time=2026-09-20T08:19:00.953Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5936worker1 # [ 155.429362] nix-grpc-daemon[1576]: time=2026-09-20T08:19:00.953Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"5937lb # [ 155.444176] niks3-server[1118]: 2026/09/20 08:19:00 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst5938lb # [ 155.461324] niks3-server[1118]: 2026/09/20 08:19:01 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv5939lb # [ 155.470998] niks3-server[1118]: 2026/09/20 08:19:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5940worker1 # [ 155.481304] nix-grpc-daemon[1576]: time=2026-09-20T08:19:01.008Z level=INFO msg="Uploading 1 narinfos"5941lb # [ 155.479543] niks3-server[1118]: 2026/09/20 08:19:01 INFO Signed narinfos id=49 count=15942lb # [ 155.485418] niks3-server[1118]: 2026/09/20 08:19:01 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls5943worker1 # [ 155.500133] nix-grpc-daemon[1576]: time=2026-09-20T08:19:01.027Z level=INFO msg="Upload complete. (299ms)"5944lb # [ 155.495681] niks3-server[1118]: 2026/09/20 08:19:01 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5945lb # [ 155.503110] niks3-server[1118]: 2026/09/20 08:19:01 INFO Completed upload id=495946worker2 # [ 155.506658] nix-grpc-daemon[1480]: ts=2026-09-20T08:19:01Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=15947lb # [ 155.507139] niks3-server[1118]: 2026/09/20 08:19:01 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo5948worker1 # [ 155.512730] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35964 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=9 outputs=15949worker2 # [ 155.519959] nix-grpc-daemon[1480]: ts=2026-09-20T08:19:01Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=05950worker1 # [ 155.524452] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359645951worker1 # [ 155.535300] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:359645952worker1 # [ 155.540461] nix-daemon[836]: reaped child process 1667, status = succeeded5953worker1 # [ 155.547443] nix-grpc-daemon[1576]: time=2026-09-20T08:19:01.075Z level=INFO msg="All 1 paths already cached"5954worker1 # [ 155.554909] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:359645955worker1 # [ 155.565135] nix-daemon[836]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)5956worker1 # [ 155.756182] nix-daemon[836]: accepted connection from pid 1691, user nix-grpc-daemon (trusted)5957worker1 # [ 155.774273] nix-daemon[836]: reaped child process 1694, status = succeeded5958worker1 # [ 155.949200] nix-daemon[836]: accepted connection from pid 1696, user nix-grpc-daemon (trusted)5959worker1 # [ 155.966478] nix-daemon[836]: reaped child process 1699, status = succeeded5960lb # [ 155.973120] niks3-server[1118]: 2026/09/20 08:19:01 INFO Received uploads request method=POST path=/api/pending_closures5961worker1 # [ 155.986141] nix-grpc-daemon[1576]: time=2026-09-20T08:19:01.513Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5962worker1 # [ 155.987690] nix-grpc-daemon[1576]: time=2026-09-20T08:19:01.513Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"5963lb # [ 156.001541] niks3-server[1118]: 2026/09/20 08:19:01 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst5964worker1 # [ 156.018464] nix-grpc-daemon[1576]: time=2026-09-20T08:19:01.545Z level=INFO msg="Uploading 1 narinfos"5965lb # [ 156.016975] niks3-server[1118]: 2026/09/20 08:19:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5966lb # [ 156.028566] niks3-server[1118]: 2026/09/20 08:19:01 INFO Signed narinfos id=50 count=15967lb # [ 156.039501] niks3-server[1118]: 2026/09/20 08:19:01 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls5968lb # [ 156.044252] niks3-server[1118]: 2026/09/20 08:19:01 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5969worker1 # [ 156.053363] nix-grpc-daemon[1576]: time=2026-09-20T08:19:01.580Z level=INFO msg="Upload complete. (475ms)"5970lb # [ 156.049725] niks3-server[1118]: 2026/09/20 08:19:01 INFO Completed upload id=505971lb # [ 156.053538] niks3-server[1118]: 2026/09/20 08:19:01 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo5972worker1 # [ 156.060215] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35964 duration_s=0 paths=1 nar_bytes_in=6245973worker1 # [ 156.071737] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359645974worker1 # [ 156.078456] nix-daemon[836]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)5975worker1 # [ 156.083474] nix-daemon[836]: reaped child process 1689, status = succeeded5976worker1 # [ 156.097140] nix-daemon[836]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)5977worker1 # [ 157.543629] nix-daemon[836]: reaped child process 1703, status = succeeded5978worker1 # [ 157.722508] nix-daemon[836]: accepted connection from pid 1718, user nix-grpc-daemon (trusted)5979worker1 # [ 157.741171] nix-daemon[836]: reaped child process 1721, status = succeeded5980lb # [ 157.751348] niks3-server[1118]: 2026/09/20 08:19:03 INFO Received uploads request method=POST path=/api/pending_closures5981worker1 # [ 157.768358] nix-grpc-daemon[1576]: time=2026-09-20T08:19:03.292Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5982worker1 # [ 157.770136] nix-grpc-daemon[1576]: time=2026-09-20T08:19:03.292Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"5983lb # [ 157.789361] niks3-server[1118]: 2026/09/20 08:19:03 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst5984lb # [ 157.802212] niks3-server[1118]: 2026/09/20 08:19:03 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv5985lb # [ 157.812334] niks3-server[1118]: 2026/09/20 08:19:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign5986worker1 # [ 157.822906] nix-grpc-daemon[1576]: time=2026-09-20T08:19:03.350Z level=INFO msg="Uploading 1 narinfos"5987lb # [ 157.822413] niks3-server[1118]: 2026/09/20 08:19:03 INFO Signed narinfos id=51 count=15988lb # [ 157.829284] niks3-server[1118]: 2026/09/20 08:19:03 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls5989lb # [ 157.838349] niks3-server[1118]: 2026/09/20 08:19:03 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete5990lb # [ 157.845584] niks3-server[1118]: 2026/09/20 08:19:03 INFO Completed upload id=515991worker1 # [ 157.850275] nix-grpc-daemon[1576]: time=2026-09-20T08:19:03.377Z level=INFO msg="Upload complete. (341ms)"5992lb # [ 157.848924] niks3-server[1118]: 2026/09/20 08:19:03 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo5993worker2 # [ 157.858965] nix-grpc-daemon[1480]: ts=2026-09-20T08:19:03Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=15994worker1 # [ 157.865245] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35964 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=10 outputs=15995worker2 # [ 157.872136] nix-grpc-daemon[1480]: ts=2026-09-20T08:19:03Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=05996worker1 # [ 157.884378] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359645997worker1 # [ 157.893031] nix-daemon[836]: reaped child process 1701, status = succeeded5998worker1 # [ 157.897769] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:359645999worker1 # [ 157.906977] nix-grpc-daemon[1576]: time=2026-09-20T08:19:03.434Z level=INFO msg="All 1 paths already cached"6000worker1 # [ 157.915472] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:359646001worker1 # [ 157.928747] nix-daemon[836]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)6002worker1 # [ 158.129853] nix-daemon[836]: accepted connection from pid 1725, user nix-grpc-daemon (trusted)6003worker1 # [ 158.148488] nix-daemon[836]: reaped child process 1728, status = succeeded6004worker1 # [ 158.322954] nix-daemon[836]: accepted connection from pid 1730, user nix-grpc-daemon (trusted)6005worker1 # [ 158.339678] nix-daemon[836]: reaped child process 1733, status = succeeded6006lb # [ 158.346107] niks3-server[1118]: 2026/09/20 08:19:03 INFO Received uploads request method=POST path=/api/pending_closures6007worker1 # [ 158.359145] nix-grpc-daemon[1576]: time=2026-09-20T08:19:03.886Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6008worker1 # [ 158.360758] nix-grpc-daemon[1576]: time=2026-09-20T08:19:03.886Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"6009lb # [ 158.374523] niks3-server[1118]: 2026/09/20 08:19:03 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst6010lb # [ 158.386039] niks3-server[1118]: 2026/09/20 08:19:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6011worker1 # [ 158.397758] nix-grpc-daemon[1576]: time=2026-09-20T08:19:03.925Z level=INFO msg="Uploading 1 narinfos"6012lb # [ 158.393389] niks3-server[1118]: 2026/09/20 08:19:03 INFO Signed narinfos id=52 count=16013lb # [ 158.402169] niks3-server[1118]: 2026/09/20 08:19:03 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls6014lb # [ 158.412469] niks3-server[1118]: 2026/09/20 08:19:03 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6015worker1 # [ 158.424401] nix-grpc-daemon[1576]: time=2026-09-20T08:19:03.952Z level=INFO msg="Upload complete. (478ms)"6016lb # [ 158.419849] niks3-server[1118]: 2026/09/20 08:19:03 INFO Completed upload id=526017lb # [ 158.423983] niks3-server[1118]: 2026/09/20 08:19:03 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo6018worker1 # [ 158.432124] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35964 duration_s=0 paths=1 nar_bytes_in=6246019worker1 # [ 158.442357] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359646020worker1 # [ 158.447889] nix-daemon[836]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)6021worker1 # [ 158.452749] nix-daemon[836]: reaped child process 1723, status = succeeded6022worker1 # [ 158.465734] nix-daemon[836]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)6023worker1 # [ 159.711301] nix-daemon[836]: reaped child process 1737, status = succeeded6024worker1 # [ 159.896460] nix-daemon[836]: accepted connection from pid 1752, user nix-grpc-daemon (trusted)6025worker1 # [ 159.915076] nix-daemon[836]: reaped child process 1755, status = succeeded6026lb # [ 159.927562] niks3-server[1118]: 2026/09/20 08:19:05 INFO Received uploads request method=POST path=/api/pending_closures6027worker1 # [ 159.944497] nix-grpc-daemon[1576]: time=2026-09-20T08:19:05.469Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6028worker1 # [ 159.946067] nix-grpc-daemon[1576]: time=2026-09-20T08:19:05.469Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"6029lb # [ 159.971633] niks3-server[1118]: 2026/09/20 08:19:05 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst6030lb # [ 159.984319] niks3-server[1118]: 2026/09/20 08:19:05 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv6031lb # [ 159.992685] niks3-server[1118]: 2026/09/20 08:19:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6032worker1 # [ 160.002468] nix-grpc-daemon[1576]: time=2026-09-20T08:19:05.529Z level=INFO msg="Uploading 1 narinfos"6033lb # [ 160.002111] niks3-server[1118]: 2026/09/20 08:19:05 INFO Signed narinfos id=53 count=16034lb # [ 160.008114] niks3-server[1118]: 2026/09/20 08:19:05 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls6035lb # [ 160.015955] niks3-server[1118]: 2026/09/20 08:19:05 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6036lb # [ 160.022845] niks3-server[1118]: 2026/09/20 08:19:05 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo6037lb # [ 160.028528] niks3-server[1118]: 2026/09/20 08:19:05 INFO Completed upload id=536038worker1 # [ 160.033304] nix-grpc-daemon[1576]: time=2026-09-20T08:19:05.560Z level=INFO msg="Upload complete. (357ms)"6039worker2 # [ 160.042748] nix-grpc-daemon[1480]: ts=2026-09-20T08:19:05Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=16040worker1 # [ 160.045628] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35964 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=11 outputs=16041worker2 # [ 160.053601] nix-grpc-daemon[1480]: ts=2026-09-20T08:19:05Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=06042worker1 # [ 160.066148] nix-daemon[836]: reaped child process 1735, status = succeeded6043worker1 # [ 160.090572] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359646044worker1 # [ 160.106526] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:359646045worker1 # [ 160.121551] nix-grpc-daemon[1576]: time=2026-09-20T08:19:05.649Z level=INFO msg="All 1 paths already cached"6046worker1 # [ 160.130430] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:359646047worker1 # [ 160.144480] nix-daemon[836]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)6048worker1 # [ 160.346811] nix-daemon[836]: accepted connection from pid 1759, user nix-grpc-daemon (trusted)6049worker1 # [ 160.364900] nix-daemon[836]: reaped child process 1762, status = succeeded6050worker1 # [ 160.539250] nix-daemon[836]: accepted connection from pid 1764, user nix-grpc-daemon (trusted)6051worker1 # [ 160.557252] nix-daemon[836]: reaped child process 1767, status = succeeded6052lb # [ 160.566212] niks3-server[1118]: 2026/09/20 08:19:06 INFO Received uploads request method=POST path=/api/pending_closures6053worker1 # [ 160.581536] nix-grpc-daemon[1576]: time=2026-09-20T08:19:06.108Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6054worker1 # [ 160.583116] nix-grpc-daemon[1576]: time=2026-09-20T08:19:06.108Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"6055lb # [ 160.600998] niks3-server[1118]: 2026/09/20 08:19:06 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst6056worker1 # [ 160.615173] nix-grpc-daemon[1576]: time=2026-09-20T08:19:06.142Z level=INFO msg="Uploading 1 narinfos"6057lb # [ 160.616559] niks3-server[1118]: 2026/09/20 08:19:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6058lb # [ 160.625391] niks3-server[1118]: 2026/09/20 08:19:06 INFO Signed narinfos id=54 count=16059lb # [ 160.635649] niks3-server[1118]: 2026/09/20 08:19:06 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls6060lb # [ 160.639249] niks3-server[1118]: 2026/09/20 08:19:06 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6061worker1 # [ 160.647614] nix-grpc-daemon[1576]: time=2026-09-20T08:19:06.175Z level=INFO msg="Upload complete. (486ms)"6062lb # [ 160.645172] niks3-server[1118]: 2026/09/20 08:19:06 INFO Completed upload id=546063lb # [ 160.647757] niks3-server[1118]: 2026/09/20 08:19:06 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo6064worker1 # [ 160.654518] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35964 duration_s=0 paths=1 nar_bytes_in=6246065worker1 # [ 160.669467] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359646066worker1 # [ 160.675915] nix-daemon[836]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)6067worker1 # [ 160.681532] nix-daemon[836]: reaped child process 1757, status = succeeded6068worker1 # [ 160.696273] nix-daemon[836]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)6069worker1 # [ 161.918317] nix-daemon[836]: reaped child process 1771, status = succeeded6070worker1 # [ 162.079731] nix-daemon[836]: accepted connection from pid 1786, user nix-grpc-daemon (trusted)6071worker1 # [ 162.096408] nix-daemon[836]: reaped child process 1789, status = succeeded6072lb # [ 162.107455] niks3-server[1118]: 2026/09/20 08:19:07 INFO Received uploads request method=POST path=/api/pending_closures6073worker1 # [ 162.122519] nix-grpc-daemon[1576]: time=2026-09-20T08:19:07.648Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6074worker1 # [ 162.123986] nix-grpc-daemon[1576]: time=2026-09-20T08:19:07.648Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"6075lb # [ 162.144436] niks3-server[1118]: 2026/09/20 08:19:07 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv6076lb # [ 162.156862] niks3-server[1118]: 2026/09/20 08:19:07 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst6077lb # [ 162.171172] niks3-server[1118]: 2026/09/20 08:19:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6078worker1 # [ 162.183957] nix-grpc-daemon[1576]: time=2026-09-20T08:19:07.711Z level=INFO msg="Uploading 1 narinfos"6079lb # [ 162.182820] niks3-server[1118]: 2026/09/20 08:19:07 INFO Signed narinfos id=55 count=16080lb # [ 162.191108] niks3-server[1118]: 2026/09/20 08:19:07 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls6081lb # [ 162.202555] niks3-server[1118]: 2026/09/20 08:19:07 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6082lb # [ 162.207023] niks3-server[1118]: 2026/09/20 08:19:07 INFO Completed upload id=556083worker1 # [ 162.211044] nix-grpc-daemon[1576]: time=2026-09-20T08:19:07.738Z level=INFO msg="Upload complete. (303ms)"6084lb # [ 162.209588] niks3-server[1118]: 2026/09/20 08:19:07 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo6085worker2 # [ 162.218734] nix-grpc-daemon[1480]: ts=2026-09-20T08:19:07Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=16086worker1 # [ 162.226103] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35964 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=12 outputs=16087worker2 # [ 162.232330] nix-grpc-daemon[1480]: ts=2026-09-20T08:19:07Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=06088worker1 # [ 162.242900] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359646089worker1 # [ 162.248381] nix-daemon[836]: reaped child process 1769, status = succeeded6090worker1 # [ 162.255961] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:359646091worker1 # [ 162.269598] nix-grpc-daemon[1576]: time=2026-09-20T08:19:07.797Z level=INFO msg="All 2 paths already cached"6092worker1 # [ 162.277865] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:359646093worker1 # [ 162.289620] nix-daemon[836]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)6094worker1 # [ 162.483859] nix-daemon[836]: accepted connection from pid 1793, user nix-grpc-daemon (trusted)6095worker1 # [ 162.502671] nix-daemon[836]: reaped child process 1796, status = succeeded6096worker1 # [ 162.676492] nix-daemon[836]: accepted connection from pid 1798, user nix-grpc-daemon (trusted)6097worker1 # [ 162.693502] nix-daemon[836]: reaped child process 1801, status = succeeded6098lb # [ 162.702644] niks3-server[1118]: 2026/09/20 08:19:08 INFO Received uploads request method=POST path=/api/pending_closures6099worker1 # [ 162.717316] nix-grpc-daemon[1576]: time=2026-09-20T08:19:08.244Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6100worker1 # [ 162.719036] nix-grpc-daemon[1576]: time=2026-09-20T08:19:08.244Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"6101lb # [ 162.731653] niks3-server[1118]: 2026/09/20 08:19:08 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst6102lb # [ 162.745411] niks3-server[1118]: 2026/09/20 08:19:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6103worker1 # [ 162.758451] nix-grpc-daemon[1576]: time=2026-09-20T08:19:08.285Z level=INFO msg="Uploading 1 narinfos"6104lb # [ 162.753842] niks3-server[1118]: 2026/09/20 08:19:08 INFO Signed narinfos id=56 count=16105lb # [ 162.763962] niks3-server[1118]: 2026/09/20 08:19:08 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls6106lb # [ 162.777093] niks3-server[1118]: 2026/09/20 08:19:08 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6107lb # [ 162.782567] niks3-server[1118]: 2026/09/20 08:19:08 INFO Completed upload id=566108lb # [ 162.786506] niks3-server[1118]: 2026/09/20 08:19:08 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo6109worker1 # [ 162.786235] nix-grpc-daemon[1576]: time=2026-09-20T08:19:08.313Z level=INFO msg="Upload complete. (482ms)"6110worker1 # [ 162.797241] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35964 duration_s=0 paths=1 nar_bytes_in=7526111worker1 # [ 162.804527] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359646112worker1 # [ 162.815305] nix-daemon[836]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)6113worker1 # [ 162.820347] nix-daemon[836]: reaped child process 1791, status = succeeded6114worker1 # [ 162.835176] nix-daemon[836]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)6115worker1 # [ 164.281290] nix-daemon[836]: reaped child process 1805, status = succeeded6116worker1 # [ 164.468149] nix-daemon[836]: accepted connection from pid 1820, user nix-grpc-daemon (trusted)6117worker1 # [ 164.486167] nix-daemon[836]: reaped child process 1823, status = succeeded6118lb # [ 164.494753] niks3-server[1118]: 2026/09/20 08:19:10 INFO Received uploads request method=POST path=/api/pending_closures6119worker1 # [ 164.512625] nix-grpc-daemon[1576]: time=2026-09-20T08:19:10.037Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6120worker1 # [ 164.515042] nix-grpc-daemon[1576]: time=2026-09-20T08:19:10.037Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"6121lb # [ 164.525808] niks3-server[1118]: 2026/09/20 08:19:10 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv6122lb # [ 164.543699] niks3-server[1118]: 2026/09/20 08:19:10 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst6123lb # [ 164.559639] niks3-server[1118]: 2026/09/20 08:19:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6124worker1 # [ 164.569902] nix-grpc-daemon[1576]: time=2026-09-20T08:19:10.096Z level=INFO msg="Uploading 1 narinfos"6125lb # [ 164.571045] niks3-server[1118]: 2026/09/20 08:19:10 INFO Signed narinfos id=57 count=16126lb # [ 164.577509] niks3-server[1118]: 2026/09/20 08:19:10 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls6127worker1 # [ 164.590897] nix-grpc-daemon[1576]: time=2026-09-20T08:19:10.118Z level=INFO msg="Upload complete. (345ms)"6128lb # [ 164.587287] niks3-server[1118]: 2026/09/20 08:19:10 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6129lb # [ 164.593161] niks3-server[1118]: 2026/09/20 08:19:10 INFO Completed upload id=576130lb # [ 164.596266] niks3-server[1118]: 2026/09/20 08:19:10 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo6131worker2 # [ 164.598066] nix-grpc-daemon[1480]: ts=2026-09-20T08:19:10Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=16132worker1 # [ 164.605278] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35964 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=13 outputs=16133worker1 # [ 164.624222] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359646134worker1 # [ 164.631525] nix-daemon[836]: reaped child process 1803, status = succeeded6135worker1 # [ 164.639882] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:359646136worker1 # [ 164.654611] nix-grpc-daemon[1576]: time=2026-09-20T08:19:10.182Z level=INFO msg="All 2 paths already cached"6137worker1 # [ 164.663556] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:359646138worker1 # [ 164.677314] nix-daemon[836]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)6139worker1 # [ 164.879103] nix-daemon[836]: accepted connection from pid 1827, user nix-grpc-daemon (trusted)6140worker1 # [ 164.896820] nix-daemon[836]: reaped child process 1830, status = succeeded6141worker1 # [ 165.068615] nix-daemon[836]: accepted connection from pid 1832, user nix-grpc-daemon (trusted)6142worker1 # [ 165.086423] nix-daemon[836]: reaped child process 1835, status = succeeded6143lb # [ 165.094297] niks3-server[1118]: 2026/09/20 08:19:10 INFO Received uploads request method=POST path=/api/pending_closures6144worker1 # [ 165.108492] nix-grpc-daemon[1576]: time=2026-09-20T08:19:10.635Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6145worker1 # [ 165.110020] nix-grpc-daemon[1576]: time=2026-09-20T08:19:10.635Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"6146lb # [ 165.122029] niks3-server[1118]: 2026/09/20 08:19:10 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst6147worker1 # [ 165.139640] nix-grpc-daemon[1576]: time=2026-09-20T08:19:10.667Z level=INFO msg="Uploading 1 narinfos"6148lb # [ 165.139084] niks3-server[1118]: 2026/09/20 08:19:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6149lb # [ 165.148967] niks3-server[1118]: 2026/09/20 08:19:10 INFO Signed narinfos id=58 count=16150lb # [ 165.152548] niks3-server[1118]: 2026/09/20 08:19:10 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls6151worker1 # [ 165.165652] nix-grpc-daemon[1576]: time=2026-09-20T08:19:10.693Z level=INFO msg="Upload complete. (472ms)"6152lb # [ 165.161898] niks3-server[1118]: 2026/09/20 08:19:10 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6153lb # [ 165.166024] niks3-server[1118]: 2026/09/20 08:19:10 INFO Completed upload id=586154worker1 # [ 165.172220] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35964 duration_s=0 paths=1 nar_bytes_in=7526155lb # [ 165.169196] niks3-server[1118]: 2026/09/20 08:19:10 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo6156worker1 # [ 165.184806] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359646157worker1 # [ 165.192208] nix-daemon[836]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)6158worker1 # [ 165.194566] nix-daemon[836]: reaped child process 1825, status = succeeded6159worker1 # [ 165.207904] nix-daemon[836]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)6160worker1 # [ 166.855687] nix-daemon[836]: reaped child process 1839, status = succeeded6161worker1 # [ 167.032095] nix-daemon[836]: accepted connection from pid 1854, user nix-grpc-daemon (trusted)6162worker1 # [ 167.053244] nix-daemon[836]: reaped child process 1857, status = succeeded6163lb # [ 167.060941] niks3-server[1118]: 2026/09/20 08:19:12 INFO Received uploads request method=POST path=/api/pending_closures6164worker1 # [ 167.076407] nix-grpc-daemon[1576]: time=2026-09-20T08:19:12.603Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6165worker1 # [ 167.077948] nix-grpc-daemon[1576]: time=2026-09-20T08:19:12.603Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"6166lb # [ 167.096299] niks3-server[1118]: 2026/09/20 08:19:12 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst6167lb # [ 167.113718] niks3-server[1118]: 2026/09/20 08:19:12 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv6168lb # [ 167.123134] niks3-server[1118]: 2026/09/20 08:19:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6169worker1 # [ 167.132822] nix-grpc-daemon[1576]: time=2026-09-20T08:19:12.660Z level=INFO msg="Uploading 1 narinfos"6170lb # [ 167.131878] niks3-server[1118]: 2026/09/20 08:19:12 INFO Signed narinfos id=59 count=16171lb # [ 167.136524] niks3-server[1118]: 2026/09/20 08:19:12 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls6172lb # [ 167.142365] niks3-server[1118]: 2026/09/20 08:19:12 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6173lb # [ 167.147829] niks3-server[1118]: 2026/09/20 08:19:12 INFO Completed upload id=596174worker1 # [ 167.152381] nix-grpc-daemon[1576]: time=2026-09-20T08:19:12.679Z level=INFO msg="Upload complete. (333ms)"6175lb # [ 167.150254] niks3-server[1118]: 2026/09/20 08:19:12 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo6176worker2 # [ 167.159854] nix-grpc-daemon[1480]: ts=2026-09-20T08:19:12Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=16177worker1 # [ 167.165240] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35964 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=14 outputs=16178worker1 # [ 167.182320] nix-daemon[836]: reaped child process 1837, status = succeeded6179worker1 # [ 167.204945] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359646180worker1 # [ 167.221259] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:359646181worker1 # [ 167.236426] nix-grpc-daemon[1576]: time=2026-09-20T08:19:12.763Z level=INFO msg="All 2 paths already cached"6182worker1 # [ 167.245795] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:359646183worker1 # [ 167.261565] nix-daemon[836]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)6184worker1 # [ 167.467701] nix-daemon[836]: accepted connection from pid 1861, user nix-grpc-daemon (trusted)6185worker1 # [ 167.488193] nix-daemon[836]: reaped child process 1864, status = succeeded6186worker1 # [ 167.670161] nix-daemon[836]: accepted connection from pid 1866, user nix-grpc-daemon (trusted)6187worker1 # [ 167.689403] nix-daemon[836]: reaped child process 1869, status = succeeded6188lb # [ 167.695842] niks3-server[1118]: 2026/09/20 08:19:13 INFO Received uploads request method=POST path=/api/pending_closures6189worker1 # [ 167.711278] nix-grpc-daemon[1576]: time=2026-09-20T08:19:13.238Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6190worker1 # [ 167.713427] nix-grpc-daemon[1576]: time=2026-09-20T08:19:13.240Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"6191lb # [ 167.727210] niks3-server[1118]: 2026/09/20 08:19:13 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst6192worker1 # [ 167.745100] nix-grpc-daemon[1576]: time=2026-09-20T08:19:13.272Z level=INFO msg="Uploading 1 narinfos"6193lb # [ 167.744226] niks3-server[1118]: 2026/09/20 08:19:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6194lb # [ 167.755003] niks3-server[1118]: 2026/09/20 08:19:13 INFO Signed narinfos id=60 count=16195worker1 # [ 167.769557] nix-grpc-daemon[1576]: time=2026-09-20T08:19:13.297Z level=INFO msg="Upload complete. (490ms)"6196lb # [ 167.760725] niks3-server[1118]: 2026/09/20 08:19:13 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls6197worker1 # [ 167.776145] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35964 duration_s=0 paths=1 nar_bytes_in=7526198lb # [ 167.772635] niks3-server[1118]: 2026/09/20 08:19:13 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6199lb # [ 167.778250] niks3-server[1118]: 2026/09/20 08:19:13 INFO Completed upload id=606200lb # [ 167.781068] niks3-server[1118]: 2026/09/20 08:19:13 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo6201worker1 # [ 167.790361] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359646202worker1 # [ 167.796411] nix-daemon[836]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)6203worker1 # [ 167.801337] nix-daemon[836]: reaped child process 1859, status = succeeded6204worker1 # [ 167.815550] nix-daemon[836]: accepted connection from pid 1520, user nix-grpc-daemon (trusted)6205worker1 # [ 168.856388] nix-daemon[836]: reaped child process 1873, status = succeeded6206worker1 # [ 169.023595] nix-daemon[836]: accepted connection from pid 1888, user nix-grpc-daemon (trusted)6207worker1 # [ 169.040558] nix-daemon[836]: reaped child process 1891, status = succeeded6208lb # [ 169.051434] niks3-server[1118]: 2026/09/20 08:19:14 INFO Received uploads request method=POST path=/api/pending_closures6209worker1 # [ 169.068429] nix-grpc-daemon[1576]: time=2026-09-20T08:19:14.594Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6210worker1 # [ 169.069993] nix-grpc-daemon[1576]: time=2026-09-20T08:19:14.594Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"6211lb # [ 169.100756] niks3-server[1118]: 2026/09/20 08:19:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6212worker1 # [ 169.113318] nix-grpc-daemon[1576]: time=2026-09-20T08:19:14.640Z level=INFO msg="Uploading 1 narinfos"6213lb # [ 169.111876] niks3-server[1118]: 2026/09/20 08:19:14 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst6214lb # [ 169.122703] niks3-server[1118]: 2026/09/20 08:19:14 INFO Signed narinfos id=61 count=16215lb # [ 169.130026] niks3-server[1118]: 2026/09/20 08:19:14 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv6216lb # [ 169.134139] niks3-server[1118]: 2026/09/20 08:19:14 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls6217worker1 # [ 169.142336] nix-grpc-daemon[1576]: time=2026-09-20T08:19:14.669Z level=INFO msg="Upload complete. (316ms)"6218lb # [ 169.138301] niks3-server[1118]: 2026/09/20 08:19:14 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6219lb # [ 169.143041] niks3-server[1118]: 2026/09/20 08:19:14 INFO Completed upload id=616220lb # [ 169.145691] niks3-server[1118]: 2026/09/20 08:19:14 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo6221worker1 # [ 169.152858] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35964 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=15 outputs=16222worker1 # [ 169.164647] nix-daemon[836]: reaped child process 1871, status = succeeded6223client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 21.47 seconds)6224worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6225worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.08 seconds)6226client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16227worker1 # [ 169.596783] nix-grpc-daemon[1520]: ts=2026-09-20T08:19:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:359646228worker2 # [ 169.614536] nix-grpc-daemon[1480]: ts=2026-09-20T08:19:15Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=06229lb # [ 172.607097] envoy[914]: conn peer=[2001:db8:1::1]:38422 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=26897 tx=10717 ms=211646230client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 120.32 seconds)6231(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 141.88 seconds)6232subtest: low disk drains a worker and builds go to the other6233worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6234worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.18 seconds)6235worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6236worker1 # [ 291.531756] nix-grpc-daemon[1520]: ts=2026-09-20T08:21:17Z level=info event=unhealthy reason=min_free6237worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.13 seconds)6238client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain >&26239worker1 # [ 292.247411] nix-grpc-daemon[1520]: ts=2026-09-20T08:21:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:359646240client # don't know how to build these paths:6241client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6242worker2 # [ 292.272473] nix-grpc-daemon[1480]: ts=2026-09-20T08:21:17Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=06243worker2 # [ 292.273452] nix-grpc-daemon[1480]: ts=2026-09-20T08:21:17Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=16244worker2 # [ 292.317913] nix-grpc-daemon[1480]: ts=2026-09-20T08:21:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346306245worker2 # [ 292.346741] nix-grpc-daemon[1480]: ts=2026-09-20T08:21:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346306246client # copying 1 paths to 'lb:50051'...6247client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...6248worker2 # [ 292.364836] nix-grpc-daemon[1480]: ts=2026-09-20T08:21:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346306249worker2 # [ 292.384662] nix-daemon[844]: accepted connection from pid 1480, user nix-grpc-daemon (trusted)6250worker2 # [ 292.591619] nix-daemon[844]: accepted connection from pid 1767, user nix-grpc-daemon (trusted)6251worker2 # [ 292.612493] nix-daemon[844]: reaped child process 1770, status = succeeded6252lb # [ 292.605277] envoy[914]: conn peer=[2001:db8:1::1]:53300 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=727 tx=456 ms=1200446253worker2 # [ 292.778891] nix-daemon[844]: accepted connection from pid 1772, user nix-grpc-daemon (trusted)6254worker2 # [ 292.797908] nix-daemon[844]: reaped child process 1775, status = succeeded6255lb # [ 292.808890] niks3-server[1118]: 2026/09/20 08:21:18 INFO Received uploads request method=POST path=/api/pending_closures6256worker2 # [ 292.825964] nix-grpc-daemon[1552]: time=2026-09-20T08:21:18.369Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6257worker2 # [ 292.827556] nix-grpc-daemon[1552]: time=2026-09-20T08:21:18.369Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6258lb # [ 292.851109] niks3-server[1118]: 2026/09/20 08:21:18 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6259lb # [ 292.863313] niks3-server[1118]: 2026/09/20 08:21:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6260worker2 # [ 292.873340] nix-grpc-daemon[1552]: time=2026-09-20T08:21:18.417Z level=INFO msg="Uploading 1 narinfos"6261lb # [ 292.873188] niks3-server[1118]: 2026/09/20 08:21:18 INFO Signed narinfos id=62 count=16262lb # [ 292.880333] niks3-server[1118]: 2026/09/20 08:21:18 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6263lb # [ 292.892270] niks3-server[1118]: 2026/09/20 08:21:18 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6264lb # [ 292.898624] niks3-server[1118]: 2026/09/20 08:21:18 INFO Completed upload id=626265worker2 # [ 292.901927] nix-grpc-daemon[1552]: time=2026-09-20T08:21:18.445Z level=INFO msg="Upload complete. (500ms)"6266lb # [ 292.901745] niks3-server[1118]: 2026/09/20 08:21:18 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6267worker2 # [ 292.913325] nix-grpc-daemon[1480]: ts=2026-09-20T08:21:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=0 paths=1 nar_bytes_in=5126268worker2 # [ 292.924335] nix-grpc-daemon[1480]: ts=2026-09-20T08:21:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346306269worker2 # [ 292.932297] nix-daemon[844]: accepted connection from pid 1480, user nix-grpc-daemon (trusted)6270worker2 # [ 292.937641] nix-daemon[844]: reaped child process 1765, status = succeeded6271client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6272worker2 # [ 292.949093] nix-daemon[844]: accepted connection from pid 1480, user nix-grpc-daemon (trusted)6273client # farm-a> worker2: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6274client # farm-a> LOG-farm-a-drain6275worker2 # [ 294.401490] nix-daemon[844]: reaped child process 1779, status = succeeded6276worker2 # [ 294.582364] nix-daemon[844]: accepted connection from pid 1794, user nix-grpc-daemon (trusted)6277worker2 # [ 294.602934] nix-daemon[844]: reaped child process 1797, status = succeeded6278lb # [ 294.611334] niks3-server[1118]: 2026/09/20 08:21:20 INFO Received uploads request method=POST path=/api/pending_closures6279worker2 # [ 294.625958] nix-grpc-daemon[1552]: time=2026-09-20T08:21:20.168Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6280worker2 # [ 294.627547] nix-grpc-daemon[1552]: time=2026-09-20T08:21:20.168Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6281lb # [ 294.652645] niks3-server[1118]: 2026/09/20 08:21:20 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6282lb # [ 294.664333] niks3-server[1118]: 2026/09/20 08:21:20 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6283lb # [ 294.676238] niks3-server[1118]: 2026/09/20 08:21:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6284lb # [ 294.681353] niks3-server[1118]: 2026/09/20 08:21:20 INFO Signed narinfos id=63 count=16285worker2 # [ 294.684588] nix-grpc-daemon[1552]: time=2026-09-20T08:21:20.227Z level=INFO msg="Uploading 1 narinfos"6286lb # [ 294.687155] niks3-server[1118]: 2026/09/20 08:21:20 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6287lb # [ 294.694904] niks3-server[1118]: 2026/09/20 08:21:20 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6288lb # [ 294.705845] niks3-server[1118]: 2026/09/20 08:21:20 INFO Completed upload id=636289worker2 # [ 294.709361] nix-grpc-daemon[1552]: time=2026-09-20T08:21:20.253Z level=INFO msg="Upload complete. (346ms)"6290lb # [ 294.708883] niks3-server[1118]: 2026/09/20 08:21:20 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6291worker2 # [ 294.728965] nix-grpc-daemon[1480]: ts=2026-09-20T08:21:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=16 outputs=16292worker2 # [ 294.744353] nix-grpc-daemon[1480]: ts=2026-09-20T08:21:20Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06293worker2 # [ 294.747801] nix-grpc-daemon[1480]: ts=2026-09-20T08:21:20Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16294worker2 # [ 294.752120] nix-daemon[844]: reaped child process 1777, status = succeeded6295worker2 # [ 294.773051] nix-grpc-daemon[1480]: ts=2026-09-20T08:21:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346306296worker2 # [ 294.787951] nix-grpc-daemon[1480]: ts=2026-09-20T08:21:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346306297worker2 # [ 294.802373] nix-grpc-daemon[1552]: time=2026-09-20T08:21:20.346Z level=INFO msg="All 1 paths already cached"6298client # copying 1 paths to 'lb:50051'...6299client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6300worker2 # [ 294.813339] nix-grpc-daemon[1480]: ts=2026-09-20T08:21:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346306301worker2 # [ 294.827450] nix-daemon[844]: accepted connection from pid 1480, user nix-grpc-daemon (trusted)6302worker2 # [ 295.039602] nix-daemon[844]: accepted connection from pid 1803, user nix-grpc-daemon (trusted)6303worker2 # [ 295.061740] nix-daemon[844]: reaped child process 1806, status = succeeded6304worker2 # [ 295.240641] nix-daemon[844]: accepted connection from pid 1808, user nix-grpc-daemon (trusted)6305worker2 # [ 295.260077] nix-daemon[844]: reaped child process 1811, status = succeeded6306lb # [ 295.267494] niks3-server[1118]: 2026/09/20 08:21:20 INFO Received uploads request method=POST path=/api/pending_closures6307worker2 # [ 295.277900] nix-grpc-daemon[1552]: time=2026-09-20T08:21:20.821Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6308worker2 # [ 295.279492] nix-grpc-daemon[1552]: time=2026-09-20T08:21:20.821Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6309lb # [ 295.292132] niks3-server[1118]: 2026/09/20 08:21:20 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6310lb # [ 295.309906] niks3-server[1118]: 2026/09/20 08:21:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6311worker2 # [ 295.319990] nix-grpc-daemon[1552]: time=2026-09-20T08:21:20.863Z level=INFO msg="Uploading 1 narinfos"6312lb # [ 295.324085] niks3-server[1118]: 2026/09/20 08:21:20 INFO Signed narinfos id=64 count=16313lb # [ 295.327113] niks3-server[1118]: 2026/09/20 08:21:20 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6314lb # [ 295.338557] niks3-server[1118]: 2026/09/20 08:21:20 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6315lb # [ 295.345219] niks3-server[1118]: 2026/09/20 08:21:20 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6316lb # [ 295.350313] niks3-server[1118]: 2026/09/20 08:21:20 INFO Completed upload id=646317worker2 # [ 295.353627] nix-grpc-daemon[1552]: time=2026-09-20T08:21:20.897Z level=INFO msg="Upload complete. (510ms)"6318worker2 # [ 295.361391] nix-grpc-daemon[1480]: ts=2026-09-20T08:21:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=0 paths=1 nar_bytes_in=6326319worker2 # [ 295.376823] nix-grpc-daemon[1480]: ts=2026-09-20T08:21:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346306320worker2 # [ 295.383862] nix-daemon[844]: accepted connection from pid 1480, user nix-grpc-daemon (trusted)6321worker2 # [ 295.389654] nix-daemon[844]: reaped child process 1801, status = succeeded6322client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6323client # farm-b> worker2: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6324worker2 # [ 295.405532] nix-daemon[844]: accepted connection from pid 1480, user nix-grpc-daemon (trusted)6325client # farm-b> LOG-farm-b-drain6326worker2 # [ 297.048779] nix-daemon[844]: reaped child process 1815, status = succeeded6327worker2 # [ 297.225585] nix-daemon[844]: accepted connection from pid 1830, user nix-grpc-daemon (trusted)6328worker2 # [ 297.245775] nix-daemon[844]: reaped child process 1833, status = succeeded6329lb # [ 297.253981] niks3-server[1118]: 2026/09/20 08:21:22 INFO Received uploads request method=POST path=/api/pending_closures6330worker2 # [ 297.269074] nix-grpc-daemon[1552]: time=2026-09-20T08:21:22.812Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6331worker2 # [ 297.270773] nix-grpc-daemon[1552]: time=2026-09-20T08:21:22.812Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6332lb # [ 297.293039] niks3-server[1118]: 2026/09/20 08:21:22 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6333lb # [ 297.305830] niks3-server[1118]: 2026/09/20 08:21:22 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6334worker2 # [ 297.322991] nix-grpc-daemon[1552]: time=2026-09-20T08:21:22.866Z level=INFO msg="Uploading 1 narinfos"6335lb # [ 297.321282] niks3-server[1118]: 2026/09/20 08:21:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6336lb # [ 297.331223] niks3-server[1118]: 2026/09/20 08:21:22 INFO Signed narinfos id=65 count=16337lb # [ 297.336936] niks3-server[1118]: 2026/09/20 08:21:22 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6338lb # [ 297.344652] niks3-server[1118]: 2026/09/20 08:21:22 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6339worker2 # [ 297.347464] nix-grpc-daemon[1552]: time=2026-09-20T08:21:22.891Z level=INFO msg="Upload complete. (330ms)"6340lb # [ 297.347744] niks3-server[1118]: 2026/09/20 08:21:22 INFO Completed upload id=656341lb # [ 297.353731] niks3-server[1118]: 2026/09/20 08:21:22 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6342worker2 # [ 297.365493] nix-grpc-daemon[1480]: ts=2026-09-20T08:21:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=17 outputs=16343worker2 # [ 297.380693] nix-grpc-daemon[1480]: ts=2026-09-20T08:21:22Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06344worker2 # [ 297.383909] nix-grpc-daemon[1480]: ts=2026-09-20T08:21:22Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16345worker2 # [ 297.388414] nix-daemon[844]: reaped child process 1813, status = succeeded6346worker2 # [ 297.411901] nix-grpc-daemon[1480]: ts=2026-09-20T08:21:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346306347worker2 # [ 297.427555] nix-grpc-daemon[1480]: ts=2026-09-20T08:21:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:346306348worker2 # [ 297.442797] nix-grpc-daemon[1552]: time=2026-09-20T08:21:22.986Z level=INFO msg="All 2 paths already cached"6349client # copying 1 paths to 'lb:50051'...6350worker2 # [ 297.453584] nix-grpc-daemon[1480]: ts=2026-09-20T08:21:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:346306351client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6352worker2 # [ 297.472482] nix-daemon[844]: accepted connection from pid 1480, user nix-grpc-daemon (trusted)6353worker2 # [ 297.677330] nix-daemon[844]: accepted connection from pid 1839, user nix-grpc-daemon (trusted)6354worker2 # [ 297.697841] nix-daemon[844]: reaped child process 1842, status = succeeded6355worker2 # [ 297.869092] nix-daemon[844]: accepted connection from pid 1844, user nix-grpc-daemon (trusted)6356worker2 # [ 297.888839] nix-daemon[844]: reaped child process 1847, status = succeeded6357lb # [ 297.895984] niks3-server[1118]: 2026/09/20 08:21:23 INFO Received uploads request method=POST path=/api/pending_closures6358worker2 # [ 297.909150] nix-grpc-daemon[1552]: time=2026-09-20T08:21:23.452Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6359worker2 # [ 297.910716] nix-grpc-daemon[1552]: time=2026-09-20T08:21:23.452Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6360lb # [ 297.927154] niks3-server[1118]: 2026/09/20 08:21:23 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6361worker2 # [ 297.943703] nix-grpc-daemon[1552]: time=2026-09-20T08:21:23.487Z level=INFO msg="Uploading 1 narinfos"6362lb # [ 297.944163] niks3-server[1118]: 2026/09/20 08:21:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6363lb # [ 297.956144] niks3-server[1118]: 2026/09/20 08:21:23 INFO Signed narinfos id=66 count=16364lb # [ 297.958755] niks3-server[1118]: 2026/09/20 08:21:23 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6365lb # [ 297.966882] niks3-server[1118]: 2026/09/20 08:21:23 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6366worker2 # [ 297.977128] nix-grpc-daemon[1552]: time=2026-09-20T08:21:23.521Z level=INFO msg="Upload complete. (486ms)"6367lb # [ 297.974726] niks3-server[1118]: 2026/09/20 08:21:23 INFO Completed upload id=666368lb # [ 297.977214] niks3-server[1118]: 2026/09/20 08:21:23 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6369worker2 # [ 297.984137] nix-grpc-daemon[1480]: ts=2026-09-20T08:21:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=0 paths=1 nar_bytes_in=7606370worker2 # [ 297.999329] nix-grpc-daemon[1480]: ts=2026-09-20T08:21:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:346306371worker2 # [ 298.005664] nix-daemon[844]: accepted connection from pid 1480, user nix-grpc-daemon (trusted)6372worker2 # [ 298.011009] nix-daemon[844]: reaped child process 1837, status = succeeded6373client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6374client # farm-top> worker2: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6375worker2 # [ 298.022699] nix-daemon[844]: accepted connection from pid 1480, user nix-grpc-daemon (trusted)6376client # farm-top> LOG-farm-top-drain6377worker2 # [ 299.074538] nix-daemon[844]: reaped child process 1851, status = succeeded6378worker2 # [ 299.254001] nix-daemon[844]: accepted connection from pid 1866, user nix-grpc-daemon (trusted)6379worker2 # [ 299.275800] nix-daemon[844]: reaped child process 1869, status = succeeded6380lb # [ 299.285680] niks3-server[1118]: 2026/09/20 08:21:24 INFO Received uploads request method=POST path=/api/pending_closures6381worker2 # [ 299.304476] nix-grpc-daemon[1552]: time=2026-09-20T08:21:24.846Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6382worker2 # [ 299.308521] nix-grpc-daemon[1552]: time=2026-09-20T08:21:24.846Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6383lb # [ 299.332501] niks3-server[1118]: 2026/09/20 08:21:24 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6384lb # [ 299.344421] niks3-server[1118]: 2026/09/20 08:21:24 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6385lb # [ 299.353427] niks3-server[1118]: 2026/09/20 08:21:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6386lb # [ 299.359650] niks3-server[1118]: 2026/09/20 08:21:24 INFO Signed narinfos id=67 count=16387worker2 # [ 299.362899] nix-grpc-daemon[1552]: time=2026-09-20T08:21:24.906Z level=INFO msg="Uploading 1 narinfos"6388lb # [ 299.365254] niks3-server[1118]: 2026/09/20 08:21:24 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6389lb # [ 299.377528] niks3-server[1118]: 2026/09/20 08:21:24 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6390lb # [ 299.384526] niks3-server[1118]: 2026/09/20 08:21:24 INFO Completed upload id=676391worker2 # [ 299.386988] nix-grpc-daemon[1552]: time=2026-09-20T08:21:24.930Z level=INFO msg="Upload complete. (350ms)"6392lb # [ 299.387582] niks3-server[1118]: 2026/09/20 08:21:24 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6393worker2 # [ 299.401245] nix-grpc-daemon[1480]: ts=2026-09-20T08:21:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34630 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=18 outputs=16394worker2 # [ 299.418166] nix-daemon[844]: reaped child process 1849, status = succeeded6395client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain >&2, in 7.47 seconds)6396client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain outPath6397client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain outPath, in 0.25 seconds)6398worker1: must succeed: rm /nix/.rw-store/fill6399worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds)6400worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6401worker1 # [ 300.534794] nix-grpc-daemon[1520]: ts=2026-09-20T08:21:26Z level=info event=healthy reason=min_free6402worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds)6403(finished: subtest: low disk drains a worker and builds go to the other, in 11.40 seconds)6404(finished: run the VM test script, in 302.21 seconds)6405test script finished in 302.50s6406cleanup6407kill QemuMachine (pid 49)6408client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6409kill QemuMachine (pid 50)6410lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6411kill QemuMachine (pid 51)6412worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6413kill QemuMachine (pid 52)6414worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6415(finished: cleanup, in 1.17 seconds)6416additionally exposed symbols:6417 client, lb, worker1, worker2,6418 vlan1,6419 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh