vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #221
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12client # Disk image does not exist, creating the virtualisation disk image...13worker2 # Disk image does not exist, creating the virtualisation disk image...14client # Formatting '/build/vm-state-client/tmp.RmtW0dUfbi', fmt=raw size=107374182415worker2: QEMU running (pid 51)16worker1: QEMU running (pid 52)17worker2 # Formatting '/build/vm-state-worker2/tmp.jsoxZbYTx1', fmt=raw size=107374182418worker1 # Disk image does not exist, creating the virtualisation disk image...19client: QEMU running (pid 49)20lb: QEMU running (pid 50)21client # mke2fs 1.47.4 (6-Mar-2025)22lb # Disk image does not exist, creating the virtualisation disk image...23worker1 # Formatting '/build/vm-state-worker1/tmp.exgOCfhsr8', fmt=raw size=107374182424worker1 # mke2fs 1.47.4 (6-Mar-2025)25worker2 # mke2fs 1.47.4 (6-Mar-2025)26client # Discarding device blocks: 0/262144 done27lb # Formatting '/build/vm-state-lb/tmp.nP1ClqSk0h', fmt=raw size=107374182428(finished: start all VMs, in 0.57 seconds)29worker1 # Discarding device blocks: 0/262144 done30worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes31client: waiting for unit network-addresses-eth1.service32worker1 # Filesystem UUID: 7d81f1a4-8389-42d4-add5-8d1b8f92635c33client # Creating filesystem with 262144 4k blocks and 65536 inodes34client # Filesystem UUID: f9a89a27-76af-4103-b21d-c9614b2de62035client: waiting for the VM to finish booting36client # Superblock backups stored on blocks:37worker1 # Superblock backups stored on blocks:38lb # mke2fs 1.47.4 (6-Mar-2025)39client # 32768, 98304, 163840, 22937640lb # Discarding device blocks: 0/262144 done41lb # Creating filesystem with 262144 4k blocks and 65536 inodes42worker1 # 32768, 98304, 163840, 22937643worker2 # Discarding device blocks: 0/262144 done44lb # Filesystem UUID: 2d23f1b1-adc0-4867-af86-0c27aa0ee8b545client # 46worker1 # 47lb # Superblock backups stored on blocks:48worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes49lb # 32768, 98304, 163840, 22937650client # Allocating group tables: 0/8 done51worker1 # Allocating group tables: 0/8 done52worker1 # Writing inode tables: 0/8 done53worker2 # Filesystem UUID: 6986c646-d06c-4392-a2ec-26d520be7cd654client # Writing inode tables: 0/8 done55lb # 56worker1 # Creating journal (8192 blocks): done57lb # Allocating group tables: 0/8 done58worker2 # Superblock backups stored on blocks:59client # Creating journal (8192 blocks): done60client # Writing superblocks and filesystem accounting information: 0/8 done61worker1 # Writing superblocks and filesystem accounting information: 0/8 done62worker2 # 32768, 98304, 163840, 22937663lb # Writing inode tables: 0/8 done64client # 65lb # Creating journal (8192 blocks): done66worker2 # 67worker1 # 68lb # Writing superblocks and filesystem accounting information: 0/8 done69client # Virtualisation disk image created.70worker1 # Virtualisation disk image created.71lb # 72worker2 # Allocating group tables: 0/8 done73lb # Virtualisation disk image created.74worker2 # Writing inode tables: 0/8 done75worker2 # Creating journal (8192 blocks): done76worker2 # Writing superblocks and filesystem accounting information: 0/8 done77worker2 # 78worker2 # Virtualisation disk image created.79worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]80worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202681worker1 # [ 0.000000] KASLR enabled82worker1 # [ 0.000000] random: crng init done83worker1 # [ 0.000000] Machine model: linux,dummy-virt84worker1 # [ 0.000000] efi: UEFI not found.85worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT86worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]87worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]88worker1 # [ 0.000000] Zone ranges:89worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]90worker1 # [ 0.000000] DMA32 empty91worker1 # [ 0.000000] Normal empty92worker1 # [ 0.000000] Device empty93worker1 # [ 0.000000] Movable zone start for each node94worker1 # [ 0.000000] Early memory node ranges95worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]96worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]97worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c40000098worker1 # [ 0.000000] psci: probing for conduit method from DT.99worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.100worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs101worker1 # [ 0.000000] psci: Trusted OS migration not required102worker1 # [ 0.000000] psci: SMC Calling Convention v1.1103worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)104worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296105worker1 # [ 0.000000] Detected PIPT I-cache on CPU0106worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)107worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface108worker1 # [ 0.000000] CPU features: detected: Spectre-v4109worker1 # [ 0.000000] CPU features: detected: Spectre-BHB110worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38111worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23112worker1 # [ 0.000000] alternatives: applying boot alternatives113worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/1mkwdgwcymjjiqwpvs4ar1vasmmkgm5n-nixos-system-worker1-test/init regInfo=/nix/store/fcv9f7jsq88241xzrmimra15crix7gaq-closure-info/registration console=ttyAMA0,115200n8 console=tty0114worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/fcv9f7jsq88241xzrmimra15crix7gaq-closure-info/registration", will be passed to user space.115worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes116worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)117worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)118worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB119worker1 # [ 0.000000] software IO TLB: area num 1.120worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB121worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)122worker1 # [ 0.000000] Fallback order for Node 0: 0123worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216124worker1 # [ 0.000000] Policy zone: DMA125worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off126worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1127worker1 # [ 0.000000] allocated 3145728 bytes of page_ext128worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages129worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups130worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.131worker1 # [ 0.000000] rcu: RCU event tracing is enabled.132worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.133worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.134worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.135worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.136worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.137worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1138worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.139worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.140worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.141worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0142worker1 # [ 0.000000] GICv3: 256 SPIs implemented143worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented144worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq145worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI146worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0147worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000148worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]149worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)150worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)151worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000152worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000153worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.154worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns155worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).156worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns157worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns158worker1 # [ 0.000038] arm-pv: using stolen time PV159worker1 # [ 0.001077] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)160worker1 # [ 0.001266] Console: colour dummy device 80x25161worker1 # [ 0.001275] printk: legacy console [tty0] enabled162worker1 # [ 0.001512] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)163worker1 # [ 0.001519] pid_max: default: 32768 minimum: 301164worker1 # [ 0.001601] LSM: initializing lsm=capability,landlock,yama,bpf,ima165worker1 # [ 0.001843] landlock: Up and running.166worker1 # [ 0.001846] Yama: becoming mindful.167worker1 # [ 0.002867] LSM support for eBPF active168lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]169worker1 # [ 0.003073] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)170worker1 # [ 0.003109] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)171lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026172lb # [ 0.000000] KASLR enabled173worker1 # [ 0.004372] cacheinfo: Unable to detect cache hierarchy for CPU 0174lb # [ 0.000000] random: crng init done175worker1 # [ 0.005160] rcu: Hierarchical SRCU implementation.176lb # [ 0.000000] Machine model: linux,dummy-virt177worker1 # [ 0.005165] rcu: Max phase no-delay instances is 1000.178lb # [ 0.000000] efi: UEFI not found.179worker1 # [ 0.006504] fsl-mc MSI: its@8080000 domain created180worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]181worker1 # [ 0.006603] EFI services will not be available.182lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT183worker1 # [ 0.006685] smp: Bringing up secondary CPUs ...184lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]185worker1 # [ 0.006695] smp: Brought up 1 node, 1 CPU186worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026187worker2 # [ 0.000000] KASLR enabled188worker1 # [ 0.006698] SMP: Total of 1 processors activated.189lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]190lb # [ 0.000000] Zone ranges:191worker1 # [ 0.006706] CPU: All CPU(s) started at EL1192worker2 # [ 0.000000] random: crng init done193worker2 # [ 0.000000] Machine model: linux,dummy-virt194worker2 # [ 0.000000] efi: UEFI not found.195lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]196worker1 # [ 0.006721] CPU features: detected: Branch Target Identification197lb # [ 0.000000] DMA32 empty198lb # [ 0.000000] Normal empty199client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]200worker1 # [ 0.006727] CPU features: detected: ARMv8.4 Translation Table Level201worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT202lb # [ 0.000000] Device empty203lb # [ 0.000000] Movable zone start for each node204worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]205worker1 # [ 0.006730] CPU features: detected: Instruction cache invalidation not required for I/D coherence206lb # [ 0.000000] Early memory node ranges207worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]208client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026209worker2 # [ 0.000000] Zone ranges:210client # [ 0.000000] KASLR enabled211lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]212worker1 # [ 0.006734] CPU features: detected: Data cache clean to the PoU not required for I/D coherence213client # [ 0.000000] random: crng init done214worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]215worker1 # [ 0.006737] CPU features: detected: Common not Private translations216client # [ 0.000000] Machine model: linux,dummy-virt217lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]218worker2 # [ 0.000000] DMA32 empty219client # [ 0.000000] efi: UEFI not found.220worker2 # [ 0.000000] Normal empty221lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000222worker1 # [ 0.006741] CPU features: detected: CRC32 instructions223worker2 # [ 0.000000] Device empty224lb # [ 0.000000] psci: probing for conduit method from DT.225worker2 # [ 0.000000] Movable zone start for each node226worker1 # [ 0.006744] CPU features: detected: Data cache clean to Point of Deep Persistence227worker2 # [ 0.000000] Early memory node ranges228client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT229client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]230lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.231worker1 # [ 0.006747] CPU features: detected: Data cache clean to Point of Persistence232client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]233worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]234lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs235client # [ 0.000000] Zone ranges:236worker1 # [ 0.006751] CPU features: detected: Data independent timing control (DIT)237worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]238lb # [ 0.000000] psci: Trusted OS migration not required239worker1 # [ 0.006754] CPU features: detected: E0PD240client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]241worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000242client # [ 0.000000] DMA32 empty243lb # [ 0.000000] psci: SMC Calling Convention v1.1244client # [ 0.000000] Normal empty245worker1 # [ 0.006756] CPU features: detected: Enhanced Counter Virtualization246worker2 # [ 0.000000] psci: probing for conduit method from DT.247client # [ 0.000000] Device empty248worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.249lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)250client # [ 0.000000] Movable zone start for each node251worker1 # [ 0.006759] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)252worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs253client # [ 0.000000] Early memory node ranges254lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296255worker1 # [ 0.006763] CPU features: detected: Enhanced Virtualization Traps256worker2 # [ 0.000000] psci: Trusted OS migration not required257lb # [ 0.000000] Detected PIPT I-cache on CPU0258client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]259worker2 # [ 0.000000] psci: SMC Calling Convention v1.1260worker1 # [ 0.006766] CPU features: detected: Fine Grained Traps261client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]262lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)263worker1 # [ 0.006769] CPU features: detected: Generic authentication (architected QARMA5 algorithm)264worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)265client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000266lb # [ 0.000000] CPU features: detected: GICv3 CPU interface267worker1 # [ 0.006774] CPU features: detected: RCpc load-acquire (LDAPR)268client # [ 0.000000] psci: probing for conduit method from DT.269worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296270lb # [ 0.000000] CPU features: detected: Spectre-v4271worker1 # [ 0.006777] CPU features: detected: LSE atomic instructions272client # [ 0.000000] psci: PSCIv1.3 detected in firmware.273worker2 # [ 0.000000] Detected PIPT I-cache on CPU0274lb # [ 0.000000] CPU features: detected: Spectre-BHB275worker1 # [ 0.006780] CPU features: detected: Privileged Access Never276client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs277lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38278worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)279client # [ 0.000000] psci: Trusted OS migration not required280lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23281worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface282client # [ 0.000000] psci: SMC Calling Convention v1.1283worker1 # [ 0.006783] CPU features: detected: PMUv3284lb # [ 0.000000] alternatives: applying boot alternatives285worker2 # [ 0.000000] CPU features: detected: Spectre-v4286worker1 # [ 0.006785] CPU features: detected: RAS Extension Support287worker2 # [ 0.000000] CPU features: detected: Spectre-BHB288client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)289worker1 # [ 0.006788] CPU features: detected: RASv1p1 Extension Support290worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38291client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296292worker1 # [ 0.006791] CPU features: detected: Random Number Generator293client # [ 0.000000] Detected PIPT I-cache on CPU0294worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23295worker1 # [ 0.006793] CPU features: detected: Speculation barrier (SB)296worker2 # [ 0.000000] alternatives: applying boot alternatives297client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)298worker1 # [ 0.006796] CPU features: detected: Stage-2 Force Write-Back299client # [ 0.000000] CPU features: detected: GICv3 CPU interface300worker1 # [ 0.006799] CPU features: detected: TLB range maintenance instructions301client # [ 0.000000] CPU features: detected: Spectre-v4302lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ynn2zqc2v8ljbhyrx04lvra7yrxsl31x-nixos-system-lb-test/init regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration console=ttyAMA0,115200n8 console=tty0303client # [ 0.000000] CPU features: detected: Spectre-BHB304worker1 # [ 0.006804] CPU features: detected: Speculative Store Bypassing Safe (SSBS)305client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38306worker1 # [ 0.006852] alternatives: applying system-wide alternatives307lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/i5d7jzm2mrpgnjivlqdpqn88fi5a5927-closure-info/registration", will be passed to user space.308client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23309worker1 # [ 0.010199] CPU features: detected: BBM Level 2 without TLB conflict abort310worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/qg68w562d3yaxrj7cqcnj76qmy692bcv-nixos-system-worker2-test/init regInfo=/nix/store/vb974qbr7pkj3k67wn303xgh99r1jy98-closure-info/registration console=ttyAMA0,115200n8 console=tty0311client # [ 0.000000] alternatives: applying boot alternatives312lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes313lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)314worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/vb974qbr7pkj3k67wn303xgh99r1jy98-closure-info/registration", will be passed to user space.315worker1 # [ 0.010407] Memory: 1406732K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)316worker1 # [ 0.010877] devtmpfs: initialized317lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)318worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes319worker1 # [ 0.013017] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)320lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB321worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)322lb # [ 0.000000] software IO TLB: area num 1.323worker1 # [ 0.013044] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).324client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/rn68xfasy69r8v22igpfx8xcz2w998v3-nixos-system-client-test/init regInfo=/nix/store/pmvqrw562x9yyxd3dvmdxxgfykn65j59-closure-info/registration console=ttyAMA0,115200n8 console=tty0325worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)326lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB327worker1 # [ 0.013289] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL328worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB329worker1 # [ 0.013294] 0 pages in range for non-PLT usage330lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)331worker2 # [ 0.000000] software IO TLB: area num 1.332worker1 # [ 0.013295] 508288 pages in range for PLT usage333lb # [ 0.000000] Fallback order for Node 0: 0334client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/pmvqrw562x9yyxd3dvmdxxgfykn65j59-closure-info/registration", will be passed to user space.335worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB336worker1 # [ 0.013414] pinctrl core: initialized pinctrl subsystem337client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes338lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216339worker1 # [ 0.014344] DMI not present or invalid.340lb # [ 0.000000] Policy zone: DMA341worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)342worker1 # [ 0.019165] NET: Registered PF_NETLINK/PF_ROUTE protocol family343client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)344worker2 # [ 0.000000] Fallback order for Node 0: 0345lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off346worker1 # [ 0.021610] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations347worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216348client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)349lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1350worker2 # [ 0.000000] Policy zone: DMA351client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB352worker1 # [ 0.021813] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations353lb # [ 0.000000] allocated 3145728 bytes of page_ext354worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off355client # [ 0.000000] software IO TLB: area num 1.356lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages357worker1 # [ 0.022038] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations358worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1359client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB360lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups361worker1 # [ 0.022067] audit: initializing netlink subsys (disabled)362worker2 # [ 0.000000] allocated 3145728 bytes of page_ext363lb # [ 0.000000] rcu: Hierarchical RCU implementation.364client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)365worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages366lb # [ 0.000000] rcu: RCU event tracing is enabled.367worker1 # [ 0.022934] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1368client # [ 0.000000] Fallback order for Node 0: 0369worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups370worker1 # [ 0.023527] thermal_sys: Registered thermal governor 'fair_share'371lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.372client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216373worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.374client # [ 0.000000] Policy zone: DMA375worker1 # [ 0.023530] thermal_sys: Registered thermal governor 'bang_bang'376lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.377worker2 # [ 0.000000] rcu: RCU event tracing is enabled.378lb # [ 0.000000] Rude variant of Tasks RCU enabled.379client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off380worker1 # [ 0.023537] thermal_sys: Registered thermal governor 'step_wise'381worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.382lb # [ 0.000000] Tracing variant of Tasks RCU enabled.383worker1 # [ 0.023540] thermal_sys: Registered thermal governor 'user_space'384worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.385client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1386client # [ 0.000000] allocated 3145728 bytes of page_ext387worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.388worker1 # [ 0.023543] thermal_sys: Registered thermal governor 'power_allocator'389lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.390worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.391client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages392worker1 # [ 0.023573] cpuidle: using governor ladder393lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1394worker1 # [ 0.023581] cpuidle: using governor menu395client # [ 0.000000] ftrace: allocated 294 pages with 4 groups396worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.397client # [ 0.000000] rcu: Hierarchical RCU implementation.398worker1 # [ 0.023800] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.399lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.400client # [ 0.000000] rcu: RCU event tracing is enabled.401worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1402worker1 # [ 0.023819] ASID allocator initialised with 65536 entries403worker1 # [ 0.025146] Serial: AMBA PL011 UART driver404client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.405lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.406worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.407client # [ 0.000000] Trampoline variant of Tasks RCU enabled.408worker1 # [ 0.030738] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1409client # [ 0.000000] Rude variant of Tasks RCU enabled.410lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.411worker1 # [ 0.030944] printk: console [ttyAMA0] enabled412client # [ 0.000000] Tracing variant of Tasks RCU enabled.413lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0414lb # [ 0.000000] GICv3: 256 SPIs implemented415client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.416lb # [ 0.000000] GICv3: 0 Extended SPIs implemented417worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.418worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.419worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0420client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1421worker2 # [ 0.000000] GICv3: 256 SPIs implemented422lb # [ 0.000000] Root IRQ handler: gic_handle_irq423worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented424lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI425worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq426client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.427lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0428worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI429worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0430lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000431client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.432lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]433worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000434client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.435worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]436lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)437client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0438client # [ 0.000000] GICv3: 256 SPIs implemented439worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)440client # [ 0.000000] GICv3: 0 Extended SPIs implemented441lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)442client # [ 0.000000] Root IRQ handler: gic_handle_irq443lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000444worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)445client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI446client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0447worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000448lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000449worker1 # [ 0.155618] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages450worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000451client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000452lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.453worker1 # [ 0.155643] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page454client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]455worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.456worker1 # [ 0.155649] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages457lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns458client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)459worker1 # [ 0.155653] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page460lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).461worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns462worker1 # [ 0.155659] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages463worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).464client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)465worker1 # [ 0.155663] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page466lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns467client # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000468worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns469worker1 # [ 0.155667] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages470lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns471client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000472lb # [ 0.000034] arm-pv: using stolen time PV473worker1 # [ 0.155671] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page474worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns475client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.476worker2 # [ 0.000034] arm-pv: using stolen time PV477lb # [ 0.000480] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)478client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns479lb # [ 0.000671] Console: colour dummy device 80x25480worker2 # [ 0.000466] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)481worker1 # [ 0.163331] fbcon: Taking over console482lb # [ 0.000681] printk: legacy console [tty0] enabled483client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).484worker2 # [ 0.000650] Console: colour dummy device 80x25485worker1 # [ 0.163350] ACPI: Interpreter disabled.486worker2 # [ 0.000659] printk: legacy console [tty0] enabled487lb # [ 0.000879] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)488client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns489worker2 # [ 0.000879] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)490client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns491worker2 # [ 0.000886] pid_max: default: 32768 minimum: 301492lb # [ 0.000886] pid_max: default: 32768 minimum: 301493client # [ 0.000037] arm-pv: using stolen time PV494worker2 # [ 0.000965] LSM: initializing lsm=capability,landlock,yama,bpf,ima495lb # [ 0.000977] LSM: initializing lsm=capability,landlock,yama,bpf,ima496worker2 # [ 0.001154] landlock: Up and running.497lb # [ 0.001126] landlock: Up and running.498client # [ 0.000520] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)499worker2 # [ 0.001157] Yama: becoming mindful.500lb # [ 0.001130] Yama: becoming mindful.501client # [ 0.000727] Console: colour dummy device 80x25502worker2 # [ 0.001771] LSM support for eBPF active503lb # [ 0.001633] LSM support for eBPF active504client # [ 0.000737] printk: legacy console [tty0] enabled505worker2 # [ 0.001939] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)506lb # [ 0.001763] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)507worker2 # [ 0.001972] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)508client # [ 0.000981] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)509client # [ 0.000988] pid_max: default: 32768 minimum: 301510worker2 # [ 0.003151] cacheinfo: Unable to detect cache hierarchy for CPU 0511worker2 # [ 0.003882] rcu: Hierarchical SRCU implementation.512client # [ 0.001071] LSM: initializing lsm=capability,landlock,yama,bpf,ima513lb # [ 0.001802] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)514worker1 # [ 0.171949] iommu: Default domain type: Translated515client # [ 0.001225] landlock: Up and running.516worker2 # [ 0.003887] rcu: Max phase no-delay instances is 1000.517client # [ 0.001228] Yama: becoming mindful.518lb # [ 0.003052] cacheinfo: Unable to detect cache hierarchy for CPU 0519worker2 # [ 0.005143] fsl-mc MSI: its@8080000 domain created520worker1 # [ 0.171965] iommu: DMA domain TLB invalidation policy: strict mode521client # [ 0.001777] LSM support for eBPF active522lb # [ 0.003909] rcu: Hierarchical SRCU implementation.523worker2 # [ 0.005237] EFI services will not be available.524worker1 # [ 0.173755] SCSI subsystem initialized525lb # [ 0.003915] rcu: Max phase no-delay instances is 1000.526client # [ 0.001938] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)527worker2 # [ 0.005353] smp: Bringing up secondary CPUs ...528worker2 # [ 0.005363] smp: Brought up 1 node, 1 CPU529lb # [ 0.005276] fsl-mc MSI: its@8080000 domain created530client # [ 0.001972] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)531worker2 # [ 0.005366] SMP: Total of 1 processors activated.532lb # [ 0.005381] EFI services will not be available.533worker1 # [ 0.174483] usbcore: registered new interface driver usbfs534worker2 # [ 0.005372] CPU: All CPU(s) started at EL1535lb # [ 0.005477] smp: Bringing up secondary CPUs ...536client # [ 0.003231] cacheinfo: Unable to detect cache hierarchy for CPU 0537worker1 # [ 0.174520] usbcore: registered new interface driver hub538lb # [ 0.005488] smp: Brought up 1 node, 1 CPU539client # [ 0.004086] rcu: Hierarchical SRCU implementation.540worker2 # [ 0.005384] CPU features: detected: Branch Target Identification541worker1 # [ 0.174540] usbcore: registered new device driver usb542lb # [ 0.005491] SMP: Total of 1 processors activated.543client # [ 0.004092] rcu: Max phase no-delay instances is 1000.544worker2 # [ 0.005389] CPU features: detected: ARMv8.4 Translation Table Level545worker1 # [ 0.174853] pps_core: LinuxPPS API ver. 1 registered546lb # [ 0.005497] CPU: All CPU(s) started at EL1547client # [ 0.005370] fsl-mc MSI: its@8080000 domain created548lb # [ 0.005510] CPU features: detected: Branch Target Identification549client # [ 0.005466] EFI services will not be available.550worker2 # [ 0.005392] CPU features: detected: Instruction cache invalidation not required for I/D coherence551worker1 # [ 0.174859] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>552client # [ 0.005547] smp: Bringing up secondary CPUs ...553worker1 # [ 0.174870] PTP clock support registered554lb # [ 0.005515] CPU features: detected: ARMv8.4 Translation Table Level555worker1 # [ 0.174924] EDAC MC: Ver: 3.0.0556client # [ 0.005557] smp: Brought up 1 node, 1 CPU557worker2 # [ 0.005396] CPU features: detected: Data cache clean to the PoU not required for I/D coherence558client # [ 0.005560] SMP: Total of 1 processors activated.559worker2 # [ 0.005399] CPU features: detected: Common not Private translations560lb # [ 0.005518] CPU features: detected: Instruction cache invalidation not required for I/D coherence561worker1 # [ 0.179692] scmi_core: SCMI protocol bus registered562client # [ 0.005566] CPU: All CPU(s) started at EL1563worker2 # [ 0.005403] CPU features: detected: CRC32 instructions564client # [ 0.005578] CPU features: detected: Branch Target Identification565lb # [ 0.005521] CPU features: detected: Data cache clean to the PoU not required for I/D coherence566worker1 # [ 0.180750] FPGA manager framework567worker2 # [ 0.005406] CPU features: detected: Data cache clean to Point of Deep Persistence568worker1 # [ 0.181806] vgaarb: loaded569client # [ 0.005584] CPU features: detected: ARMv8.4 Translation Table Level570lb # [ 0.005525] CPU features: detected: Common not Private translations571worker2 # [ 0.005410] CPU features: detected: Data cache clean to Point of Persistence572lb # [ 0.005528] CPU features: detected: CRC32 instructions573client # [ 0.005588] CPU features: detected: Instruction cache invalidation not required for I/D coherence574worker1 # [ 0.182497] clocksource: Switched to clocksource arch_sys_counter575worker2 # [ 0.005413] CPU features: detected: Data independent timing control (DIT)576lb # [ 0.005531] CPU features: detected: Data cache clean to Point of Deep Persistence577worker2 # [ 0.005416] CPU features: detected: E0PD578client # [ 0.005591] CPU features: detected: Data cache clean to the PoU not required for I/D coherence579worker2 # [ 0.005418] CPU features: detected: Enhanced Counter Virtualization580lb # [ 0.005535] CPU features: detected: Data cache clean to Point of Persistence581client # [ 0.005595] CPU features: detected: Common not Private translations582lb # [ 0.005538] CPU features: detected: Data independent timing control (DIT)583worker2 # [ 0.005421] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)584client # [ 0.005598] CPU features: detected: CRC32 instructions585worker1 # [ 0.185302] VFS: Disk quotas dquot_6.6.0586lb # [ 0.005541] CPU features: detected: E0PD587worker2 # [ 0.005425] CPU features: detected: Enhanced Virtualization Traps588client # [ 0.005601] CPU features: detected: Data cache clean to Point of Deep Persistence589worker1 # [ 0.185345] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)590lb # [ 0.005544] CPU features: detected: Enhanced Counter Virtualization591worker2 # [ 0.005428] CPU features: detected: Fine Grained Traps592client # [ 0.005605] CPU features: detected: Data cache clean to Point of Persistence593lb # [ 0.005547] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)594worker2 # [ 0.005431] CPU features: detected: Generic authentication (architected QARMA5 algorithm)595client # [ 0.005609] CPU features: detected: Data independent timing control (DIT)596lb # [ 0.005550] CPU features: detected: Enhanced Virtualization Traps597worker2 # [ 0.005436] CPU features: detected: RCpc load-acquire (LDAPR)598client # [ 0.005612] CPU features: detected: E0PD599lb # [ 0.005553] CPU features: detected: Fine Grained Traps600worker2 # [ 0.005439] CPU features: detected: LSE atomic instructions601worker1 # [ 0.189327] netfs: FS-Cache loaded602worker2 # [ 0.005442] CPU features: detected: Privileged Access Never603worker1 # [ 0.189516] pnp: PnP ACPI: disabled604worker2 # [ 0.005445] CPU features: detected: PMUv3605lb # [ 0.005557] CPU features: detected: Generic authentication (architected QARMA5 algorithm)606lb # [ 0.005563] CPU features: detected: RCpc load-acquire (LDAPR)607worker2 # [ 0.005448] CPU features: detected: RAS Extension Support608lb # [ 0.005566] CPU features: detected: LSE atomic instructions609worker2 # [ 0.005450] CPU features: detected: RASv1p1 Extension Support610lb # [ 0.005569] CPU features: detected: Privileged Access Never611worker2 # [ 0.005453] CPU features: detected: Random Number Generator612client # [ 0.005614] CPU features: detected: Enhanced Counter Virtualization613lb # [ 0.005571] CPU features: detected: PMUv3614client # [ 0.005618] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)615client # [ 0.005621] CPU features: detected: Enhanced Virtualization Traps616client # [ 0.005624] CPU features: detected: Fine Grained Traps617client # [ 0.005628] CPU features: detected: Generic authentication (architected QARMA5 algorithm)618client # [ 0.005634] CPU features: detected: RCpc load-acquire (LDAPR)619worker2 # [ 0.005456] CPU features: detected: Speculation barrier (SB)620lb # [ 0.005574] CPU features: detected: RAS Extension Support621client # [ 0.005637] CPU features: detected: LSE atomic instructions622worker2 # [ 0.005459] CPU features: detected: Stage-2 Force Write-Back623lb # [ 0.005577] CPU features: detected: RASv1p1 Extension Support624client # [ 0.005640] CPU features: detected: Privileged Access Never625worker2 # [ 0.005462] CPU features: detected: TLB range maintenance instructions626worker1 # [ 0.193586] NET: Registered PF_INET protocol family627client # [ 0.005643] CPU features: detected: PMUv3628lb # [ 0.005579] CPU features: detected: Random Number Generator629worker2 # [ 0.005467] CPU features: detected: Speculative Store Bypassing Safe (SSBS)630lb # [ 0.005582] CPU features: detected: Speculation barrier (SB)631client # [ 0.005646] CPU features: detected: RAS Extension Support632worker1 # [ 0.193866] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)633worker2 # [ 0.005509] alternatives: applying system-wide alternatives634lb # [ 0.005585] CPU features: detected: Stage-2 Force Write-Back635client # [ 0.005649] CPU features: detected: RASv1p1 Extension Support636client # [ 0.005652] CPU features: detected: Random Number Generator637worker2 # [ 0.008773] CPU features: detected: BBM Level 2 without TLB conflict abort638lb # [ 0.005588] CPU features: detected: TLB range maintenance instructions639client # [ 0.005654] CPU features: detected: Speculation barrier (SB)640lb # [ 0.005594] CPU features: detected: Speculative Store Bypassing Safe (SSBS)641client # [ 0.005657] CPU features: detected: Stage-2 Force Write-Back642lb # [ 0.005633] alternatives: applying system-wide alternatives643worker2 # [ 0.008964] Memory: 1406756K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)644worker2 # [ 0.009431] devtmpfs: initialized645client # [ 0.005660] CPU features: detected: TLB range maintenance instructions646lb # [ 0.008977] CPU features: detected: BBM Level 2 without TLB conflict abort647worker2 # [ 0.011430] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)648client # [ 0.005666] CPU features: detected: Speculative Store Bypassing Safe (SSBS)649client # [ 0.005706] alternatives: applying system-wide alternatives650worker2 # [ 0.011453] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).651lb # [ 0.009248] Memory: 1406528K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)652client # [ 0.009082] CPU features: detected: BBM Level 2 without TLB conflict abort653worker2 # [ 0.011659] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL654lb # [ 0.009714] devtmpfs: initialized655worker2 # [ 0.011664] 0 pages in range for non-PLT usage656lb # [ 0.011891] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)657worker2 # [ 0.011665] 508288 pages in range for PLT usage658client # [ 0.009248] Memory: 1406540K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)659worker2 # [ 0.011803] pinctrl core: initialized pinctrl subsystem660lb # [ 0.011916] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).661worker2 # [ 0.012682] DMI not present or invalid.662lb # [ 0.012124] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL663worker2 # [ 0.016326] NET: Registered PF_NETLINK/PF_ROUTE protocol family664client # [ 0.009736] devtmpfs: initialized665lb # [ 0.012130] 0 pages in range for non-PLT usage666worker2 # [ 0.018820] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations667lb # [ 0.012132] 508288 pages in range for PLT usage668client # [ 0.011684] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)669lb # [ 0.012261] pinctrl core: initialized pinctrl subsystem670worker2 # [ 0.019048] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations671client # [ 0.011709] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).672lb # [ 0.013193] DMI not present or invalid.673client # [ 0.011902] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL674lb # [ 0.016374] NET: Registered PF_NETLINK/PF_ROUTE protocol family675worker2 # [ 0.019269] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations676client # [ 0.011907] 0 pages in range for non-PLT usage677worker2 # [ 0.019303] audit: initializing netlink subsys (disabled)678lb # [ 0.018823] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations679client # [ 0.011908] 508288 pages in range for PLT usage680worker2 # [ 0.020000] thermal_sys: Registered thermal governor 'fair_share'681client # [ 0.012019] pinctrl core: initialized pinctrl subsystem682lb # [ 0.019039] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations683worker2 # [ 0.020002] thermal_sys: Registered thermal governor 'bang_bang'684client # [ 0.012795] DMI not present or invalid.685lb # [ 0.019264] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations686worker2 # [ 0.020007] thermal_sys: Registered thermal governor 'step_wise'687client # [ 0.016210] NET: Registered PF_NETLINK/PF_ROUTE protocol family688lb # [ 0.019294] audit: initializing netlink subsys (disabled)689worker2 # [ 0.020012] thermal_sys: Registered thermal governor 'user_space'690client # [ 0.018790] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations691lb # [ 0.020005] thermal_sys: Registered thermal governor 'fair_share'692worker2 # [ 0.020015] thermal_sys: Registered thermal governor 'power_allocator'693client # [ 0.019010] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations694lb # [ 0.020008] thermal_sys: Registered thermal governor 'bang_bang'695worker2 # [ 0.020052] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1696client # [ 0.019243] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations697worker2 # [ 0.020061] cpuidle: using governor ladder698lb # [ 0.020012] thermal_sys: Registered thermal governor 'step_wise'699worker2 # [ 0.020068] cpuidle: using governor menu700client # [ 0.019278] audit: initializing netlink subsys (disabled)701lb # [ 0.020018] thermal_sys: Registered thermal governor 'user_space'702worker2 # [ 0.020276] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.703client # [ 0.019951] thermal_sys: Registered thermal governor 'fair_share'704lb # [ 0.020021] thermal_sys: Registered thermal governor 'power_allocator'705worker2 # [ 0.020295] ASID allocator initialised with 65536 entries706client # [ 0.019954] thermal_sys: Registered thermal governor 'bang_bang'707worker2 # [ 0.021542] Serial: AMBA PL011 UART driver708lb # [ 0.020051] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1709client # [ 0.019958] thermal_sys: Registered thermal governor 'step_wise'710lb # [ 0.020060] cpuidle: using governor ladder711lb # [ 0.020066] cpuidle: using governor menu712worker2 # [ 0.027112] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1713client # [ 0.019964] thermal_sys: Registered thermal governor 'user_space'714worker2 # [ 0.027303] printk: console [ttyAMA0] enabled715lb # [ 0.020271] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.716client # [ 0.019966] thermal_sys: Registered thermal governor 'power_allocator'717lb # [ 0.020289] ASID allocator initialised with 65536 entries718client # [ 0.019996] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1719lb # [ 0.021581] Serial: AMBA PL011 UART driver720client # [ 0.020005] cpuidle: using governor ladder721client # [ 0.020011] cpuidle: using governor menu722lb # [ 0.027214] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1723lb # [ 0.027382] printk: console [ttyAMA0] enabled724client # [ 0.020235] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.725client # [ 0.020254] ASID allocator initialised with 65536 entries726client # [ 0.021581] Serial: AMBA PL011 UART driver727client # [ 0.027031] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1728client # [ 0.027194] printk: console [ttyAMA0] enabled729worker2 # [ 0.151192] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages730worker2 # [ 0.151219] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page731worker2 # [ 0.151226] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages732worker2 # [ 0.151230] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page733lb # [ 0.158226] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages734worker2 # [ 0.151235] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages735lb # [ 0.158256] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page736lb # [ 0.158262] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages737worker2 # [ 0.151239] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page738client # [ 0.151423] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages739worker2 # [ 0.151244] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages740lb # [ 0.158266] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page741client # [ 0.151447] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page742worker2 # [ 0.151248] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page743lb # [ 0.158271] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages744client # [ 0.151452] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages745lb # [ 0.158275] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page746client # [ 0.151457] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page747lb # [ 0.158279] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages748client # [ 0.151462] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages749worker2 # [ 0.159196] fbcon: Taking over console750worker2 # [ 0.159217] ACPI: Interpreter disabled.751lb # [ 0.158283] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page752worker1 # [ 0.226866] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)753client # [ 0.151466] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page754client # [ 0.151470] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages755worker1 # [ 0.226936] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)756client # [ 0.151475] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page757worker1 # [ 0.226989] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)758lb # [ 0.166909] fbcon: Taking over console759worker1 # [ 0.227089] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)760lb # [ 0.166931] ACPI: Interpreter disabled.761worker1 # [ 0.227232] TCP: Hash tables configured (established 16384 bind 16384)762client # [ 0.159499] fbcon: Taking over console763worker1 # [ 0.227339] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)764client # [ 0.159517] ACPI: Interpreter disabled.765worker1 # [ 0.227383] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)766worker1 # [ 0.227422] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)767worker1 # [ 0.227517] NET: Registered PF_UNIX/PF_LOCAL protocol family768worker1 # [ 0.227570] NET: Registered PF_XDP protocol family769worker1 # [ 0.227589] PCI: CLS 0 bytes, default 64770worker2 # [ 0.167674] iommu: Default domain type: Translated771worker2 # [ 0.167688] iommu: DMA domain TLB invalidation policy: strict mode772worker1 # [ 0.227855] Trying to unpack rootfs image as initramfs...773worker2 # [ 0.168255] SCSI subsystem initialized774lb # [ 0.174530] iommu: Default domain type: Translated775lb # [ 0.174543] iommu: DMA domain TLB invalidation policy: strict mode776worker2 # [ 0.170251] usbcore: registered new interface driver usbfs777lb # [ 0.176435] SCSI subsystem initialized778worker2 # [ 0.170292] usbcore: registered new interface driver hub779worker1 # [ 0.244705] kvm [1]: HYP mode not available780client # [ 0.167121] iommu: Default domain type: Translated781worker2 # [ 0.170310] usbcore: registered new device driver usb782client # [ 0.167134] iommu: DMA domain TLB invalidation policy: strict mode783worker2 # [ 0.170617] pps_core: LinuxPPS API ver. 1 registered784lb # [ 0.177215] usbcore: registered new interface driver usbfs785client # [ 0.167545] SCSI subsystem initialized786worker2 # [ 0.170624] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>787worker2 # [ 0.170633] PTP clock support registered788client # [ 0.169630] usbcore: registered new interface driver usbfs789worker2 # [ 0.170717] EDAC MC: Ver: 3.0.0790client # [ 0.169668] usbcore: registered new interface driver hub791worker2 # [ 0.175499] scmi_core: SCMI protocol bus registered792client # [ 0.169688] usbcore: registered new device driver usb793lb # [ 0.177251] usbcore: registered new interface driver hub794lb # [ 0.177272] usbcore: registered new device driver usb795lb # [ 0.177581] pps_core: LinuxPPS API ver. 1 registered796lb # [ 0.177588] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>797lb # [ 0.177606] PTP clock support registered798client # [ 0.169994] pps_core: LinuxPPS API ver. 1 registered799lb # [ 0.177656] EDAC MC: Ver: 3.0.0800worker2 # [ 0.176599] FPGA manager framework801worker2 # [ 0.177583] vgaarb: loaded802client # [ 0.170000] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>803lb # [ 0.182424] scmi_core: SCMI protocol bus registered804client # [ 0.170011] PTP clock support registered805worker2 # [ 0.178244] clocksource: Switched to clocksource arch_sys_counter806client # [ 0.170063] EDAC MC: Ver: 3.0.0807lb # [ 0.183503] FPGA manager framework808lb # [ 0.184589] vgaarb: loaded809client # [ 0.175029] scmi_core: SCMI protocol bus registered810client # [ 0.176124] FPGA manager framework811client # [ 0.177237] vgaarb: loaded812client # [ 0.177949] clocksource: Switched to clocksource arch_sys_counter813worker2 # [ 0.184639] VFS: Disk quotas dquot_6.6.0814lb # [ 0.189027] clocksource: Switched to clocksource arch_sys_counter815lb # [ 0.189742] VFS: Disk quotas dquot_6.6.0816worker2 # [ 0.184708] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)817lb # [ 0.189781] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)818worker2 # [ 0.186477] netfs: FS-Cache loaded819worker2 # [ 0.186632] pnp: PnP ACPI: disabled820lb # [ 0.192322] netfs: FS-Cache loaded821lb # [ 0.192469] pnp: PnP ACPI: disabled822client # [ 0.183775] VFS: Disk quotas dquot_6.6.0823client # [ 0.183822] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)824client # [ 0.187863] netfs: FS-Cache loaded825client # [ 0.188031] pnp: PnP ACPI: disabled826worker2 # [ 0.190713] NET: Registered PF_INET protocol family827worker2 # [ 0.191020] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)828lb # [ 0.198984] NET: Registered PF_INET protocol family829lb # [ 0.199299] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)830client # [ 0.192195] NET: Registered PF_INET protocol family831client # [ 0.192496] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)832lb # [ 0.232866] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)833lb # [ 0.232936] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)834lb # [ 0.232977] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)835worker2 # [ 0.224625] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)836worker2 # [ 0.224694] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)837lb # [ 0.233077] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)838lb # [ 0.233223] TCP: Hash tables configured (established 16384 bind 16384)839worker2 # [ 0.224730] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)840worker2 # [ 0.224827] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)841worker2 # [ 0.224973] TCP: Hash tables configured (established 16384 bind 16384)842worker2 # [ 0.225083] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)843worker2 # [ 0.225126] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)844worker2 # [ 0.225167] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)845worker2 # [ 0.225297] NET: Registered PF_UNIX/PF_LOCAL protocol family846worker2 # [ 0.225330] NET: Registered PF_XDP protocol family847client # [ 0.227016] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)848worker2 # [ 0.225351] PCI: CLS 0 bytes, default 64849worker2 # [ 0.225610] Trying to unpack rootfs image as initramfs...850client # [ 0.227084] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)851client # [ 0.227123] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)852lb # [ 0.238439] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)853lb # [ 0.238495] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)854client # [ 0.227227] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)855worker2 # [ 0.240180] kvm [1]: HYP mode not available856client # [ 0.227373] TCP: Hash tables configured (established 16384 bind 16384)857lb # [ 0.238535] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)858lb # [ 0.238678] NET: Registered PF_UNIX/PF_LOCAL protocol family859client # [ 0.227482] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)860lb # [ 0.238740] NET: Registered PF_XDP protocol family861client # [ 0.227525] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)862lb # [ 0.238761] PCI: CLS 0 bytes, default 64863lb # [ 0.239030] Trying to unpack rootfs image as initramfs...864client # [ 0.227564] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)865client # [ 0.227663] NET: Registered PF_UNIX/PF_LOCAL protocol family866client # [ 0.227713] NET: Registered PF_XDP protocol family867client # [ 0.227735] PCI: CLS 0 bytes, default 64868client # [ 0.228020] Trying to unpack rootfs image as initramfs...869lb # [ 0.250604] kvm [1]: HYP mode not available870client # [ 0.244050] kvm [1]: HYP mode not available871worker1 # [ 0.443184] Initialise system trusted keyrings872worker1 # [ 0.444040] workingset: timestamp_bits=42 max_order=19 bucket_order=0873worker1 # [ 0.445461] squashfs: version 4.0 (2009/01/31) Phillip Lougher874worker1 # [ 0.446323] 9p: Installing v9fs 9p2000 file system support875worker1 # [ 0.475311] Key type asymmetric registered876worker1 # [ 0.475348] Asymmetric key parser 'x509' registered877worker1 # [ 0.475434] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)878worker1 # [ 0.477739] io scheduler mq-deadline registered879worker1 # [ 0.477753] io scheduler kyber registered880worker1 # [ 0.491635] pl061_gpio 9030000.pl061: PL061 GPIO chip registered881worker1 # [ 0.492252] ledtrig-cpu: registered to indicate activity on CPUs882worker1 # [ 0.492648] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:883worker1 # [ 0.492670] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000884worker1 # [ 0.492682] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000885worker1 # [ 0.492690] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000886worker1 # [ 0.492712] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits887worker1 # [ 0.492736] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]888worker1 # [ 0.492819] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00889worker1 # [ 0.492828] pci_bus 0000:00: root bus resource [bus 00-ff]890worker1 # [ 0.492835] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]891worker1 # [ 0.492839] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]892worker1 # [ 0.492845] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]893worker1 # [ 0.492950] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint894worker1 # [ 0.493419] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint895worker1 # [ 0.493658] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]896worker1 # [ 0.493676] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]897worker1 # [ 0.493706] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]898worker1 # [ 0.493727] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]899worker1 # [ 0.494209] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint900worker1 # [ 0.494399] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]901worker1 # [ 0.494417] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]902worker2 # [ 0.443084] Initialise system trusted keyrings903worker1 # [ 0.494447] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]904worker2 # [ 0.443919] workingset: timestamp_bits=42 max_order=19 bucket_order=0905worker1 # [ 0.494962] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint906worker1 # [ 0.495153] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]907worker2 # [ 0.445287] squashfs: version 4.0 (2009/01/31) Phillip Lougher908worker1 # [ 0.495170] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]909worker2 # [ 0.446080] 9p: Installing v9fs 9p2000 file system support910worker1 # [ 0.495203] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]911worker1 # [ 0.495701] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint912worker1 # [ 0.495884] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]913worker1 # [ 0.495900] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]914worker1 # [ 0.495934] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]915worker1 # [ 0.496402] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint916worker1 # [ 0.496587] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]917worker1 # [ 0.496604] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]918lb # [ 0.457472] Initialise system trusted keyrings919worker1 # [ 0.496634] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]920lb # [ 0.458388] workingset: timestamp_bits=42 max_order=19 bucket_order=0921worker1 # [ 0.497096] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint922lb # [ 0.459891] squashfs: version 4.0 (2009/01/31) Phillip Lougher923worker1 # [ 0.497291] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]924client # [ 0.450790] Initialise system trusted keyrings925worker1 # [ 0.497307] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]926client # [ 0.451599] workingset: timestamp_bits=42 max_order=19 bucket_order=0927lb # [ 0.460760] 9p: Installing v9fs 9p2000 file system support928worker1 # [ 0.497337] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]929client # [ 0.453057] squashfs: version 4.0 (2009/01/31) Phillip Lougher930worker1 # [ 0.497829] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint931worker1 # [ 0.498018] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]932client # [ 0.453901] 9p: Installing v9fs 9p2000 file system support933worker1 # [ 0.498034] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]934worker1 # [ 0.498064] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]935worker1 # [ 0.498083] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]936worker1 # [ 0.538666] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint937worker1 # [ 0.538890] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]938worker1 # [ 0.538921] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]939worker1 # [ 0.539455] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint940worker1 # [ 0.539647] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]941worker1 # [ 0.539677] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]942worker1 # [ 0.540081] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint943worker1 # [ 0.540266] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]944worker2 # [ 0.474969] Key type asymmetric registered945worker1 # [ 0.540522] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint946worker2 # [ 0.475005] Asymmetric key parser 'x509' registered947worker1 # [ 0.540810] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]948worker2 # [ 0.475094] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)949worker1 # [ 0.540829] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]950worker2 # [ 0.477320] io scheduler mq-deadline registered951worker1 # [ 0.540859] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]952worker2 # [ 0.477334] io scheduler kyber registered953worker1 # [ 0.541320] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint954worker1 # [ 0.541523] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]955worker1 # [ 0.541540] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]956worker1 # [ 0.541569] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]957worker1 # [ 0.542186] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned958worker1 # [ 0.542197] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned959worker1 # [ 0.542203] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned960worker1 # [ 0.542253] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned961lb # [ 0.489636] Key type asymmetric registered962lb # [ 0.489671] Asymmetric key parser 'x509' registered963worker1 # [ 0.542301] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned964worker1 # [ 0.542349] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned965client # [ 0.482790] Key type asymmetric registered966lb # [ 0.489772] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)967worker1 # [ 0.542397] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned968client # [ 0.482834] Asymmetric key parser 'x509' registered969lb # [ 0.492050] io scheduler mq-deadline registered970lb # [ 0.492063] io scheduler kyber registered971worker1 # [ 0.542445] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned972client # [ 0.482934] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)973client # [ 0.485216] io scheduler mq-deadline registered974worker1 # [ 0.542493] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned975client # [ 0.485229] io scheduler kyber registered976worker2 # [ 0.490472] pl061_gpio 9030000.pl061: PL061 GPIO chip registered977worker2 # [ 0.491295] ledtrig-cpu: registered to indicate activity on CPUs978worker2 # [ 0.491734] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:979worker1 # [ 0.570668] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned980worker1 # [ 0.570741] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned981worker2 # [ 0.491756] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000982lb # [ 0.505591] pl061_gpio 9030000.pl061: PL061 GPIO chip registered983worker1 # [ 0.570791] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned984worker2 # [ 0.491776] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000985worker1 # [ 0.570941] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned986worker2 # [ 0.491786] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000987worker1 # [ 0.570996] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned988worker2 # [ 0.491810] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits989worker1 # [ 0.571022] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned990worker2 # [ 0.491838] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]991worker1 # [ 0.571047] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned992worker2 # [ 0.491940] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00993worker1 # [ 0.571072] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned994worker2 # [ 0.491950] pci_bus 0000:00: root bus resource [bus 00-ff]995worker1 # [ 0.571100] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned996worker2 # [ 0.491956] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]997lb # [ 0.507179] ledtrig-cpu: registered to indicate activity on CPUs998worker1 # [ 0.571124] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned999worker2 # [ 0.491961] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1000lb # [ 0.507639] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1001worker2 # [ 0.491966] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1002worker1 # [ 0.571150] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1003worker1 # [ 0.571176] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1004client # [ 0.499002] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1005lb # [ 0.507659] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001006worker2 # [ 0.492061] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1007worker1 # [ 0.571200] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1008client # [ 0.499613] ledtrig-cpu: registered to indicate activity on CPUs1009lb # [ 0.507672] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001010worker2 # [ 0.492520] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1011worker1 # [ 0.571223] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1012client # [ 0.499986] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1013worker2 # [ 0.492715] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1014worker1 # [ 0.571248] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1015lb # [ 0.507681] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001016client # [ 0.500004] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001017worker2 # [ 0.492732] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1018worker1 # [ 0.571272] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1019lb # [ 0.507756] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1020worker2 # [ 0.492762] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1021client # [ 0.500019] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001022worker1 # [ 0.571295] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1023lb # [ 0.507790] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1024worker2 # [ 0.492779] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1025worker1 # [ 0.571318] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1026client # [ 0.500027] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001027lb # [ 0.507905] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001028worker2 # [ 0.493252] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1029worker1 # [ 0.571340] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1030worker2 # [ 0.493439] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1031lb # [ 0.507915] pci_bus 0000:00: root bus resource [bus 00-ff]1032client # [ 0.500049] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1033worker1 # [ 0.571363] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1034worker2 # [ 0.493456] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1035lb # [ 0.507922] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1036worker1 # [ 0.571385] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1037client # [ 0.500072] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1038worker2 # [ 0.493485] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1039lb # [ 0.507927] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1040worker1 # [ 0.571408] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1041client # [ 0.500161] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001042worker2 # [ 0.493945] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1043client # [ 0.500171] pci_bus 0000:00: root bus resource [bus 00-ff]1044worker1 # [ 0.571430] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1045lb # [ 0.507932] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1046worker1 # [ 0.571453] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1047lb # [ 0.508008] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1048client # [ 0.500177] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1049worker2 # [ 0.494128] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1050worker2 # [ 0.494144] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1051worker1 # [ 0.571475] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1052client # [ 0.500183] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1053lb # [ 0.508496] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1054worker1 # [ 0.571512] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1055worker2 # [ 0.494177] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1056lb # [ 0.508692] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1057client # [ 0.500189] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1058worker1 # [ 0.571522] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1059worker2 # [ 0.494680] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1060lb # [ 0.508711] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1061worker1 # [ 0.571527] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1062client # [ 0.500312] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1063worker2 # [ 0.494868] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1064lb # [ 0.508744] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1065worker1 # [ 0.572738] pci 0000:00:0a.0: enabling device (0000 -> 0002)1066worker2 # [ 0.494883] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1067client # [ 0.500800] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1068lb # [ 0.508760] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1069client # [ 0.501016] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1070worker2 # [ 0.494916] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1071lb # [ 0.509225] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1072client # [ 0.501035] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1073worker2 # [ 0.495397] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1074lb # [ 0.509449] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1075client # [ 0.501068] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1076worker2 # [ 0.495583] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1077lb # [ 0.509468] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1078client # [ 0.501087] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1079worker2 # [ 0.495599] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1080lb # [ 0.509499] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1081worker2 # [ 0.495630] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1082client # [ 0.501587] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1083lb # [ 0.509991] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1084client # [ 0.501793] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1085worker2 # [ 0.496100] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1086lb # [ 0.510195] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1087client # [ 0.501811] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1088worker2 # [ 0.496290] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1089lb # [ 0.510215] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1090client # [ 0.501847] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1091worker2 # [ 0.496306] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1092lb # [ 0.510247] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1093worker2 # [ 0.496337] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1094client # [ 0.502369] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1095lb # [ 0.510765] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1096client # [ 0.502588] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1097worker2 # [ 0.496797] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1098lb # [ 0.510963] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1099client # [ 0.502605] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1100lb # [ 0.510981] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1101worker2 # [ 0.496985] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1102client # [ 0.502636] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1103worker2 # [ 0.497001] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1104lb # [ 0.511017] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1105worker2 # [ 0.497032] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1106client # [ 0.503125] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1107worker2 # [ 0.497047] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1108lb # [ 0.511512] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1109client # [ 0.503314] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1110lb # [ 0.511718] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1111worker2 # [ 0.497536] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1112client # [ 0.503330] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1113lb # [ 0.511736] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1114worker2 # [ 0.497730] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1115client # [ 0.503363] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1116lb # [ 0.511767] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1117worker2 # [ 0.497761] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1118client # [ 0.503846] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1119lb # [ 0.512244] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1120client # [ 0.504040] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1121worker2 # [ 0.498223] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1122lb # [ 0.512431] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1123client # [ 0.504059] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1124lb # [ 0.512448] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1125client # [ 0.504092] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1126lb # [ 0.512478] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1127client # [ 0.504559] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1128lb # [ 0.512946] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1129client # [ 0.504752] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1130lb # [ 0.513138] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1131client # [ 0.504768] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1132lb # [ 0.513156] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1133client # [ 0.504800] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1134lb # [ 0.513187] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1135client # [ 0.505261] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1136lb # [ 0.513204] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1137client # [ 0.505455] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1138client # [ 0.505471] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1139client # [ 0.505501] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1140client # [ 0.505518] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1141worker1 # [ 0.621932] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1142lb # [ 0.553861] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1143lb # [ 0.554086] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1144worker2 # [ 0.546581] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1145lb # [ 0.554118] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1146worker2 # [ 0.546637] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1147client # [ 0.546089] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1148lb # [ 0.554597] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1149client # [ 0.546306] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1150worker2 # [ 0.547178] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1151lb # [ 0.554789] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1152client # [ 0.546339] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1153worker2 # [ 0.547365] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1154lb # [ 0.554820] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1155client # [ 0.546896] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1156worker2 # [ 0.547638] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1157lb # [ 0.555223] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1158worker2 # [ 0.547960] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1159client # [ 0.547089] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1160lb # [ 0.555411] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1161worker2 # [ 0.547980] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1162client # [ 0.547119] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1163worker2 # [ 0.548009] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1164lb # [ 0.555669] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1165client # [ 0.547538] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1166lb # [ 0.556002] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1167worker2 # [ 0.548487] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1168worker1 # [ 0.632113] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1169client # [ 0.547729] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1170lb # [ 0.556023] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1171worker2 # [ 0.548677] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1172client # [ 0.547992] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1173worker2 # [ 0.548693] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1174lb # [ 0.556053] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1175client # [ 0.548295] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1176worker2 # [ 0.548724] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1177lb # [ 0.556541] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1178client # [ 0.548314] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1179lb # [ 0.556732] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1180worker2 # [ 0.549345] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1181client # [ 0.548346] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1182lb # [ 0.556748] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1183worker2 # [ 0.549357] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1184client # [ 0.548840] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1185lb # [ 0.556778] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1186worker2 # [ 0.549362] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1187client # [ 0.549029] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1188client # [ 0.549045] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1189worker2 # [ 0.549410] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1190client # [ 0.549076] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1191worker2 # [ 0.549461] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1192client # [ 0.549676] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1193worker2 # [ 0.549511] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1194client # [ 0.549688] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1195lb # [ 0.570872] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1196worker2 # [ 0.549559] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1197lb # [ 0.570890] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1198client # [ 0.549695] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1199worker2 # [ 0.549607] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1200lb # [ 0.570896] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1201client # [ 0.549742] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1202worker2 # [ 0.549656] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1203lb # [ 0.570947] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1204client # [ 0.549790] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1205worker1 # [ 0.643249] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1206worker2 # [ 0.549705] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1207worker1 # [ 0.645612] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1208lb # [ 0.570996] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1209client # [ 0.549838] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1210worker2 # [ 0.549756] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1211lb # [ 0.571043] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1212client # [ 0.549886] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1213worker2 # [ 0.549803] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1214lb # [ 0.571091] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1215client # [ 0.549934] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1216worker2 # [ 0.549882] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1217lb # [ 0.571139] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1218worker1 # [ 0.649599] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1219worker2 # [ 0.549939] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1220lb # [ 0.571188] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1221worker2 # [ 0.549961] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1222worker2 # [ 0.549983] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1223lb # [ 0.571237] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1224worker2 # [ 0.550005] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1225lb # [ 0.571285] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1226worker2 # [ 0.550030] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1227lb # [ 0.571333] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1228worker2 # [ 0.550053] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1229lb # [ 0.571407] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1230worker2 # [ 0.550076] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1231lb # [ 0.571505] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1232worker2 # [ 0.550098] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1233lb # [ 0.571530] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1234worker2 # [ 0.550121] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1235lb # [ 0.571552] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1236worker2 # [ 0.550143] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1237lb # [ 0.571576] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1238worker2 # [ 0.550166] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1239lb # [ 0.571602] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1240worker2 # [ 0.550189] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1241lb # [ 0.571624] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1242worker2 # [ 0.550210] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1243lb # [ 0.571647] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1244worker2 # [ 0.550232] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1245client # [ 0.578139] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1246lb # [ 0.571671] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1247worker2 # [ 0.550273] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1248worker1 # [ 0.658564] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1249client # [ 0.578226] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1250lb # [ 0.571694] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1251worker2 # [ 0.550297] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1252worker1 # [ 0.661004] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1253client # [ 0.578276] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1254lb # [ 0.571734] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1255worker2 # [ 0.550319] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1256lb # [ 0.571760] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1257worker2 # [ 0.550342] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1258client # [ 0.578327] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1259lb # [ 0.571785] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1260worker2 # [ 0.550364] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1261lb # [ 0.571810] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1262worker2 # [ 0.550386] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1263client # [ 0.578518] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1264worker2 # [ 0.550408] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1265lb # [ 0.571831] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1266client # [ 0.578630] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1267worker2 # [ 0.550436] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1268lb # [ 0.571853] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1269client # [ 0.578656] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1270worker2 # [ 0.550446] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1271lb # [ 0.571875] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1272client # [ 0.578679] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1273worker2 # [ 0.550450] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1274lb # [ 0.571896] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1275client # [ 0.578703] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1276worker2 # [ 0.551679] pci 0000:00:0a.0: enabling device (0000 -> 0002)1277client # [ 0.578735] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1278client # [ 0.578761] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1279client # [ 0.578784] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1280client # [ 0.578807] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1281client # [ 0.578832] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1282lb # [ 0.571918] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1283client # [ 0.578856] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1284lb # [ 0.571941] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1285lb # [ 0.571965] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1286lb # [ 0.571988] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1287lb # [ 0.572017] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1288lb # [ 0.572028] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1289lb # [ 0.572032] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1290lb # [ 0.573222] pci 0000:00:0a.0: enabling device (0000 -> 0002)1291worker1 # [ 0.672868] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1292client # [ 0.578880] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1293client # [ 0.578904] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1294client # [ 0.578929] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1295client # [ 0.578953] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1296client # [ 0.578977] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1297client # [ 0.579002] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1298client # [ 0.579026] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1299lb # [ 0.609516] pci 0000:00:0a.0: quirk_usb_early_handoff+0x0/0xa60 took 35444 usecs1300client # [ 0.579050] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1301client # [ 0.579074] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1302client # [ 0.579099] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1303client # [ 0.579125] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1304client # [ 0.579160] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1305client # [ 0.579170] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1306client # [ 0.579175] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1307client # [ 0.580443] pci 0000:00:0a.0: enabling device (0000 -> 0002)1308worker1 # [ 0.682820] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1309worker2 # [ 0.615043] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1310worker2 # [ 0.617612] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1311worker1 # [ 0.694834] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1312worker1 # [ 0.697737] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1313worker2 # [ 0.629444] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1314lb # [ 0.636905] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1315lb # [ 0.640446] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1316worker1 # [ 0.711898] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1317client # [ 0.633319] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1318worker2 # [ 0.640552] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1319worker1 # [ 0.714899] msm_serial: driver initialized1320worker1 # [ 0.715075] SuperH (H)SCI(F) driver initialized1321worker1 # [ 0.715130] STM32 USART driver initialized1322lb # [ 0.646895] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1323client # [ 0.643610] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1324worker2 # [ 0.651007] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1325client # [ 0.647148] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1326client # [ 0.649266] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1327lb # [ 0.658187] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1328lb # [ 0.660663] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1329worker2 # [ 0.656276] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1330client # [ 0.659581] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1331worker2 # [ 0.662548] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1332lb # [ 0.671339] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1333worker2 # [ 0.664985] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1334lb # [ 0.674564] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1335lb # [ 0.676948] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1336client # [ 0.666712] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1337client # [ 0.669130] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1338worker2 # [ 0.675521] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1339worker1 # [ 0.751989] loop: module loaded1340worker2 # [ 0.677628] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1341worker1 # [ 0.752264] virtio_blk virtio5: 1/0/0 default/read/poll queues1342worker1 # [ 0.753158] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1343lb # [ 0.687455] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1344client # [ 0.679718] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1345worker2 # [ 0.689768] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1346lb # [ 0.694116] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1347lb # [ 0.696822] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1348worker1 # [ 0.767364] megasas: 07.734.00.00-rc11349worker1 # [ 0.768243] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1350worker1 # [ 0.770863] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001351client # [ 0.690286] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1352worker1 # [ 0.770935] Intel/Sharp Extended Query Table at 0x00311353worker1 # [ 0.772694] Using buffer write method1354client # [ 0.692612] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1355worker2 # [ 0.702776] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1356client # [ 0.695431] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1357worker1 # [ 0.772792] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1358lb # [ 0.714189] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1359worker1 # [ 0.782537] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001360worker1 # [ 0.782578] Intel/Sharp Extended Query Table at 0x00311361worker2 # [ 0.711807] msm_serial: driver initialized1362client # [ 0.709058] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1363worker2 # [ 0.711965] SuperH (H)SCI(F) driver initialized1364worker2 # [ 0.712020] STM32 USART driver initialized1365client # [ 0.712008] msm_serial: driver initialized1366client # [ 0.712161] SuperH (H)SCI(F) driver initialized1367client # [ 0.712215] STM32 USART driver initialized1368lb # [ 0.722774] msm_serial: driver initialized1369worker1 # [ 0.795200] Using buffer write method1370lb # [ 0.722950] SuperH (H)SCI(F) driver initialized1371worker1 # [ 0.795257] Concatenating MTD devices:1372worker1 # [ 0.795261] (0): "0.flash"1373lb # [ 0.723007] STM32 USART driver initialized1374worker1 # [ 0.795266] (1): "0.flash"1375worker1 # [ 0.795269] into device "0.flash"1376worker2 # [ 0.745674] loop: module loaded1377worker2 # [ 0.745906] virtio_blk virtio5: 1/0/0 default/read/poll queues1378worker2 # [ 0.746796] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1379lb # [ 0.756639] loop: module loaded1380lb # [ 0.756867] virtio_blk virtio5: 1/0/0 default/read/poll queues1381lb # [ 0.757794] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1382client # [ 0.752003] loop: module loaded1383client # [ 0.752234] virtio_blk virtio5: 1/0/0 default/read/poll queues1384client # [ 0.753123] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1385worker2 # [ 0.755210] megasas: 07.734.00.00-rc11386worker2 # [ 0.755992] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1387lb # [ 0.766219] megasas: 07.734.00.00-rc11388worker2 # [ 0.758236] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001389worker2 # [ 0.758301] Intel/Sharp Extended Query Table at 0x00311390lb # [ 0.767043] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1391worker2 # [ 0.760241] Using buffer write method1392worker2 # [ 0.760351] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1393client # [ 0.766935] megasas: 07.734.00.00-rc11394worker2 # [ 0.774282] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001395worker2 # [ 0.774331] Intel/Sharp Extended Query Table at 0x00311396client # [ 0.767773] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1397lb # [ 0.777373] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001398worker2 # [ 0.776266] Using buffer write method1399lb # [ 0.777415] Intel/Sharp Extended Query Table at 0x00311400worker2 # [ 0.776314] Concatenating MTD devices:1401worker2 # [ 0.776319] (0): "0.flash"1402client # [ 0.770223] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001403lb # [ 0.779465] Using buffer write method1404worker2 # [ 0.776324] (1): "0.flash"1405client # [ 0.770259] Intel/Sharp Extended Query Table at 0x00311406worker2 # [ 0.776327] into device "0.flash"1407lb # [ 0.779577] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1408client # [ 0.772059] Using buffer write method1409client # [ 0.772160] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1410lb # [ 0.781716] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001411lb # [ 0.781753] Intel/Sharp Extended Query Table at 0x00311412lb # [ 0.783759] Using buffer write method1413lb # [ 0.783796] Concatenating MTD devices:1414lb # [ 0.783801] (0): "0.flash"1415lb # [ 0.783805] (1): "0.flash"1416lb # [ 0.783809] into device "0.flash"1417client # [ 0.781987] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001418client # [ 0.782049] Intel/Sharp Extended Query Table at 0x00311419client # [ 0.785241] Using buffer write method1420client # [ 0.785286] Concatenating MTD devices:1421client # [ 0.785290] (0): "0.flash"1422client # [ 0.785295] (1): "0.flash"1423client # [ 0.785298] into device "0.flash"1424worker1 # [ 1.081339] Freeing initrd memory: 26148K1425worker1 # [ 1.087974] tun: Universal TUN/TAP device driver, 1.61426worker1 # [ 1.092281] thunder_xcv, ver 1.01427worker1 # [ 1.092337] thunder_bgx, ver 1.01428worker1 # [ 1.092360] nicpf, ver 1.01429worker1 # [ 1.092942] e1000: Intel(R) PRO/1000 Network Driver1430worker1 # [ 1.092950] e1000: Copyright (c) 1999-2006 Intel Corporation.1431worker1 # [ 1.092976] e1000e: Intel(R) PRO/1000 Network Driver1432worker1 # [ 1.092986] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1433worker1 # [ 1.093017] igb: Intel(R) Gigabit Ethernet Network Driver1434worker1 # [ 1.093023] igb: Copyright (c) 2007-2014 Intel Corporation.1435worker1 # [ 1.093047] igbvf: Intel(R) Gigabit Virtual Function Network Driver1436worker1 # [ 1.093054] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1437worker1 # [ 1.093191] sky2: driver version 1.301438worker1 # [ 1.095325] ehci-pci 0000:00:0a.0: EHCI Host Controller1439worker1 # [ 1.095363] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11440worker1 # [ 1.095576] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001441worker1 # [ 1.105719] usbcore: registered new interface driver usb-storage1442worker1 # [ 1.105852] usbcore: registered new interface driver usbserial_generic1443worker1 # [ 1.105868] usbserial: USB Serial support registered for generic1444worker1 # [ 1.106488] hv_vmbus: registering driver hyperv_keyboard1445worker1 # [ 1.106544] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001446worker1 # [ 1.106916] hub 1-0:1.0: USB hub found1447worker1 # [ 1.106936] hub 1-0:1.0: 6 ports detected1448worker1 # [ 1.113075] rtc-pl031 9010000.pl031: registered as rtc01449worker1 # [ 1.113115] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:04:51 UTC (1789891491)1450worker1 # [ 1.113490] i2c_dev: i2c /dev entries driver1451worker1 # [ 1.118672] sdhci: Secure Digital Host Controller Interface driver1452worker1 # [ 1.118688] sdhci: Copyright(c) Pierre Ossman1453worker1 # [ 1.118969] Synopsys Designware Multimedia Card Interface Driver1454worker1 # [ 1.119355] sdhci-pltfm: SDHCI platform and OF driver helper1455worker1 # [ 1.121312] hid: raw HID events driver (C) Jiri Kosina1456worker1 # [ 1.121604] usbcore: registered new interface driver usbhid1457worker1 # [ 1.121611] usbhid: USB HID core driver1458worker1 # [ 1.127390] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1459worker1 # [ 1.129030] drop_monitor: Initializing network drop monitor service1460worker1 # [ 1.129193] NET: Registered PF_INET6 protocol family1461worker1 # [ 1.132806] Segment Routing with IPv61462worker1 # [ 1.132840] In-situ OAM (IOAM) with IPv61463worker1 # [ 1.132890] NET: Registered PF_PACKET protocol family1464worker1 # [ 1.134622] 9pnet: Installing 9P2000 support1465worker1 # [ 1.137054] Key type dns_resolver registered1466worker1 # [ 1.144499] registered taskstats version 11467worker1 # [ 1.144746] Loading compiled-in X.509 certificates1468worker2 # [ 1.075264] Freeing initrd memory: 26148K1469worker1 # [ 1.154073] Demotion targets for Node 0: null1470worker1 # [ 1.154246] Key type .fscrypt registered1471worker1 # [ 1.154253] Key type fscrypt-provisioning registered1472worker1 # [ 1.154363] ima: No TPM chip found, activating TPM-bypass!1473worker2 # [ 1.081870] tun: Universal TUN/TAP device driver, 1.61474worker1 # [ 1.154384] ima: Allocated hash algorithm: sha11475worker1 # [ 1.154411] ima: No architecture policies found1476worker1 # [ 1.158986] input: gpio-keys as /devices/platform/gpio-keys/input/input01477client # [ 1.083080] Freeing initrd memory: 26160K1478lb # [ 1.090678] Freeing initrd memory: 26140K1479worker2 # [ 1.086357] thunder_xcv, ver 1.01480worker2 # [ 1.086422] thunder_bgx, ver 1.01481worker2 # [ 1.086444] nicpf, ver 1.01482worker2 # [ 1.087087] e1000: Intel(R) PRO/1000 Network Driver1483lb # [ 1.097567] tun: Universal TUN/TAP device driver, 1.61484worker2 # [ 1.087098] e1000: Copyright (c) 1999-2006 Intel Corporation.1485worker2 # [ 1.087120] e1000e: Intel(R) PRO/1000 Network Driver1486client # [ 1.089660] tun: Universal TUN/TAP device driver, 1.61487worker2 # [ 1.087130] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1488worker2 # [ 1.087160] igb: Intel(R) Gigabit Ethernet Network Driver1489worker2 # [ 1.087166] igb: Copyright (c) 2007-2014 Intel Corporation.1490worker2 # [ 1.087189] igbvf: Intel(R) Gigabit Virtual Function Network Driver1491worker2 # [ 1.087194] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1492worker2 # [ 1.087333] sky2: driver version 1.301493worker2 # [ 1.088917] usbcore: registered new interface driver usb-storage1494worker2 # [ 1.089078] usbcore: registered new interface driver usbserial_generic1495worker2 # [ 1.089092] usbserial: USB Serial support registered for generic1496worker2 # [ 1.089694] hv_vmbus: registering driver hyperv_keyboard1497lb # [ 1.101949] thunder_xcv, ver 1.01498worker2 # [ 1.091139] ehci-pci 0000:00:0a.0: EHCI Host Controller1499lb # [ 1.102013] thunder_bgx, ver 1.01500lb # [ 1.102040] nicpf, ver 1.01501lb # [ 1.102622] e1000: Intel(R) PRO/1000 Network Driver1502worker2 # [ 1.091171] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11503lb # [ 1.102629] e1000: Copyright (c) 1999-2006 Intel Corporation.1504client # [ 1.094147] thunder_xcv, ver 1.01505lb # [ 1.102653] e1000e: Intel(R) PRO/1000 Network Driver1506client # [ 1.094201] thunder_bgx, ver 1.01507worker2 # [ 1.091408] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001508client # [ 1.094224] nicpf, ver 1.01509worker2 # [ 1.102412] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001510lb # [ 1.102663] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1511client # [ 1.094819] e1000: Intel(R) PRO/1000 Network Driver1512worker2 # [ 1.102859] hub 1-0:1.0: USB hub found1513lb # [ 1.102692] igb: Intel(R) Gigabit Ethernet Network Driver1514client # [ 1.094828] e1000: Copyright (c) 1999-2006 Intel Corporation.1515worker2 # [ 1.102876] hub 1-0:1.0: 6 ports detected1516lb # [ 1.102698] igb: Copyright (c) 2007-2014 Intel Corporation.1517client # [ 1.094852] e1000e: Intel(R) PRO/1000 Network Driver1518lb # [ 1.102722] igbvf: Intel(R) Gigabit Virtual Function Network Driver1519lb # [ 1.102728] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1520worker1 # [ 1.182203] clk: Disabling unused clocks1521client # [ 1.094864] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1522worker2 # [ 1.107001] rtc-pl031 9010000.pl031: registered as rtc01523worker1 # [ 1.182249] PM: genpd: Disabling unused power domains1524lb # [ 1.102866] sky2: driver version 1.301525client # [ 1.094893] igb: Intel(R) Gigabit Ethernet Network Driver1526client # [ 1.094898] igb: Copyright (c) 2007-2014 Intel Corporation.1527lb # [ 1.104761] usbcore: registered new interface driver usb-storage1528client # [ 1.094921] igbvf: Intel(R) Gigabit Virtual Function Network Driver1529worker2 # [ 1.107044] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:04:52 UTC (1789891492)1530lb # [ 1.104904] usbcore: registered new interface driver usbserial_generic1531worker2 # [ 1.107475] i2c_dev: i2c /dev entries driver1532client # [ 1.094927] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1533client # [ 1.095061] sky2: driver version 1.301534lb # [ 1.104918] usbserial: USB Serial support registered for generic1535lb # [ 1.106236] ehci-pci 0000:00:0a.0: EHCI Host Controller1536client # [ 1.096660] usbcore: registered new interface driver usb-storage1537client # [ 1.096776] usbcore: registered new interface driver usbserial_generic1538lb # [ 1.106272] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11539worker1 # [ 1.186682] Freeing unused kernel memory: 4736K1540client # [ 1.096792] usbserial: USB Serial support registered for generic1541worker1 # [ 1.186900] Run /init as init process1542client # [ 1.097405] hv_vmbus: registering driver hyperv_keyboard1543lb # [ 1.106501] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001544worker2 # [ 1.112504] sdhci: Secure Digital Host Controller Interface driver1545client # [ 1.098768] ehci-pci 0000:00:0a.0: EHCI Host Controller1546lb # [ 1.118037] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001547client # [ 1.098803] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11548worker2 # [ 1.112515] sdhci: Copyright(c) Pierre Ossman1549lb # [ 1.118569] hub 1-0:1.0: USB hub found1550client # [ 1.099620] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001551worker2 # [ 1.112784] Synopsys Designware Multimedia Card Interface Driver1552lb # [ 1.118605] hub 1-0:1.0: 6 ports detected1553worker2 # [ 1.113155] sdhci-pltfm: SDHCI platform and OF driver helper1554client # [ 1.112027] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001555lb # [ 1.121857] hv_vmbus: registering driver hyperv_keyboard1556client # [ 1.112489] hub 1-0:1.0: USB hub found1557worker2 # [ 1.117628] hid: raw HID events driver (C) Jiri Kosina1558client # [ 1.112511] hub 1-0:1.0: 6 ports detected1559worker2 # [ 1.117880] usbcore: registered new interface driver usbhid1560worker2 # [ 1.117887] usbhid: USB HID core driver1561lb # [ 1.123615] rtc-pl031 9010000.pl031: registered as rtc01562client # [ 1.115171] rtc-pl031 9010000.pl031: registered as rtc01563lb # [ 1.123651] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:04:52 UTC (1789891492)1564lb # [ 1.124049] i2c_dev: i2c /dev entries driver1565client # [ 1.115212] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T08:04:52 UTC (1789891492)1566client # [ 1.115687] i2c_dev: i2c /dev entries driver1567worker2 # [ 1.120918] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1568worker2 # [ 1.123690] drop_monitor: Initializing network drop monitor service1569worker2 # [ 1.123954] NET: Registered PF_INET6 protocol family1570worker2 # [ 1.126106] Segment Routing with IPv61571client # [ 1.120822] sdhci: Secure Digital Host Controller Interface driver1572worker2 # [ 1.126128] In-situ OAM (IOAM) with IPv61573client # [ 1.120836] sdhci: Copyright(c) Pierre Ossman1574worker2 # [ 1.126159] NET: Registered PF_PACKET protocol family1575client # [ 1.121107] Synopsys Designware Multimedia Card Interface Driver1576client # [ 1.121480] sdhci-pltfm: SDHCI platform and OF driver helper1577lb # [ 1.129914] sdhci: Secure Digital Host Controller Interface driver1578lb # [ 1.129931] sdhci: Copyright(c) Pierre Ossman1579worker2 # [ 1.128118] 9pnet: Installing 9P2000 support1580worker1 # [ 1.205196] systemd[1]: Successfully made /usr/ read-only.1581lb # [ 1.130225] Synopsys Designware Multimedia Card Interface Driver1582lb # [ 1.130631] sdhci-pltfm: SDHCI platform and OF driver helper1583client # [ 1.126126] hid: raw HID events driver (C) Jiri Kosina1584lb # [ 1.132583] hid: raw HID events driver (C) Jiri Kosina1585client # [ 1.126374] usbcore: registered new interface driver usbhid1586lb # [ 1.132840] usbcore: registered new interface driver usbhid1587client # [ 1.126382] usbhid: USB HID core driver1588lb # [ 1.132848] usbhid: USB HID core driver1589worker2 # [ 1.131369] Key type dns_resolver registered1590client # [ 1.129429] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1591lb # [ 1.138955] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1592client # [ 1.132203] drop_monitor: Initializing network drop monitor service1593client # [ 1.132456] NET: Registered PF_INET6 protocol family1594lb # [ 1.140806] drop_monitor: Initializing network drop monitor service1595worker2 # [ 1.137969] registered taskstats version 11596lb # [ 1.141001] NET: Registered PF_INET6 protocol family1597worker2 # [ 1.138198] Loading compiled-in X.509 certificates1598client # [ 1.134725] Segment Routing with IPv61599client # [ 1.134749] In-situ OAM (IOAM) with IPv61600lb # [ 1.144835] Segment Routing with IPv61601client # [ 1.134783] NET: Registered PF_PACKET protocol family1602lb # [ 1.144890] In-situ OAM (IOAM) with IPv61603lb # [ 1.144927] NET: Registered PF_PACKET protocol family1604client # [ 1.136486] 9pnet: Installing 9P2000 support1605lb # [ 1.146738] 9pnet: Installing 9P2000 support1606client # [ 1.139626] Key type dns_resolver registered1607worker2 # [ 1.147262] Demotion targets for Node 0: null1608worker2 # [ 1.147404] Key type .fscrypt registered1609lb # [ 1.150058] Key type dns_resolver registered1610worker2 # [ 1.147411] Key type fscrypt-provisioning registered1611worker2 # [ 1.147551] ima: No TPM chip found, activating TPM-bypass!1612worker2 # [ 1.147579] ima: Allocated hash algorithm: sha11613worker2 # [ 1.147608] ima: No architecture policies found1614lb # [ 1.157184] registered taskstats version 11615worker2 # [ 1.152295] input: gpio-keys as /devices/platform/gpio-keys/input/input01616client # [ 1.146215] registered taskstats version 11617client # [ 1.146379] Loading compiled-in X.509 certificates1618lb # [ 1.158025] Loading compiled-in X.509 certificates1619client # [ 1.155824] Demotion targets for Node 0: null1620client # [ 1.156005] Key type .fscrypt registered1621client # [ 1.156012] Key type fscrypt-provisioning registered1622client # [ 1.156130] ima: No TPM chip found, activating TPM-bypass!1623client # [ 1.156154] ima: Allocated hash algorithm: sha11624client # [ 1.156181] ima: No architecture policies found1625lb # [ 1.166904] Demotion targets for Node 0: null1626lb # [ 1.167057] Key type .fscrypt registered1627lb # [ 1.167064] Key type fscrypt-provisioning registered1628lb # [ 1.167177] ima: No TPM chip found, activating TPM-bypass!1629lb # [ 1.167198] ima: Allocated hash algorithm: sha11630lb # [ 1.167227] ima: No architecture policies found1631client # [ 1.160716] input: gpio-keys as /devices/platform/gpio-keys/input/input01632lb # [ 1.171597] input: gpio-keys as /devices/platform/gpio-keys/input/input01633worker2 # [ 1.178493] clk: Disabling unused clocks1634worker2 # [ 1.178530] PM: genpd: Disabling unused power domains1635worker2 # [ 1.183110] Freeing unused kernel memory: 4736K1636worker2 # [ 1.183377] Run /init as init process1637lb # [ 1.196928] clk: Disabling unused clocks1638lb # [ 1.196972] PM: genpd: Disabling unused power domains1639client # [ 1.186418] clk: Disabling unused clocks1640client # [ 1.186481] PM: genpd: Disabling unused power domains1641client # [ 1.190941] Freeing unused kernel memory: 4736K1642client # [ 1.191195] Run /init as init process1643lb # [ 1.201605] Freeing unused kernel memory: 4736K1644lb # [ 1.201806] Run /init as init process1645worker2 # [ 1.201199] systemd[1]: Successfully made /usr/ read-only.1646client # [ 1.208717] systemd[1]: Successfully made /usr/ read-only.1647lb # [ 1.220550] systemd[1]: Successfully made /usr/ read-only.1648worker1 # [ 1.354545] usb 1-1: new high-speed USB device number 2 using ehci-pci1649worker2 # [ 1.350330] usb 1-1: new high-speed USB device number 2 using ehci-pci1650lb # [ 1.365405] usb 1-1: new high-speed USB device number 2 using ehci-pci1651client # [ 1.358072] usb 1-1: new high-speed USB device number 2 using ehci-pci1652worker1 # [ 1.506365] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11653worker1 # [ 1.540118] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1654worker1 # [ 1.546092] systemd[1]: Detected virtualization qemu.1655worker1 # [ 1.547101] systemd[1]: Detected architecture arm64.1656worker1 # [ 1.548000] systemd[1]: Running in initrd.1657worker1 # [ 1.549350] systemd[1]: Initializing machine ID from random generator.1658worker1 # [ 1.550880] systemd[1]: Hostname set to <worker1>.1659worker2 # [ 1.504911] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11660lb # [ 1.517588] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11661client # [ 1.512431] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11662worker1 # [ 1.594822] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01663worker2 # [ 1.536556] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1664worker2 # [ 1.549068] systemd[1]: Detected virtualization qemu.1665worker2 # [ 1.551216] systemd[1]: Detected architecture arm64.1666worker2 # [ 1.553178] systemd[1]: Running in initrd.1667worker2 # [ 1.556054] systemd[1]: Initializing machine ID from random generator.1668client # [ 1.543887] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1669worker2 # [ 1.559420] systemd[1]: Hostname set to <worker2>.1670client # [ 1.556505] systemd[1]: Detected virtualization qemu.1671lb # [ 1.556082] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1672client # [ 1.558680] systemd[1]: Detected architecture arm64.1673lb # [ 1.568613] systemd[1]: Detected virtualization qemu.1674client # [ 1.560663] systemd[1]: Running in initrd.1675lb # [ 1.570760] systemd[1]: Detected architecture arm64.1676lb # [ 1.572737] systemd[1]: Running in initrd.1677client # [ 1.563395] systemd[1]: Initializing machine ID from random generator.1678client # [ 1.566765] systemd[1]: Hostname set to <client>.1679lb # [ 1.575814] systemd[1]: Initializing machine ID from random generator.1680lb # [ 1.579202] systemd[1]: Hostname set to <lb>.1681worker2 # [ 1.586768] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01682lb # [ 1.605912] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01683client # [ 1.610481] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01684worker1 # [ 1.714602] usb 1-2: new high-speed USB device number 3 using ehci-pci1685worker2 # [ 1.710558] usb 1-2: new high-speed USB device number 3 using ehci-pci1686lb # [ 1.725408] usb 1-2: new high-speed USB device number 3 using ehci-pci1687client # [ 1.734015] usb 1-2: new high-speed USB device number 3 using ehci-pci1688worker1 # [ 1.836862] systemd[1]: bpf-restrict-fs: LSM BPF program attached1689worker1 # [ 1.872870] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21690worker1 # [ 1.878791] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01691worker1 # [ 1.926284] systemd[1]: Queued start job for default target Initrd Default Target.1692worker1 # [ 1.937132] systemd[1]: Created slice Slice /system/modprobe.1693worker1 # [ 1.938295] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1694worker1 # [ 1.939607] systemd[1]: Expecting device /dev/disk/by-label/nixos...1695worker1 # [ 1.939658] systemd[1]: Reached target Path Units.1696worker1 # [ 1.939677] systemd[1]: Reached target Slice Units.1697worker1 # [ 1.939695] systemd[1]: Reached target Swaps.1698worker2 # [ 1.865080] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21699worker1 # [ 1.939714] systemd[1]: Reached target Timer Units.1700worker1 # [ 1.939939] systemd[1]: Listening on D-Bus System Message Bus Socket.1701worker1 # [ 1.940093] systemd[1]: Listening on Journal Socket (/dev/log).1702worker1 # [ 1.940225] systemd[1]: Listening on Journal Sockets.1703worker1 # [ 1.940348] systemd[1]: Listening on udev Control Socket.1704worker1 # [ 1.940453] systemd[1]: Listening on udev Kernel Socket.1705worker1 # [ 1.940474] systemd[1]: Reached target Socket Units.1706client # [ 1.868896] systemd[1]: bpf-restrict-fs: LSM BPF program attached1707worker1 # [ 1.950114] systemd[1]: Starting Create List of Static Device Nodes...1708worker2 # [ 1.874617] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01709worker1 # [ 1.956405] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1710worker1 # [ 1.957453] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1711lb # [ 1.885124] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21712lb # [ 1.891469] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01713worker1 # [ 1.968357] systemd[1]: Mounting Kernel Configuration File System...1714client # [ 1.890345] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21715client # [ 1.892539] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01716worker2 # [ 1.914042] systemd[1]: bpf-restrict-fs: LSM BPF program attached1717lb # [ 1.930298] systemd[1]: bpf-restrict-fs: LSM BPF program attached1718worker1 # [ 2.003338] systemd[1]: Starting Journal Service...1719worker1 # [ 2.006332] systemd[1]: Starting Load Kernel Modules...1720worker1 # [ 2.007400] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1721worker1 # [ 2.016475] systemd[1]: Starting Coldplug All udev Devices...1722client # [ 1.944004] systemd[1]: Queued start job for default target Initrd Default Target.1723client # [ 1.952285] systemd[1]: Created slice Slice /system/modprobe.1724client # [ 1.953336] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1725client # [ 1.954508] systemd[1]: Expecting device /dev/disk/by-label/nixos...1726client # [ 1.955351] systemd[1]: Reached target Path Units.1727client # [ 1.956009] systemd[1]: Reached target Slice Units.1728client # [ 1.956667] systemd[1]: Reached target Swaps.1729client # [ 1.957219] systemd[1]: Reached target Timer Units.1730client # [ 1.958210] systemd[1]: Listening on D-Bus System Message Bus Socket.1731client # [ 1.959252] systemd[1]: Listening on Journal Socket (/dev/log).1732client # [ 1.960204] systemd[1]: Listening on Journal Sockets.1733client # [ 1.961029] systemd[1]: Listening on udev Control Socket.1734client # [ 1.961858] systemd[1]: Listening on udev Kernel Socket.1735client # [ 1.962684] systemd[1]: Reached target Socket Units.1736client # [ 1.964911] systemd[1]: Starting Create List of Static Device Nodes...1737client # [ 1.974212] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1738worker1 # [ 2.050802] systemd[1]: Finished Create List of Static Device Nodes.1739client # [ 1.975257] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1740worker1 # [ 2.052137] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1741worker1 # [ 2.052515] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1742worker1 # [ 2.052812] systemd[1]: Mounted Kernel Configuration File System.1743client # [ 1.982311] systemd[1]: Mounting Kernel Configuration File System...1744worker1 # [ 2.071099] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1745worker2 # [ 2.001806] systemd[1]: Queued start job for default target Initrd Default Target.1746lb # [ 2.011796] systemd[1]: Queued start job for default target Initrd Default Target.1747client # [ 2.005374] systemd[1]: Starting Journal Service...1748worker2 # [ 2.013191] systemd[1]: Created slice Slice /system/modprobe.1749lb # [ 2.019676] systemd[1]: Created slice Slice /system/modprobe.1750lb # [ 2.020769] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1751worker2 # [ 2.014325] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1752worker1 # [ 2.091454] systemd-journald[73]: Collecting audit messages is disabled.1753lb # [ 2.021937] systemd[1]: Expecting device /dev/disk/by-label/nixos...1754worker2 # [ 2.014370] systemd[1]: Expecting device /dev/disk/by-label/nixos...1755lb # [ 2.022757] systemd[1]: Reached target Path Units.1756worker2 # [ 2.014405] systemd[1]: Reached target Path Units.1757lb # [ 2.023400] systemd[1]: Reached target Slice Units.1758worker2 # [ 2.014424] systemd[1]: Reached target Slice Units.1759lb # [ 2.024086] systemd[1]: Reached target Swaps.1760worker2 # [ 2.014441] systemd[1]: Reached target Swaps.1761lb # [ 2.024680] systemd[1]: Reached target Timer Units.1762worker2 # [ 2.014459] systemd[1]: Reached target Timer Units.1763lb # [ 2.025557] systemd[1]: Listening on D-Bus System Message Bus Socket.1764worker2 # [ 2.014693] systemd[1]: Listening on D-Bus System Message Bus Socket.1765worker2 # [ 2.014831] systemd[1]: Listening on Journal Socket (/dev/log).1766lb # [ 2.026564] systemd[1]: Listening on Journal Socket (/dev/log).1767worker2 # [ 2.014955] systemd[1]: Listening on Journal Sockets.1768lb # [ 2.027476] systemd[1]: Listening on Journal Sockets.1769worker2 # [ 2.015075] systemd[1]: Listening on udev Control Socket.1770lb # [ 2.028310] systemd[1]: Listening on udev Control Socket.1771worker2 # [ 2.015184] systemd[1]: Listening on udev Kernel Socket.1772worker2 # [ 2.015205] systemd[1]: Reached target Socket Units.1773lb # [ 2.029145] systemd[1]: Listening on udev Kernel Socket.1774worker2 # [ 2.025249] systemd[1]: Starting Create List of Static Device Nodes...1775lb # [ 2.029959] systemd[1]: Reached target Socket Units.1776lb # [ 2.032336] systemd[1]: Starting Create List of Static Device Nodes...1777client # [ 2.023398] systemd[1]: Starting Load Kernel Modules...1778client # [ 2.024292] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1779worker2 # [ 2.034594] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1780worker2 # [ 2.035647] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1781lb # [ 2.041595] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1782lb # [ 2.042599] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1783worker2 # [ 2.041098] systemd[1]: Mounting Kernel Configuration File System...1784worker1 # [ 2.116853] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1785lb # [ 2.049712] systemd[1]: Mounting Kernel Configuration File System...1786client # [ 2.051272] systemd-journald[73]: Collecting audit messages is disabled.1787client # [ 2.052392] systemd[1]: Starting Coldplug All udev Devices...1788worker1 # [ 2.134647] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1789client # [ 2.058105] systemd[1]: Finished Create List of Static Device Nodes.1790client # [ 2.060116] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1791worker1 # [ 2.139410] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1792lb # [ 2.070444] systemd[1]: Starting Journal Service...1793worker2 # [ 2.072434] systemd[1]: Starting Journal Service...1794worker1 # [ 2.148005] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01795worker2 # [ 2.075401] systemd[1]: Starting Load Kernel Modules...1796worker1 # [ 2.148263] [drm] features: -virgl +edid -resource_blob -host_visible1797worker1 # [ 2.148275] [drm] features: -context_init1798worker1 # [ 2.149089] [drm] number of scanouts: 11799worker2 # [ 2.076305] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1800worker1 # [ 2.149108] [drm] number of cap sets: 01801worker1 # [ 2.155273] systemd[1]: Starting Create Static Device Nodes in /dev...1802lb # [ 2.089749] systemd[1]: Starting Load Kernel Modules...1803lb # [ 2.090708] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1804client # [ 2.082297] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1805client # [ 2.083131] systemd[1]: Mounted Kernel Configuration File System.1806worker2 # [ 2.090583] systemd[1]: Starting Coldplug All udev Devices...1807client # [ 2.094739] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1808lb # [ 2.101255] systemd[1]: Starting Coldplug All udev Devices...1809worker2 # [ 2.103315] systemd[1]: Finished Create List of Static Device Nodes.1810worker1 # [ 2.175125] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1811worker1 # [ 2.175157] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01812worker2 # [ 2.107601] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1813lb # [ 2.129648] systemd[1]: Finished Create List of Static Device Nodes.1814lb # [ 2.131292] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1815worker2 # [ 2.126761] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1816worker2 # [ 2.127659] systemd[1]: Mounted Kernel Configuration File System.1817worker2 # [ 2.139034] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1818lb # [ 2.145669] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1819lb # [ 2.147084] systemd[1]: Mounted Kernel Configuration File System.1820client # [ 2.133755] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1821worker2 # [ 2.148535] systemd-journald[73]: Collecting audit messages is disabled.1822worker1 # [ 2.218979] Console: switching to colour frame buffer device 160x501823worker1 # [ 2.228849] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1824lb # [ 2.162014] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1825client # [ 2.158214] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1826worker1 # [ 2.243498] systemd[1]: Finished Create Static Device Nodes in /dev.1827client # [ 2.166812] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1828worker1 # [ 2.246752] systemd[1]: Reached target Preparation for Local File Systems.1829worker1 # [ 2.249113] systemd[1]: Reached target Local File Systems.1830client # [ 2.172240] systemd[1]: Starting Create Static Device Nodes in /dev...1831lb # [ 2.183914] systemd-journald[73]: Collecting audit messages is disabled.1832client # [ 2.176983] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01833client # [ 2.177255] [drm] features: -virgl +edid -resource_blob -host_visible1834client # [ 2.177266] [drm] features: -context_init1835worker2 # [ 2.184135] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1836worker1 # [ 2.263309] systemd[1]: Starting Rule-based Manager for Device Events and Files...1837worker2 # [ 2.190363] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1838client # [ 2.194310] [drm] number of scanouts: 11839client # [ 2.194352] [drm] number of cap sets: 01840lb # [ 2.202304] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1841worker2 # [ 2.199714] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01842worker2 # [ 2.199989] [drm] features: -virgl +edid -resource_blob -host_visible1843client # [ 2.197460] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1844worker2 # [ 2.200001] [drm] features: -context_init1845lb # [ 2.207099] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1846worker2 # [ 2.200795] [drm] number of scanouts: 11847client # [ 2.197485] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01848worker2 # [ 2.200816] [drm] number of cap sets: 01849worker1 # [ 2.279292] systemd[1]: Finished Load Kernel Modules.1850worker1 # [ 2.291161] systemd[1]: Starting Apply Kernel Variables...1851worker2 # [ 2.223346] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1852lb # [ 2.229476] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01853lb # [ 2.229745] [drm] features: -virgl +edid -resource_blob -host_visible1854lb # [ 2.229758] [drm] features: -context_init1855worker1 # [ 2.285727] systemd-modules-load[74]: Inserted module 'dm_mod'1856lb # [ 2.230557] [drm] number of scanouts: 11857worker1 # [ 2.286946] systemd-modules-load[74]: Module 'virtio_balloon' is built in1858worker2 # [ 2.231063] systemd[1]: Starting Create Static Device Nodes in /dev...1859lb # [ 2.230580] [drm] number of cap sets: 01860worker1 # [ 2.306660] systemd[1]: Started Journal Service.1861worker2 # [ 2.232386] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1862worker2 # [ 2.232413] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01863worker1 # [ 2.300561] systemd-modules-load[74]: Module 'virtio_console' is built in1864lb # [ 2.247093] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1865lb # [ 2.247138] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01866worker1 # [ 2.303294] systemd-modules-load[74]: Inserted module 'virtio_gpu'1867lb # [ 2.252239] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1868client # [ 2.238326] Console: switching to colour frame buffer device 160x501869client # [ 2.245296] systemd[1]: Finished Create Static Device Nodes in /dev.1870worker1 # [ 2.306783] systemd-modules-load[74]: Module 'virtio_rng' is built in1871client # [ 2.245518] systemd[1]: Reached target Preparation for Local File Systems.1872client # [ 2.245544] systemd[1]: Reached target Local File Systems.1873worker1 # [ 2.316125] systemd[1]: Starting Create System Files and Directories...1874client # [ 2.254684] systemd[1]: Starting Rule-based Manager for Device Events and Files...1875lb # [ 2.268565] systemd[1]: Starting Create Static Device Nodes in /dev...1876client # [ 2.242633] systemd-modules-load[75]: Inserted module 'dm_mod'1877client # [ 2.262241] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1878client # [ 2.265811] systemd[1]: Started Journal Service.1879client # [ 2.253952] systemd-modules-load[75]: Module 'virtio_balloon' is built in1880worker2 # [ 2.270841] Console: switching to colour frame buffer device 160x501881client # [ 2.255245] systemd-modules-load[75]: Module 'virtio_console' is built in1882worker2 # [ 2.275908] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1883client # [ 2.262057] systemd-modules-load[75]: Inserted module 'virtio_gpu'1884lb # [ 2.285768] Console: switching to colour frame buffer device 160x501885lb # [ 2.286454] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1886client # [ 2.268276] systemd-modules-load[75]: Module 'virtio_rng' is built in1887client # [ 2.272663] systemd[1]: Finished Load Kernel Modules.1888worker2 # [ 2.301608] systemd[1]: Finished Load Kernel Modules.1889lb # [ 2.306756] systemd[1]: Finished Load Kernel Modules.1890worker2 # [ 2.304671] systemd[1]: Starting Apply Kernel Variables...1891lb # [ 2.318010] systemd[1]: Starting Apply Kernel Variables...1892worker1 # [ 2.373439] systemd[1]: Finished Apply Kernel Variables.1893worker2 # [ 2.323170] systemd[1]: Finished Create Static Device Nodes in /dev.1894client # [ 2.303114] systemd[1]: Starting Apply Kernel Variables...1895worker2 # [ 2.325663] systemd[1]: Reached target Preparation for Local File Systems.1896client # [ 2.304838] systemd[1]: Starting Create System Files and Directories...1897worker2 # [ 2.327967] systemd[1]: Reached target Local File Systems.1898worker1 # [ 2.386123] systemd-udevd[79]: Using default interface naming scheme 'v261'.1899worker2 # [ 2.338853] systemd[1]: Starting Rule-based Manager for Device Events and Files...1900worker1 # [ 2.398189] systemd[1]: Finished Create System Files and Directories.1901lb # [ 2.353912] systemd[1]: Finished Create Static Device Nodes in /dev.1902lb # [ 2.354298] systemd[1]: Reached target Preparation for Local File Systems.1903lb # [ 2.354343] systemd[1]: Reached target Local File Systems.1904lb # [ 2.369944] systemd[1]: Starting Rule-based Manager for Device Events and Files...1905worker2 # [ 2.348666] systemd-modules-load[74]: Inserted module 'dm_mod'1906worker1 # [ 2.423457] systemd[1]: Started Rule-based Manager for Device Events and Files.1907worker2 # [ 2.368231] systemd[1]: Started Journal Service.1908worker2 # [ 2.356773] systemd-modules-load[74]: Module 'virtio_balloon' is built in1909worker2 # [ 2.358076] systemd-modules-load[74]: Module 'virtio_console' is built in1910worker2 # [ 2.359234] systemd-modules-load[74]: Inserted module 'virtio_gpu'1911client # [ 2.363864] systemd[1]: Finished Apply Kernel Variables.1912worker2 # [ 2.376853] systemd-modules-load[74]: Module 'virtio_rng' is built in1913worker2 # [ 2.378103] systemd[1]: Starting Create System Files and Directories...1914client # [ 2.376211] systemd[1]: Finished Create System Files and Directories.1915client # [ 2.378112] systemd-udevd[79]: Using default interface naming scheme 'v261'.1916lb # [ 2.409920] systemd[1]: Finished Apply Kernel Variables.1917lb # [ 2.414240] systemd[1]: Started Journal Service.1918lb # [ 2.404232] systemd-modules-load[74]: Inserted module 'dm_mod'1919lb # [ 2.406674] systemd-modules-load[74]: Module 'virtio_balloon' is built in1920lb # [ 2.407949] systemd-modules-load[74]: Module 'virtio_console' is built in1921worker2 # [ 2.406917] systemd[1]: Finished Apply Kernel Variables.1922client # [ 2.409226] systemd[1]: Started Rule-based Manager for Device Events and Files.1923lb # [ 2.416657] systemd-modules-load[74]: Inserted module 'virtio_gpu'1924lb # [ 2.417781] systemd-modules-load[74]: Module 'virtio_rng' is built in1925lb # [ 2.418909] systemd[1]: Starting Create System Files and Directories...1926worker1 # [ 2.497500] systemd[1]: Starting Virtual Console Setup...1927worker2 # [ 2.449653] systemd-udevd[80]: Using default interface naming scheme 'v261'.1928worker2 # [ 2.458192] systemd[1]: Finished Create System Files and Directories.1929lb # [ 2.470852] systemd-udevd[80]: Using default interface naming scheme 'v261'.1930client # [ 2.481556] systemd[1]: Starting Virtual Console Setup...1931worker2 # [ 2.492177] systemd[1]: Started Rule-based Manager for Device Events and Files.1932lb # [ 2.496487] systemd[1]: Finished Create System Files and Directories.1933worker1 # [ 2.564683] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1934worker1 # [ 2.568663] systemd[1]: Finished Virtual Console Setup.1935lb # [ 2.517542] systemd[1]: Started Rule-based Manager for Device Events and Files.1936client # [ 2.552771] systemd-vconsole-setup[104]: Configuration of first virtual console was skipped, ignoring remaining ones.1937client # [ 2.556933] systemd[1]: Finished Virtual Console Setup.1938worker2 # [ 2.567331] systemd[1]: Starting Virtual Console Setup...1939lb # [ 2.596614] systemd[1]: Starting Virtual Console Setup...1940worker2 # [ 2.624768] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones.1941worker2 # [ 2.629094] systemd[1]: Finished Virtual Console Setup.1942lb # [ 2.648599] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones.1943lb # [ 2.654784] systemd[1]: Finished Virtual Console Setup.1944worker1 # [ 3.179718] systemd[1]: Finished Coldplug All udev Devices.1945worker1 # [ 3.181658] systemd[1]: Reached target System Initialization.1946worker1 # [ 3.184132] systemd[1]: Reached target Basic System.1947client # [ 3.172931] systemd[1]: Finished Coldplug All udev Devices.1948client # [ 3.173994] systemd[1]: Reached target System Initialization.1949client # [ 3.174868] systemd[1]: Reached target Basic System.1950worker2 # [ 3.260581] systemd[1]: Finished Coldplug All udev Devices.1951worker2 # [ 3.262088] systemd[1]: Reached target System Initialization.1952worker2 # [ 3.264215] systemd[1]: Reached target Basic System.1953worker1 # [ 3.366776] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line.1954lb # [ 3.310054] systemd[1]: Finished Coldplug All udev Devices.1955lb # [ 3.311143] systemd[1]: Reached target System Initialization.1956lb # [ 3.312088] systemd[1]: Reached target Basic System.1957worker1 # [ 3.392683] (udev-worker)[100]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1958worker1 # [ 3.400255] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line.1959client # [ 3.332459] (udev-worker)[99]: Network interface NamePolicy= disabled on kernel command line.1960client # [ 3.366243] (udev-worker)[100]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1961client # [ 3.374065] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line.1962worker1 # [ 3.466851] systemd[1]: Found device /dev/disk/by-label/nixos.1963worker1 # [ 3.468969] systemd[1]: Reached target Initrd Root Device.1964worker1 # [ 3.473533] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1965worker2 # [ 3.455819] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line.1966client # [ 3.455954] systemd[1]: Found device /dev/disk/by-label/nixos.1967client # [ 3.459989] systemd[1]: Reached target Initrd Root Device.1968worker1 # [ 3.540612] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1969client # [ 3.464889] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1970worker1 # [ 3.549589] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1971worker2 # [ 3.474115] (udev-worker)[99]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1972worker2 # [ 3.479895] (udev-worker)[99]: Network interface NamePolicy= disabled on kernel command line.1973lb # [ 3.483313] (udev-worker)[92]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1974worker1 # [ 3.560339] systemd[1]: Mounting /sysroot...1975lb # [ 3.505203] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line.1976lb # [ 3.516126] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line.1977client # [ 3.528414] systemd-fsck[113]: nixos: clean, 12/65536 files, 13019/262144 blocks1978worker1 # [ 3.627717] EXT4-fs (vda): mounted filesystem 7d81f1a4-8389-42d4-add5-8d1b8f92635c r/w with ordered data mode. Quota mode: none.1979client # [ 3.535485] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1980worker1 # [ 3.617717] systemd[1]: Mounted /sysroot.1981worker1 # [ 3.619055] systemd[1]: Reached target Initrd Root File System.1982worker1 # [ 3.624295] systemd[1]: Starting Mountpoints Configured in the Real Root...1983client # [ 3.551646] systemd[1]: Mounting /sysroot...1984worker2 # [ 3.556852] systemd[1]: Found device /dev/disk/by-label/nixos.1985worker2 # [ 3.567301] systemd[1]: Reached target Initrd Root Device.1986worker2 # [ 3.575292] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1987worker1 # [ 3.655921] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload.1988worker1 # [ 3.664132] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)...1989worker1 # [ 3.669525] systemd[1]: Reloading...1990client # [ 3.607338] EXT4-fs (vda): mounted filesystem f9a89a27-76af-4103-b21d-c9614b2de620 r/w with ordered data mode. Quota mode: none.1991client # [ 3.595568] systemd[1]: Mounted /sysroot.1992client # [ 3.596848] systemd[1]: Reached target Initrd Root File System.1993client # [ 3.600453] systemd[1]: Starting Mountpoints Configured in the Real Root...1994lb # [ 3.616745] systemd[1]: Found device /dev/disk/by-label/nixos.1995lb # [ 3.620769] systemd[1]: Reached target Initrd Root Device.1996lb # [ 3.625055] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1997worker2 # [ 3.638648] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks1998client # [ 3.634505] systemd-sysroot-fstab-check[121]: /sysroot should be mounted in the initrd, will request daemon-reload.1999client # [ 3.640311] systemd[1]: Reload requested from client PID 121 ('systemd-sysroot') (unit initrd-parse-etc.service)...2000worker2 # [ 3.647708] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.
loading 1,493 hidden lines…
3494lb # [ 24.774948] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3495lb # [ 24.778711] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3496lb # [ 24.781645] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3497lb # [ 24.784963] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3498lb # [ 24.810486] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3499lb # [ 24.813157] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3500lb # [ 24.819273] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3501lb # [ 24.822439] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3502lb # [ 24.827821] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3503lb # [ 24.831212] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13504lb # [ 24.836182] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso3505lb # [ 24.838535] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3506lb # [ 24.842057] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector3507lb # [ 24.850216] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3508lb # [ 24.856331] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3509lb # [ 24.858476] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3510lb # [ 24.869369] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3511lb # [ 24.872139] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default3512lb # [ 24.874223] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3513lb # [ 24.876819] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default3514lb # [ 24.879085] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3515lb # [ 24.881777] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3516lb # [ 24.884588] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3517lb # [ 24.891022] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3518lb # [ 24.893383] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3519lb # [ 24.895796] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23520lb # [ 24.898252] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3521lb # [ 24.901141] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable3522lb # [ 24.903494] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid3523lb # [ 24.905470] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3524lb # [ 24.907598] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo3525lb # [ 24.909865] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3526lb # [ 24.913382] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth23527lb # [ 24.916351] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23528lb # [ 24.918691] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default3529lb # [ 24.920824] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3530lb # [ 24.923553] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3531lb # [ 24.927987] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3532lb # [ 24.930450] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3533lb # [ 24.934008] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3534lb # [ 24.939677] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple3535lb # [ 24.942551] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3536lb # [ 24.945229] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection3537lb # [ 24.947312] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy3538lb # [ 24.950489] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3539lb # [ 24.953591] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3540lb # [ 24.956567] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3541lb # [ 24.959002] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default3542lb # [ 24.961632] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default3543lb # [ 24.965499] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3544lb # [ 24.975873] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3545lb # [ 24.978708] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3546lb # [ 24.982866] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind3547lb # [ 24.984962] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3548lb # [ 24.987685] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3549lb # [ 24.992630] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3550lb # [ 24.994817] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3551lb # [ 25.004213] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert3552lb # [ 25.006646] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy3553lb # [ 25.009871] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3554lb # [ 25.011946] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3555lb # [ 25.014782] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy3556lb # [ 25.030991] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3557lb # [ 25.034207] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3558lb # [ 25.037034] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3559lb # [ 25.038953] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3560lb # [ 25.041127] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3561lb # [ 25.043337] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter3562lb # [ 25.045538] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3563lb # [ 25.048684] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic3564lb # [ 25.050708] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3565lb # [ 25.058723] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params3566lb # [ 25.070648] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3567lb # [ 25.073692] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3568lb # [ 25.077755] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3569lb # [ 25.110253] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3570lb # [ 25.117988] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83571lb # [ 25.120097] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3572lb # [ 25.122928] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3573lb # [ 25.125515] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3574lb # [ 25.129352] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift3575lb # [ 25.133086] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3576lb # [ 25.137774] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator3577lb # [ 25.140541] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction3578lb # [ 25.145682] envoy[895]: [2026-09-20 08:05:16.099][895][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection3579lb # [ 25.151242] envoy[895]: [2026-09-20 08:05:16.156][895][info][main] [source/server/server.cc:531] HTTP header map info:3580lb # [ 25.152958] envoy[895]: [2026-09-20 08:05:16.182][895][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id3581lb # [ 25.169502] envoy[895]: [2026-09-20 08:05:16.182][895][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:3582lb # [ 25.173344] envoy[895]: [2026-09-20 08:05:16.182][895][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id3583lb # [ 25.183292] envoy[895]: [2026-09-20 08:05:16.182][895][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status3584lb # [ 25.185633] envoy[895]: [2026-09-20 08:05:16.362][895][info][main] [source/server/server.cc:968] runtime: {}3585lb # [ 25.187075] envoy[895]: [2026-09-20 08:05:16.389][895][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.3586lb # [ 25.189600] envoy[895]: [2026-09-20 08:05:16.389][895][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99013587lb # [ 25.191486] envoy[895]: [2026-09-20 08:05:16.389][895][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99013588lb # [ 25.193439] envoy[895]: [2026-09-20 08:05:16.402][895][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration3589lb # [ 25.195452] envoy[895]: [2026-09-20 08:05:16.402][895][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)3590lb # [ 25.198068] envoy[895]: [2026-09-20 08:05:16.402][895][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)3591lb # [ 25.238939] envoy[895]: [2026-09-20 08:05:16.635][895][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)3592worker2 # [ 25.250937] systemd[1]: Starting Nix worker-protocol over gRPC...3593lb # [ 25.259318] envoy[895]: [2026-09-20 08:05:16.655][895][info][config] [source/server/configuration_impl.cc:164] loading stats configuration3594worker1 # [ 25.333065] systemd[1]: Starting Nix worker-protocol over gRPC...3595lb # [ 25.262707] envoy[895]: [2026-09-20 08:05:16.656][895][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.3596lb # [ 25.266444] envoy[895]: [2026-09-20 08:05:16.656][895][info][main] [source/server/server.cc:1077] starting main dispatch loop3597worker2 # [ 25.515653] nix-grpc-daemon[774]: ts=2026-09-20T08:05:16Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3598worker2 # [ 25.530751] nix-grpc-daemon[774]: ts=2026-09-20T08:05:16Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=13599worker1 # [ 25.641996] nix-grpc-daemon[832]: ts=2026-09-20T08:05:16Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3600worker2 # [ 25.577680] nix-grpc-daemon[774]: ts=2026-09-20T08:05:16Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3601worker1 # [ 25.658176] nix-grpc-daemon[832]: ts=2026-09-20T08:05:16Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=13602worker2 # [ 25.591717] systemd[1]: Started Nix worker-protocol over gRPC.3603worker2 # [ 25.618439] nix-grpc-daemon[774]: ts=2026-09-20T08:05:17Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3604lb # [ 25.620613] envoy[895]: [2026-09-20 08:05:17.017][895][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization3605lb # [ 25.629244] envoy[895]: [2026-09-20 08:05:17.024][895][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized3606lb # [ 25.635243] envoy[895]: [2026-09-20 08:05:17.024][895][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager3607worker1 # [ 25.713168] nix-grpc-daemon[832]: ts=2026-09-20T08:05:16Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3608worker1 # [ 25.715125] systemd[1]: Started Nix worker-protocol over gRPC.3609lb # [ 25.640899] envoy[895]: [2026-09-20 08:05:17.024][895][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers3610worker1 # [ 25.755905] nix-grpc-daemon[832]: ts=2026-09-20T08:05:16Z level=info event=scheduler_connected addr=lb:500513611worker1 # [ 25.763066] nix-grpc-daemon[832]: ts=2026-09-20T08:05:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3612worker2 # [ 25.819308] nix-grpc-daemon[774]: ts=2026-09-20T08:05:17Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3613worker1 # [ 25.964513] nix-grpc-daemon[832]: ts=2026-09-20T08:05:16Z level=info event=scheduler_connected addr=lb:500513614worker1 # [ 25.983418] nix-grpc-daemon[832]: ts=2026-09-20T08:05:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3615worker1 # [ 26.184836] nix-grpc-daemon[832]: ts=2026-09-20T08:05:16Z level=info event=scheduler_connected addr=lb:500513616worker1 # [ 26.193254] nix-grpc-daemon[832]: ts=2026-09-20T08:05:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3617worker2 # [ 26.219796] nix-grpc-daemon[774]: ts=2026-09-20T08:05:17Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3618worker1 # [ 26.394982] nix-grpc-daemon[832]: ts=2026-09-20T08:05:16Z level=info event=scheduler_connected addr=lb:500513619worker1 # [ 26.400157] nix-grpc-daemon[832]: ts=2026-09-20T08:05:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3620lb # [ 26.453415] envoy[895]: conn peer=192.168.1.4:48920 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=91 tx=55 ms=133621worker1 # [ 26.601367] nix-grpc-daemon[832]: ts=2026-09-20T08:05:17Z level=info event=scheduler_connected addr=lb:500513622worker1 # [ 26.610232] nix-grpc-daemon[832]: ts=2026-09-20T08:05:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3623worker1 # [ 26.811837] nix-grpc-daemon[832]: ts=2026-09-20T08:05:17Z level=info event=scheduler_connected addr=lb:500513624worker1 # [ 26.815889] nix-grpc-daemon[832]: ts=2026-09-20T08:05:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3625worker1 # [ 27.017143] nix-grpc-daemon[832]: ts=2026-09-20T08:05:17Z level=info event=scheduler_connected addr=lb:500513626worker1 # [ 27.023524] nix-grpc-daemon[832]: ts=2026-09-20T08:05:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3627worker2 # [ 27.021811] nix-grpc-daemon[774]: ts=2026-09-20T08:05:18Z level=info event=scheduler_connected addr=lb:500513628worker2 # [ 27.027148] nix-grpc-daemon[774]: ts=2026-09-20T08:05:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3629worker1 # [ 27.224991] nix-grpc-daemon[832]: ts=2026-09-20T08:05:17Z level=info event=scheduler_connected addr=lb:500513630worker1 # [ 27.230214] nix-grpc-daemon[832]: ts=2026-09-20T08:05:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3631worker2 # [ 27.228306] nix-grpc-daemon[774]: ts=2026-09-20T08:05:18Z level=info event=scheduler_connected addr=lb:500513632worker2 # [ 27.233785] nix-grpc-daemon[774]: ts=2026-09-20T08:05:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3633worker1 # [ 27.431771] nix-grpc-daemon[832]: ts=2026-09-20T08:05:17Z level=info event=scheduler_connected addr=lb:500513634worker1 # [ 27.440152] nix-grpc-daemon[832]: ts=2026-09-20T08:05:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3635worker2 # [ 27.434576] nix-grpc-daemon[774]: ts=2026-09-20T08:05:18Z level=info event=scheduler_connected addr=lb:500513636worker2 # [ 27.439572] nix-grpc-daemon[774]: ts=2026-09-20T08:05:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3637worker1 # [ 27.641271] nix-grpc-daemon[832]: ts=2026-09-20T08:05:18Z level=info event=scheduler_connected addr=lb:500513638worker1 # [ 27.646344] nix-grpc-daemon[832]: ts=2026-09-20T08:05:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3639worker2 # [ 27.640372] nix-grpc-daemon[774]: ts=2026-09-20T08:05:19Z level=info event=scheduler_connected addr=lb:500513640worker2 # [ 27.644769] nix-grpc-daemon[774]: ts=2026-09-20T08:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3641worker1 # [ 27.852171] nix-grpc-daemon[832]: ts=2026-09-20T08:05:18Z level=info event=scheduler_connected addr=lb:500513642worker1 # [ 27.856649] nix-grpc-daemon[832]: ts=2026-09-20T08:05:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3643worker2 # [ 27.854055] nix-grpc-daemon[774]: ts=2026-09-20T08:05:19Z level=info event=scheduler_connected addr=lb:500513644worker2 # [ 27.861773] nix-grpc-daemon[774]: ts=2026-09-20T08:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3645worker1 # [ 28.052702] nix-grpc-daemon[832]: ts=2026-09-20T08:05:18Z level=info event=scheduler_connected addr=lb:500513646worker1 # [ 28.057630] nix-grpc-daemon[832]: ts=2026-09-20T08:05:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3647worker2 # [ 28.066083] nix-grpc-daemon[774]: ts=2026-09-20T08:05:19Z level=info event=scheduler_connected addr=lb:500513648worker2 # [ 28.071935] nix-grpc-daemon[774]: ts=2026-09-20T08:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3649worker1 # [ 28.258668] nix-grpc-daemon[832]: ts=2026-09-20T08:05:18Z level=info event=scheduler_connected addr=lb:500513650worker1 # [ 28.267043] nix-grpc-daemon[832]: ts=2026-09-20T08:05:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3651worker2 # [ 28.273331] nix-grpc-daemon[774]: ts=2026-09-20T08:05:19Z level=info event=scheduler_connected addr=lb:500513652worker2 # [ 28.278170] nix-grpc-daemon[774]: ts=2026-09-20T08:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3653worker1 # [ 28.468668] nix-grpc-daemon[832]: ts=2026-09-20T08:05:18Z level=info event=scheduler_connected addr=lb:500513654worker1 # [ 28.476515] nix-grpc-daemon[832]: ts=2026-09-20T08:05:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3655worker2 # [ 28.479616] nix-grpc-daemon[774]: ts=2026-09-20T08:05:19Z level=info event=scheduler_connected addr=lb:500513656worker2 # [ 28.487289] nix-grpc-daemon[774]: ts=2026-09-20T08:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3657worker1 # [ 28.677990] nix-grpc-daemon[832]: ts=2026-09-20T08:05:19Z level=info event=scheduler_connected addr=lb:500513658worker1 # [ 28.687159] nix-grpc-daemon[832]: ts=2026-09-20T08:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3659worker2 # [ 28.688787] nix-grpc-daemon[774]: ts=2026-09-20T08:05:20Z level=info event=scheduler_connected addr=lb:500513660worker2 # [ 28.696996] nix-grpc-daemon[774]: ts=2026-09-20T08:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3661worker1 # [ 28.891642] nix-grpc-daemon[832]: ts=2026-09-20T08:05:19Z level=info event=scheduler_connected addr=lb:500513662worker1 # [ 28.897831] nix-grpc-daemon[832]: ts=2026-09-20T08:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3663worker2 # [ 28.897964] nix-grpc-daemon[774]: ts=2026-09-20T08:05:20Z level=info event=scheduler_connected addr=lb:500513664worker2 # [ 28.902276] nix-grpc-daemon[774]: ts=2026-09-20T08:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3665worker1 # [ 29.098518] nix-grpc-daemon[832]: ts=2026-09-20T08:05:19Z level=info event=scheduler_connected addr=lb:500513666worker1 # [ 29.103121] nix-grpc-daemon[832]: ts=2026-09-20T08:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3667worker2 # [ 29.105244] nix-grpc-daemon[774]: ts=2026-09-20T08:05:20Z level=info event=scheduler_connected addr=lb:500513668worker2 # [ 29.108404] nix-grpc-daemon[774]: ts=2026-09-20T08:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3669worker1 # [ 29.304801] nix-grpc-daemon[832]: ts=2026-09-20T08:05:19Z level=info event=scheduler_connected addr=lb:500513670worker1 # [ 29.312852] nix-grpc-daemon[832]: ts=2026-09-20T08:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3671worker2 # [ 29.309642] nix-grpc-daemon[774]: ts=2026-09-20T08:05:20Z level=info event=scheduler_connected addr=lb:500513672worker2 # [ 29.317282] nix-grpc-daemon[774]: ts=2026-09-20T08:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3673worker1 # [ 29.515370] nix-grpc-daemon[832]: ts=2026-09-20T08:05:19Z level=info event=scheduler_connected addr=lb:500513674worker1 # [ 29.522375] nix-grpc-daemon[832]: ts=2026-09-20T08:05:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3675worker2 # [ 29.518127] nix-grpc-daemon[774]: ts=2026-09-20T08:05:20Z level=info event=scheduler_connected addr=lb:500513676worker2 # [ 29.521824] nix-grpc-daemon[774]: ts=2026-09-20T08:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3677worker1 # [ 29.723379] nix-grpc-daemon[832]: ts=2026-09-20T08:05:20Z level=info event=scheduler_connected addr=lb:500513678worker1 # [ 29.731660] nix-grpc-daemon[832]: ts=2026-09-20T08:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3679worker2 # [ 29.723319] nix-grpc-daemon[774]: ts=2026-09-20T08:05:21Z level=info event=scheduler_connected addr=lb:500513680worker2 # [ 29.731786] nix-grpc-daemon[774]: ts=2026-09-20T08:05:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3681worker1 # [ 29.936148] nix-grpc-daemon[832]: ts=2026-09-20T08:05:20Z level=info event=scheduler_connected addr=lb:500513682worker1 # [ 29.941771] nix-grpc-daemon[832]: ts=2026-09-20T08:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3683worker2 # [ 29.932713] nix-grpc-daemon[774]: ts=2026-09-20T08:05:21Z level=info event=scheduler_connected addr=lb:500513684worker2 # [ 29.937545] nix-grpc-daemon[774]: ts=2026-09-20T08:05:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3685worker1 # [ 30.143018] nix-grpc-daemon[832]: ts=2026-09-20T08:05:20Z level=info event=scheduler_connected addr=lb:500513686worker1 # [ 30.150988] nix-grpc-daemon[832]: ts=2026-09-20T08:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3687worker2 # [ 30.139240] nix-grpc-daemon[774]: ts=2026-09-20T08:05:21Z level=info event=scheduler_connected addr=lb:500513688worker2 # [ 30.143353] nix-grpc-daemon[774]: ts=2026-09-20T08:05:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3689worker1 # [ 30.352506] nix-grpc-daemon[832]: ts=2026-09-20T08:05:20Z level=info event=scheduler_connected addr=lb:500513690worker1 # [ 30.360323] nix-grpc-daemon[832]: ts=2026-09-20T08:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3691worker2 # [ 30.345071] nix-grpc-daemon[774]: ts=2026-09-20T08:05:21Z level=info event=scheduler_connected addr=lb:500513692worker2 # [ 30.354234] nix-grpc-daemon[774]: ts=2026-09-20T08:05:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3693worker1 # [ 30.561774] nix-grpc-daemon[832]: ts=2026-09-20T08:05:20Z level=info event=scheduler_connected addr=lb:500513694worker1 # [ 30.570786] nix-grpc-daemon[832]: ts=2026-09-20T08:05:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3695worker2 # [ 30.555603] nix-grpc-daemon[774]: ts=2026-09-20T08:05:21Z level=info event=scheduler_connected addr=lb:500513696worker2 # [ 30.563708] nix-grpc-daemon[774]: ts=2026-09-20T08:05:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3697worker1 # [ 30.771879] nix-grpc-daemon[832]: ts=2026-09-20T08:05:21Z level=info event=scheduler_connected addr=lb:500513698worker1 # [ 30.777700] nix-grpc-daemon[832]: ts=2026-09-20T08:05:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3699worker2 # [ 30.764686] nix-grpc-daemon[774]: ts=2026-09-20T08:05:22Z level=info event=scheduler_connected addr=lb:500513700worker2 # [ 30.772919] nix-grpc-daemon[774]: ts=2026-09-20T08:05:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3701worker1 # [ 30.982503] nix-grpc-daemon[832]: ts=2026-09-20T08:05:21Z level=info event=scheduler_connected addr=lb:500513702worker1 # [ 30.987187] nix-grpc-daemon[832]: ts=2026-09-20T08:05:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3703worker2 # [ 30.974236] nix-grpc-daemon[774]: ts=2026-09-20T08:05:22Z level=info event=scheduler_connected addr=lb:500513704worker2 # [ 30.983510] nix-grpc-daemon[774]: ts=2026-09-20T08:05:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3705worker1 # [ 31.183534] nix-grpc-daemon[832]: ts=2026-09-20T08:05:21Z level=info event=scheduler_connected addr=lb:500513706worker1 # [ 31.191142] nix-grpc-daemon[832]: ts=2026-09-20T08:05:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3707worker2 # [ 31.185885] nix-grpc-daemon[774]: ts=2026-09-20T08:05:22Z level=info event=scheduler_connected addr=lb:500513708worker2 # [ 31.191166] nix-grpc-daemon[774]: ts=2026-09-20T08:05:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3709worker1 # [ 31.392736] nix-grpc-daemon[832]: ts=2026-09-20T08:05:21Z level=info event=scheduler_connected addr=lb:500513710worker1 # [ 31.400673] nix-grpc-daemon[832]: ts=2026-09-20T08:05:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3711worker2 # [ 31.392910] nix-grpc-daemon[774]: ts=2026-09-20T08:05:22Z level=info event=scheduler_connected addr=lb:500513712worker2 # [ 31.401098] nix-grpc-daemon[774]: ts=2026-09-20T08:05:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3713worker1 # [ 31.602029] nix-grpc-daemon[832]: ts=2026-09-20T08:05:22Z level=info event=scheduler_connected addr=lb:500513714worker1 # [ 31.610568] nix-grpc-daemon[832]: ts=2026-09-20T08:05:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3715worker2 # [ 31.602555] nix-grpc-daemon[774]: ts=2026-09-20T08:05:23Z level=info event=scheduler_connected addr=lb:500513716worker2 # [ 31.612210] nix-grpc-daemon[774]: ts=2026-09-20T08:05:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3717worker1 # [ 31.812190] nix-grpc-daemon[832]: ts=2026-09-20T08:05:22Z level=info event=scheduler_connected addr=lb:500513718worker1 # [ 31.819394] nix-grpc-daemon[832]: ts=2026-09-20T08:05:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3719worker2 # [ 31.813487] nix-grpc-daemon[774]: ts=2026-09-20T08:05:23Z level=info event=scheduler_connected addr=lb:500513720worker2 # [ 31.821185] nix-grpc-daemon[774]: ts=2026-09-20T08:05:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3721worker1 # [ 32.025240] nix-grpc-daemon[832]: ts=2026-09-20T08:05:22Z level=info event=scheduler_connected addr=lb:500513722worker1 # [ 32.032491] nix-grpc-daemon[832]: ts=2026-09-20T08:05:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3723worker2 # [ 32.022605] nix-grpc-daemon[774]: ts=2026-09-20T08:05:23Z level=info event=scheduler_connected addr=lb:500513724worker2 # [ 32.031239] nix-grpc-daemon[774]: ts=2026-09-20T08:05:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3725worker1 # [ 32.226129] nix-grpc-daemon[832]: ts=2026-09-20T08:05:22Z level=info event=scheduler_connected addr=lb:500513726worker1 # [ 32.230065] nix-grpc-daemon[832]: ts=2026-09-20T08:05:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3727worker2 # [ 32.235413] nix-grpc-daemon[774]: ts=2026-09-20T08:05:23Z level=info event=scheduler_connected addr=lb:500513728worker2 # [ 32.241177] nix-grpc-daemon[774]: ts=2026-09-20T08:05:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3729worker1 # [ 32.431625] nix-grpc-daemon[832]: ts=2026-09-20T08:05:22Z level=info event=scheduler_connected addr=lb:500513730worker1 # [ 32.439371] nix-grpc-daemon[832]: ts=2026-09-20T08:05:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3731worker2 # [ 32.442393] nix-grpc-daemon[774]: ts=2026-09-20T08:05:23Z level=info event=scheduler_connected addr=lb:500513732worker2 # [ 32.451651] nix-grpc-daemon[774]: ts=2026-09-20T08:05:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3733worker1 # [ 32.640978] nix-grpc-daemon[832]: ts=2026-09-20T08:05:23Z level=info event=scheduler_connected addr=lb:500513734worker1 # [ 32.649210] nix-grpc-daemon[832]: ts=2026-09-20T08:05:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3735worker2 # [ 32.653681] nix-grpc-daemon[774]: ts=2026-09-20T08:05:24Z level=info event=scheduler_connected addr=lb:500513736worker2 # [ 32.661817] nix-grpc-daemon[774]: ts=2026-09-20T08:05:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3737worker1 # [ 32.850250] nix-grpc-daemon[832]: ts=2026-09-20T08:05:23Z level=info event=scheduler_connected addr=lb:500513738worker1 # [ 32.856570] nix-grpc-daemon[832]: ts=2026-09-20T08:05:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3739worker2 # [ 32.863188] nix-grpc-daemon[774]: ts=2026-09-20T08:05:24Z level=info event=scheduler_connected addr=lb:500513740worker2 # [ 32.871322] nix-grpc-daemon[774]: ts=2026-09-20T08:05:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3741worker1 # [ 33.058445] nix-grpc-daemon[832]: ts=2026-09-20T08:05:23Z level=info event=scheduler_connected addr=lb:500513742worker1 # [ 33.063993] nix-grpc-daemon[832]: ts=2026-09-20T08:05:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3743worker2 # [ 33.072277] nix-grpc-daemon[774]: ts=2026-09-20T08:05:24Z level=info event=scheduler_connected addr=lb:500513744worker2 # [ 33.079089] nix-grpc-daemon[774]: ts=2026-09-20T08:05:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3745worker1 # [ 33.265748] nix-grpc-daemon[832]: ts=2026-09-20T08:05:23Z level=info event=scheduler_connected addr=lb:500513746worker1 # [ 33.274868] nix-grpc-daemon[832]: ts=2026-09-20T08:05:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3747worker2 # [ 33.281056] nix-grpc-daemon[774]: ts=2026-09-20T08:05:24Z level=info event=scheduler_connected addr=lb:500513748worker2 # [ 33.286662] nix-grpc-daemon[774]: ts=2026-09-20T08:05:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3749worker1 # [ 33.476424] nix-grpc-daemon[832]: ts=2026-09-20T08:05:23Z level=info event=scheduler_connected addr=lb:500513750worker1 # [ 33.485000] nix-grpc-daemon[832]: ts=2026-09-20T08:05:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3751worker2 # [ 33.487722] nix-grpc-daemon[774]: ts=2026-09-20T08:05:24Z level=info event=scheduler_connected addr=lb:500513752worker2 # [ 33.492798] nix-grpc-daemon[774]: ts=2026-09-20T08:05:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3753worker1 # [ 33.686078] nix-grpc-daemon[832]: ts=2026-09-20T08:05:24Z level=info event=scheduler_connected addr=lb:500513754worker1 # [ 33.690987] nix-grpc-daemon[832]: ts=2026-09-20T08:05:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3755worker2 # [ 33.693821] nix-grpc-daemon[774]: ts=2026-09-20T08:05:25Z level=info event=scheduler_connected addr=lb:500513756worker2 # [ 33.698146] nix-grpc-daemon[774]: ts=2026-09-20T08:05:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3757worker1 # [ 33.892230] nix-grpc-daemon[832]: ts=2026-09-20T08:05:24Z level=info event=scheduler_connected addr=lb:500513758worker1 # [ 33.898430] nix-grpc-daemon[832]: ts=2026-09-20T08:05:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3759worker2 # [ 33.899688] nix-grpc-daemon[774]: ts=2026-09-20T08:05:25Z level=info event=scheduler_connected addr=lb:500513760worker2 # [ 33.908205] nix-grpc-daemon[774]: ts=2026-09-20T08:05:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3761worker1 # [ 34.100068] nix-grpc-daemon[832]: ts=2026-09-20T08:05:24Z level=info event=scheduler_connected addr=lb:500513762worker1 # [ 34.103260] nix-grpc-daemon[832]: ts=2026-09-20T08:05:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3763worker2 # [ 34.109023] nix-grpc-daemon[774]: ts=2026-09-20T08:05:25Z level=info event=scheduler_connected addr=lb:500513764worker2 # [ 34.113188] nix-grpc-daemon[774]: ts=2026-09-20T08:05:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3765worker1 # [ 34.304289] nix-grpc-daemon[832]: ts=2026-09-20T08:05:24Z level=info event=scheduler_connected addr=lb:500513766worker1 # [ 34.309037] nix-grpc-daemon[832]: ts=2026-09-20T08:05:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3767worker2 # [ 34.317387] nix-grpc-daemon[774]: ts=2026-09-20T08:05:25Z level=info event=scheduler_connected addr=lb:500513768worker2 # [ 34.322936] nix-grpc-daemon[774]: ts=2026-09-20T08:05:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3769worker1 # [ 34.510606] nix-grpc-daemon[832]: ts=2026-09-20T08:05:24Z level=info event=scheduler_connected addr=lb:500513770worker1 # [ 34.525007] nix-grpc-daemon[832]: ts=2026-09-20T08:05:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3771worker2 # [ 34.524259] nix-grpc-daemon[774]: ts=2026-09-20T08:05:25Z level=info event=scheduler_connected addr=lb:500513772worker2 # [ 34.532712] nix-grpc-daemon[774]: ts=2026-09-20T08:05:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3773worker1 # [ 34.733408] nix-grpc-daemon[832]: ts=2026-09-20T08:05:25Z level=info event=scheduler_connected addr=lb:500513774worker1 # [ 34.739348] nix-grpc-daemon[832]: ts=2026-09-20T08:05:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3775worker2 # [ 34.733964] nix-grpc-daemon[774]: ts=2026-09-20T08:05:26Z level=info event=scheduler_connected addr=lb:500513776worker2 # [ 34.744298] nix-grpc-daemon[774]: ts=2026-09-20T08:05:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3777worker1 # [ 34.940545] nix-grpc-daemon[832]: ts=2026-09-20T08:05:25Z level=info event=scheduler_connected addr=lb:500513778worker1 # [ 34.949261] nix-grpc-daemon[832]: ts=2026-09-20T08:05:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3779worker2 # [ 34.945586] nix-grpc-daemon[774]: ts=2026-09-20T08:05:26Z level=info event=scheduler_connected addr=lb:500513780worker2 # [ 34.954520] nix-grpc-daemon[774]: ts=2026-09-20T08:05:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3781worker1 # [ 35.151097] nix-grpc-daemon[832]: ts=2026-09-20T08:05:25Z level=info event=scheduler_connected addr=lb:500513782worker1 # [ 35.155462] nix-grpc-daemon[832]: ts=2026-09-20T08:05:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3783worker2 # [ 35.156072] nix-grpc-daemon[774]: ts=2026-09-20T08:05:26Z level=info event=scheduler_connected addr=lb:500513784worker2 # [ 35.164700] nix-grpc-daemon[774]: ts=2026-09-20T08:05:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3785worker1 # [ 35.356649] nix-grpc-daemon[832]: ts=2026-09-20T08:05:25Z level=info event=scheduler_connected addr=lb:500513786worker1 # [ 35.363942] nix-grpc-daemon[832]: ts=2026-09-20T08:05:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3787worker2 # [ 35.369154] nix-grpc-daemon[774]: ts=2026-09-20T08:05:26Z level=info event=scheduler_connected addr=lb:500513788worker2 # [ 35.374299] nix-grpc-daemon[774]: ts=2026-09-20T08:05:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3789worker1 # [ 35.562861] nix-grpc-daemon[832]: ts=2026-09-20T08:05:25Z level=info event=scheduler_connected addr=lb:500513790worker1 # [ 35.568999] nix-grpc-daemon[832]: ts=2026-09-20T08:05:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3791worker2 # [ 35.575319] nix-grpc-daemon[774]: ts=2026-09-20T08:05:26Z level=info event=scheduler_connected addr=lb:500513792worker2 # [ 35.580982] nix-grpc-daemon[774]: ts=2026-09-20T08:05:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3793worker1 # [ 35.770403] nix-grpc-daemon[832]: ts=2026-09-20T08:05:26Z level=info event=scheduler_connected addr=lb:500513794worker1 # [ 35.778762] nix-grpc-daemon[832]: ts=2026-09-20T08:05:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3795worker2 # [ 35.782005] nix-grpc-daemon[774]: ts=2026-09-20T08:05:27Z level=info event=scheduler_connected addr=lb:500513796worker2 # [ 35.788515] nix-grpc-daemon[774]: ts=2026-09-20T08:05:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3797worker1 # [ 35.980193] nix-grpc-daemon[832]: ts=2026-09-20T08:05:26Z level=info event=scheduler_connected addr=lb:500513798worker1 # [ 35.989435] nix-grpc-daemon[832]: ts=2026-09-20T08:05:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3799worker2 # [ 35.989483] nix-grpc-daemon[774]: ts=2026-09-20T08:05:27Z level=info event=scheduler_connected addr=lb:500513800worker2 # [ 35.998365] nix-grpc-daemon[774]: ts=2026-09-20T08:05:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3801worker1 # [ 36.192229] nix-grpc-daemon[832]: ts=2026-09-20T08:05:26Z level=info event=scheduler_connected addr=lb:500513802worker1 # [ 36.195736] nix-grpc-daemon[832]: ts=2026-09-20T08:05:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3803worker2 # [ 36.199764] nix-grpc-daemon[774]: ts=2026-09-20T08:05:27Z level=info event=scheduler_connected addr=lb:500513804worker2 # [ 36.208652] nix-grpc-daemon[774]: ts=2026-09-20T08:05:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3805worker1 # [ 36.397408] nix-grpc-daemon[832]: ts=2026-09-20T08:05:26Z level=info event=scheduler_connected addr=lb:500513806worker1 # [ 36.405581] nix-grpc-daemon[832]: ts=2026-09-20T08:05:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3807worker2 # [ 36.411345] nix-grpc-daemon[774]: ts=2026-09-20T08:05:27Z level=info event=scheduler_connected addr=lb:500513808worker2 # [ 36.419670] nix-grpc-daemon[774]: ts=2026-09-20T08:05:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3809worker1 # [ 36.606603] nix-grpc-daemon[832]: ts=2026-09-20T08:05:27Z level=info event=scheduler_connected addr=lb:500513810worker1 # [ 36.612269] nix-grpc-daemon[832]: ts=2026-09-20T08:05:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3811worker2 # [ 36.621332] nix-grpc-daemon[774]: ts=2026-09-20T08:05:28Z level=info event=scheduler_connected addr=lb:500513812worker2 # [ 36.626310] nix-grpc-daemon[774]: ts=2026-09-20T08:05:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3813worker1 # [ 36.813586] nix-grpc-daemon[832]: ts=2026-09-20T08:05:27Z level=info event=scheduler_connected addr=lb:500513814worker1 # [ 36.821497] nix-grpc-daemon[832]: ts=2026-09-20T08:05:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3815worker2 # [ 36.827805] nix-grpc-daemon[774]: ts=2026-09-20T08:05:28Z level=info event=scheduler_connected addr=lb:500513816worker2 # [ 36.836372] nix-grpc-daemon[774]: ts=2026-09-20T08:05:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3817worker1 # [ 37.023000] nix-grpc-daemon[832]: ts=2026-09-20T08:05:27Z level=info event=scheduler_connected addr=lb:500513818worker1 # [ 37.027575] nix-grpc-daemon[832]: ts=2026-09-20T08:05:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3819worker2 # [ 37.037903] nix-grpc-daemon[774]: ts=2026-09-20T08:05:28Z level=info event=scheduler_connected addr=lb:500513820worker2 # [ 37.043441] nix-grpc-daemon[774]: ts=2026-09-20T08:05:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3821worker1 # [ 37.229133] nix-grpc-daemon[832]: ts=2026-09-20T08:05:27Z level=info event=scheduler_connected addr=lb:500513822worker1 # [ 37.234103] nix-grpc-daemon[832]: ts=2026-09-20T08:05:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3823worker2 # [ 37.244506] nix-grpc-daemon[774]: ts=2026-09-20T08:05:28Z level=info event=scheduler_connected addr=lb:500513824worker2 # [ 37.248771] nix-grpc-daemon[774]: ts=2026-09-20T08:05:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3825worker1 # [ 37.435709] nix-grpc-daemon[832]: ts=2026-09-20T08:05:27Z level=info event=scheduler_connected addr=lb:500513826worker1 # [ 37.443662] nix-grpc-daemon[832]: ts=2026-09-20T08:05:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3827worker2 # [ 37.450500] nix-grpc-daemon[774]: ts=2026-09-20T08:05:28Z level=info event=scheduler_connected addr=lb:500513828worker2 # [ 37.455291] nix-grpc-daemon[774]: ts=2026-09-20T08:05:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3829worker1 # [ 37.645352] nix-grpc-daemon[832]: ts=2026-09-20T08:05:28Z level=info event=scheduler_connected addr=lb:500513830worker1 # [ 37.653712] nix-grpc-daemon[832]: ts=2026-09-20T08:05:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3831worker2 # [ 37.656439] nix-grpc-daemon[774]: ts=2026-09-20T08:05:29Z level=info event=scheduler_connected addr=lb:500513832worker2 # [ 37.664136] nix-grpc-daemon[774]: ts=2026-09-20T08:05:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3833worker1 # [ 37.855074] nix-grpc-daemon[832]: ts=2026-09-20T08:05:28Z level=info event=scheduler_connected addr=lb:500513834worker1 # [ 37.863234] nix-grpc-daemon[832]: ts=2026-09-20T08:05:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3835worker2 # [ 37.865490] nix-grpc-daemon[774]: ts=2026-09-20T08:05:29Z level=info event=scheduler_connected addr=lb:500513836worker2 # [ 37.872880] nix-grpc-daemon[774]: ts=2026-09-20T08:05:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3837worker1 # [ 38.064818] nix-grpc-daemon[832]: ts=2026-09-20T08:05:28Z level=info event=scheduler_connected addr=lb:500513838worker1 # [ 38.072878] nix-grpc-daemon[832]: ts=2026-09-20T08:05:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3839worker2 # [ 38.074339] nix-grpc-daemon[774]: ts=2026-09-20T08:05:29Z level=info event=scheduler_connected addr=lb:500513840worker2 # [ 38.082838] nix-grpc-daemon[774]: ts=2026-09-20T08:05:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3841worker1 # [ 38.276380] nix-grpc-daemon[832]: ts=2026-09-20T08:05:28Z level=info event=scheduler_connected addr=lb:500513842worker1 # [ 38.280757] nix-grpc-daemon[832]: ts=2026-09-20T08:05:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3843worker2 # [ 38.284316] nix-grpc-daemon[774]: ts=2026-09-20T08:05:29Z level=info event=scheduler_connected addr=lb:500513844worker2 # [ 38.292641] nix-grpc-daemon[774]: ts=2026-09-20T08:05:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3845worker1 # [ 38.482025] nix-grpc-daemon[832]: ts=2026-09-20T08:05:28Z level=info event=scheduler_connected addr=lb:500513846worker1 # [ 38.490233] nix-grpc-daemon[832]: ts=2026-09-20T08:05:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3847worker2 # [ 38.497302] nix-grpc-daemon[774]: ts=2026-09-20T08:05:29Z level=info event=scheduler_connected addr=lb:500513848worker2 # [ 38.503006] nix-grpc-daemon[774]: ts=2026-09-20T08:05:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3849worker1 # [ 38.691994] nix-grpc-daemon[832]: ts=2026-09-20T08:05:29Z level=info event=scheduler_connected addr=lb:500513850worker1 # [ 38.702468] nix-grpc-daemon[832]: ts=2026-09-20T08:05:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3851worker2 # [ 38.704392] nix-grpc-daemon[774]: ts=2026-09-20T08:05:30Z level=info event=scheduler_connected addr=lb:500513852worker2 # [ 38.713357] nix-grpc-daemon[774]: ts=2026-09-20T08:05:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3853worker1 # [ 38.902047] nix-grpc-daemon[832]: ts=2026-09-20T08:05:29Z level=info event=scheduler_connected addr=lb:500513854worker1 # [ 38.907911] nix-grpc-daemon[832]: ts=2026-09-20T08:05:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3855worker2 # [ 38.914599] nix-grpc-daemon[774]: ts=2026-09-20T08:05:30Z level=info event=scheduler_connected addr=lb:500513856worker2 # [ 38.922544] nix-grpc-daemon[774]: ts=2026-09-20T08:05:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3857worker1 # [ 39.109240] nix-grpc-daemon[832]: ts=2026-09-20T08:05:29Z level=info event=scheduler_connected addr=lb:500513858worker1 # [ 39.117147] nix-grpc-daemon[832]: ts=2026-09-20T08:05:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3859worker2 # [ 39.124223] nix-grpc-daemon[774]: ts=2026-09-20T08:05:30Z level=info event=scheduler_connected addr=lb:500513860worker2 # [ 39.132377] nix-grpc-daemon[774]: ts=2026-09-20T08:05:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3861worker1 # [ 39.320476] nix-grpc-daemon[832]: ts=2026-09-20T08:05:29Z level=info event=scheduler_connected addr=lb:500513862worker1 # [ 39.328929] nix-grpc-daemon[832]: ts=2026-09-20T08:05:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3863worker2 # [ 39.333428] nix-grpc-daemon[774]: ts=2026-09-20T08:05:30Z level=info event=scheduler_connected addr=lb:500513864worker2 # [ 39.341497] nix-grpc-daemon[774]: ts=2026-09-20T08:05:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3865worker1 # [ 39.530085] nix-grpc-daemon[832]: ts=2026-09-20T08:05:29Z level=info event=scheduler_connected addr=lb:500513866worker1 # [ 39.535242] nix-grpc-daemon[832]: ts=2026-09-20T08:05:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3867worker2 # [ 39.544725] nix-grpc-daemon[774]: ts=2026-09-20T08:05:30Z level=info event=scheduler_connected addr=lb:500513868worker2 # [ 39.548887] nix-grpc-daemon[774]: ts=2026-09-20T08:05:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3869worker1 # [ 39.736506] nix-grpc-daemon[832]: ts=2026-09-20T08:05:30Z level=info event=scheduler_connected addr=lb:500513870worker1 # [ 39.740803] nix-grpc-daemon[832]: ts=2026-09-20T08:05:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3871worker2 # [ 39.750229] nix-grpc-daemon[774]: ts=2026-09-20T08:05:31Z level=info event=scheduler_connected addr=lb:500513872worker2 # [ 39.758022] nix-grpc-daemon[774]: ts=2026-09-20T08:05:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3873worker1 # [ 39.942005] nix-grpc-daemon[832]: ts=2026-09-20T08:05:30Z level=info event=scheduler_connected addr=lb:500513874worker1 # [ 39.948916] nix-grpc-daemon[832]: ts=2026-09-20T08:05:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3875worker2 # [ 39.958906] nix-grpc-daemon[774]: ts=2026-09-20T08:05:31Z level=info event=scheduler_connected addr=lb:500513876worker2 # [ 39.963195] nix-grpc-daemon[774]: ts=2026-09-20T08:05:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3877worker1 # [ 40.150961] nix-grpc-daemon[832]: ts=2026-09-20T08:05:30Z level=info event=scheduler_connected addr=lb:500513878worker1 # [ 40.159878] nix-grpc-daemon[832]: ts=2026-09-20T08:05:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3879worker2 # [ 40.164957] nix-grpc-daemon[774]: ts=2026-09-20T08:05:31Z level=info event=scheduler_connected addr=lb:500513880worker2 # [ 40.173822] nix-grpc-daemon[774]: ts=2026-09-20T08:05:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3881worker1 # [ 40.363700] nix-grpc-daemon[832]: ts=2026-09-20T08:05:30Z level=info event=scheduler_connected addr=lb:500513882worker1 # [ 40.373823] nix-grpc-daemon[832]: ts=2026-09-20T08:05:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3883worker2 # [ 40.375299] nix-grpc-daemon[774]: ts=2026-09-20T08:05:31Z level=info event=scheduler_connected addr=lb:500513884worker2 # [ 40.384673] nix-grpc-daemon[774]: ts=2026-09-20T08:05:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3885worker1 # [ 40.575240] nix-grpc-daemon[832]: ts=2026-09-20T08:05:30Z level=info event=scheduler_connected addr=lb:500513886worker1 # [ 40.583148] nix-grpc-daemon[832]: ts=2026-09-20T08:05:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3887worker2 # [ 40.588453] nix-grpc-daemon[774]: ts=2026-09-20T08:05:31Z level=info event=scheduler_connected addr=lb:500513888worker2 # [ 40.594672] nix-grpc-daemon[774]: ts=2026-09-20T08:05:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3889worker1 # [ 40.784379] nix-grpc-daemon[832]: ts=2026-09-20T08:05:31Z level=info event=scheduler_connected addr=lb:500513890worker1 # [ 40.793297] nix-grpc-daemon[832]: ts=2026-09-20T08:05:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3891worker2 # [ 40.795666] nix-grpc-daemon[774]: ts=2026-09-20T08:05:32Z level=info event=scheduler_connected addr=lb:500513892worker2 # [ 40.800875] nix-grpc-daemon[774]: ts=2026-09-20T08:05:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3893worker1 # [ 40.994405] nix-grpc-daemon[832]: ts=2026-09-20T08:05:31Z level=info event=scheduler_connected addr=lb:500513894worker1 # [ 40.998983] nix-grpc-daemon[832]: ts=2026-09-20T08:05:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3895worker2 # [ 41.002267] nix-grpc-daemon[774]: ts=2026-09-20T08:05:32Z level=info event=scheduler_connected addr=lb:500513896worker2 # [ 41.011089] nix-grpc-daemon[774]: ts=2026-09-20T08:05:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3897worker1 # [ 41.200479] nix-grpc-daemon[832]: ts=2026-09-20T08:05:31Z level=info event=scheduler_connected addr=lb:500513898worker1 # [ 41.209870] nix-grpc-daemon[832]: ts=2026-09-20T08:05:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3899worker2 # [ 41.212652] nix-grpc-daemon[774]: ts=2026-09-20T08:05:32Z level=info event=scheduler_connected addr=lb:500513900worker2 # [ 41.219995] nix-grpc-daemon[774]: ts=2026-09-20T08:05:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3901worker1 # [ 41.415271] nix-grpc-daemon[832]: ts=2026-09-20T08:05:31Z level=info event=scheduler_connected addr=lb:500513902worker1 # [ 41.423702] nix-grpc-daemon[832]: ts=2026-09-20T08:05:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3903worker2 # [ 41.421011] nix-grpc-daemon[774]: ts=2026-09-20T08:05:32Z level=info event=scheduler_connected addr=lb:500513904worker2 # [ 41.426878] nix-grpc-daemon[774]: ts=2026-09-20T08:05:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3905worker1 # [ 41.623709] nix-grpc-daemon[832]: ts=2026-09-20T08:05:32Z level=info event=scheduler_connected addr=lb:500513906worker1 # [ 41.629442] nix-grpc-daemon[832]: ts=2026-09-20T08:05:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3907worker2 # [ 41.628779] nix-grpc-daemon[774]: ts=2026-09-20T08:05:33Z level=info event=scheduler_connected addr=lb:500513908worker2 # [ 41.633572] nix-grpc-daemon[774]: ts=2026-09-20T08:05:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3909worker1 # [ 41.830885] nix-grpc-daemon[832]: ts=2026-09-20T08:05:32Z level=info event=scheduler_connected addr=lb:500513910worker1 # [ 41.838894] nix-grpc-daemon[832]: ts=2026-09-20T08:05:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3911worker2 # [ 41.834892] nix-grpc-daemon[774]: ts=2026-09-20T08:05:33Z level=info event=scheduler_connected addr=lb:500513912worker2 # [ 41.842696] nix-grpc-daemon[774]: ts=2026-09-20T08:05:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3913worker1 # [ 42.039942] nix-grpc-daemon[832]: ts=2026-09-20T08:05:32Z level=info event=scheduler_connected addr=lb:500513914worker1 # [ 42.050560] nix-grpc-daemon[832]: ts=2026-09-20T08:05:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3915worker2 # [ 42.043568] nix-grpc-daemon[774]: ts=2026-09-20T08:05:33Z level=info event=scheduler_connected addr=lb:500513916worker2 # [ 42.049208] nix-grpc-daemon[774]: ts=2026-09-20T08:05:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3917worker1 # [ 42.247769] nix-grpc-daemon[832]: ts=2026-09-20T08:05:32Z level=info event=scheduler_connected addr=lb:500513918worker1 # [ 42.255073] nix-grpc-daemon[832]: ts=2026-09-20T08:05:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3919worker2 # [ 42.250736] nix-grpc-daemon[774]: ts=2026-09-20T08:05:33Z level=info event=scheduler_connected addr=lb:500513920worker2 # [ 42.258828] nix-grpc-daemon[774]: ts=2026-09-20T08:05:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3921lb # [ 42.379926] rustfs-bucket-start[1103]: mb s3://farm3922worker1 # [ 42.459290] nix-grpc-daemon[832]: ts=2026-09-20T08:05:32Z level=info event=scheduler_connected addr=lb:500513923lb # [ 42.392518] systemd[1]: Finished rustfs-bucket.service.3924worker1 # [ 42.465988] nix-grpc-daemon[832]: ts=2026-09-20T08:05:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3925lb # [ 42.401616] systemd[1]: Starting niks3 server...3926worker2 # [ 42.460186] nix-grpc-daemon[774]: ts=2026-09-20T08:05:33Z level=info event=scheduler_connected addr=lb:500513927worker2 # [ 42.468459] nix-grpc-daemon[774]: ts=2026-09-20T08:05:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3928worker1 # [ 42.667218] nix-grpc-daemon[832]: ts=2026-09-20T08:05:33Z level=info event=scheduler_connected addr=lb:500513929worker1 # [ 42.674963] nix-grpc-daemon[832]: ts=2026-09-20T08:05:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3930worker2 # [ 42.673054] nix-grpc-daemon[774]: ts=2026-09-20T08:05:34Z level=info event=scheduler_connected addr=lb:500513931worker2 # [ 42.679675] nix-grpc-daemon[774]: ts=2026-09-20T08:05:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3932lb # [ 42.716166] postgres[1120]: [1120] ERROR: relation "goose_db_version" does not exist at character 363933lb # [ 42.717772] postgres[1120]: [1120] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC3934lb # [ 42.760376] niks3-server[1112]: 2026/09/20 08:05:34 OK 20241026095416_initial_model.sql (27.24ms)3935lb # [ 42.766585] niks3-server[1112]: 2026/09/20 08:05:34 OK 20251210153512_drop_unused_gin_index.sql (3.52ms)3936lb # [ 42.775994] niks3-server[1112]: 2026/09/20 08:05:34 OK 20251218171726_add_pins.sql (9.33ms)3937lb # [ 42.785085] niks3-server[1112]: 2026/09/20 08:05:34 OK 20260628120000_add_object_size_and_stats.sql (9.01ms)3938lb # [ 42.793013] niks3-server[1112]: 2026/09/20 08:05:34 OK 20260905000000_add_claims.sql (7.87ms)3939lb # [ 42.799503] niks3-server[1112]: 2026/09/20 08:05:34 OK 20260920000000_drop_claims.sql (6.27ms)3940lb # [ 42.802320] niks3-server[1112]: 2026/09/20 08:05:34 goose: successfully migrated database to version: 202609200000003941worker1 # [ 42.875949] nix-grpc-daemon[832]: ts=2026-09-20T08:05:33Z level=info event=scheduler_connected addr=lb:500513942lb # [ 42.810465] niks3-server[1112]: 2026/09/20 08:05:34 OK 1_commit_pending_closure.sql (10.9ms)3943worker1 # [ 42.881427] nix-grpc-daemon[832]: ts=2026-09-20T08:05:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3944lb # [ 42.814746] niks3-server[1112]: 2026/09/20 08:05:34 OK 2_object_stats_trigger.sql (4.1ms)3945lb # [ 42.816829] niks3-server[1112]: 2026/09/20 08:05:34 goose: up to current file version: 23946lb # [ 42.821048] niks3-server[1112]: 2026/09/20 08:05:34 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key3947worker2 # [ 42.822334] nix-grpc-daemon[774]: ts=2026-09-20T08:05:34Z level=info event=scheduler_lock_lost error="error: http://lb:5751/api/farm/lead: Timeout was reached"3948worker2 # [ 42.880401] nix-grpc-daemon[774]: ts=2026-09-20T08:05:34Z level=info event=scheduler_connected addr=lb:500513949worker2 # [ 42.886203] nix-grpc-daemon[774]: ts=2026-09-20T08:05:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3950worker1 # [ 42.966360] nix-grpc-daemon[832]: ts=2026-09-20T08:05:33Z level=info event=scheduler_lock_lost error="error: http://lb:5751/api/farm/lead: Timeout was reached"3951lb # [ 42.900869] niks3-server[1112]: 2026/09/20 08:05:34 INFO Read proxy enabled — serving cache objects from S33952lb # [ 42.902910] niks3-server[1112]: 2026/09/20 08:05:34 INFO Using socket-activated listener address=0.0.0.0:57513953lb # [ 42.908185] systemd[1]: Started niks3 server.3954lb # [ 42.912862] niks3-server[1112]: 2026/09/20 08:05:34 INFO systemd watchdog enabled interval=15s3955lb # [ 42.914854] systemd[1]: Reached target Multi-User System.3956lb # [ 42.915850] systemd[1]: Startup finished in 1.185s (kernel) + 4.957s (initrd) + 36.767s (userspace) = 42.910s.3957lb # [ 42.924006] niks3-server[1112]: 2026/09/20 08:05:34 INFO Starting HTTP server address=0.0.0.0:57513958lb # [ 42.932340] niks3-server[1112]: 2026/09/20 08:05:34 INFO lead: acquired remote=192.168.1.3:592883959lb # [ 42.940139] niks3-server[1112]: 2026/09/20 08:05:34 INFO lead: released remote=192.168.1.3:592883960lb # [ 42.950181] niks3-server[1112]: 2026/09/20 08:05:34 INFO lead: acquired remote=192.168.1.4:562743961lb # [ 42.951930] niks3-server[1112]: 2026/09/20 08:05:34 INFO lead: released remote=192.168.1.4:562743962worker1 # [ 43.082902] nix-grpc-daemon[832]: ts=2026-09-20T08:05:33Z level=info event=scheduler_connected addr=lb:500513963worker1 # [ 43.090431] nix-grpc-daemon[832]: ts=2026-09-20T08:05:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3964worker2 # [ 43.087708] nix-grpc-daemon[774]: ts=2026-09-20T08:05:34Z level=info event=scheduler_connected addr=lb:500513965worker2 # [ 43.095376] nix-grpc-daemon[774]: ts=2026-09-20T08:05:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3966worker1 # [ 43.292055] nix-grpc-daemon[832]: ts=2026-09-20T08:05:33Z level=info event=scheduler_connected addr=lb:500513967worker1 # [ 43.300233] nix-grpc-daemon[832]: ts=2026-09-20T08:05:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3968lb: (finished: waiting for unit niks3.service, in 25.46 seconds)3969lb: waiting for TCP port 5751 on localhost3970worker2 # [ 43.296755] nix-grpc-daemon[774]: ts=2026-09-20T08:05:34Z level=info event=scheduler_connected addr=lb:500513971worker2 # [ 43.305486] nix-grpc-daemon[774]: ts=2026-09-20T08:05:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3972lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!3973lb: (finished: waiting for TCP port 5751 on localhost, in 0.11 seconds)3974lb: waiting for unit envoy.service3975worker1 # [ 43.501985] nix-grpc-daemon[832]: ts=2026-09-20T08:05:33Z level=info event=scheduler_connected addr=lb:500513976worker1 # [ 43.506531] nix-grpc-daemon[832]: ts=2026-09-20T08:05:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3977lb: (finished: waiting for unit envoy.service, in 0.09 seconds)3978lb: waiting for TCP port 50051 on localhost3979worker2 # [ 43.506943] nix-grpc-daemon[774]: ts=2026-09-20T08:05:34Z level=info event=scheduler_connected addr=lb:500513980worker2 # [ 43.514953] nix-grpc-daemon[774]: ts=2026-09-20T08:05:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3981lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!3982lb: (finished: waiting for TCP port 50051 on localhost, in 0.05 seconds)3983worker1 # [ 43.711032] nix-grpc-daemon[832]: ts=2026-09-20T08:05:34Z level=info event=scheduler_connected addr=lb:500513984worker1 # [ 43.716514] nix-grpc-daemon[832]: ts=2026-09-20T08:05:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3985lb: waiting until exactly no endpoints of aarch64-linux are unhealthy3986lb: must succeed: curl -sf localhost:9901/clusters3987worker2 # [ 43.716923] nix-grpc-daemon[774]: ts=2026-09-20T08:05:35Z level=info event=scheduler_connected addr=lb:500513988worker2 # [ 43.720831] nix-grpc-daemon[774]: ts=2026-09-20T08:05:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3989lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.12 seconds)3990lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.12 seconds)3991subtest: one node schedules and both builders hold a WorkerSession on it3992lb: must succeed: curl -sf localhost:9901/clusters3993lb # [ 43.845781] niks3-server[1112]: 2026/09/20 08:05:35 INFO lead: acquired remote=192.168.1.4:461563994worker2 # [ 43.842515] nix-grpc-daemon[774]: ts=2026-09-20T08:05:35Z level=info event=scheduler_take_over3995worker1 # [ 43.917068] nix-grpc-daemon[832]: ts=2026-09-20T08:05:34Z level=info event=scheduler_connected addr=lb:500513996worker1 # [ 43.925163] nix-grpc-daemon[832]: ts=2026-09-20T08:05:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"3997lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)3998worker2 # [ 43.922271] nix-grpc-daemon[774]: ts=2026-09-20T08:05:35Z level=info event=scheduler_connected addr=lb:500513999worker2 # [ 43.931784] nix-grpc-daemon[774]: ts=2026-09-20T08:05:35Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04000worker1 # [ 44.126260] nix-grpc-daemon[832]: ts=2026-09-20T08:05:34Z level=info event=scheduler_connected addr=lb:500514001worker1 # [ 44.130368] nix-grpc-daemon[832]: ts=2026-09-20T08:05:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4002worker1 # [ 44.331222] nix-grpc-daemon[832]: ts=2026-09-20T08:05:34Z level=info event=scheduler_connected addr=lb:500514003worker2 # [ 44.260415] nix-grpc-daemon[774]: ts=2026-09-20T08:05:35Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04004lb: must succeed: curl -sf localhost:9901/clusters4005lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)4006worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4007worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.11 seconds)4008(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 1.30 seconds)4009subtest: balancer auth: client cert, bearer token, nothing, unknown CN4010lb # [ 45.238678] envoy[895]: conn peer=[::1]:37836 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=44011worker2 # [ 45.501087] nix-grpc-daemon[774]: ts=2026-09-20T08:05:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:475384012worker2 # [ 45.508687] systemd[1]: Started Nix Daemon.4013worker2 # [ 45.854345] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4014worker2 # [ 45.892348] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 51 ms (attempt 1/5)4015worker2 # [ 45.946831] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 156 ms (attempt 2/5)4016worker2 # [ 46.110603] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 249 ms (attempt 3/5)4017worker2 # [ 46.365372] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 191 ms (attempt 4/5)4018worker2 # [ 46.564876] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4019worker2 # [ 46.593732] nix-grpc-daemon[774]: ts=2026-09-20T08:05:38Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:475384020worker2 # [ 46.603659] nix-grpc-daemon[774]: ts=2026-09-20T08:05:38Z level=debug event=path_info_miss path=rn68xfasy69r8v22igpfx8xcz2w998v3-nixos-system-client-test error="error: path '/nix/store/rn68xfasy69r8v22igpfx8xcz2w998v3-nixos-system-client-test' is required, but there is no substituter that can build it"4021worker1 # [ 46.713525] nix-grpc-daemon[832]: ts=2026-09-20T08:05:37Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:528444022worker1 # [ 46.730644] systemd[1]: Started Nix Daemon.4023worker1 # [ 47.030319] nix-daemon[895]: accepted connection from pid 832, user nix-grpc-daemon (trusted)4024worker1 # [ 47.063523] nix-grpc-daemon[832]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 73 ms (attempt 1/5)4025worker1 # [ 47.139807] nix-grpc-daemon[832]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 152 ms (attempt 2/5)4026worker1 # [ 47.292306] nix-grpc-daemon[832]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 269 ms (attempt 3/5)4027worker1 # [ 47.564851] nix-grpc-daemon[832]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 686 ms (attempt 4/5)4028worker1 # [ 48.255396] nix-grpc-daemon[832]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4029worker1 # [ 48.274062] nix-grpc-daemon[832]: ts=2026-09-20T08:05:38Z level=debug event=path_info_miss path=rn68xfasy69r8v22igpfx8xcz2w998v3-nixos-system-client-test error="error: path '/nix/store/rn68xfasy69r8v22igpfx8xcz2w998v3-nixos-system-client-test' is required, but there is no substituter that can build it"4030client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4031client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.13 seconds)4032client: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4033client: (finished: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds)4034worker2 # [ 48.670817] nix-grpc-daemon[774]: ts=2026-09-20T08:05:40Z level=info event=oidc_jwks provider=mock keys=14035worker2 # [ 48.671031] nix-grpc-daemon[774]: ts=2026-09-20T08:05:40Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:475384036worker1 # [ 48.765678] nix-grpc-daemon[832]: ts=2026-09-20T08:05:39Z level=info event=oidc_jwks provider=mock keys=14037worker1 # [ 48.769235] nix-grpc-daemon[832]: ts=2026-09-20T08:05:39Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:528444038worker1 # [ 48.774103] nix-grpc-daemon[832]: ts=2026-09-20T08:05:39Z level=debug event=path_info_miss path=rn68xfasy69r8v22igpfx8xcz2w998v3-nixos-system-client-test error="error: path '/nix/store/rn68xfasy69r8v22igpfx8xcz2w998v3-nixos-system-client-test' is required, but there is no substituter that can build it"4039worker1 # [ 48.782062] nix-grpc-daemon[832]: ts=2026-09-20T08:05:39Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:528444040worker1 # [ 48.786727] nix-grpc-daemon[832]: ts=2026-09-20T08:05:39Z level=debug event=path_info_miss path=rn68xfasy69r8v22igpfx8xcz2w998v3-nixos-system-client-test error="error: path '/nix/store/rn68xfasy69r8v22igpfx8xcz2w998v3-nixos-system-client-test' is required, but there is no substituter that can build it"4041client: must succeed: rm -r /var/lib/nix-grpc-store4042client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds)4043worker2 # [ 49.019110] nix-grpc-daemon[774]: ts=2026-09-20T08:05:40Z level=info event=denied method=QueryMissing cn=- role=none4044worker1 # [ 49.394220] nix-grpc-daemon[832]: ts=2026-09-20T08:05:39Z level=info event=denied method=QueryMissing cn=stranger role=none4045(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 4.22 seconds)4046subtest: DAG build is scheduled across workers and lands in the cache4047client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&24048worker2 # [ 49.600500] nix-grpc-daemon[774]: ts=2026-09-20T08:05:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:475384049client # don't know how to build these paths:4050client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4051worker2 # [ 49.641309] nix-grpc-daemon[774]: ts=2026-09-20T08:05:41Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=04052worker2 # [ 49.647379] nix-grpc-daemon[774]: ts=2026-09-20T08:05:41Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.4:50051 clients=14053worker2 # [ 49.697597] nix-grpc-daemon[774]: ts=2026-09-20T08:05:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475384054worker2 # [ 49.719061] nix-grpc-daemon[774]: ts=2026-09-20T08:05:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475384055client # copying 1 paths to 'lb:50051'...4056worker2 # [ 49.740120] nix-grpc-daemon[774]: ts=2026-09-20T08:05:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:475384057client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...4058worker2 # [ 49.757608] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4059worker2 # [ 49.783391] nix-grpc-daemon[774]: ts=2026-09-20T08:05:41Z level=info event=niks3_push_started pid=8544060worker2 # [ 50.303902] nix-daemon[842]: accepted connection from pid 867, user nix-grpc-daemon (trusted)4061worker2 # [ 50.329150] nix-daemon[842]: reaped child process 870, status = succeeded4062worker2 # [ 50.548157] nix-daemon[842]: accepted connection from pid 872, user nix-grpc-daemon (trusted)4063worker2 # [ 50.572659] nix-daemon[842]: reaped child process 875, status = succeeded4064lb # [ 50.589864] niks3-server[1112]: 2026/09/20 08:05:41 INFO Received uploads request method=POST path=/api/pending_closures4065worker2 # [ 50.621720] nix-grpc-daemon[854]: time=2026-09-20T08:05:42.032Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4066worker2 # [ 50.626525] nix-grpc-daemon[854]: time=2026-09-20T08:05:42.035Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"4067lb # [ 50.677109] niks3-server[1112]: 2026/09/20 08:05:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4068lb # [ 50.701798] niks3-server[1112]: 2026/09/20 08:05:42 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst4069lb # [ 50.732956] niks3-server[1112]: 2026/09/20 08:05:42 INFO Signed narinfos id=1 count=14070worker2 # [ 50.734497] nix-grpc-daemon[854]: time=2026-09-20T08:05:42.144Z level=INFO msg="Uploading 1 narinfos"4071lb # [ 50.744743] niks3-server[1112]: 2026/09/20 08:05:42 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls4072lb # [ 50.753175] niks3-server[1112]: 2026/09/20 08:05:42 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4073lb # [ 50.764147] niks3-server[1112]: 2026/09/20 08:05:42 INFO Completed upload id=14074worker2 # [ 50.762848] nix-grpc-daemon[854]: time=2026-09-20T08:05:42.173Z level=INFO msg="Upload complete. (672ms)"4075worker2 # [ 50.771571] nix-grpc-daemon[774]: ts=2026-09-20T08:05:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47538 duration_s=1 paths=1 nar_bytes_in=5044076lb # [ 50.774640] niks3-server[1112]: 2026/09/20 08:05:42 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo4077worker2 # [ 50.784531] nix-grpc-daemon[774]: ts=2026-09-20T08:05:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475384078worker2 # [ 50.790983] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4079worker2 # [ 50.795105] nix-daemon[842]: reaped child process 852, status = succeeded4080worker2 # [ 50.805276] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4081client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...4082client # farm-a> worker2: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv4083client # farm-a> LOG-farm-a-t14084worker2 # [ 51.836498] nix-daemon[842]: reaped child process 879, status = succeeded4085worker2 # [ 52.029509] nix-daemon[842]: accepted connection from pid 894, user nix-grpc-daemon (trusted)4086worker2 # [ 52.053704] nix-daemon[842]: reaped child process 897, status = succeeded4087lb # [ 52.077339] niks3-server[1112]: 2026/09/20 08:05:43 INFO Received uploads request method=POST path=/api/pending_closures4088worker2 # [ 52.098407] nix-grpc-daemon[854]: time=2026-09-20T08:05:43.507Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4089worker2 # [ 52.101934] nix-grpc-daemon[854]: time=2026-09-20T08:05:43.508Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"4090lb # [ 52.146626] niks3-server[1112]: 2026/09/20 08:05:43 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv4091lb # [ 52.162770] niks3-server[1112]: 2026/09/20 08:05:43 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4092lb # [ 52.180940] niks3-server[1112]: 2026/09/20 08:05:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4093worker2 # [ 52.186583] nix-grpc-daemon[854]: time=2026-09-20T08:05:43.596Z level=INFO msg="Uploading 1 narinfos"4094lb # [ 52.189565] niks3-server[1112]: 2026/09/20 08:05:43 INFO Signed narinfos id=2 count=14095lb # [ 52.197110] niks3-server[1112]: 2026/09/20 08:05:43 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls4096lb # [ 52.208154] niks3-server[1112]: 2026/09/20 08:05:43 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4097worker2 # [ 52.217511] nix-grpc-daemon[854]: time=2026-09-20T08:05:43.628Z level=INFO msg="Upload complete. (397ms)"4098lb # [ 52.218743] niks3-server[1112]: 2026/09/20 08:05:43 INFO Completed upload id=24099lb # [ 52.229605] niks3-server[1112]: 2026/09/20 08:05:43 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo4100worker2 # [ 52.229526] nix-grpc-daemon[774]: ts=2026-09-20T08:05:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47538 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=14101worker2 # [ 52.241085] nix-grpc-daemon[774]: ts=2026-09-20T08:05:43Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=04102worker2 # [ 52.242953] nix-grpc-daemon[774]: ts=2026-09-20T08:05:43Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.4:50051 clients=14103worker2 # [ 52.248205] nix-daemon[842]: reaped child process 877, status = succeeded4104worker2 # [ 52.291614] nix-grpc-daemon[774]: ts=2026-09-20T08:05:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475384105worker2 # [ 52.304607] nix-grpc-daemon[774]: ts=2026-09-20T08:05:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475384106worker2 # [ 52.319754] nix-grpc-daemon[854]: time=2026-09-20T08:05:43.730Z level=INFO msg="All 1 paths already cached"4107client # copying 1 paths to 'lb:50051'...4108worker2 # [ 52.333509] nix-grpc-daemon[774]: ts=2026-09-20T08:05:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:475384109client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...4110worker2 # [ 52.352986] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4111worker2 # [ 52.539666] nix-daemon[842]: accepted connection from pid 903, user nix-grpc-daemon (trusted)4112worker2 # [ 52.571154] nix-daemon[842]: reaped child process 906, status = succeeded4113worker2 # [ 52.748939] nix-daemon[842]: accepted connection from pid 908, user nix-grpc-daemon (trusted)4114worker2 # [ 52.774147] nix-daemon[842]: reaped child process 911, status = succeeded4115lb # [ 52.787802] niks3-server[1112]: 2026/09/20 08:05:44 INFO Received uploads request method=POST path=/api/pending_closures4116worker2 # [ 52.815487] nix-grpc-daemon[854]: time=2026-09-20T08:05:44.225Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4117worker2 # [ 52.818560] nix-grpc-daemon[854]: time=2026-09-20T08:05:44.226Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"4118lb # [ 52.839640] niks3-server[1112]: 2026/09/20 08:05:44 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst4119lb # [ 52.850308] niks3-server[1112]: 2026/09/20 08:05:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4120worker2 # [ 52.853757] nix-grpc-daemon[854]: time=2026-09-20T08:05:44.264Z level=INFO msg="Uploading 1 narinfos"4121lb # [ 52.859017] niks3-server[1112]: 2026/09/20 08:05:44 INFO Signed narinfos id=3 count=14122lb # [ 52.864217] niks3-server[1112]: 2026/09/20 08:05:44 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls4123lb # [ 52.872503] niks3-server[1112]: 2026/09/20 08:05:44 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4124lb # [ 52.882509] niks3-server[1112]: 2026/09/20 08:05:44 INFO Completed upload id=34125worker2 # [ 52.883914] nix-grpc-daemon[854]: time=2026-09-20T08:05:44.294Z level=INFO msg="Upload complete. (520ms)"4126lb # [ 52.889113] niks3-server[1112]: 2026/09/20 08:05:44 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo4127worker2 # [ 52.891959] nix-grpc-daemon[774]: ts=2026-09-20T08:05:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47538 duration_s=0 paths=1 nar_bytes_in=6244128worker2 # [ 52.900740] nix-grpc-daemon[774]: ts=2026-09-20T08:05:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475384129worker2 # [ 52.913108] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4130worker2 # [ 52.915653] nix-daemon[842]: reaped child process 901, status = succeeded4131client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...4132worker2 # [ 52.927867] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4133client # farm-b> worker2: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv4134client # farm-b> LOG-farm-b-t14135worker2 # [ 54.353881] nix-daemon[842]: reaped child process 915, status = succeeded4136worker2 # [ 54.568103] nix-daemon[842]: accepted connection from pid 930, user nix-grpc-daemon (trusted)4137worker2 # [ 54.596841] nix-daemon[842]: reaped child process 933, status = succeeded4138lb # [ 54.623300] niks3-server[1112]: 2026/09/20 08:05:46 INFO Received uploads request method=POST path=/api/pending_closures4139worker2 # [ 54.637518] nix-grpc-daemon[854]: time=2026-09-20T08:05:46.047Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4140worker2 # [ 54.639198] nix-grpc-daemon[854]: time=2026-09-20T08:05:46.047Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"4141lb # [ 54.668988] niks3-server[1112]: 2026/09/20 08:05:46 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst4142lb # [ 54.675058] niks3-server[1112]: 2026/09/20 08:05:46 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv4143worker2 # [ 54.682740] nix-grpc-daemon[854]: time=2026-09-20T08:05:46.093Z level=INFO msg="Uploading 1 narinfos"4144lb # [ 54.683964] niks3-server[1112]: 2026/09/20 08:05:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4145lb # [ 54.686527] niks3-server[1112]: 2026/09/20 08:05:46 INFO Signed narinfos id=4 count=14146lb # [ 54.693369] niks3-server[1112]: 2026/09/20 08:05:46 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls4147lb # [ 54.704344] niks3-server[1112]: 2026/09/20 08:05:46 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4148lb # [ 54.709425] niks3-server[1112]: 2026/09/20 08:05:46 INFO Completed upload id=44149worker2 # [ 54.708396] nix-grpc-daemon[854]: time=2026-09-20T08:05:46.119Z level=INFO msg="Upload complete. (369ms)"4150lb # [ 54.712909] niks3-server[1112]: 2026/09/20 08:05:46 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo4151worker2 # [ 54.715769] nix-grpc-daemon[774]: ts=2026-09-20T08:05:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47538 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=14152worker2 # [ 54.728839] nix-daemon[842]: reaped child process 913, status = succeeded4153worker2 # [ 54.736321] nix-grpc-daemon[774]: ts=2026-09-20T08:05:46Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=04154worker2 # [ 54.738951] nix-grpc-daemon[774]: ts=2026-09-20T08:05:46Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.4:50051 clients=14155worker2 # [ 54.787604] nix-grpc-daemon[774]: ts=2026-09-20T08:05:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475384156worker2 # [ 54.806656] nix-grpc-daemon[774]: ts=2026-09-20T08:05:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475384157worker2 # [ 54.817730] nix-grpc-daemon[854]: time=2026-09-20T08:05:46.228Z level=INFO msg="All 2 paths already cached"4158client # copying 1 paths to 'lb:50051'...4159client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...4160worker2 # [ 54.826201] nix-grpc-daemon[774]: ts=2026-09-20T08:05:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:475384161worker2 # [ 54.840500] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4162worker2 # [ 55.021448] nix-daemon[842]: accepted connection from pid 939, user nix-grpc-daemon (trusted)4163worker2 # [ 55.058891] nix-daemon[842]: reaped child process 942, status = succeeded4164worker2 # [ 55.237010] nix-daemon[842]: accepted connection from pid 944, user nix-grpc-daemon (trusted)4165lb # [ 55.236882] envoy[895]: conn peer=[2001:db8:1::1]:45564 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=749 tx=423 ms=27564166lb # [ 55.243746] envoy[895]: conn peer=[2001:db8:1::1]:45566 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=363 ms=664167lb # [ 55.251160] envoy[895]: conn peer=[2001:db8:1::1]:45568 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=114168worker2 # [ 55.261657] nix-daemon[842]: reaped child process 947, status = succeeded4169lb # [ 55.258078] envoy[895]: conn peer=[2001:db8:1::1]:45578 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=114170lb # [ 55.276207] niks3-server[1112]: 2026/09/20 08:05:46 INFO Received uploads request method=POST path=/api/pending_closures4171worker2 # [ 55.288534] nix-grpc-daemon[854]: time=2026-09-20T08:05:46.699Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4172worker2 # [ 55.290126] nix-grpc-daemon[854]: time=2026-09-20T08:05:46.699Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"4173lb # [ 55.312888] niks3-server[1112]: 2026/09/20 08:05:46 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst4174worker2 # [ 55.330714] nix-grpc-daemon[854]: time=2026-09-20T08:05:46.741Z level=INFO msg="Uploading 1 narinfos"4175lb # [ 55.332142] niks3-server[1112]: 2026/09/20 08:05:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4176lb # [ 55.343231] niks3-server[1112]: 2026/09/20 08:05:46 INFO Signed narinfos id=5 count=14177lb # [ 55.350352] niks3-server[1112]: 2026/09/20 08:05:46 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls4178lb # [ 55.364698] niks3-server[1112]: 2026/09/20 08:05:46 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4179lb # [ 55.371580] niks3-server[1112]: 2026/09/20 08:05:46 INFO Completed upload id=54180worker2 # [ 55.370227] nix-grpc-daemon[854]: time=2026-09-20T08:05:46.781Z level=INFO msg="Upload complete. (519ms)"4181lb # [ 55.375092] niks3-server[1112]: 2026/09/20 08:05:46 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo4182worker2 # [ 55.376625] nix-grpc-daemon[774]: ts=2026-09-20T08:05:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47538 duration_s=0 paths=1 nar_bytes_in=7524183worker2 # [ 55.387682] nix-grpc-daemon[774]: ts=2026-09-20T08:05:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475384184worker2 # [ 55.395578] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4185worker2 # [ 55.400339] nix-daemon[842]: reaped child process 937, status = succeeded4186client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...4187worker2 # [ 55.413372] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4188client # farm-top> worker2: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4189client # farm-top> LOG-farm-top-t14190worker2 # [ 56.245169] nix-daemon[842]: reaped child process 951, status = succeeded4191worker2 # [ 56.433973] nix-daemon[842]: accepted connection from pid 966, user nix-grpc-daemon (trusted)4192worker2 # [ 56.458638] nix-daemon[842]: reaped child process 969, status = succeeded4193lb # [ 56.475676] niks3-server[1112]: 2026/09/20 08:05:47 INFO Received uploads request method=POST path=/api/pending_closures4194worker2 # [ 56.488867] nix-grpc-daemon[854]: time=2026-09-20T08:05:47.898Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4195worker2 # [ 56.490453] nix-grpc-daemon[854]: time=2026-09-20T08:05:47.898Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"4196lb # [ 56.518069] niks3-server[1112]: 2026/09/20 08:05:47 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4197lb # [ 56.534893] niks3-server[1112]: 2026/09/20 08:05:47 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst4198lb # [ 56.546306] niks3-server[1112]: 2026/09/20 08:05:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4199worker2 # [ 56.550051] nix-grpc-daemon[854]: time=2026-09-20T08:05:47.960Z level=INFO msg="Uploading 1 narinfos"4200lb # [ 56.554585] niks3-server[1112]: 2026/09/20 08:05:47 INFO Signed narinfos id=6 count=14201lb # [ 56.559371] niks3-server[1112]: 2026/09/20 08:05:47 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls4202lb # [ 56.569821] niks3-server[1112]: 2026/09/20 08:05:47 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4203lb # [ 56.577182] niks3-server[1112]: 2026/09/20 08:05:47 INFO Completed upload id=64204worker2 # [ 56.576267] nix-grpc-daemon[854]: time=2026-09-20T08:05:47.987Z level=INFO msg="Upload complete. (350ms)"4205lb # [ 56.587156] niks3-server[1112]: 2026/09/20 08:05:47 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo4206worker2 # [ 56.590076] nix-grpc-daemon[774]: ts=2026-09-20T08:05:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47538 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=14207worker2 # [ 56.606335] nix-daemon[842]: reaped child process 949, status = succeeded4208client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&2, in 7.35 seconds)4209client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath4210client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath, in 0.28 seconds)4211client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4212client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.03 seconds)4213client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4214client # copying 3 paths...4215client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...4216client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...4217client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...4218client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.34 seconds)4219(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 8.11 seconds)4220subtest: repeat is answered Cached by the scheduler without building4221worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4222worker1 # finding garbage collector roots...4223worker1 # deleting specified paths...4224worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4225worker1 # deleting unused links...4226worker1 # note: hard linking is currently saving 0.0 KiB4227worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.29 seconds)4228worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4229worker2 # finding garbage collector roots...4230worker2 # deleting specified paths...4231worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4232worker2 # deleting unused links...4233worker2 # note: hard linking is currently saving 0.0 KiB4234worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.31 seconds)4235client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&24236worker1 # [ 58.416270] nix-grpc-daemon[832]: ts=2026-09-20T08:05:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:528444237client # don't know how to build these paths:4238client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4239worker2 # [ 58.367898] nix-grpc-daemon[774]: ts=2026-09-20T08:05:49Z level=debug event=want client=2 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=14240worker2 # [ 58.385285] nix-grpc-daemon[774]: ts=2026-09-20T08:05:49Z level=debug event=want client=2 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=14241worker2 # [ 58.398398] nix-grpc-daemon[774]: ts=2026-09-20T08:05:49Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=14242client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 >&2, in 0.37 seconds)4243client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath4244client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag t1 outPath, in 0.23 seconds)4245lb: must succeed: curl -sf localhost:9901/clusters4246lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)4247lb: must succeed: curl -sf localhost:9901/clusters4248lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4249worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true4250worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.09 seconds)4251(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.59 seconds)4252subtest: two clients wanting the same drv build it once4253client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4254client # [ 59.125422] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4255client # Running as unit: dedup1.service; invocation ID: 10d6c94853d44e71b6b7f95cdbbc47b24256client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.11 seconds)4257client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4258worker2 # [ 59.425895] nix-grpc-daemon[774]: ts=2026-09-20T08:05:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:475384259client # [ 59.426866] nix[868]: don't know how to build these paths:4260client # [ 59.428203] nix[868]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4261worker2 # [ 59.442298] nix-grpc-daemon[774]: ts=2026-09-20T08:05:50Z level=debug event=want client=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04262worker2 # [ 59.445020] nix-grpc-daemon[774]: ts=2026-09-20T08:05:50Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.3:50051 clients=14263worker1 # [ 59.524605] nix-grpc-daemon[832]: ts=2026-09-20T08:05:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:528444264worker1 # [ 59.546304] nix-grpc-daemon[832]: ts=2026-09-20T08:05:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:528444265client # [ 59.479874] nix[868]: copying 1 paths to 'lb:50051'...4266client # [ 59.481420] nix[868]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4267worker1 # [ 59.559613] nix-grpc-daemon[832]: ts=2026-09-20T08:05:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:528444268worker1 # [ 59.577332] nix-daemon[895]: accepted connection from pid 832, user nix-grpc-daemon (trusted)4269worker1 # [ 59.604933] nix-grpc-daemon[832]: ts=2026-09-20T08:05:50Z level=info event=niks3_push_started pid=9184270worker1 # [ 60.105398] nix-daemon[895]: accepted connection from pid 931, user nix-grpc-daemon (trusted)4271worker1 # [ 60.133025] nix-daemon[895]: reaped child process 934, status = succeeded4272worker1 # [ 60.336618] nix-daemon[895]: accepted connection from pid 936, user nix-grpc-daemon (trusted)4273client # [ 60.255907] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4274client # Running as unit: dedup2.service; invocation ID: 629aa074ecf4430da5cb3c03673e12db4275worker1 # [ 60.361251] nix-daemon[895]: reaped child process 939, status = succeeded4276client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.14 seconds)4277lb # [ 60.307969] niks3-server[1112]: 2026/09/20 08:05:51 INFO Received uploads request method=POST path=/api/pending_closures4278worker1 # [ 60.402445] nix-grpc-daemon[918]: time=2026-09-20T08:05:50.804Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4279worker1 # [ 60.404720] nix-grpc-daemon[918]: time=2026-09-20T08:05:50.804Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4280lb # [ 60.358461] niks3-server[1112]: 2026/09/20 08:05:51 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4281lb # [ 60.375189] niks3-server[1112]: 2026/09/20 08:05:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4282worker1 # [ 60.456280] nix-grpc-daemon[918]: time=2026-09-20T08:05:50.860Z level=INFO msg="Uploading 1 narinfos"4283lb # [ 60.389068] niks3-server[1112]: 2026/09/20 08:05:51 INFO Signed narinfos id=7 count=14284lb # [ 60.397405] niks3-server[1112]: 2026/09/20 08:05:51 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4285lb # [ 60.412193] niks3-server[1112]: 2026/09/20 08:05:51 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4286worker1 # [ 60.492169] nix-grpc-daemon[918]: time=2026-09-20T08:05:50.897Z level=INFO msg="Upload complete. (610ms)"4287lb # [ 60.419373] niks3-server[1112]: 2026/09/20 08:05:51 INFO Completed upload id=74288lb # [ 60.423536] niks3-server[1112]: 2026/09/20 08:05:51 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4289worker1 # [ 60.498306] nix-grpc-daemon[832]: ts=2026-09-20T08:05:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52844 duration_s=0 paths=1 nar_bytes_in=4324290worker1 # [ 60.504355] nix-grpc-daemon[832]: ts=2026-09-20T08:05:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:528444291worker1 # [ 60.515242] nix-daemon[895]: accepted connection from pid 832, user nix-grpc-daemon (trusted)4292worker1 # [ 60.519505] nix-daemon[895]: reaped child process 916, status = succeeded4293client # [ 60.451939] nix[868]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4294worker1 # [ 60.533448] nix-daemon[895]: accepted connection from pid 832, user nix-grpc-daemon (trusted)4295worker1 # [ 60.715831] nix-grpc-daemon[832]: ts=2026-09-20T08:05:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:528444296client # [ 60.655424] nix[884]: this derivation will be built:4297worker1 # [ 60.738237] nix-grpc-daemon[832]: ts=2026-09-20T08:05:51Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:528444298client # [ 60.664416] nix[884]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4299worker2 # [ 60.683974] nix-grpc-daemon[774]: ts=2026-09-20T08:05:52Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04300worker1 # [ 60.766666] nix-grpc-daemon[832]: ts=2026-09-20T08:05:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:528444301client # [ 60.690325] nix[884]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4302client: must succeed: sleep 24303client: (finished: must succeed: sleep 2, in 2.06 seconds)4304client: waiting for success: ! systemctl is-active dedup1 dedup24305worker1 # [ 63.983509] nix-daemon[895]: reaped child process 947, status = succeeded4306worker1 # [ 64.175033] nix-daemon[895]: accepted connection from pid 972, user nix-grpc-daemon (trusted)4307worker1 # [ 64.201239] nix-daemon[895]: reaped child process 975, status = succeeded4308lb # [ 64.141361] niks3-server[1112]: 2026/09/20 08:05:55 INFO Received uploads request method=POST path=/api/pending_closures4309worker1 # [ 64.228273] nix-grpc-daemon[918]: time=2026-09-20T08:05:54.631Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4310worker1 # [ 64.230610] nix-grpc-daemon[918]: time=2026-09-20T08:05:54.631Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4311lb # [ 64.182098] niks3-server[1112]: 2026/09/20 08:05:55 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4312lb # [ 64.191328] niks3-server[1112]: 2026/09/20 08:05:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4313lb # [ 64.193954] niks3-server[1112]: 2026/09/20 08:05:55 INFO Signed narinfos id=8 count=14314worker1 # [ 64.266325] nix-grpc-daemon[918]: time=2026-09-20T08:05:54.669Z level=INFO msg="Uploading 1 narinfos"4315lb # [ 64.195883] niks3-server[1112]: 2026/09/20 08:05:55 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4316lb # [ 64.205560] niks3-server[1112]: 2026/09/20 08:05:55 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4317lb # [ 64.212403] niks3-server[1112]: 2026/09/20 08:05:55 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4318lb # [ 64.220257] niks3-server[1112]: 2026/09/20 08:05:55 INFO Completed upload id=84319worker1 # [ 64.293523] nix-grpc-daemon[918]: time=2026-09-20T08:05:54.698Z level=INFO msg="Upload complete. (340ms)"4320lb # [ 64.225238] niks3-server[1112]: 2026/09/20 08:05:55 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4321worker1 # [ 64.300687] nix-grpc-daemon[832]: ts=2026-09-20T08:05:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52844 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=4 outputs=14322worker1 # [ 64.303686] nix-grpc-daemon[832]: ts=2026-09-20T08:05:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52844 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=4 outputs=14323worker1 # [ 64.313329] nix-daemon[895]: reaped child process 945, status = succeeded4324client # [ 64.276253] systemd[1]: dedup1.service: Deactivated successfully.4325client # [ 64.286813] systemd[1]: dedup1.service: Consumed 175ms CPU time over 5.155s wall clock time, 37.2M memory peak, 8.5K incoming IP traffic, 9.1K outgoing IP traffic.4326client # [ 64.327184] systemd[1]: dedup2.service: Deactivated successfully.4327client # [ 64.330427] systemd[1]: dedup2.service: Consumed 213ms CPU time over 4.074s wall clock time, 31M memory peak, 7.8K incoming IP traffic, 6.8K outgoing IP traffic.4328client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.12 seconds)4329client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4330client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.08 seconds)4331worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4332worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds)4333worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4334worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds)4335worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4336worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.07 seconds)4337worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4338lb # [ 65.237282] envoy[895]: conn peer=[2001:db8:1::1]:45590 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9453 tx=3837 ms=70694339lb # [ 65.237430] envoy[895]: conn peer=[2001:db8:1::1]:59728 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1162 tx=481 ms=784340lb # [ 65.237466] envoy[895]: conn peer=[2001:db8:1::1]:59738 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2992 tx=1371 ms=48304341lb # [ 65.237542] envoy[895]: conn peer=[2001:db8:1::1]:59754 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1579 tx=1374 ms=36564342worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.05 seconds)4343(finished: subtest: two clients wanting the same drv build it once, in 6.23 seconds)4344subtest: build hook: nix-daemon with builders = grpc://lb4345client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag hook 2>/tmp/hook.log4346client # [ 65.487877] systemd[1]: Started Nix Daemon.4347client # [ 65.707296] nix-daemon[926]: accepted connection from pid 923, user root (trusted)4348worker2 # [ 65.949020] nix-grpc-daemon[774]: ts=2026-09-20T08:05:57Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:475384349worker2 # [ 65.956184] nix-grpc-daemon[774]: ts=2026-09-20T08:05:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475384350worker2 # [ 65.989498] nix-grpc-daemon[774]: ts=2026-09-20T08:05:57Z level=debug event=want client=5 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04351worker2 # [ 65.997447] nix-grpc-daemon[774]: ts=2026-09-20T08:05:57Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.4:50051 clients=14352worker2 # [ 66.007934] nix-grpc-daemon[774]: ts=2026-09-20T08:05:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475384353worker2 # [ 66.022062] nix-grpc-daemon[774]: ts=2026-09-20T08:05:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475384354worker2 # [ 66.035037] nix-grpc-daemon[774]: ts=2026-09-20T08:05:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:475384355worker2 # [ 66.043485] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4356worker2 # [ 66.243715] nix-daemon[842]: accepted connection from pid 1026, user nix-grpc-daemon (trusted)4357worker2 # [ 66.267591] nix-daemon[842]: reaped child process 1029, status = succeeded4358worker2 # [ 66.477481] nix-daemon[842]: accepted connection from pid 1031, user nix-grpc-daemon (trusted)4359worker2 # [ 66.500353] nix-daemon[842]: reaped child process 1034, status = succeeded4360lb # [ 66.516679] niks3-server[1112]: 2026/09/20 08:05:57 INFO Received uploads request method=POST path=/api/pending_closures4361worker2 # [ 66.522808] nix-grpc-daemon[854]: time=2026-09-20T08:05:57.933Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4362worker2 # [ 66.524827] nix-grpc-daemon[854]: time=2026-09-20T08:05:57.933Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4363lb # [ 66.541131] niks3-server[1112]: 2026/09/20 08:05:57 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4364lb # [ 66.556153] niks3-server[1112]: 2026/09/20 08:05:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4365worker2 # [ 66.559706] nix-grpc-daemon[854]: time=2026-09-20T08:05:57.970Z level=INFO msg="Uploading 1 narinfos"4366lb # [ 66.564867] niks3-server[1112]: 2026/09/20 08:05:57 INFO Signed narinfos id=9 count=14367lb # [ 66.566511] niks3-server[1112]: 2026/09/20 08:05:57 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4368lb # [ 66.577603] niks3-server[1112]: 2026/09/20 08:05:57 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4369lb # [ 66.584337] niks3-server[1112]: 2026/09/20 08:05:57 INFO Completed upload id=94370worker2 # [ 66.581916] nix-grpc-daemon[854]: time=2026-09-20T08:05:57.992Z level=INFO msg="Upload complete. (529ms)"4371lb # [ 66.587095] niks3-server[1112]: 2026/09/20 08:05:57 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4372worker2 # [ 66.592373] nix-grpc-daemon[774]: ts=2026-09-20T08:05:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47538 duration_s=0 paths=1 nar_bytes_in=5124373worker2 # [ 66.600497] nix-grpc-daemon[774]: ts=2026-09-20T08:05:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475384374worker2 # [ 66.617035] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4375worker2 # [ 66.620520] nix-daemon[842]: reaped child process 1024, status = succeeded4376worker2 # [ 66.632728] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4377worker2 # [ 67.468683] nix-daemon[842]: reaped child process 1038, status = succeeded4378worker2 # [ 67.656240] nix-daemon[842]: accepted connection from pid 1053, user nix-grpc-daemon (trusted)4379worker2 # [ 67.682329] nix-daemon[842]: reaped child process 1056, status = succeeded4380lb # [ 67.702752] niks3-server[1112]: 2026/09/20 08:05:59 INFO Received uploads request method=POST path=/api/pending_closures4381worker2 # [ 67.712631] nix-grpc-daemon[854]: time=2026-09-20T08:05:59.120Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4382worker2 # [ 67.714493] nix-grpc-daemon[854]: time=2026-09-20T08:05:59.120Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4383lb # [ 67.751024] niks3-server[1112]: 2026/09/20 08:05:59 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4384worker2 # [ 67.759320] nix-grpc-daemon[854]: time=2026-09-20T08:05:59.170Z level=INFO msg="Uploading 1 narinfos"4385lb # [ 67.761552] niks3-server[1112]: 2026/09/20 08:05:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4386lb # [ 67.771144] niks3-server[1112]: 2026/09/20 08:05:59 INFO Signed narinfos id=10 count=14387lb # [ 67.777389] niks3-server[1112]: 2026/09/20 08:05:59 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4388lb # [ 67.784229] niks3-server[1112]: 2026/09/20 08:05:59 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4389lb # [ 67.793726] niks3-server[1112]: 2026/09/20 08:05:59 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4390worker2 # [ 67.792081] nix-grpc-daemon[854]: time=2026-09-20T08:05:59.203Z level=INFO msg="Upload complete. (345ms)"4391lb # [ 67.796769] niks3-server[1112]: 2026/09/20 08:05:59 INFO Completed upload id=104392lb # [ 67.800151] niks3-server[1112]: 2026/09/20 08:05:59 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4393worker2 # [ 67.805227] nix-grpc-daemon[774]: ts=2026-09-20T08:05:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47538 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=5 outputs=14394worker2 # [ 67.823982] nix-grpc-daemon[774]: ts=2026-09-20T08:05:59Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:475384395worker2 # [ 67.828352] nix-daemon[842]: reaped child process 1036, status = succeeded4396worker2 # [ 67.848148] nix-grpc-daemon[774]: ts=2026-09-20T08:05:59Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:475384397worker2 # [ 67.853494] nix-grpc-daemon[774]: ts=2026-09-20T08:05:59Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47538 duration_s=0 paths=1 nar_bytes_out=1284398worker2 # [ 68.186529] nix-grpc-daemon[774]: ts=2026-09-20T08:05:59Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:475384399worker1 # [ 68.271184] nix-grpc-daemon[832]: ts=2026-09-20T08:05:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:528444400worker2 # [ 68.225784] nix-grpc-daemon[774]: ts=2026-09-20T08:05:59Z level=debug event=want client=6 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04401worker2 # [ 68.231715] nix-grpc-daemon[774]: ts=2026-09-20T08:05:59Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.4:50051 clients=14402worker2 # [ 68.237043] nix-grpc-daemon[774]: ts=2026-09-20T08:05:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475384403worker2 # [ 68.242102] nix-grpc-daemon[774]: ts=2026-09-20T08:05:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475384404worker2 # [ 68.249904] nix-grpc-daemon[854]: time=2026-09-20T08:05:59.660Z level=INFO msg="All 1 paths already cached"4405worker2 # [ 68.257559] nix-grpc-daemon[774]: ts=2026-09-20T08:05:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:475384406worker2 # [ 68.267286] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4407worker2 # [ 68.463091] nix-daemon[842]: accepted connection from pid 1062, user nix-grpc-daemon (trusted)4408worker2 # [ 68.490475] nix-daemon[842]: reaped child process 1065, status = succeeded4409worker2 # [ 68.664483] nix-daemon[842]: accepted connection from pid 1067, user nix-grpc-daemon (trusted)4410worker2 # [ 68.689328] nix-daemon[842]: reaped child process 1070, status = succeeded4411lb # [ 68.701363] niks3-server[1112]: 2026/09/20 08:06:00 INFO Received uploads request method=POST path=/api/pending_closures4412worker2 # [ 68.712727] nix-grpc-daemon[854]: time=2026-09-20T08:06:00.123Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4413worker2 # [ 68.715091] nix-grpc-daemon[854]: time=2026-09-20T08:06:00.125Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4414lb # [ 68.732386] niks3-server[1112]: 2026/09/20 08:06:00 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4415lb # [ 68.744228] niks3-server[1112]: 2026/09/20 08:06:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4416worker2 # [ 68.748710] nix-grpc-daemon[854]: time=2026-09-20T08:06:00.159Z level=INFO msg="Uploading 1 narinfos"4417lb # [ 68.753382] niks3-server[1112]: 2026/09/20 08:06:00 INFO Signed narinfos id=11 count=14418lb # [ 68.754876] niks3-server[1112]: 2026/09/20 08:06:00 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4419lb # [ 68.763704] niks3-server[1112]: 2026/09/20 08:06:00 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4420lb # [ 68.768249] niks3-server[1112]: 2026/09/20 08:06:00 INFO Completed upload id=114421worker2 # [ 68.766065] nix-grpc-daemon[854]: time=2026-09-20T08:06:00.177Z level=INFO msg="Upload complete. (487ms)"4422lb # [ 68.769968] niks3-server[1112]: 2026/09/20 08:06:00 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4423worker2 # [ 68.771350] nix-grpc-daemon[774]: ts=2026-09-20T08:06:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47538 duration_s=0 paths=1 nar_bytes_in=6244424worker2 # [ 68.783072] nix-grpc-daemon[774]: ts=2026-09-20T08:06:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475384425worker2 # [ 68.792448] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4426worker2 # [ 68.796756] nix-daemon[842]: reaped child process 1060, status = succeeded4427worker2 # [ 68.809560] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4428worker2 # [ 70.045680] nix-daemon[842]: reaped child process 1074, status = succeeded4429worker2 # [ 70.232335] nix-daemon[842]: accepted connection from pid 1089, user nix-grpc-daemon (trusted)4430worker2 # [ 70.253624] nix-daemon[842]: reaped child process 1092, status = succeeded4431lb # [ 70.273586] niks3-server[1112]: 2026/09/20 08:06:01 INFO Received uploads request method=POST path=/api/pending_closures4432worker2 # [ 70.284548] nix-grpc-daemon[854]: time=2026-09-20T08:06:01.694Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4433worker2 # [ 70.286212] nix-grpc-daemon[854]: time=2026-09-20T08:06:01.694Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4434lb # [ 70.314138] niks3-server[1112]: 2026/09/20 08:06:01 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4435lb # [ 70.321276] niks3-server[1112]: 2026/09/20 08:06:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4436lb # [ 70.323392] niks3-server[1112]: 2026/09/20 08:06:01 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4437worker2 # [ 70.328036] nix-grpc-daemon[854]: time=2026-09-20T08:06:01.738Z level=INFO msg="Uploading 1 narinfos"4438lb # [ 70.331230] niks3-server[1112]: 2026/09/20 08:06:01 INFO Signed narinfos id=12 count=14439lb # [ 70.335610] niks3-server[1112]: 2026/09/20 08:06:01 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4440lb # [ 70.346298] niks3-server[1112]: 2026/09/20 08:06:01 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4441lb # [ 70.352854] niks3-server[1112]: 2026/09/20 08:06:01 INFO Completed upload id=124442lb # [ 70.355921] niks3-server[1112]: 2026/09/20 08:06:01 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4443worker2 # [ 70.350361] nix-grpc-daemon[854]: time=2026-09-20T08:06:01.761Z level=INFO msg="Upload complete. (331ms)"4444worker2 # [ 70.361688] nix-grpc-daemon[774]: ts=2026-09-20T08:06:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47538 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=6 outputs=14445worker2 # [ 70.368400] nix-grpc-daemon[774]: ts=2026-09-20T08:06:01Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:475384446worker2 # [ 70.375194] nix-daemon[842]: reaped child process 1072, status = succeeded4447worker2 # [ 70.386104] nix-grpc-daemon[774]: ts=2026-09-20T08:06:01Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:475384448worker2 # [ 70.389962] nix-grpc-daemon[774]: ts=2026-09-20T08:06:01Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47538 duration_s=0 paths=1 nar_bytes_out=1764449worker2 # [ 70.711018] nix-grpc-daemon[774]: ts=2026-09-20T08:06:02Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:475384450worker1 # [ 70.794573] nix-grpc-daemon[832]: ts=2026-09-20T08:06:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:528444451worker2 # [ 70.753549] nix-grpc-daemon[774]: ts=2026-09-20T08:06:02Z level=debug event=want client=7 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04452worker2 # [ 70.757538] nix-grpc-daemon[774]: ts=2026-09-20T08:06:02Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.4:50051 clients=14453worker2 # [ 70.761811] nix-grpc-daemon[774]: ts=2026-09-20T08:06:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475384454worker2 # [ 70.770196] nix-grpc-daemon[774]: ts=2026-09-20T08:06:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475384455worker2 # [ 70.784062] nix-grpc-daemon[854]: time=2026-09-20T08:06:02.195Z level=INFO msg="All 2 paths already cached"4456worker2 # [ 70.792728] nix-grpc-daemon[774]: ts=2026-09-20T08:06:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:475384457worker2 # [ 70.805182] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4458worker2 # [ 71.027588] nix-daemon[842]: accepted connection from pid 1098, user nix-grpc-daemon (trusted)4459worker2 # [ 71.053821] nix-daemon[842]: reaped child process 1101, status = succeeded4460worker2 # [ 71.248400] nix-daemon[842]: accepted connection from pid 1103, user nix-grpc-daemon (trusted)4461worker2 # [ 71.272686] nix-daemon[842]: reaped child process 1106, status = succeeded4462lb # [ 71.285365] niks3-server[1112]: 2026/09/20 08:06:02 INFO Received uploads request method=POST path=/api/pending_closures4463worker2 # [ 71.295271] nix-grpc-daemon[854]: time=2026-09-20T08:06:02.705Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4464worker2 # [ 71.297618] nix-grpc-daemon[854]: time=2026-09-20T08:06:02.708Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4465lb # [ 71.321968] niks3-server[1112]: 2026/09/20 08:06:02 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4466lb # [ 71.340774] niks3-server[1112]: 2026/09/20 08:06:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4467worker2 # [ 71.346140] nix-grpc-daemon[854]: time=2026-09-20T08:06:02.756Z level=INFO msg="Uploading 1 narinfos"4468lb # [ 71.356534] niks3-server[1112]: 2026/09/20 08:06:02 INFO Signed narinfos id=13 count=14469lb # [ 71.359776] niks3-server[1112]: 2026/09/20 08:06:02 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4470lb # [ 71.373871] niks3-server[1112]: 2026/09/20 08:06:02 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4471lb # [ 71.386420] niks3-server[1112]: 2026/09/20 08:06:02 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4472lb # [ 71.391234] niks3-server[1112]: 2026/09/20 08:06:02 INFO Completed upload id=134473worker2 # [ 71.389816] nix-grpc-daemon[854]: time=2026-09-20T08:06:02.800Z level=INFO msg="Upload complete. (569ms)"4474worker2 # [ 71.402018] nix-grpc-daemon[774]: ts=2026-09-20T08:06:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47538 duration_s=0 paths=1 nar_bytes_in=7524475worker2 # [ 71.417016] nix-grpc-daemon[774]: ts=2026-09-20T08:06:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475384476worker2 # [ 71.432646] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4477worker2 # [ 71.436647] nix-daemon[842]: reaped child process 1096, status = succeeded4478worker2 # [ 71.455884] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4479worker2 # [ 72.511655] nix-daemon[842]: reaped child process 1110, status = succeeded4480worker2 # [ 72.713731] nix-daemon[842]: accepted connection from pid 1125, user nix-grpc-daemon (trusted)4481worker2 # [ 72.736865] nix-daemon[842]: reaped child process 1128, status = succeeded4482lb # [ 72.750891] niks3-server[1112]: 2026/09/20 08:06:04 INFO Received uploads request method=POST path=/api/pending_closures4483worker2 # [ 72.762552] nix-grpc-daemon[854]: time=2026-09-20T08:06:04.172Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4484worker2 # [ 72.764525] nix-grpc-daemon[854]: time=2026-09-20T08:06:04.172Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4485lb # [ 72.798948] niks3-server[1112]: 2026/09/20 08:06:04 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4486lb # [ 72.819941] niks3-server[1112]: 2026/09/20 08:06:04 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4487worker2 # [ 72.823986] nix-grpc-daemon[854]: time=2026-09-20T08:06:04.234Z level=INFO msg="Uploading 1 narinfos"4488lb # [ 72.827183] niks3-server[1112]: 2026/09/20 08:06:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4489lb # [ 72.835448] niks3-server[1112]: 2026/09/20 08:06:04 INFO Signed narinfos id=14 count=14490lb # [ 72.839853] niks3-server[1112]: 2026/09/20 08:06:04 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4491lb # [ 72.848281] niks3-server[1112]: 2026/09/20 08:06:04 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4492lb # [ 72.853995] niks3-server[1112]: 2026/09/20 08:06:04 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4493lb # [ 72.858150] niks3-server[1112]: 2026/09/20 08:06:04 INFO Completed upload id=144494worker2 # [ 72.856693] nix-grpc-daemon[854]: time=2026-09-20T08:06:04.267Z level=INFO msg="Upload complete. (384ms)"4495worker2 # [ 72.863493] nix-grpc-daemon[774]: ts=2026-09-20T08:06:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47538 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=7 outputs=14496worker1 # [ 72.944836] nix-grpc-daemon[832]: ts=2026-09-20T08:06:03Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:528444497worker2 # [ 72.874016] nix-daemon[842]: reaped child process 1108, status = succeeded4498worker1 # [ 72.961281] nix-grpc-daemon[832]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4499worker1 # [ 72.985823] nix-grpc-daemon[832]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4500worker1 # [ 73.004375] nix-grpc-daemon[832]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...4501worker2 # [ 72.973179] nix-grpc-daemon[774]: ts=2026-09-20T08:06:04Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:475384502worker2 # [ 72.977345] nix-grpc-daemon[774]: ts=2026-09-20T08:06:04Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47538 duration_s=0 paths=1 nar_bytes_out=2324503client # [ 73.060492] nix-daemon[926]: reaped child process 928, status = succeeded4504client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.81 seconds)4505client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4506client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.03 seconds)4507client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4508client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.04 seconds)4509client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4510client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.04 seconds)4511(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.93 seconds)4512subtest: an input only one worker has still reaches the builder4513client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4514client # this derivation will be built:4515client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4516client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4517client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.56 seconds)4518client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4519client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.24 seconds)4520worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4521worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.28 seconds)4522worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4523worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds)4524client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24525client # [ 74.534848] nix-daemon[926]: accepted connection from pid 1008, user root (trusted)4526client # this derivation will be built:4527client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4528worker1 # [ 74.859596] nix-grpc-daemon[832]: ts=2026-09-20T08:06:05Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:528444529client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4530worker1 # [ 74.868685] nix-grpc-daemon[832]: ts=2026-09-20T08:06:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:528444531worker1 # [ 75.091344] nix-daemon[895]: accepted connection from pid 996, user nix-grpc-daemon (trusted)4532worker1 # [ 75.112997] nix-daemon[895]: reaped child process 999, status = succeeded4533lb # [ 75.053979] niks3-server[1112]: 2026/09/20 08:06:06 INFO Received uploads request method=POST path=/api/pending_closures4534worker1 # [ 75.138278] nix-grpc-daemon[918]: time=2026-09-20T08:06:05.542Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4535worker1 # [ 75.139959] nix-grpc-daemon[918]: time=2026-09-20T08:06:05.542Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4536lb # [ 75.087080] niks3-server[1112]: 2026/09/20 08:06:06 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4537lb # [ 75.105149] niks3-server[1112]: 2026/09/20 08:06:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4538worker1 # [ 75.183018] nix-grpc-daemon[918]: time=2026-09-20T08:06:05.587Z level=INFO msg="Uploading 1 narinfos"4539lb # [ 75.115906] niks3-server[1112]: 2026/09/20 08:06:06 INFO Signed narinfos id=15 count=14540lb # [ 75.122128] niks3-server[1112]: 2026/09/20 08:06:06 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4541lb # [ 75.133365] niks3-server[1112]: 2026/09/20 08:06:06 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4542lb # [ 75.139580] niks3-server[1112]: 2026/09/20 08:06:06 INFO Completed upload id=154543worker1 # [ 75.212640] nix-grpc-daemon[918]: time=2026-09-20T08:06:05.617Z level=INFO msg="Upload complete. (345ms)"4544lb # [ 75.142631] niks3-server[1112]: 2026/09/20 08:06:06 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4545worker2 # [ 75.163148] nix-grpc-daemon[774]: ts=2026-09-20T08:06:06Z level=debug event=want client=8 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04546worker2 # [ 75.166218] nix-grpc-daemon[774]: ts=2026-09-20T08:06:06Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=14547worker1 # [ 75.287120] nix-grpc-daemon[832]: ts=2026-09-20T08:06:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:528444548worker1 # [ 75.306663] nix-grpc-daemon[832]: ts=2026-09-20T08:06:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:528444549lb # [ 75.240181] envoy[895]: conn peer=[2001:db8:1::1]:60226 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3418 tx=1640 ms=19684550lb # [ 75.247247] envoy[895]: conn peer=[2001:db8:1::1]:60234 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=333 ms=714551lb # [ 75.259400] envoy[895]: conn peer=[2001:db8:1::1]:60240 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3888 tx=1876 ms=22644552client # copying 2 paths to 'lb:50051'...4553lb # [ 75.266187] envoy[895]: conn peer=[2001:db8:1::1]:60248 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=375 ms=614554client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4555lb # [ 75.273562] envoy[895]: conn peer=[2001:db8:1::1]:60264 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4339 tx=2223 ms=22864556worker1 # [ 75.347335] nix-grpc-daemon[832]: ts=2026-09-20T08:06:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:528444557lb # [ 75.278564] envoy[895]: conn peer=[2001:db8:1::1]:45754 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=412 tx=406 ms=224558client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4559worker1 # [ 75.366960] nix-daemon[895]: accepted connection from pid 832, user nix-grpc-daemon (trusted)4560worker1 # [ 75.593528] nix-daemon[895]: accepted connection from pid 1003, user nix-grpc-daemon (trusted)4561worker1 # [ 75.618553] nix-daemon[895]: reaped child process 1006, status = succeeded4562worker1 # [ 75.802311] nix-daemon[895]: accepted connection from pid 1008, user nix-grpc-daemon (trusted)4563worker1 # [ 75.827331] nix-daemon[895]: reaped child process 1011, status = succeeded4564lb # [ 75.768300] niks3-server[1112]: 2026/09/20 08:06:07 INFO Received uploads request method=POST path=/api/pending_closures4565lb # [ 75.775616] niks3-server[1112]: 2026/09/20 08:06:07 INFO Received uploads request method=POST path=/api/pending_closures4566worker1 # [ 75.853963] nix-grpc-daemon[918]: time=2026-09-20T08:06:06.258Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4567worker1 # [ 75.855719] nix-grpc-daemon[918]: time=2026-09-20T08:06:06.258Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4568worker1 # [ 75.857769] nix-grpc-daemon[918]: time=2026-09-20T08:06:06.258Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4569lb # [ 75.797171] niks3-server[1112]: 2026/09/20 08:06:07 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4570lb # [ 75.807521] niks3-server[1112]: 2026/09/20 08:06:07 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4571lb # [ 75.816462] niks3-server[1112]: 2026/09/20 08:06:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4572lb # [ 75.825088] niks3-server[1112]: 2026/09/20 08:06:07 INFO Signed narinfos id=17 count=24573worker1 # [ 75.897468] nix-grpc-daemon[918]: time=2026-09-20T08:06:06.301Z level=INFO msg="Uploading 3 narinfos"4574lb # [ 75.826441] niks3-server[1112]: 2026/09/20 08:06:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4575lb # [ 75.833062] niks3-server[1112]: 2026/09/20 08:06:07 INFO Signed narinfos id=16 count=14576lb # [ 75.834413] niks3-server[1112]: 2026/09/20 08:06:07 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4577lb # [ 75.839659] niks3-server[1112]: 2026/09/20 08:06:07 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4578lb # [ 75.850487] niks3-server[1112]: 2026/09/20 08:06:07 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4579lb # [ 75.858504] niks3-server[1112]: 2026/09/20 08:06:07 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4580lb # [ 75.864198] niks3-server[1112]: 2026/09/20 08:06:07 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4581lb # [ 75.868695] niks3-server[1112]: 2026/09/20 08:06:07 INFO Completed upload id=164582lb # [ 75.871440] niks3-server[1112]: 2026/09/20 08:06:07 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4583lb # [ 75.874399] niks3-server[1112]: 2026/09/20 08:06:07 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4584lb # [ 75.876423] niks3-server[1112]: 2026/09/20 08:06:07 INFO Completed upload id=174585worker1 # [ 75.947585] nix-grpc-daemon[918]: time=2026-09-20T08:06:06.352Z level=INFO msg="Upload complete. (557ms)"4586worker1 # [ 75.958221] nix-grpc-daemon[832]: ts=2026-09-20T08:06:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52844 duration_s=0 paths=2 nar_bytes_in=9844587worker1 # [ 75.972851] nix-grpc-daemon[832]: ts=2026-09-20T08:06:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:528444588worker1 # [ 75.982610] nix-daemon[895]: accepted connection from pid 832, user nix-grpc-daemon (trusted)4589worker1 # [ 75.991171] nix-daemon[895]: reaped child process 1001, status = succeeded4590client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4591worker1 # [ 76.003630] nix-daemon[895]: accepted connection from pid 832, user nix-grpc-daemon (trusted)4592client # uses-input-w1onlya> node-a: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4593worker1 # [ 77.243643] nix-daemon[895]: reaped child process 1015, status = succeeded4594worker1 # [ 77.421854] nix-daemon[895]: accepted connection from pid 1030, user nix-grpc-daemon (trusted)4595worker1 # [ 77.448142] nix-daemon[895]: reaped child process 1033, status = succeeded4596lb # [ 77.387604] niks3-server[1112]: 2026/09/20 08:06:08 INFO Received uploads request method=POST path=/api/pending_closures4597worker1 # [ 77.471750] nix-grpc-daemon[918]: time=2026-09-20T08:06:07.876Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4598lb # [ 77.420203] niks3-server[1112]: 2026/09/20 08:06:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4599worker1 # [ 77.502929] nix-grpc-daemon[918]: time=2026-09-20T08:06:07.907Z level=INFO msg="Uploading 1 narinfos"4600lb # [ 77.436501] niks3-server[1112]: 2026/09/20 08:06:08 INFO Signed narinfos id=18 count=14601lb # [ 77.439954] niks3-server[1112]: 2026/09/20 08:06:08 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4602lb # [ 77.459237] niks3-server[1112]: 2026/09/20 08:06:08 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4603worker1 # [ 77.537718] nix-grpc-daemon[918]: time=2026-09-20T08:06:07.942Z level=INFO msg="Upload complete. (321ms)"4604lb # [ 77.465857] niks3-server[1112]: 2026/09/20 08:06:08 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4605lb # [ 77.470904] niks3-server[1112]: 2026/09/20 08:06:08 INFO Completed upload id=184606worker1 # [ 77.544600] nix-grpc-daemon[832]: ts=2026-09-20T08:06:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52844 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=8 outputs=14607lb # [ 77.473485] niks3-server[1112]: 2026/09/20 08:06:08 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4608worker1 # [ 77.556786] nix-daemon[895]: reaped child process 1013, status = succeeded4609client # copying 1 paths...4610worker1 # [ 77.594550] nix-grpc-daemon[832]: ts=2026-09-20T08:06:07Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:528444611client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4612worker2 # [ 77.554395] nix-grpc-daemon[774]: ts=2026-09-20T08:06:08Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:475384613worker2 # [ 77.570727] nix-grpc-daemon[774]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'...4614worker2 # [ 77.597901] nix-grpc-daemon[774]: ts=2026-09-20T08:06:09Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47538 duration_s=0 paths=1 nar_bytes_out=1204615client # [ 77.721515] nix-daemon[926]: reaped child process 1011, status = succeeded4616client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.43 seconds)4617client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24618client # [ 77.966259] nix-daemon[926]: accepted connection from pid 1029, user root (trusted)4619client # this derivation will be built:4620client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4621worker2 # [ 78.182549] nix-grpc-daemon[774]: ts=2026-09-20T08:06:09Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:475384622client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4623worker2 # [ 78.192395] nix-grpc-daemon[774]: ts=2026-09-20T08:06:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475384624worker2 # [ 78.222524] nix-grpc-daemon[774]: ts=2026-09-20T08:06:09Z level=debug event=want client=9 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04625worker2 # [ 78.225754] nix-grpc-daemon[774]: ts=2026-09-20T08:06:09Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=14626worker2 # [ 78.230156] nix-grpc-daemon[774]: ts=2026-09-20T08:06:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475384627worker2 # [ 78.238652] nix-grpc-daemon[774]: ts=2026-09-20T08:06:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475384628client # copying 1 paths to 'lb:50051'...4629client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4630worker2 # [ 78.259559] nix-grpc-daemon[774]: ts=2026-09-20T08:06:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:475384631worker2 # [ 78.268783] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4632worker2 # [ 78.284085] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 60 ms (attempt 1/5)4633worker2 # [ 78.347611] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 3 ms (attempt 2/5)4634worker2 # [ 78.357165] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 158 ms (attempt 3/5)4635worker2 # [ 78.522100] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 684 ms (attempt 4/5)4636worker2 # [ 79.207580] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4637worker2 # [ 79.213345] nix-grpc-daemon[774]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4638worker2 # [ 79.405918] nix-daemon[842]: accepted connection from pid 1144, user nix-grpc-daemon (trusted)4639worker2 # [ 79.433506] nix-daemon[842]: reaped child process 1147, status = succeeded4640worker2 # [ 79.618851] nix-daemon[842]: accepted connection from pid 1149, user nix-grpc-daemon (trusted)4641worker2 # [ 79.644138] nix-daemon[842]: reaped child process 1152, status = succeeded4642lb # [ 79.656780] niks3-server[1112]: 2026/09/20 08:06:11 INFO Received uploads request method=POST path=/api/pending_closures4643worker2 # [ 79.667037] nix-grpc-daemon[854]: time=2026-09-20T08:06:11.077Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4644worker2 # [ 79.668836] nix-grpc-daemon[854]: time=2026-09-20T08:06:11.077Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4645lb # [ 79.689131] niks3-server[1112]: 2026/09/20 08:06:11 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4646lb # [ 79.708544] niks3-server[1112]: 2026/09/20 08:06:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4647worker2 # [ 79.714554] nix-grpc-daemon[854]: time=2026-09-20T08:06:11.125Z level=INFO msg="Uploading 1 narinfos"4648lb # [ 79.723565] niks3-server[1112]: 2026/09/20 08:06:11 INFO Signed narinfos id=19 count=14649lb # [ 79.730428] niks3-server[1112]: 2026/09/20 08:06:11 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4650lb # [ 79.742322] niks3-server[1112]: 2026/09/20 08:06:11 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4651worker2 # [ 79.747931] nix-grpc-daemon[854]: time=2026-09-20T08:06:11.158Z level=INFO msg="Upload complete. (512ms)"4652lb # [ 79.750272] niks3-server[1112]: 2026/09/20 08:06:11 INFO Completed upload id=194653lb # [ 79.753824] niks3-server[1112]: 2026/09/20 08:06:11 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4654worker2 # [ 79.756228] nix-grpc-daemon[774]: ts=2026-09-20T08:06:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47538 duration_s=1 paths=1 nar_bytes_in=5684655worker2 # [ 79.768535] nix-grpc-daemon[774]: ts=2026-09-20T08:06:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:475384656worker2 # [ 79.788245] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4657worker2 # [ 79.794185] nix-daemon[842]: reaped child process 1138, status = succeeded4658worker2 # [ 79.803525] nix-grpc-daemon[774]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...4659client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4660worker2 # [ 79.824149] nix-daemon[842]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4661client # uses-input-w1onlyb> worker2: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4662worker2 # [ 81.064306] nix-daemon[842]: reaped child process 1157, status = succeeded4663worker2 # [ 81.243895] nix-daemon[842]: accepted connection from pid 1172, user nix-grpc-daemon (trusted)4664worker2 # [ 81.268315] nix-daemon[842]: reaped child process 1175, status = succeeded4665lb # [ 81.283122] niks3-server[1112]: 2026/09/20 08:06:12 INFO Received uploads request method=POST path=/api/pending_closures4666worker2 # [ 81.294817] nix-grpc-daemon[854]: time=2026-09-20T08:06:12.705Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4667lb # [ 81.324288] niks3-server[1112]: 2026/09/20 08:06:12 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4668worker2 # [ 81.331349] nix-grpc-daemon[854]: time=2026-09-20T08:06:12.742Z level=INFO msg="Uploading 1 narinfos"4669lb # [ 81.334929] niks3-server[1112]: 2026/09/20 08:06:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4670lb # [ 81.345751] niks3-server[1112]: 2026/09/20 08:06:12 INFO Signed narinfos id=20 count=14671lb # [ 81.352619] niks3-server[1112]: 2026/09/20 08:06:12 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4672lb # [ 81.361033] niks3-server[1112]: 2026/09/20 08:06:12 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4673lb # [ 81.367444] niks3-server[1112]: 2026/09/20 08:06:12 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4674lb # [ 81.373327] niks3-server[1112]: 2026/09/20 08:06:12 INFO Completed upload id=204675worker2 # [ 81.371891] nix-grpc-daemon[854]: time=2026-09-20T08:06:12.782Z level=INFO msg="Upload complete. (336ms)"4676worker2 # [ 81.385175] nix-grpc-daemon[774]: ts=2026-09-20T08:06:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47538 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=9 outputs=14677worker2 # [ 81.399847] nix-daemon[842]: reaped child process 1154, status = succeeded4678client # copying 1 paths...4679worker2 # [ 81.428222] nix-grpc-daemon[774]: ts=2026-09-20T08:06:12Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:475384680client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4681worker2 # [ 81.467685] nix-grpc-daemon[774]: ts=2026-09-20T08:06:12Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:475384682worker2 # [ 81.473313] nix-grpc-daemon[774]: ts=2026-09-20T08:06:12Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47538 duration_s=0 paths=1 nar_bytes_out=1204683client # [ 81.600751] nix-daemon[926]: reaped child process 1032, status = succeeded4684client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.88 seconds)4685client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24686client # [ 81.846596] nix-daemon[926]: accepted connection from pid 1051, user root (trusted)4687client # this derivation will be built:4688client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4689worker2 # [ 82.076092] nix-grpc-daemon[774]: ts=2026-09-20T08:06:13Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:475384690client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'...4691worker2 # [ 82.086378] nix-grpc-daemon[774]: ts=2026-09-20T08:06:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:475384692worker2 # [ 82.157828] nix-grpc-daemon[854]: time=2026-09-20T08:06:13.568Z level=INFO msg="All 1 paths already cached"4693worker2 # [ 82.185453] nix-grpc-daemon[774]: ts=2026-09-20T08:06:13Z level=debug event=want client=10 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04694worker2 # [ 82.192978] nix-grpc-daemon[774]: ts=2026-09-20T08:06:13Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=14695worker1 # [ 82.274684] nix-grpc-daemon[832]: ts=2026-09-20T08:06:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:528444696worker1 # [ 82.296734] nix-grpc-daemon[832]: ts=2026-09-20T08:06:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:528444697worker1 # [ 82.315855] nix-grpc-daemon[918]: time=2026-09-20T08:06:12.720Z level=INFO msg="All 1 paths already cached"4698client # copying 1 paths to 'lb:50051'...4699client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4700worker1 # [ 82.329289] nix-grpc-daemon[832]: ts=2026-09-20T08:06:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:528444701worker1 # [ 82.346325] nix-daemon[895]: accepted connection from pid 832, user nix-grpc-daemon (trusted)4702worker1 # [ 82.582936] nix-daemon[895]: accepted connection from pid 1037, user nix-grpc-daemon (trusted)4703worker1 # [ 82.610065] nix-daemon[895]: reaped child process 1040, status = succeeded4704worker1 # [ 82.818438] nix-daemon[895]: accepted connection from pid 1042, user nix-grpc-daemon (trusted)4705lb # [ 82.772545] niks3-server[1112]: 2026/09/20 08:06:14 INFO Received uploads request method=POST path=/api/pending_closures4706worker1 # [ 82.847676] nix-daemon[895]: reaped child process 1045, status = succeeded4707worker1 # [ 82.850846] nix-grpc-daemon[918]: time=2026-09-20T08:06:13.255Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4708worker1 # [ 82.853550] nix-grpc-daemon[918]: time=2026-09-20T08:06:13.255Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4709lb # [ 82.788836] niks3-server[1112]: 2026/09/20 08:06:14 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4710lb # [ 82.796124] niks3-server[1112]: 2026/09/20 08:06:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4711worker1 # [ 82.872734] nix-grpc-daemon[918]: time=2026-09-20T08:06:13.277Z level=INFO msg="Uploading 1 narinfos"4712lb # [ 82.801994] niks3-server[1112]: 2026/09/20 08:06:14 INFO Signed narinfos id=21 count=14713lb # [ 82.803718] niks3-server[1112]: 2026/09/20 08:06:14 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4714lb # [ 82.811856] niks3-server[1112]: 2026/09/20 08:06:14 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4715lb # [ 82.833532] niks3-server[1112]: 2026/09/20 08:06:14 INFO Completed upload id=214716worker1 # [ 82.906524] nix-grpc-daemon[918]: time=2026-09-20T08:06:13.311Z level=INFO msg="Upload complete. (539ms)"4717lb # [ 82.835199] niks3-server[1112]: 2026/09/20 08:06:14 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4718worker1 # [ 82.912378] nix-grpc-daemon[832]: ts=2026-09-20T08:06:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52844 duration_s=0 paths=1 nar_bytes_in=5684719worker1 # [ 82.917472] nix-grpc-daemon[832]: ts=2026-09-20T08:06:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:528444720worker1 # [ 82.928491] nix-daemon[895]: accepted connection from pid 832, user nix-grpc-daemon (trusted)4721worker1 # [ 82.932076] nix-daemon[895]: reaped child process 1035, status = succeeded4722client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4723worker1 # [ 82.944151] nix-daemon[895]: accepted connection from pid 832, user nix-grpc-daemon (trusted)4724client # uses-input-w1onlyc> node-a: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4725worker1 # [ 83.970598] nix-daemon[895]: reaped child process 1049, status = succeeded4726worker1 # [ 84.150437] nix-daemon[895]: accepted connection from pid 1064, user nix-grpc-daemon (trusted)4727worker1 # [ 84.176224] nix-daemon[895]: reaped child process 1067, status = succeeded4728lb # [ 84.115844] niks3-server[1112]: 2026/09/20 08:06:15 INFO Received uploads request method=POST path=/api/pending_closures4729worker1 # [ 84.200580] nix-grpc-daemon[918]: time=2026-09-20T08:06:14.605Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4730lb # [ 84.148994] niks3-server[1112]: 2026/09/20 08:06:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4731worker1 # [ 84.231697] nix-grpc-daemon[918]: time=2026-09-20T08:06:14.636Z level=INFO msg="Uploading 1 narinfos"4732lb # [ 84.163664] niks3-server[1112]: 2026/09/20 08:06:15 INFO Signed narinfos id=22 count=14733lb # [ 84.176524] niks3-server[1112]: 2026/09/20 08:06:15 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4734lb # [ 84.186432] niks3-server[1112]: 2026/09/20 08:06:15 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4735lb # [ 84.196477] niks3-server[1112]: 2026/09/20 08:06:15 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4736lb # [ 84.207560] niks3-server[1112]: 2026/09/20 08:06:15 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4737lb # [ 84.215184] niks3-server[1112]: 2026/09/20 08:06:15 INFO Completed upload id=224738worker1 # [ 84.288631] nix-grpc-daemon[918]: time=2026-09-20T08:06:14.693Z level=INFO msg="Upload complete. (334ms)"4739worker1 # [ 84.301270] nix-grpc-daemon[832]: ts=2026-09-20T08:06:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52844 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=10 outputs=14740worker1 # [ 84.317661] nix-daemon[895]: reaped child process 1047, status = succeeded4741client # copying 1 paths...4742worker2 # [ 84.273101] nix-grpc-daemon[774]: ts=2026-09-20T08:06:15Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:475384743worker2 # [ 84.284325] nix-grpc-daemon[774]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'...4744client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4745worker2 # [ 84.319922] nix-grpc-daemon[774]: ts=2026-09-20T08:06:15Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:475384746worker2 # [ 84.322482] nix-grpc-daemon[774]: ts=2026-09-20T08:06:15Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:47538 duration_s=0 paths=1 nar_bytes_out=1204747client # [ 84.434087] nix-daemon[926]: reaped child process 1054, status = succeeded4748client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.84 seconds)4749(finished: subtest: an input only one worker has still reaches the builder, in 11.26 seconds)4750subtest: upload whose reference the worker lacks is completed from the cache4751client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4752client # this derivation will be built:4753client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4754client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4755client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.49 seconds)4756client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4757client # this derivation will be built:4758client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4759lb # [ 85.240284] envoy[895]: conn peer=[2001:db8:1::1]:45770 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3851 tx=1788 ms=28704760lb # [ 85.240664] envoy[895]: conn peer=[2001:db8:1::1]:45784 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=1074761lb # [ 85.240814] envoy[895]: conn peer=[2001:db8:1::1]:45786 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3713 tx=1826 ms=33464762lb # [ 85.240938] envoy[895]: conn peer=[2001:db8:1::1]:41284 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=674763lb # [ 85.241054] envoy[895]: conn peer=[2001:db8:1::1]:41306 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=614764lb # [ 85.241173] envoy[895]: conn peer=[2001:db8:1::1]:41290 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3770 tx=1933 ms=23064765client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4766client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.51 seconds)4767client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4768client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.22 seconds)4769worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4770worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.27 seconds)4771worker2 # [ 86.036964] systemd[1]: Stopping Nix worker-protocol over gRPC...4772worker2 # [ 86.624201] nix-grpc-daemon[774]: ts=2026-09-20T08:06:18Z level=info event=signal_exit4773worker2 # [ 87.087754] nix-grpc-daemon[774]: ts=2026-09-20T08:06:18Z level=info event=scheduler_yield4774worker1 # [ 87.167559] nix-grpc-daemon[832]: ts=2026-09-20T08:06:17Z level=info event=scheduler_restarting addr=lb:500514775lb # [ 87.095328] niks3-server[1112]: 2026/09/20 08:06:18 INFO lead: released remote=192.168.1.4:461564776worker2 # [ 87.095062] nix-grpc-daemon[774]: ts=2026-09-20T08:06:18Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:452744777worker2 # [ 87.100985] nix-grpc-daemon[774]: ts=2026-09-20T08:06:18Z level=info event=worker_gone addr=192.168.1.3:500514778worker2 # [ 87.107534] nix-grpc-daemon[774]: ts=2026-09-20T08:06:18Z level=info event=scheduler_restarting addr=lb:500514779worker2 # [ 87.111962] nix-grpc-daemon[774]: ts=2026-09-20T08:06:18Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:452744780worker2 # [ 87.116621] nix-grpc-daemon[774]: ts=2026-09-20T08:06:18Z level=info event=worker_gone addr=192.168.1.4:500514781worker1 # [ 87.368101] nix-grpc-daemon[832]: ts=2026-09-20T08:06:17Z level=info event=scheduler_connected addr=lb:500514782worker2 # [ 87.296386] nix-grpc-daemon[774]: ts=2026-09-20T08:06:18Z level=info event=scheduler_connected addr=lb:500514783worker1 # [ 87.376288] nix-grpc-daemon[832]: ts=2026-09-20T08:06:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4784worker2 # [ 87.308562] nix-grpc-daemon[774]: ts=2026-09-20T08:06:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4785worker1 # [ 87.577243] nix-grpc-daemon[832]: ts=2026-09-20T08:06:17Z level=info event=scheduler_connected addr=lb:500514786worker1 # [ 87.582505] nix-grpc-daemon[832]: ts=2026-09-20T08:06:17Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4787worker2 # [ 87.509767] nix-grpc-daemon[774]: ts=2026-09-20T08:06:18Z level=info event=scheduler_connected addr=lb:500514788worker2 # [ 87.518219] nix-grpc-daemon[774]: ts=2026-09-20T08:06:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4789worker1 # [ 87.783902] nix-grpc-daemon[832]: ts=2026-09-20T08:06:18Z level=info event=scheduler_connected addr=lb:500514790worker1 # [ 87.791672] nix-grpc-daemon[832]: ts=2026-09-20T08:06:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4791worker2 # [ 87.722021] nix-grpc-daemon[774]: ts=2026-09-20T08:06:19Z level=info event=scheduler_connected addr=lb:500514792worker2 # [ 87.728176] nix-grpc-daemon[774]: ts=2026-09-20T08:06:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4793worker1 # [ 87.993144] nix-grpc-daemon[832]: ts=2026-09-20T08:06:18Z level=info event=scheduler_connected addr=lb:500514794worker1 # [ 88.001065] nix-grpc-daemon[832]: ts=2026-09-20T08:06:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4795worker2 # [ 87.928932] nix-grpc-daemon[774]: ts=2026-09-20T08:06:19Z level=info event=scheduler_connected addr=lb:500514796worker2 # [ 87.936481] nix-grpc-daemon[774]: ts=2026-09-20T08:06:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4797worker2 # [ 88.093812] nix-grpc-daemon[774]: ts=2026-09-20T08:06:19Z level=info event=scheduler_restarting4798worker2 # [ 88.122244] nix-daemon[842]: reaped child process 844, status = succeeded4799worker1 # [ 88.205245] nix-grpc-daemon[832]: ts=2026-09-20T08:06:18Z level=info event=scheduler_connected addr=lb:500514800worker1 # [ 88.211188] nix-grpc-daemon[832]: ts=2026-09-20T08:06:18Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4801worker2 # [ 88.161124] nix-grpc-daemon[774]: ts=2026-09-20T08:06:19Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4802worker1 # [ 88.412444] nix-grpc-daemon[832]: ts=2026-09-20T08:06:18Z level=info event=scheduler_connected addr=lb:500514803worker2 # [ 88.340383] nix-grpc-daemon[774]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4804worker2 # [ 88.342990] nix-grpc-daemon[774]: E0000 00:00:1789891579.751077 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true4805worker2 # [ 88.749772] nix-grpc-daemon[774]: E0000 00:00:1789891580.159402 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4806worker2 # [ 88.790592] nix-grpc-daemon[774]: E0000 00:00:1789891580.201389 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true4807lb # [ 88.902265] niks3-server[1112]: 2026/09/20 08:06:20 INFO lead: acquired remote=192.168.1.3:381024808worker1 # [ 88.976287] nix-grpc-daemon[832]: ts=2026-09-20T08:06:19Z level=info event=scheduler_take_over4809worker1 # [ 89.392801] nix-grpc-daemon[832]: ts=2026-09-20T08:06:19Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4810worker2 # [ 89.341623] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4811worker2 # [ 89.349759] systemd[1]: Stopped Nix worker-protocol over gRPC.4812worker2 # [ 89.357163] systemd[1]: nix-grpc-daemon.service: Consumed 3.753s CPU time over 1min 4.088s wall clock time, 59.9M memory peak, 94.9K incoming IP traffic, 176K outgoing IP traffic.4813worker2 # [ 89.372371] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4814worker2 # [ 89.374678] systemd[1]: Closed Nix worker-protocol over gRPC.4815worker2 # [ 89.378476] systemd[1]: nix-grpc-daemon.socket: Consumed 913us CPU time over 1min 16.579s wall clock time, 256K memory peak, 128.3K incoming IP traffic, 105.3K outgoing IP traffic.4816lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4817lb: must succeed: curl -sf localhost:9901/clusters4818lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4819lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4820client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24821worker1 # [ 89.592961] nix-grpc-daemon[832]: ts=2026-09-20T08:06:19Z level=info event=scheduler_connected addr=lb:500514822worker1 # [ 89.599425] nix-grpc-daemon[832]: ts=2026-09-20T08:06:20Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04823worker1 # [ 89.814690] nix-grpc-daemon[832]: ts=2026-09-20T08:06:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:528444824worker1 # [ 89.827156] nix-grpc-daemon[832]: ts=2026-09-20T08:06:20Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:528444825client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4826client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.32 seconds)4827worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4828worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)4829worker2 # [ 89.910742] systemd[1]: Listening on Nix worker-protocol over gRPC.4830worker1 # [ 90.073173] systemd[1]: Stopping Nix worker-protocol over gRPC...4831worker2 # [ 90.326278] systemd[1]: Starting Nix worker-protocol over gRPC...4832worker2 # [ 90.557347] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:21Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4833worker2 # [ 90.560278] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:21Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14834worker2 # [ 90.569013] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:21Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4835worker2 # [ 90.571300] systemd[1]: Started Nix worker-protocol over gRPC.4836worker2 # [ 90.600196] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:22Z level=info event=scheduler_connected addr=lb:500514837worker1 # [ 90.678073] nix-grpc-daemon[832]: ts=2026-09-20T08:06:21Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04838worker1 # [ 90.765975] nix-grpc-daemon[832]: ts=2026-09-20T08:06:21Z level=info event=signal_exit4839worker1 # [ 91.233082] nix-grpc-daemon[832]: ts=2026-09-20T08:06:21Z level=info event=scheduler_yield4840lb # [ 91.165528] niks3-server[1112]: 2026/09/20 08:06:22 INFO lead: released remote=192.168.1.3:381024841worker2 # [ 91.166445] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:22Z level=info event=scheduler_restarting addr=lb:500514842worker1 # [ 91.245513] nix-grpc-daemon[832]: ts=2026-09-20T08:06:21Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:583344843worker1 # [ 91.250745] nix-grpc-daemon[832]: ts=2026-09-20T08:06:21Z level=info event=worker_gone addr=192.168.1.4:500514844worker1 # [ 91.259354] nix-grpc-daemon[832]: ts=2026-09-20T08:06:21Z level=info event=scheduler_restarting addr=lb:500514845worker1 # [ 91.263815] nix-grpc-daemon[832]: ts=2026-09-20T08:06:21Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:583344846worker1 # [ 91.268636] nix-grpc-daemon[832]: ts=2026-09-20T08:06:21Z level=info event=worker_gone addr=192.168.1.3:500514847worker2 # [ 91.367157] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:22Z level=info event=scheduler_connected addr=lb:500514848worker2 # [ 91.372549] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4849worker1 # [ 91.458133] nix-grpc-daemon[832]: ts=2026-09-20T08:06:21Z level=info event=scheduler_connected addr=lb:500514850worker1 # [ 91.476717] nix-grpc-daemon[832]: ts=2026-09-20T08:06:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4851worker2 # [ 91.578557] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:22Z level=info event=scheduler_connected addr=lb:500514852worker2 # [ 91.583002] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4853worker1 # [ 91.681805] nix-grpc-daemon[832]: ts=2026-09-20T08:06:22Z level=info event=scheduler_connected addr=lb:500514854worker1 # [ 91.686345] nix-grpc-daemon[832]: ts=2026-09-20T08:06:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4855worker2 # [ 91.779727] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:23Z level=info event=scheduler_connected addr=lb:500514856worker2 # [ 91.788396] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4857worker1 # [ 91.883060] nix-grpc-daemon[832]: ts=2026-09-20T08:06:22Z level=info event=scheduler_connected addr=lb:500514858worker1 # [ 91.890846] nix-grpc-daemon[832]: ts=2026-09-20T08:06:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4859worker2 # [ 91.989738] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:23Z level=info event=scheduler_connected addr=lb:500514860worker2 # [ 91.997246] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4861worker1 # [ 92.092096] nix-grpc-daemon[832]: ts=2026-09-20T08:06:22Z level=info event=scheduler_connected addr=lb:500514862worker1 # [ 92.101339] nix-grpc-daemon[832]: ts=2026-09-20T08:06:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4863worker1 # [ 92.238569] nix-grpc-daemon[832]: ts=2026-09-20T08:06:22Z level=info event=scheduler_restarting4864worker1 # [ 92.266587] nix-daemon[895]: reaped child process 897, status = succeeded4865worker2 # [ 92.198416] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:23Z level=info event=scheduler_connected addr=lb:500514866worker2 # [ 92.205972] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4867worker1 # [ 92.311282] nix-grpc-daemon[832]: ts=2026-09-20T08:06:22Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4868worker2 # [ 92.407347] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:23Z level=info event=scheduler_connected addr=lb:500514869worker1 # [ 92.484856] nix-grpc-daemon[832]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4870worker1 # [ 92.489574] nix-grpc-daemon[832]: E0000 00:00:1789891582.889688 876 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true4871worker1 # [ 92.924873] nix-grpc-daemon[832]: E0000 00:00:1789891583.328678 876 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4872worker1 # [ 92.957624] nix-grpc-daemon[832]: E0000 00:00:1789891583.362765 876 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true4873worker2 # [ 93.263869] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:24Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4874worker1 # [ 93.361314] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4875worker1 # [ 93.369239] systemd[1]: Stopped Nix worker-protocol over gRPC.4876worker1 # [ 93.371749] systemd[1]: nix-grpc-daemon.service: Consumed 2.311s CPU time over 1min 8.034s wall clock time, 47.8M memory peak, 61.2K incoming IP traffic, 108.7K outgoing IP traffic.4877worker1 # [ 93.393054] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4878worker1 # [ 93.396886] systemd[1]: Closed Nix worker-protocol over gRPC.4879worker1 # [ 93.398559] systemd[1]: nix-grpc-daemon.socket: Consumed 959us CPU time over 1min 19.574s wall clock time, 256K memory peak, 107.5K incoming IP traffic, 89.5K outgoing IP traffic.4880lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4881lb: must succeed: curl -sf localhost:9901/clusters4882lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4883lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4884client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24885worker2 # [ 93.464080] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:24Z level=info event=scheduler_connected addr=lb:500514886worker2 # [ 93.472101] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4887worker2 # [ 93.673328] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:25Z level=info event=scheduler_connected addr=lb:500514888worker2 # [ 93.679350] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:25Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4889worker2 # [ 93.698180] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:479744890worker2 # [ 93.717491] nix-daemon[842]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)4891worker2 # [ 93.740994] nix-grpc-daemon[1199]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 78 ms (attempt 1/5)4892worker2 # [ 93.825123] nix-grpc-daemon[1199]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 72 ms (attempt 2/5)4893worker2 # [ 93.880442] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:25Z level=info event=scheduler_connected addr=lb:500514894worker2 # [ 93.888649] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4895worker2 # [ 93.905043] nix-grpc-daemon[1199]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 192 ms (attempt 3/5)4896worker2 # [ 94.090045] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:25Z level=info event=scheduler_connected addr=lb:500514897worker2 # [ 94.096087] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:25Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4898worker2 # [ 94.105325] nix-grpc-daemon[1199]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 216 ms (attempt 4/5)4899worker2 # [ 94.299224] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:25Z level=info event=scheduler_connected addr=lb:500514900worker2 # [ 94.305580] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4901worker2 # [ 94.329729] nix-grpc-daemon[1199]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4902client # copying 2 paths...4903client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...4904worker2 # [ 94.361124] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:479744905client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...4906worker2 # [ 94.381217] nix-daemon[842]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)4907worker2 # [ 94.417648] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:25Z level=info event=niks3_push_started pid=12554908worker2 # [ 94.506434] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:25Z level=info event=scheduler_connected addr=lb:500514909worker2 # [ 94.532326] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:25Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4910worker2 # [ 94.712317] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:26Z level=info event=scheduler_connected addr=lb:500514911worker2 # [ 94.716301] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4912worker2 # [ 94.881610] nix-daemon[842]: accepted connection from pid 1268, user nix-grpc-daemon (trusted)4913worker2 # [ 94.903435] nix-daemon[842]: reaped child process 1271, status = succeeded4914worker2 # [ 94.916998] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:26Z level=info event=scheduler_connected addr=lb:500514915worker2 # [ 94.930122] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:26Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"4916lb # [ 94.923857] niks3-server[1112]: 2026/09/20 08:06:26 INFO Received uploads request method=POST path=/api/pending_closures4917lb # [ 94.936203] niks3-server[1112]: 2026/09/20 08:06:26 INFO Received uploads request method=POST path=/api/pending_closures4918worker2 # [ 94.948557] nix-grpc-daemon[1255]: time=2026-09-20T08:06:26.356Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4919worker2 # [ 94.950223] nix-grpc-daemon[1255]: time=2026-09-20T08:06:26.356Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"4920worker2 # [ 94.953344] nix-grpc-daemon[1255]: time=2026-09-20T08:06:26.356Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"4921lb # [ 94.991782] niks3-server[1112]: 2026/09/20 08:06:26 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst4922lb # [ 95.015611] niks3-server[1112]: 2026/09/20 08:06:26 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst4923lb # [ 95.028312] niks3-server[1112]: 2026/09/20 08:06:26 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls4924lb # [ 95.037727] niks3-server[1112]: 2026/09/20 08:06:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4925lb # [ 95.047672] niks3-server[1112]: 2026/09/20 08:06:26 INFO Signed narinfos id=24 count=24926worker2 # [ 95.044352] nix-grpc-daemon[1255]: time=2026-09-20T08:06:26.453Z level=INFO msg="Uploading 3 narinfos"4927lb # [ 95.050511] niks3-server[1112]: 2026/09/20 08:06:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4928lb # [ 95.056468] niks3-server[1112]: 2026/09/20 08:06:26 INFO Signed narinfos id=23 count=14929lb # [ 95.058871] niks3-server[1112]: 2026/09/20 08:06:26 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls4930lb # [ 95.076654] niks3-server[1112]: 2026/09/20 08:06:26 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4931lb # [ 95.091529] niks3-server[1112]: 2026/09/20 08:06:26 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo4932lb # [ 95.098856] niks3-server[1112]: 2026/09/20 08:06:26 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4933lb # [ 95.105195] niks3-server[1112]: 2026/09/20 08:06:26 INFO Completed upload id=234934lb # [ 95.106601] niks3-server[1112]: 2026/09/20 08:06:26 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4935lb # [ 95.112334] niks3-server[1112]: 2026/09/20 08:06:26 INFO Completed upload id=244936worker2 # [ 95.109506] nix-grpc-daemon[1255]: time=2026-09-20T08:06:26.520Z level=INFO msg="Upload complete. (426ms)"4937lb # [ 95.115132] niks3-server[1112]: 2026/09/20 08:06:26 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4938worker2 # [ 95.120549] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47974 duration_s=0 paths=2 nar_bytes_in=3124939worker2 # [ 95.140540] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:26Z level=info event=scheduler_connected addr=lb:500514940worker2 # [ 95.148625] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4941worker2 # [ 95.154232] nix-daemon[842]: reaped child process 1253, status = succeeded4942client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.74 seconds)4943worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache4944worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.04 seconds)4945lb # [ 95.242620] envoy[895]: conn peer=[2001:db8:1::4]:42972 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=12945 tx=3716 ms=616994946lb # [ 95.249469] envoy[895]: conn peer=[2001:db8:1::1]:41316 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=519 ms=334947lb # [ 95.255020] envoy[895]: conn peer=[2001:db8:1::3]:37090 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=14672 tx=3967 ms=665604948lb # [ 95.263440] envoy[895]: conn peer=[2001:db8:1::1]:60694 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1010 tx=305 ms=14404949worker1 # [ 95.372870] systemd[1]: Listening on Nix worker-protocol over gRPC.4950worker1 # [ 95.381416] systemd[1]: Starting Nix worker-protocol over gRPC...4951worker2 # [ 95.338061] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:26Z level=info event=scheduler_connected addr=lb:500514952worker1 # [ 95.599333] nix-grpc-daemon[1090]: ts=2026-09-20T08:06:26Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4953worker1 # [ 95.603142] nix-grpc-daemon[1090]: ts=2026-09-20T08:06:26Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14954worker1 # [ 95.612102] nix-grpc-daemon[1090]: ts=2026-09-20T08:06:26Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4955worker1 # [ 95.614002] systemd[1]: Started Nix worker-protocol over gRPC.4956worker1 # [ 95.629325] nix-grpc-daemon[1090]: ts=2026-09-20T08:06:26Z level=info event=scheduler_take_over4957lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4958lb: must succeed: curl -sf localhost:9901/clusters4959worker1 # [ 95.635161] nix-grpc-daemon[1090]: ts=2026-09-20T08:06:26Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04960lb # [ 95.556354] niks3-server[1112]: 2026/09/20 08:06:26 INFO lead: acquired remote=192.168.1.3:520504961worker1 # [ 95.651149] nix-grpc-daemon[1090]: ts=2026-09-20T08:06:26Z level=info event=scheduler_connected addr=lb:500514962worker1 # [ 95.657038] nix-grpc-daemon[1090]: ts=2026-09-20T08:06:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4963lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.12 seconds)4964worker1 # [ 95.858443] nix-grpc-daemon[1090]: ts=2026-09-20T08:06:26Z level=info event=scheduler_connected addr=lb:500514965worker1 # [ 95.865317] nix-grpc-daemon[1090]: ts=2026-09-20T08:06:26Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04966lb: must succeed: curl -sf localhost:9901/clusters4967lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)4968lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.22 seconds)4969(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 12.32 seconds)4970subtest: scheduler down: the other node takes the lock and keeps it4971lb: must succeed: curl -sf localhost:9901/clusters4972lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4973lb: must succeed: curl -sf localhost:9901/clusters4974lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4975lb: must succeed: curl -sf localhost:9901/clusters4976lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4977lb: must succeed: curl -sf localhost:9901/clusters4978lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4979worker1 # [ 97.171431] systemd[1]: Stopping Nix worker-protocol over gRPC...4980worker1 # [ 97.614300] nix-grpc-daemon[1090]: ts=2026-09-20T08:06:28Z level=info event=signal_exit4981worker1 # [ 97.828251] nix-grpc-daemon[1090]: ts=2026-09-20T08:06:28Z level=info event=scheduler_yield4982worker1 # [ 97.840219] nix-grpc-daemon[1090]: ts=2026-09-20T08:06:28Z level=info event=scheduler_restarting addr=lb:500514983lb # [ 97.769882] niks3-server[1112]: 2026/09/20 08:06:29 INFO lead: released remote=192.168.1.3:520504984worker1 # [ 97.846270] nix-grpc-daemon[1090]: ts=2026-09-20T08:06:28Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:343904985worker2 # [ 97.776629] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:29Z level=info event=scheduler_restarting addr=lb:500514986worker1 # [ 97.852573] nix-grpc-daemon[1090]: ts=2026-09-20T08:06:28Z level=info event=worker_gone addr=192.168.1.3:500514987worker1 # [ 97.856836] nix-grpc-daemon[1090]: ts=2026-09-20T08:06:28Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:343904988worker1 # [ 97.862162] nix-grpc-daemon[1090]: ts=2026-09-20T08:06:28Z level=info event=worker_gone addr=192.168.1.4:500514989worker1 # [ 98.041430] nix-grpc-daemon[1090]: ts=2026-09-20T08:06:28Z level=info event=scheduler_connected addr=lb:500514990worker2 # [ 97.975961] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:29Z level=info event=scheduler_connected addr=lb:500514991worker1 # [ 98.049370] nix-grpc-daemon[1090]: ts=2026-09-20T08:06:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4992worker2 # [ 97.983438] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4993worker1 # [ 98.251066] nix-grpc-daemon[1090]: ts=2026-09-20T08:06:28Z level=info event=scheduler_connected addr=lb:500514994worker2 # [ 98.185252] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:29Z level=info event=scheduler_connected addr=lb:500514995worker1 # [ 98.258977] nix-grpc-daemon[1090]: ts=2026-09-20T08:06:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4996worker2 # [ 98.194226] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4997worker1 # [ 98.460466] nix-grpc-daemon[1090]: ts=2026-09-20T08:06:28Z level=info event=scheduler_connected addr=lb:500514998worker1 # [ 98.466628] nix-grpc-daemon[1090]: ts=2026-09-20T08:06:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4999worker2 # [ 98.395347] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:29Z level=info event=scheduler_connected addr=lb:500515000worker2 # [ 98.406515] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5001worker1 # [ 98.669038] nix-grpc-daemon[1090]: ts=2026-09-20T08:06:29Z level=info event=scheduler_connected addr=lb:500515002worker1 # [ 98.675045] nix-grpc-daemon[1090]: ts=2026-09-20T08:06:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5003worker2 # [ 98.607380] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:30Z level=info event=scheduler_connected addr=lb:500515004worker2 # [ 98.612319] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5005worker1 # [ 98.834213] nix-grpc-daemon[1090]: ts=2026-09-20T08:06:29Z level=info event=scheduler_restarting5006worker2 # [ 98.817022] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:30Z level=info event=scheduler_connected addr=lb:500515007worker2 # [ 98.821634] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5008worker2 # [ 99.022803] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:30Z level=info event=scheduler_connected addr=lb:500515009worker1 # [ 99.100745] nix-grpc-daemon[1090]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5010worker1 # [ 99.105534] nix-grpc-daemon[1090]: E0000 00:00:1789891589.505592 1133 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5011worker1 # [ 99.352159] nix-grpc-daemon[1090]: E0000 00:00:1789891589.756943 1133 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5012worker1 # [ 99.361465] nix-grpc-daemon[1090]: E0000 00:00:1789891589.766622 1133 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true5013worker2 # [ 99.544850] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:30Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5014worker1 # [ 99.649176] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5015worker1 # [ 99.657166] systemd[1]: Stopped Nix worker-protocol over gRPC.5016worker1 # [ 99.659880] systemd[1]: nix-grpc-daemon.service: Consumed 221ms CPU time over 4.263s wall clock time, 10.8M memory peak, 7.4K incoming IP traffic, 7.5K outgoing IP traffic.5017worker1 # [ 99.681980] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5018worker1 # [ 99.684889] systemd[1]: Closed Nix worker-protocol over gRPC.5019worker1 # [ 99.688906] systemd[1]: nix-grpc-daemon.socket: Consumed 1ms CPU time over 4.315s wall clock time, 256K memory peak, 18.8K incoming IP traffic, 13.4K outgoing IP traffic.5020worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5021worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.10 seconds)5022worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5023worker2 # [ 99.745902] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:31Z level=info event=scheduler_connected addr=lb:500515024worker2 # [ 99.750647] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5025worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)5026worker2 # [ 99.953706] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:31Z level=info event=scheduler_connected addr=lb:500515027worker2 # [ 99.959416] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:31Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5028worker2 # [ 100.160422] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:31Z level=info event=scheduler_connected addr=lb:500515029worker2 # [ 100.168133] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5030worker2 # [ 100.369457] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:31Z level=info event=scheduler_connected addr=lb:500515031worker2 # [ 100.375117] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:31Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5032worker2 # [ 100.576227] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:31Z level=info event=scheduler_connected addr=lb:500515033lb # [ 100.587383] niks3-server[1112]: 2026/09/20 08:06:31 INFO lead: acquired remote=192.168.1.4:568445034worker2 # [ 100.584282] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5035worker2 # [ 100.590677] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:32Z level=info event=scheduler_take_over5036worker2 # [ 100.785545] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:32Z level=info event=scheduler_connected addr=lb:500515037worker2 # [ 100.791876] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:32Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05038worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5039worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.10 seconds)5040client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby >&25041client # don't know how to build these paths:5042client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5043worker2 # [ 101.233882] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:479745044worker2 # [ 101.285296] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:32Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=05045worker2 # [ 101.293490] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:32Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.4:50051 clients=15046worker2 # [ 101.332244] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479745047worker2 # [ 101.353250] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:479745048client # copying 1 paths to 'lb:50051'...5049client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...5050worker2 # [ 101.374864] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:479745051worker2 # [ 101.394031] nix-daemon[842]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5052worker2 # [ 101.622987] nix-daemon[842]: accepted connection from pid 1296, user nix-grpc-daemon (trusted)5053worker2 # [ 101.649539] nix-daemon[842]: reaped child process 1299, status = succeeded5054worker2 # [ 101.837313] nix-daemon[842]: accepted connection from pid 1301, user nix-grpc-daemon (trusted)5055worker2 # [ 101.859581] nix-daemon[842]: reaped child process 1304, status = succeeded5056lb # [ 101.874264] niks3-server[1112]: 2026/09/20 08:06:33 INFO Received uploads request method=POST path=/api/pending_closures5057worker2 # [ 101.893310] nix-grpc-daemon[1255]: time=2026-09-20T08:06:33.303Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5058worker2 # [ 101.894878] nix-grpc-daemon[1255]: time=2026-09-20T08:06:33.303Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"5059lb # [ 101.943430] niks3-server[1112]: 2026/09/20 08:06:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5060lb # [ 101.959324] niks3-server[1112]: 2026/09/20 08:06:33 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst5061lb # [ 101.983731] niks3-server[1112]: 2026/09/20 08:06:33 INFO Signed narinfos id=25 count=15062worker2 # [ 101.982799] nix-grpc-daemon[1255]: time=2026-09-20T08:06:33.393Z level=INFO msg="Uploading 1 narinfos"5063lb # [ 102.005189] niks3-server[1112]: 2026/09/20 08:06:33 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5064lb # [ 102.024614] niks3-server[1112]: 2026/09/20 08:06:33 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo5065lb # [ 102.030408] niks3-server[1112]: 2026/09/20 08:06:33 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls5066lb # [ 102.036357] niks3-server[1112]: 2026/09/20 08:06:33 INFO Completed upload id=255067worker2 # [ 102.034993] nix-grpc-daemon[1255]: time=2026-09-20T08:06:33.445Z level=INFO msg="Upload complete. (619ms)"5068worker2 # [ 102.046989] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47974 duration_s=0 paths=1 nar_bytes_in=5205069worker2 # [ 102.063054] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479745070worker2 # [ 102.079332] nix-daemon[842]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5071worker2 # [ 102.092370] nix-daemon[842]: reaped child process 1294, status = succeeded5072client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...5073client # farm-a> worker2: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5074worker2 # [ 102.101829] nix-daemon[842]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5075client # farm-a> LOG-farm-a-on-standby5076worker2 # [ 103.131080] nix-daemon[842]: reaped child process 1308, status = succeeded5077worker2 # [ 103.304172] nix-daemon[842]: accepted connection from pid 1323, user nix-grpc-daemon (trusted)5078worker2 # [ 103.325485] nix-daemon[842]: reaped child process 1326, status = succeeded5079lb # [ 103.341698] niks3-server[1112]: 2026/09/20 08:06:34 INFO Received uploads request method=POST path=/api/pending_closures5080worker2 # [ 103.356510] nix-grpc-daemon[1255]: time=2026-09-20T08:06:34.765Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5081worker2 # [ 103.358148] nix-grpc-daemon[1255]: time=2026-09-20T08:06:34.765Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"5082lb # [ 103.395646] niks3-server[1112]: 2026/09/20 08:06:34 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5083lb # [ 103.407285] niks3-server[1112]: 2026/09/20 08:06:34 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5084lb # [ 103.423427] niks3-server[1112]: 2026/09/20 08:06:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5085worker2 # [ 103.429791] nix-grpc-daemon[1255]: time=2026-09-20T08:06:34.839Z level=INFO msg="Uploading 1 narinfos"5086lb # [ 103.431584] niks3-server[1112]: 2026/09/20 08:06:34 INFO Signed narinfos id=26 count=15087lb # [ 103.439103] niks3-server[1112]: 2026/09/20 08:06:34 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls5088lb # [ 103.449643] niks3-server[1112]: 2026/09/20 08:06:34 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5089lb # [ 103.464689] niks3-server[1112]: 2026/09/20 08:06:34 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo5090lb # [ 103.470631] niks3-server[1112]: 2026/09/20 08:06:34 INFO Completed upload id=265091worker2 # [ 103.469107] nix-grpc-daemon[1255]: time=2026-09-20T08:06:34.880Z level=INFO msg="Upload complete. (352ms)"5092worker2 # [ 103.500274] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47974 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=15093worker2 # [ 103.515844] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:34Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=05094worker2 # [ 103.520594] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:34Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.4:50051 clients=15095worker2 # [ 103.525481] nix-daemon[842]: reaped child process 1306, status = succeeded5096worker2 # [ 103.545446] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479745097worker2 # [ 103.567338] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:479745098worker2 # [ 103.593192] nix-grpc-daemon[1255]: time=2026-09-20T08:06:35.004Z level=INFO msg="All 1 paths already cached"5099client # copying 1 paths to 'lb:50051'...5100client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...5101worker2 # [ 103.607233] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:479745102worker2 # [ 103.625887] nix-daemon[842]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5103worker2 # [ 103.867641] nix-daemon[842]: accepted connection from pid 1332, user nix-grpc-daemon (trusted)5104worker2 # [ 103.889565] nix-daemon[842]: reaped child process 1335, status = succeeded5105worker2 # [ 104.095343] nix-daemon[842]: accepted connection from pid 1337, user nix-grpc-daemon (trusted)5106worker2 # [ 104.118029] nix-daemon[842]: reaped child process 1340, status = succeeded5107lb # [ 104.128654] niks3-server[1112]: 2026/09/20 08:06:35 INFO Received uploads request method=POST path=/api/pending_closures5108worker2 # [ 104.141655] nix-grpc-daemon[1255]: time=2026-09-20T08:06:35.552Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5109worker2 # [ 104.143304] nix-grpc-daemon[1255]: time=2026-09-20T08:06:35.552Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"5110lb # [ 104.180955] niks3-server[1112]: 2026/09/20 08:06:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5111worker2 # [ 104.186263] nix-grpc-daemon[1255]: time=2026-09-20T08:06:35.596Z level=INFO msg="Uploading 1 narinfos"5112lb # [ 104.194727] niks3-server[1112]: 2026/09/20 08:06:35 INFO Signed narinfos id=27 count=15113lb # [ 104.203425] niks3-server[1112]: 2026/09/20 08:06:35 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5114lb # [ 104.435894] niks3-server[1112]: 2026/09/20 08:06:35 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst5115lb # [ 104.543454] niks3-server[1112]: 2026/09/20 08:06:35 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls5116lb # [ 104.593906] niks3-server[1112]: 2026/09/20 08:06:35 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo5117lb # [ 104.609200] niks3-server[1112]: 2026/09/20 08:06:36 INFO Completed upload id=275118worker2 # [ 104.609938] nix-grpc-daemon[1255]: time=2026-09-20T08:06:36.018Z level=INFO msg="Upload complete. (961ms)"5119worker2 # [ 104.617506] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47974 duration_s=1 paths=1 nar_bytes_in=6405120worker2 # [ 104.629315] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479745121worker2 # [ 104.634849] nix-daemon[842]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5122worker2 # [ 104.638966] nix-daemon[842]: reaped child process 1330, status = succeeded5123client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...5124worker2 # [ 104.650125] nix-daemon[842]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5125client # farm-b> worker2: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5126lb # [ 105.245930] envoy[895]: conn peer=[2001:db8:1::3]:38276 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1163 tx=413 ms=32425127client # farm-b> LOG-farm-b-on-standby5128worker2 # [ 105.899973] nix-daemon[842]: reaped child process 1344, status = succeeded5129worker2 # [ 106.114638] nix-daemon[842]: accepted connection from pid 1359, user nix-grpc-daemon (trusted)5130worker2 # [ 106.135832] nix-daemon[842]: reaped child process 1362, status = succeeded5131lb # [ 106.154649] niks3-server[1112]: 2026/09/20 08:06:37 INFO Received uploads request method=POST path=/api/pending_closures5132worker2 # [ 106.170146] nix-grpc-daemon[1255]: time=2026-09-20T08:06:37.579Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5133worker2 # [ 106.172250] nix-grpc-daemon[1255]: time=2026-09-20T08:06:37.579Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"5134lb # [ 106.188355] niks3-server[1112]: 2026/09/20 08:06:37 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5135lb # [ 106.203336] niks3-server[1112]: 2026/09/20 08:06:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5136worker2 # [ 106.205210] nix-grpc-daemon[1255]: time=2026-09-20T08:06:37.616Z level=INFO msg="Uploading 1 narinfos"5137lb # [ 106.212093] niks3-server[1112]: 2026/09/20 08:06:37 INFO Signed narinfos id=28 count=15138lb # [ 106.216955] niks3-server[1112]: 2026/09/20 08:06:37 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls5139lb # [ 106.219192] niks3-server[1112]: 2026/09/20 08:06:37 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst5140lb # [ 106.227455] niks3-server[1112]: 2026/09/20 08:06:37 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5141lb # [ 106.233353] niks3-server[1112]: 2026/09/20 08:06:37 INFO Completed upload id=285142worker2 # [ 106.231680] nix-grpc-daemon[1255]: time=2026-09-20T08:06:37.642Z level=INFO msg="Upload complete. (368ms)"5143lb # [ 106.235444] niks3-server[1112]: 2026/09/20 08:06:37 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo5144worker2 # [ 106.236843] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47974 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=15145worker2 # [ 106.248427] nix-daemon[842]: reaped child process 1342, status = succeeded5146worker2 # [ 106.252564] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:37Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=05147worker2 # [ 106.255227] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:37Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.4:50051 clients=15148worker2 # [ 106.302674] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479745149worker2 # [ 106.314415] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:479745150worker2 # [ 106.326255] nix-grpc-daemon[1255]: time=2026-09-20T08:06:37.737Z level=INFO msg="All 2 paths already cached"5151client # copying 1 paths to 'lb:50051'...5152client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...5153worker2 # [ 106.336118] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:479745154worker2 # [ 106.351032] nix-daemon[842]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5155worker2 # [ 106.564977] nix-daemon[842]: accepted connection from pid 1368, user nix-grpc-daemon (trusted)5156worker2 # [ 106.588251] nix-daemon[842]: reaped child process 1371, status = succeeded5157worker2 # [ 106.800209] nix-daemon[842]: accepted connection from pid 1373, user nix-grpc-daemon (trusted)5158worker2 # [ 106.825421] nix-daemon[842]: reaped child process 1376, status = succeeded5159lb # [ 106.839187] niks3-server[1112]: 2026/09/20 08:06:38 INFO Received uploads request method=POST path=/api/pending_closures5160worker2 # [ 106.860520] nix-grpc-daemon[1255]: time=2026-09-20T08:06:38.271Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5161worker2 # [ 106.862177] nix-grpc-daemon[1255]: time=2026-09-20T08:06:38.271Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"5162lb # [ 106.888148] niks3-server[1112]: 2026/09/20 08:06:38 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst5163worker2 # [ 106.907301] nix-grpc-daemon[1255]: time=2026-09-20T08:06:38.318Z level=INFO msg="Uploading 1 narinfos"5164lb # [ 106.908659] niks3-server[1112]: 2026/09/20 08:06:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5165lb # [ 106.919664] niks3-server[1112]: 2026/09/20 08:06:38 INFO Signed narinfos id=29 count=15166lb # [ 106.930574] niks3-server[1112]: 2026/09/20 08:06:38 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls5167lb # [ 106.940332] niks3-server[1112]: 2026/09/20 08:06:38 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5168worker2 # [ 106.949410] nix-grpc-daemon[1255]: time=2026-09-20T08:06:38.360Z level=INFO msg="Upload complete. (582ms)"5169lb # [ 106.951095] niks3-server[1112]: 2026/09/20 08:06:38 INFO Completed upload id=295170worker2 # [ 106.953591] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47974 duration_s=0 paths=1 nar_bytes_in=7685171lb # [ 106.955952] niks3-server[1112]: 2026/09/20 08:06:38 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo5172worker2 # [ 106.959878] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479745173worker2 # [ 106.970004] nix-daemon[842]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5174worker2 # [ 106.973940] nix-daemon[842]: reaped child process 1366, status = succeeded5175client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...5176client # farm-top> worker2: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5177worker2 # [ 106.986450] nix-daemon[842]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5178client # farm-top> LOG-farm-top-on-standby5179worker2 # [ 108.437088] nix-daemon[842]: reaped child process 1380, status = succeeded5180worker2 # [ 108.645190] nix-daemon[842]: accepted connection from pid 1395, user nix-grpc-daemon (trusted)5181worker2 # [ 108.670755] nix-daemon[842]: reaped child process 1398, status = succeeded5182lb # [ 108.687637] niks3-server[1112]: 2026/09/20 08:06:40 INFO Received uploads request method=POST path=/api/pending_closures5183worker2 # [ 108.698302] nix-grpc-daemon[1255]: time=2026-09-20T08:06:40.108Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5184worker2 # [ 108.702231] nix-grpc-daemon[1255]: time=2026-09-20T08:06:40.111Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"5185lb # [ 108.749202] niks3-server[1112]: 2026/09/20 08:06:40 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst5186lb # [ 108.762532] niks3-server[1112]: 2026/09/20 08:06:40 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5187worker2 # [ 108.775034] nix-grpc-daemon[1255]: time=2026-09-20T08:06:40.185Z level=INFO msg="Uploading 1 narinfos"5188lb # [ 108.777857] niks3-server[1112]: 2026/09/20 08:06:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5189lb # [ 108.787694] niks3-server[1112]: 2026/09/20 08:06:40 INFO Signed narinfos id=30 count=15190lb # [ 108.793360] niks3-server[1112]: 2026/09/20 08:06:40 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls5191lb # [ 108.804184] niks3-server[1112]: 2026/09/20 08:06:40 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5192lb # [ 108.811360] niks3-server[1112]: 2026/09/20 08:06:40 INFO Completed upload id=305193worker2 # [ 108.809426] nix-grpc-daemon[1255]: time=2026-09-20T08:06:40.220Z level=INFO msg="Upload complete. (411ms)"5194lb # [ 108.814512] niks3-server[1112]: 2026/09/20 08:06:40 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo5195worker2 # [ 108.825648] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47974 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=15196worker2 # [ 108.847927] nix-daemon[842]: reaped child process 1378, status = succeeded5197client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby >&2, in 7.99 seconds)5198client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby outPath5199client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag on-standby outPath, in 0.26 seconds)5200worker1 # [ 109.315212] systemd[1]: Listening on Nix worker-protocol over gRPC.5201worker1 # [ 109.327243] systemd[1]: Starting Nix worker-protocol over gRPC...5202worker1 # [ 109.547436] nix-grpc-daemon[1154]: ts=2026-09-20T08:06:39Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5203worker1 # [ 109.550464] nix-grpc-daemon[1154]: ts=2026-09-20T08:06:39Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15204worker1 # [ 109.559171] nix-grpc-daemon[1154]: ts=2026-09-20T08:06:39Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5205worker1 # [ 109.569535] systemd[1]: Started Nix worker-protocol over gRPC.5206lb: must succeed: curl -sf localhost:9901/clusters5207worker1 # [ 109.584680] nix-grpc-daemon[1154]: ts=2026-09-20T08:06:39Z level=info event=scheduler_connected addr=lb:500515208worker2 # [ 109.513339] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:40Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05209lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5210worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5211worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.10 seconds)5212lb: must succeed: curl -sf localhost:9901/clusters5213lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5214lb: must succeed: curl -sf localhost:9901/clusters5215lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5216worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5217worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.10 seconds)5218(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 13.17 seconds)5219subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5220client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs5221client # [ 110.025757] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.5222client # Running as unit: rs.service; invocation ID: 5d14c4fb9cac485ca3040a4d7cba10e55223client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.11 seconds)5224worker1 # [ 110.371272] nix-grpc-daemon[1154]: ts=2026-09-20T08:06:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:542705225worker1 # [ 110.390224] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)5226client # [ 110.335737] nix[1154]: don't know how to build these paths:5227client # [ 110.339380] nix[1154]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5228worker2 # [ 110.357867] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:41Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=05229worker2 # [ 110.365192] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:41Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.4:50051 clients=15230worker2 # [ 110.412651] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479745231worker2 # [ 110.435617] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:479745232client # [ 110.448219] nix[1154]: copying 1 paths to 'lb:50051'...5233client # [ 110.453614] nix[1154]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...5234worker2 # [ 110.458977] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:479745235worker2 # [ 110.477967] nix-daemon[842]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5236worker2 # [ 110.717222] nix-daemon[842]: accepted connection from pid 1413, user nix-grpc-daemon (trusted)5237worker2 # [ 110.739326] nix-daemon[842]: reaped child process 1416, status = succeeded5238worker2 # [ 110.946714] nix-daemon[842]: accepted connection from pid 1418, user nix-grpc-daemon (trusted)5239worker2 # [ 110.969940] nix-daemon[842]: reaped child process 1421, status = succeeded5240lb # [ 110.986924] niks3-server[1112]: 2026/09/20 08:06:42 INFO Received uploads request method=POST path=/api/pending_closures5241worker2 # [ 110.999128] nix-grpc-daemon[1255]: time=2026-09-20T08:06:42.409Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5242worker2 # [ 111.001099] nix-grpc-daemon[1255]: time=2026-09-20T08:06:42.409Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"5243lb # [ 111.014218] niks3-server[1112]: 2026/09/20 08:06:42 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst5244lb # [ 111.024435] niks3-server[1112]: 2026/09/20 08:06:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5245worker2 # [ 111.025881] nix-grpc-daemon[1255]: time=2026-09-20T08:06:42.436Z level=INFO msg="Uploading 1 narinfos"5246lb # [ 111.031880] niks3-server[1112]: 2026/09/20 08:06:42 INFO Signed narinfos id=31 count=15247lb # [ 111.034903] niks3-server[1112]: 2026/09/20 08:06:42 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls5248lb # [ 111.044400] niks3-server[1112]: 2026/09/20 08:06:42 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5249lb # [ 111.052246] niks3-server[1112]: 2026/09/20 08:06:42 INFO Completed upload id=315250lb # [ 111.054681] niks3-server[1112]: 2026/09/20 08:06:42 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5251worker2 # [ 111.050607] nix-grpc-daemon[1255]: time=2026-09-20T08:06:42.461Z level=INFO msg="Upload complete. (552ms)"5252worker2 # [ 111.056478] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47974 duration_s=0 paths=1 nar_bytes_in=4165253worker2 # [ 111.065134] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:479745254worker2 # [ 111.077429] nix-daemon[842]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5255worker2 # [ 111.082435] nix-daemon[842]: reaped child process 1411, status = succeeded5256worker2 # [ 111.093980] nix-daemon[842]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5257client # [ 111.089197] nix[1154]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5258lb: must succeed: curl -sf localhost:9901/clusters5259lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.12 seconds)5260lb: must succeed: curl -sf localhost:9901/clusters5261lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5262lb: must succeed: curl -sf localhost:9901/clusters5263lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5264lb: must succeed: curl -sf localhost:9901/clusters5265lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5266worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5267worker1 # [ 113.245651] systemd-journald[273]: Received client request to rotate journal, rotating.5268worker1 # [ 113.270388] systemd-journald[273]: Vacuuming done, freed 0B of archived journals from /var/log/journal/ce6d4eb6c7e04c7cb24724ba950982e9.5269worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.12 seconds)5270worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service5271worker2 # [ 113.253810] systemd[1]: Stopping Nix worker-protocol over gRPC...5272worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.07 seconds)5273client: must succeed: sleep 5.05274worker2 # [ 113.599284] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:45Z level=info event=draining5275lb # [ 115.244187] envoy[895]: conn peer=[2001:db8:1::1]:54220 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9540 tx=3865 ms=76615276client: (finished: must succeed: sleep 5.0, in 5.09 seconds)5277worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5278worker2 # [ 118.731009] nix-daemon[842]: reaped child process 1425, status = succeeded5279worker2 # [ 118.892717] nix-daemon[842]: accepted connection from pid 1465, user nix-grpc-daemon (trusted)5280worker2 # [ 118.914470] nix-daemon[842]: reaped child process 1468, status = succeeded5281lb # [ 118.931450] niks3-server[1112]: 2026/09/20 08:06:50 INFO Received uploads request method=POST path=/api/pending_closures5282worker2 # [ 118.943739] nix-grpc-daemon[1255]: time=2026-09-20T08:06:50.351Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5283worker2 # [ 118.945502] nix-grpc-daemon[1255]: time=2026-09-20T08:06:50.351Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5284lb # [ 118.975604] niks3-server[1112]: 2026/09/20 08:06:50 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5285lb # [ 118.991816] niks3-server[1112]: 2026/09/20 08:06:50 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5286worker2 # [ 119.000269] nix-grpc-daemon[1255]: time=2026-09-20T08:06:50.410Z level=INFO msg="Uploading 1 narinfos"5287lb # [ 119.002540] niks3-server[1112]: 2026/09/20 08:06:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5288lb # [ 119.012801] niks3-server[1112]: 2026/09/20 08:06:50 INFO Signed narinfos id=32 count=15289lb # [ 119.018555] niks3-server[1112]: 2026/09/20 08:06:50 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5290lb # [ 119.027790] niks3-server[1112]: 2026/09/20 08:06:50 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5291lb # [ 119.035707] niks3-server[1112]: 2026/09/20 08:06:50 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5292lb # [ 119.040441] niks3-server[1112]: 2026/09/20 08:06:50 INFO Completed upload id=325293worker2 # [ 119.038189] nix-grpc-daemon[1255]: time=2026-09-20T08:06:50.449Z level=INFO msg="Upload complete. (323ms)"5294worker2 # [ 119.053360] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47974 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15295worker2 # [ 119.070921] nix-daemon[842]: reaped child process 1423, status = succeeded5296client # [ 119.093139] systemd[1]: rs.service: Deactivated successfully.5297client # [ 119.099194] systemd[1]: rs.service: Consumed 191ms CPU time over 9.068s wall clock time, 39.2M memory peak, 8.5K incoming IP traffic, 9.1K outgoing IP traffic.5298worker2 # [ 119.600517] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:51Z level=info event=signal_exit5299worker2 # [ 119.616150] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:51Z level=info event=scheduler_yield5300lb # [ 119.620247] niks3-server[1112]: 2026/09/20 08:06:51 INFO lead: released remote=192.168.1.4:568445301worker2 # [ 119.628335] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:51Z level=info event=scheduler_restarting addr=lb:500515302worker1 # [ 119.705103] nix-grpc-daemon[1154]: ts=2026-09-20T08:06:50Z level=info event=scheduler_restarting addr=lb:500515303worker2 # [ 119.634500] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:51Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:479705304worker2 # [ 119.639820] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:51Z level=info event=worker_gone addr=192.168.1.4:500515305worker2 # [ 119.644085] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:51Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:479705306worker2 # [ 119.649646] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:51Z level=info event=worker_gone addr=192.168.1.3:500515307worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 1.13 seconds)5308client: waiting for success: ! systemctl is-active rs5309worker1 # [ 119.904591] nix-grpc-daemon[1154]: ts=2026-09-20T08:06:50Z level=info event=scheduler_connected addr=lb:500515310worker2 # [ 119.829754] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:51Z level=info event=scheduler_connected addr=lb:500515311worker2 # [ 119.843121] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5312worker1 # [ 119.928430] nix-grpc-daemon[1154]: ts=2026-09-20T08:06:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5313client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds)5314client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5315client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.06 seconds)5316client: must fail: journalctl -u rs | grep -q 'reconnecting'5317client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5318lb: must succeed: curl -sf localhost:9901/clusters5319worker2 # [ 120.044518] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:51Z level=info event=scheduler_connected addr=lb:500515320worker2 # [ 120.050200] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5321worker1 # [ 120.129098] nix-grpc-daemon[1154]: ts=2026-09-20T08:06:50Z level=info event=scheduler_connected addr=lb:500515322worker1 # [ 120.132966] nix-grpc-daemon[1154]: ts=2026-09-20T08:06:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5323lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5324worker2 # [ 120.252627] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:51Z level=info event=scheduler_connected addr=lb:500515325worker2 # [ 120.258038] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5326worker1 # [ 120.334028] nix-grpc-daemon[1154]: ts=2026-09-20T08:06:50Z level=info event=scheduler_connected addr=lb:500515327worker1 # [ 120.339508] nix-grpc-daemon[1154]: ts=2026-09-20T08:06:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5328worker2 # [ 120.459143] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:51Z level=info event=scheduler_connected addr=lb:500515329worker1 # [ 120.540400] nix-grpc-daemon[1154]: ts=2026-09-20T08:06:50Z level=info event=scheduler_connected addr=lb:500515330worker2 # [ 120.464972] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5331worker1 # [ 120.548165] nix-grpc-daemon[1154]: ts=2026-09-20T08:06:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5332worker2 # [ 120.622612] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:52Z level=info event=scheduler_restarting5333worker2 # [ 120.647279] nix-daemon[842]: reaped child process 1248, status = succeeded5334worker2 # [ 120.649533] nix-grpc-daemon[1199]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5335worker2 # [ 120.651716] nix-grpc-daemon[1199]: E0000 00:00:1789891612.060480 1242 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true5336worker2 # [ 120.659208] nix-grpc-daemon[1199]: E0000 00:00:1789891612.070118 1242 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5337worker1 # [ 120.751477] nix-grpc-daemon[1154]: ts=2026-09-20T08:06:51Z level=info event=scheduler_connected addr=lb:500515338worker2 # [ 120.683506] nix-grpc-daemon[1199]: ts=2026-09-20T08:06:52Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5339worker1 # [ 120.758062] nix-grpc-daemon[1154]: ts=2026-09-20T08:06:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5340worker1 # [ 120.958850] nix-grpc-daemon[1154]: ts=2026-09-20T08:06:51Z level=info event=scheduler_connected addr=lb:500515341worker2 # [ 120.887162] nix-grpc-daemon[1199]: E0000 00:00:1789891612.297945 1242 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5342lb: must succeed: curl -sf localhost:9901/clusters5343lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5344worker1 # [ 121.778879] nix-grpc-daemon[1154]: ts=2026-09-20T08:06:52Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5345worker2 # [ 121.725344] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5346worker2 # [ 121.728948] systemd[1]: Stopped Nix worker-protocol over gRPC.5347worker2 # [ 121.731500] systemd[1]: nix-grpc-daemon.service: Consumed 2.312s CPU time over 31.396s wall clock time, 33.6M memory peak, 59.1K incoming IP traffic, 116.8K outgoing IP traffic.5348worker2 # [ 121.754669] systemd[1]: Starting Nix worker-protocol over gRPC...5349worker1 # [ 121.979372] nix-grpc-daemon[1154]: ts=2026-09-20T08:06:52Z level=info event=scheduler_connected addr=lb:500515350worker1 # [ 121.988274] nix-grpc-daemon[1154]: ts=2026-09-20T08:06:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5351worker2 # [ 121.973066] nix-grpc-daemon[1475]: ts=2026-09-20T08:06:53Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5352worker2 # [ 121.975950] nix-grpc-daemon[1475]: ts=2026-09-20T08:06:53Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15353worker2 # [ 121.985735] nix-grpc-daemon[1475]: ts=2026-09-20T08:06:53Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5354worker2 # [ 121.987572] systemd[1]: Started Nix worker-protocol over gRPC.5355worker2 # [ 121.995476] nix-grpc-daemon[1475]: ts=2026-09-20T08:06:53Z level=info event=scheduler_take_over5356lb # [ 121.997860] niks3-server[1112]: 2026/09/20 08:06:53 INFO lead: acquired remote=192.168.1.4:584505357worker2 # [ 122.005571] nix-grpc-daemon[1475]: ts=2026-09-20T08:06:53Z level=info event=scheduler_connected addr=lb:500515358worker2 # [ 122.016971] nix-grpc-daemon[1475]: ts=2026-09-20T08:06:53Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05359worker1 # [ 122.189123] nix-grpc-daemon[1154]: ts=2026-09-20T08:06:52Z level=info event=scheduler_connected addr=lb:500515360worker1 # [ 122.195332] nix-grpc-daemon[1154]: ts=2026-09-20T08:06:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5361lb: must succeed: curl -sf localhost:9901/clusters5362lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5363worker1 # [ 122.396710] nix-grpc-daemon[1154]: ts=2026-09-20T08:06:52Z level=info event=scheduler_connected addr=lb:500515364worker2 # [ 122.324866] nix-grpc-daemon[1475]: ts=2026-09-20T08:06:53Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05365lb: must succeed: curl -sf localhost:9901/clusters5366lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5367worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5368worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds)5369(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.47 seconds)5370subtest: scheduler restart mid-build: build finishes, no double build5371client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5372client # [ 123.478916] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5373client # Running as unit: mid.service; invocation ID: 1e26ac6d1cd848fdb1152ec9ae8ea6515374client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.09 seconds)5375worker2 # [ 123.743020] nix-grpc-daemon[1475]: ts=2026-09-20T08:06:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:415705376worker2 # [ 123.758487] nix-daemon[842]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)5377client # [ 123.772719] nix[1190]: don't know how to build these paths:5378client # [ 123.773977] nix[1190]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5379worker2 # [ 123.787745] nix-grpc-daemon[1475]: ts=2026-09-20T08:06:55Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05380worker2 # [ 123.790647] nix-grpc-daemon[1475]: ts=2026-09-20T08:06:55Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=15381worker2 # [ 123.839977] nix-grpc-daemon[1475]: ts=2026-09-20T08:06:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:415705382worker2 # [ 123.859289] nix-grpc-daemon[1475]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 16 ms (attempt 1/5)5383worker2 # [ 123.883145] nix-grpc-daemon[1475]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 138 ms (attempt 2/5)5384worker2 # [ 124.029070] nix-grpc-daemon[1475]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 70 ms (attempt 3/5)5385worker2 # [ 124.099476] nix-grpc-daemon[1475]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 83 ms (attempt 4/5)5386worker2 # [ 124.191211] nix-grpc-daemon[1475]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5387worker2 # [ 124.214580] nix-grpc-daemon[1475]: ts=2026-09-20T08:06:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:415705388client # [ 124.224167] nix[1190]: copying 1 paths to 'lb:50051'...5389client # [ 124.230256] nix[1190]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5390worker2 # [ 124.234717] nix-grpc-daemon[1475]: ts=2026-09-20T08:06:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:415705391worker2 # [ 124.250742] nix-daemon[842]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)5392worker2 # [ 124.283336] nix-grpc-daemon[1475]: ts=2026-09-20T08:06:55Z level=info event=niks3_push_started pid=15425393worker2 # [ 124.686489] nix-daemon[842]: accepted connection from pid 1555, user nix-grpc-daemon (trusted)5394worker2 # [ 124.706761] nix-daemon[842]: reaped child process 1558, status = succeeded5395worker2 # [ 124.908806] nix-daemon[842]: accepted connection from pid 1560, user nix-grpc-daemon (trusted)5396worker2 # [ 124.929314] nix-daemon[842]: reaped child process 1567, status = succeeded5397lb # [ 124.946000] niks3-server[1112]: 2026/09/20 08:06:56 INFO Received uploads request method=POST path=/api/pending_closures5398worker2 # [ 124.954656] nix-grpc-daemon[1542]: time=2026-09-20T08:06:56.364Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5399worker2 # [ 124.956396] nix-grpc-daemon[1542]: time=2026-09-20T08:06:56.364Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5400lb # [ 124.990283] niks3-server[1112]: 2026/09/20 08:06:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5401lb # [ 125.004486] niks3-server[1112]: 2026/09/20 08:06:56 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5402lb # [ 125.009725] niks3-server[1112]: 2026/09/20 08:06:56 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5403worker2 # [ 125.018204] nix-grpc-daemon[1542]: time=2026-09-20T08:06:56.428Z level=INFO msg="Uploading 1 narinfos"5404lb # [ 125.019500] niks3-server[1112]: 2026/09/20 08:06:56 INFO Signed narinfos id=33 count=15405lb # [ 125.028603] niks3-server[1112]: 2026/09/20 08:06:56 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5406lb # [ 125.036815] niks3-server[1112]: 2026/09/20 08:06:56 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo5407lb # [ 125.048111] niks3-server[1112]: 2026/09/20 08:06:56 INFO Completed upload id=335408worker2 # [ 125.048800] nix-grpc-daemon[1542]: time=2026-09-20T08:06:56.459Z level=INFO msg="Upload complete. (539ms)"5409worker2 # [ 125.059715] nix-grpc-daemon[1475]: ts=2026-09-20T08:06:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41570 duration_s=0 paths=1 nar_bytes_in=4245410worker2 # [ 125.075957] nix-grpc-daemon[1475]: ts=2026-09-20T08:06:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:415705411worker2 # [ 125.085297] nix-daemon[842]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)5412worker2 # [ 125.088627] nix-daemon[842]: reaped child process 1540, status = succeeded5413worker2 # [ 125.101446] nix-daemon[842]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)5414client # [ 125.096975] nix[1190]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5415lb # [ 125.242197] envoy[895]: conn peer=[2001:db8:1::1]:54234 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2940 tx=1352 ms=87745416lb # [ 125.247660] envoy[895]: conn peer=[2001:db8:1::4]:50720 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=5536 tx=1819 ms=300795417lb: must succeed: curl -sf localhost:9901/clusters5418lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5419lb: must succeed: curl -sf localhost:9901/clusters5420lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5421worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5422worker2 # [ 126.348274] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1475 (nix-grpc-daemon) on client request.5423worker2 # [ 126.349906] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5424lb # [ 126.361182] niks3-server[1112]: 2026/09/20 08:06:57 INFO lead: released remote=192.168.1.4:584505425client # [ 126.354334] nix[1190]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5426worker1 # [ 126.432799] nix-grpc-daemon[1154]: ts=2026-09-20T08:06:56Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5427client # [ 126.361121] nix[1190]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5428worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.08 seconds)5429client: must succeed: sleep 5.05430worker2 # [ 126.390377] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5431worker2 # [ 126.398852] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5432worker2 # [ 126.400526] systemd[1]: nix-grpc-daemon.service: Consumed 526ms CPU time over 4.635s wall clock time, 31.5M memory peak, 11.8K incoming IP traffic, 14.9K outgoing IP traffic.5433worker2 # [ 126.408357] nix-daemon[842]: reaped child process 1533, status = succeeded5434worker2 # [ 126.410084] nix-daemon[842]: reaped child process 1569, status = succeeded5435worker2 # [ 126.420383] nix-daemon[1571]: unexpected Nix daemon error: error: interrupted by the user5436worker2 # [ 126.424702] nix-daemon[842]: reaped child process 1571, status = failed with exit code 15437worker1 # [ 126.632596] nix-grpc-daemon[1154]: ts=2026-09-20T08:06:57Z level=info event=scheduler_connected addr=lb:500515438worker2 # [ 126.562419] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5439worker2 # [ 126.575305] systemd[1]: Starting Nix worker-protocol over gRPC...5440worker2 # [ 126.790925] nix-grpc-daemon[1603]: ts=2026-09-20T08:06:58Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5441worker2 # [ 126.793467] nix-grpc-daemon[1603]: ts=2026-09-20T08:06:58Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15442worker2 # [ 126.801284] nix-grpc-daemon[1603]: ts=2026-09-20T08:06:58Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5443worker2 # [ 126.803071] systemd[1]: Started Nix worker-protocol over gRPC.5444worker2 # [ 126.823099] nix-grpc-daemon[1603]: ts=2026-09-20T08:06:58Z level=info event=scheduler_take_over5445lb # [ 126.824934] niks3-server[1112]: 2026/09/20 08:06:58 INFO lead: acquired remote=192.168.1.4:585085446worker2 # [ 126.838174] nix-grpc-daemon[1603]: ts=2026-09-20T08:06:58Z level=info event=scheduler_connected addr=lb:500515447worker1 # [ 126.910373] nix-grpc-daemon[1154]: ts=2026-09-20T08:06:57Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5448worker2 # [ 126.840549] nix-grpc-daemon[1603]: ts=2026-09-20T08:06:58Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05449worker2 # [ 126.868084] nix-grpc-daemon[1603]: ts=2026-09-20T08:06:58Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05450worker2 # [ 126.870668] nix-grpc-daemon[1603]: ts=2026-09-20T08:06:58Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=15451worker2 # [ 126.919828] nix-grpc-daemon[1603]: ts=2026-09-20T08:06:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:416205452worker2 # [ 126.931895] nix-daemon[842]: accepted connection from pid 1603, user nix-grpc-daemon (trusted)5453worker2 # [ 126.949535] nix-daemon[842]: accepted connection from pid 1603, user nix-grpc-daemon (trusted)5454worker2 # [ 126.960614] nix-daemon[842]: accepted connection from pid 1603, user nix-grpc-daemon (trusted)5455client # [ 126.955708] nix[1190]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5456worker1 # [ 127.111565] nix-grpc-daemon[1154]: ts=2026-09-20T08:06:57Z level=info event=scheduler_connected addr=lb:500515457worker2 # [ 127.039446] nix-grpc-daemon[1603]: ts=2026-09-20T08:06:58Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05458client: (finished: must succeed: sleep 5.0, in 5.07 seconds)5459client: waiting for success: ! systemctl is-active mid5460worker2 # [ 131.985379] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:03Z level=info event=niks3_push_started pid=16825461worker2 # [ 132.035343] nix-daemon[842]: reaped child process 1658, status = succeeded5462worker2 # [ 132.412656] nix-daemon[842]: accepted connection from pid 1695, user nix-grpc-daemon (trusted)5463worker2 # [ 132.430859] nix-daemon[842]: reaped child process 1698, status = succeeded5464lb # [ 132.454037] niks3-server[1112]: 2026/09/20 08:07:03 INFO Received uploads request method=POST path=/api/pending_closures5465worker2 # [ 132.465078] nix-grpc-daemon[1682]: time=2026-09-20T08:07:03.875Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5466worker2 # [ 132.466696] nix-grpc-daemon[1682]: time=2026-09-20T08:07:03.875Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5467lb # [ 132.505912] niks3-server[1112]: 2026/09/20 08:07:03 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5468lb # [ 132.518410] niks3-server[1112]: 2026/09/20 08:07:03 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5469lb # [ 132.530003] niks3-server[1112]: 2026/09/20 08:07:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5470worker2 # [ 132.534181] nix-grpc-daemon[1682]: time=2026-09-20T08:07:03.944Z level=INFO msg="Uploading 1 narinfos"5471lb # [ 132.535565] niks3-server[1112]: 2026/09/20 08:07:03 INFO Signed narinfos id=34 count=15472lb # [ 132.539391] niks3-server[1112]: 2026/09/20 08:07:03 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls5473lb # [ 132.552182] niks3-server[1112]: 2026/09/20 08:07:03 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5474lb # [ 132.560465] niks3-server[1112]: 2026/09/20 08:07:03 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo5475lb # [ 132.565126] niks3-server[1112]: 2026/09/20 08:07:03 INFO Completed upload id=345476worker2 # [ 132.563341] nix-grpc-daemon[1682]: time=2026-09-20T08:07:03.974Z level=INFO msg="Upload complete. (327ms)"5477worker2 # [ 132.580565] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41620 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15478worker2 # [ 132.595199] nix-daemon[842]: reaped child process 1656, status = succeeded5479client # [ 132.618564] systemd[1]: mid.service: Deactivated successfully.5480client # [ 132.623093] systemd[1]: mid.service: Consumed 190ms CPU time over 9.143s wall clock time, 37.2M memory peak, 9.8K incoming IP traffic, 10.7K outgoing IP traffic.5481client: (finished: waiting for success: ! systemctl is-active mid, in 1.15 seconds)5482client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5483client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.05 seconds)5484(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 9.57 seconds)5485subtest: interrupting the client stops the build on the worker5486client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5487client # [ 133.020205] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5488client # Running as unit: intr.service; invocation ID: 42c042e9633d49f7aa7039cfa9b4420e5489client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds)5490worker1 # [ 133.328666] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:03Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:542705491client # [ 133.259697] nix[1226]: don't know how to build these paths:5492client # [ 133.260963] nix[1226]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5493worker2 # [ 133.275013] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:04Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05494worker2 # [ 133.281446] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:04Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.3:50051 clients=15495worker1 # [ 133.394086] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542705496worker1 # [ 133.414945] nix-grpc-daemon[1154]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 26 ms (attempt 1/5)5497worker1 # [ 133.448923] nix-grpc-daemon[1154]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 161 ms (attempt 2/5)5498worker1 # [ 133.618061] nix-grpc-daemon[1154]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 99 ms (attempt 3/5)5499worker1 # [ 133.717380] nix-grpc-daemon[1154]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 261 ms (attempt 4/5)5500worker1 # [ 133.986873] nix-grpc-daemon[1154]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5501worker1 # [ 134.004218] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542705502client # [ 133.936505] nix[1226]: copying 1 paths to 'lb:50051'...5503worker1 # [ 134.016119] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:542705504client # [ 133.940252] nix[1226]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5505worker1 # [ 134.036770] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)5506worker1 # [ 134.068132] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:04Z level=info event=niks3_push_started pid=12845507worker1 # [ 134.497978] nix-daemon[895]: accepted connection from pid 1301, user nix-grpc-daemon (trusted)5508worker1 # [ 134.518473] nix-daemon[895]: reaped child process 1304, status = succeeded5509worker1 # [ 134.706883] nix-daemon[895]: accepted connection from pid 1306, user nix-grpc-daemon (trusted)5510worker1 # [ 134.726170] nix-daemon[895]: reaped child process 1309, status = succeeded5511lb # [ 134.666228] niks3-server[1112]: 2026/09/20 08:07:06 INFO Received uploads request method=POST path=/api/pending_closures5512worker1 # [ 134.750941] nix-grpc-daemon[1284]: time=2026-09-20T08:07:05.154Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5513worker1 # [ 134.752786] nix-grpc-daemon[1284]: time=2026-09-20T08:07:05.154Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5514lb # [ 134.704839] niks3-server[1112]: 2026/09/20 08:07:06 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5515lb # [ 134.718257] niks3-server[1112]: 2026/09/20 08:07:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5516worker1 # [ 134.799948] nix-grpc-daemon[1284]: time=2026-09-20T08:07:05.204Z level=INFO msg="Uploading 1 narinfos"5517lb # [ 134.730603] niks3-server[1112]: 2026/09/20 08:07:06 INFO Signed narinfos id=35 count=15518lb # [ 134.739761] niks3-server[1112]: 2026/09/20 08:07:06 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5519lb # [ 134.749203] niks3-server[1112]: 2026/09/20 08:07:06 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5520lb # [ 134.761580] niks3-server[1112]: 2026/09/20 08:07:06 INFO Completed upload id=355521worker1 # [ 134.834864] nix-grpc-daemon[1284]: time=2026-09-20T08:07:05.240Z level=INFO msg="Upload complete. (527ms)"5522lb # [ 134.764177] niks3-server[1112]: 2026/09/20 08:07:06 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5523worker1 # [ 134.847261] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54270 duration_s=0 paths=1 nar_bytes_in=4245524worker1 # [ 134.863110] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542705525worker1 # [ 134.869929] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)5526worker1 # [ 134.875476] nix-daemon[895]: reaped child process 1282, status = succeeded5527client # [ 134.811267] nix[1226]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5528worker1 # [ 134.892304] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)5529lb # [ 135.242127] envoy[895]: conn peer=[2001:db8:1::4]:47388 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=470 tx=226 ms=43565530lb # [ 135.247391] envoy[895]: conn peer=[2001:db8:1::1]:46906 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3845 tx=1702 ms=88515531client: must succeed: systemctl kill -s INT intr5532client # [ 136.732871] systemd[1]: intr.service: Sent signal SIGINT to main process 1226 (nix) on client request.5533worker1 # [ 136.817445] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:07Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5534client # [ 136.740599] nix[1226]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5535client # [ 136.744515] nix[1226]: error: interrupted by the user5536client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds)5537client # [ 136.785835] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5538client # [ 136.788509] systemd[1]: intr.service: Failed with result 'exit-code'.5539client # [ 136.791650] systemd[1]: intr.service: Consumed 152ms CPU time over 3.770s wall clock time, 39.2M memory peak, 7.6K incoming IP traffic, 8.8K outgoing IP traffic.5540worker1 # [ 136.922948] nix-daemon[895]: reaped child process 1311, status = succeeded5541worker1 # [ 136.928782] nix-daemon[1313]: unexpected Nix daemon error: error: interrupted by the user5542worker1 # [ 136.936167] nix-daemon[895]: reaped child process 1313, status = failed with exit code 15543(finished: subtest: interrupting the client stops the build on the worker, in 5.09 seconds)5544subtest: a deploy mid-build drains: the build finishes, the new generation takes over5545client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5546client # [ 138.146600] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5547client # Running as unit: sw.service; invocation ID: 4e88f2303de84334a2c132e52657369a5548client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.11 seconds)5549client # [ 138.396756] nix[1246]: don't know how to build these paths:5550client # [ 138.397909] nix[1246]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5551worker1 # [ 138.474704] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:542705552worker2 # [ 138.417494] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:09Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05553worker2 # [ 138.423288] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:09Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.4:50051 clients=15554worker2 # [ 138.463563] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:416205555worker2 # [ 138.480999] nix-grpc-daemon[1603]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 43 ms (attempt 1/5)5556worker2 # [ 138.532034] nix-grpc-daemon[1603]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 143 ms (attempt 2/5)5557worker2 # [ 138.675729] nix-grpc-daemon[1603]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 51 ms (attempt 3/5)5558worker2 # [ 138.734798] nix-grpc-daemon[1603]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 770 ms (attempt 4/5)5559worker2 # [ 139.514544] nix-grpc-daemon[1603]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5560worker2 # [ 139.536541] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:416205561client # [ 139.547273] nix[1246]: copying 1 paths to 'lb:50051'...5562worker2 # [ 139.555035] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:416205563client # [ 139.553861] nix[1246]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5564worker2 # [ 139.570631] nix-daemon[842]: accepted connection from pid 1603, user nix-grpc-daemon (trusted)5565worker2 # [ 139.768611] nix-daemon[842]: accepted connection from pid 1741, user nix-grpc-daemon (trusted)5566worker2 # [ 139.791492] nix-daemon[842]: reaped child process 1744, status = succeeded5567worker2 # [ 139.979601] nix-daemon[842]: accepted connection from pid 1746, user nix-grpc-daemon (trusted)5568worker2 # [ 140.002234] nix-daemon[842]: reaped child process 1749, status = succeeded5569lb # [ 140.016979] niks3-server[1112]: 2026/09/20 08:07:11 INFO Received uploads request method=POST path=/api/pending_closures5570worker2 # [ 140.027303] nix-grpc-daemon[1682]: time=2026-09-20T08:07:11.437Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5571worker2 # [ 140.029017] nix-grpc-daemon[1682]: time=2026-09-20T08:07:11.437Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5572lb # [ 140.051084] niks3-server[1112]: 2026/09/20 08:07:11 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5573worker2 # [ 140.064703] nix-grpc-daemon[1682]: time=2026-09-20T08:07:11.475Z level=INFO msg="Uploading 1 narinfos"5574lb # [ 140.066259] niks3-server[1112]: 2026/09/20 08:07:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5575lb # [ 140.077481] niks3-server[1112]: 2026/09/20 08:07:11 INFO Signed narinfos id=36 count=15576lb # [ 140.084573] niks3-server[1112]: 2026/09/20 08:07:11 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5577lb # [ 140.095273] niks3-server[1112]: 2026/09/20 08:07:11 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5578lb # [ 140.103748] niks3-server[1112]: 2026/09/20 08:07:11 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5579lb # [ 140.110568] niks3-server[1112]: 2026/09/20 08:07:11 INFO Completed upload id=365580worker2 # [ 140.108994] nix-grpc-daemon[1682]: time=2026-09-20T08:07:11.520Z level=INFO msg="Upload complete. (523ms)"5581worker2 # [ 140.119033] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41620 duration_s=0 paths=1 nar_bytes_in=4165582worker2 # [ 140.136675] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:416205583worker2 # [ 140.140431] nix-daemon[842]: accepted connection from pid 1603, user nix-grpc-daemon (trusted)5584worker2 # [ 140.148248] nix-daemon[842]: reaped child process 1739, status = succeeded5585client # [ 140.153888] nix[1246]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5586worker2 # [ 140.161607] nix-daemon[842]: accepted connection from pid 1603, user nix-grpc-daemon (trusted)5587worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&25588worker2 # Checking switch inhibitors... done5589worker2 # [ 142.855563] nixos[1784]: switching to system configuration /nix/store/8ffha6vy7p357xaxfdqywjrqi4pvmmmi-nixos-system-worker2-test5590worker2 # [ 142.862099] systemd[1]: Stopped target Remote File Systems.5591worker2 # [ 142.863077] systemd[1]: Stopped target Local File Systems.5592worker2 # activating the configuration...5593worker2 # setting up /etc...5594worker2 # [ 143.664820] systemd[1]: Reload requested from client PID 1784 ('.switch-to-conf') (unit backdoor.service)...5595worker2 # [ 143.667676] systemd[1]: Reloading...5596worker2 # [ 144.553651] systemd[1]: Reloading finished in 883 ms.5597worker2 # restarting sysinit-reactivation.target5598worker2 # [ 144.637805] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....5599worker2 # [ 144.793318] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..5600worker2 # [ 144.800383] systemd[1]: Reached target Reactivate sysinit units.5601worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service5602worker2 # [ 144.804959] systemd[1]: Reloading D-Bus System Message Bus...5603worker2 # [ 144.810590] dbus-broker-launch[499]: Caught SIGHUP, trigger reload.5604worker2 # [ 144.820784] systemd[1]: Reloading Nix worker-protocol over gRPC...5605worker2 # [ 144.853738] dbus-broker-launch[499]: Looking up NSS user entry for 'systemd-timesync'...5606worker2 # [ 144.856491] dbus-broker-launch[499]: NSS returned no entry for 'systemd-timesync'5607worker2 # [ 144.859077] dbus-broker-launch[499]: Invalid user-name in /nix/store/c8a4kacp5lnfwrcxrjmwczbl8ba32m4a-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"5608worker2 # [ 144.868746] systemd[1]: Reloaded Nix worker-protocol over gRPC.5609worker2 # [ 144.906527] systemd[1]: Reloaded D-Bus System Message Bus.5610worker2 # [ 144.910793] systemd[1]: Reached target Local File Systems.5611worker2 # [ 144.911694] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore5612worker2 # [ 144.919822] systemd[1]: Starting Create SUID/SGID Wrappers...5613worker2 # [ 144.932623] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.5614worker2 # [ 144.933843] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc675615worker2 # [ 144.945212] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore5616worker2 # [ 144.946787] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5617worker2 # [ 144.948215] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5618worker2 # [ 144.949432] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os5619worker2 # [ 144.956404] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki5620worker2 # [ 144.957855] systemd[1]: Reached target Remote File Systems.5621lb # [ 145.242596] envoy[895]: conn peer=[2001:db8:1::1]:60168 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=730 ms=35155622worker2 # [ 145.435306] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.5623worker2 # [ 145.439065] systemd[1]: Finished Create SUID/SGID Wrappers.5624worker2 # [ 145.444378] systemd[1]: Starting linger-users.service...5625worker2 # [ 145.500850] systemd[1]: linger-users.service: Deactivated successfully.5626worker2 # [ 145.501944] systemd[1]: Finished linger-users.service.5627worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service5628worker2 # [ 145.754762] nixos[1784]: finished switching to system configuration /nix/store/8ffha6vy7p357xaxfdqywjrqi4pvmmmi-nixos-system-worker2-test5629worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 3.76 seconds)5630worker2: must succeed: pgrep -f 'read -t [9]0 x'5631worker2 # [ 145.819382] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:17Z level=info event=draining5632worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.07 seconds)5633client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain >&25634client # don't know how to build these paths:5635client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5636worker1 # [ 146.179899] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:16Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:542705637worker2 # [ 146.116797] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:17Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05638worker2 # [ 146.118834] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:17Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.3:50051 clients=15639worker1 # [ 146.245028] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542705640worker1 # [ 146.266973] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542705641client # copying 1 paths to 'lb:50051'...5642worker1 # [ 146.286527] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:542705643client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5644worker1 # [ 146.317280] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)5645worker1 # [ 146.535928] nix-daemon[895]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)5646worker1 # [ 146.559394] nix-daemon[895]: reaped child process 1370, status = succeeded5647worker1 # [ 146.737256] nix-daemon[895]: accepted connection from pid 1372, user nix-grpc-daemon (trusted)5648worker1 # [ 146.758611] nix-daemon[895]: reaped child process 1375, status = succeeded5649lb # [ 146.703085] niks3-server[1112]: 2026/09/20 08:07:18 INFO Received uploads request method=POST path=/api/pending_closures5650worker1 # [ 146.863473] nix-grpc-daemon[1284]: time=2026-09-20T08:07:17.267Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5651worker1 # [ 146.866864] nix-grpc-daemon[1284]: time=2026-09-20T08:07:17.267Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5652lb # [ 146.818862] niks3-server[1112]: 2026/09/20 08:07:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5653worker1 # [ 146.904442] nix-grpc-daemon[1284]: time=2026-09-20T08:07:17.308Z level=INFO msg="Uploading 1 narinfos"5654lb # [ 146.834126] niks3-server[1112]: 2026/09/20 08:07:18 INFO Signed narinfos id=37 count=15655lb # [ 146.846067] niks3-server[1112]: 2026/09/20 08:07:18 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5656lb # [ 146.869011] niks3-server[1112]: 2026/09/20 08:07:18 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5657lb # [ 146.883049] niks3-server[1112]: 2026/09/20 08:07:18 INFO Completed upload id=375658worker1 # [ 146.953114] nix-grpc-daemon[1284]: time=2026-09-20T08:07:17.358Z level=INFO msg="Upload complete. (616ms)"5659lb # [ 146.889747] niks3-server[1112]: 2026/09/20 08:07:18 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5660worker1 # [ 146.964741] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54270 duration_s=0 paths=1 nar_bytes_in=5285661lb # [ 146.897732] niks3-server[1112]: 2026/09/20 08:07:18 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5662worker1 # [ 146.984534] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542705663worker1 # [ 146.996411] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)5664worker1 # [ 147.003974] nix-daemon[895]: reaped child process 1365, status = succeeded5665client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5666client # farm-a> node-a: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5667worker1 # [ 147.024954] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)5668client # farm-a> LOG-farm-a-during-drain5669worker1 # [ 148.265842] nix-daemon[895]: reaped child process 1379, status = succeeded5670worker1 # [ 148.444953] nix-daemon[895]: accepted connection from pid 1394, user nix-grpc-daemon (trusted)5671worker1 # [ 148.464903] nix-daemon[895]: reaped child process 1397, status = succeeded5672lb # [ 148.404734] niks3-server[1112]: 2026/09/20 08:07:19 INFO Received uploads request method=POST path=/api/pending_closures5673worker1 # [ 148.492332] nix-grpc-daemon[1284]: time=2026-09-20T08:07:18.894Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5674worker1 # [ 148.494031] nix-grpc-daemon[1284]: time=2026-09-20T08:07:18.894Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5675lb # [ 148.449054] niks3-server[1112]: 2026/09/20 08:07:19 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5676lb # [ 148.463518] niks3-server[1112]: 2026/09/20 08:07:19 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5677lb # [ 148.473946] niks3-server[1112]: 2026/09/20 08:07:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5678worker1 # [ 148.553886] nix-grpc-daemon[1284]: time=2026-09-20T08:07:18.957Z level=INFO msg="Uploading 1 narinfos"5679lb # [ 148.485416] niks3-server[1112]: 2026/09/20 08:07:19 INFO Signed narinfos id=38 count=15680lb # [ 148.490598] niks3-server[1112]: 2026/09/20 08:07:19 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5681lb # [ 148.503413] niks3-server[1112]: 2026/09/20 08:07:19 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5682lb # [ 148.511372] niks3-server[1112]: 2026/09/20 08:07:19 INFO Completed upload id=385683worker1 # [ 148.587118] nix-grpc-daemon[1284]: time=2026-09-20T08:07:18.992Z level=INFO msg="Upload complete. (346ms)"5684lb # [ 148.516680] niks3-server[1112]: 2026/09/20 08:07:19 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo5685worker2 # [ 148.528791] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:19Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05686worker2 # [ 148.530621] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:19Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.3:50051 clients=15687worker1 # [ 148.599637] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54270 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=15688worker1 # [ 148.622309] nix-daemon[895]: reaped child process 1377, status = succeeded5689worker1 # [ 148.656448] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542705690worker1 # [ 148.673786] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542705691worker1 # [ 148.692800] nix-grpc-daemon[1284]: time=2026-09-20T08:07:19.097Z level=INFO msg="All 1 paths already cached"5692client # copying 1 paths to 'lb:50051'...5693worker1 # [ 148.703976] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:542705694client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5695worker1 # [ 148.724708] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)5696worker1 # [ 148.937142] nix-daemon[895]: accepted connection from pid 1401, user nix-grpc-daemon (trusted)5697worker1 # [ 148.958735] nix-daemon[895]: reaped child process 1404, status = succeeded5698worker1 # [ 149.144329] nix-daemon[895]: accepted connection from pid 1406, user nix-grpc-daemon (trusted)5699worker1 # [ 149.165781] nix-daemon[895]: reaped child process 1409, status = succeeded5700lb # [ 149.105069] niks3-server[1112]: 2026/09/20 08:07:20 INFO Received uploads request method=POST path=/api/pending_closures5701worker1 # [ 149.188913] nix-grpc-daemon[1284]: time=2026-09-20T08:07:19.593Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5702worker1 # [ 149.190443] nix-grpc-daemon[1284]: time=2026-09-20T08:07:19.593Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"5703lb # [ 149.134695] niks3-server[1112]: 2026/09/20 08:07:20 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst5704lb # [ 149.151842] niks3-server[1112]: 2026/09/20 08:07:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5705worker1 # [ 149.231499] nix-grpc-daemon[1284]: time=2026-09-20T08:07:19.636Z level=INFO msg="Uploading 1 narinfos"5706lb # [ 149.166122] niks3-server[1112]: 2026/09/20 08:07:20 INFO Signed narinfos id=39 count=15707lb # [ 149.177469] niks3-server[1112]: 2026/09/20 08:07:20 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls5708worker1 # [ 149.258486] nix-grpc-daemon[1284]: time=2026-09-20T08:07:19.663Z level=INFO msg="Upload complete. (515ms)"5709lb # [ 149.186808] niks3-server[1112]: 2026/09/20 08:07:20 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5710lb # [ 149.192391] niks3-server[1112]: 2026/09/20 08:07:20 INFO Completed upload id=395711lb # [ 149.195487] niks3-server[1112]: 2026/09/20 08:07:20 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo5712worker1 # [ 149.269036] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54270 duration_s=0 paths=1 nar_bytes_in=6405713worker1 # [ 149.279661] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542705714worker1 # [ 149.287299] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)5715worker1 # [ 149.292184] nix-daemon[895]: reaped child process 1399, status = succeeded5716client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...5717client # farm-b> node-a: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5718worker1 # [ 149.305860] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)5719client # farm-b> LOG-farm-b-during-drain5720worker1 # [ 150.333370] nix-daemon[895]: reaped child process 1413, status = succeeded5721worker1 # [ 150.501445] nix-daemon[895]: accepted connection from pid 1428, user nix-grpc-daemon (trusted)5722worker1 # [ 150.522893] nix-daemon[895]: reaped child process 1431, status = succeeded5723lb # [ 150.466326] niks3-server[1112]: 2026/09/20 08:07:21 INFO Received uploads request method=POST path=/api/pending_closures5724worker1 # [ 150.548045] nix-grpc-daemon[1284]: time=2026-09-20T08:07:20.952Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5725worker1 # [ 150.550468] nix-grpc-daemon[1284]: time=2026-09-20T08:07:20.955Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"5726lb # [ 150.510549] niks3-server[1112]: 2026/09/20 08:07:21 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst5727worker1 # [ 150.598855] nix-grpc-daemon[1284]: time=2026-09-20T08:07:21.003Z level=INFO msg="Uploading 1 narinfos"5728lb # [ 150.525622] niks3-server[1112]: 2026/09/20 08:07:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5729lb # [ 150.534316] niks3-server[1112]: 2026/09/20 08:07:21 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5730lb # [ 150.540258] niks3-server[1112]: 2026/09/20 08:07:21 INFO Signed narinfos id=40 count=15731lb # [ 150.546434] niks3-server[1112]: 2026/09/20 08:07:21 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls5732lb # [ 150.550736] niks3-server[1112]: 2026/09/20 08:07:21 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5733lb # [ 150.556433] niks3-server[1112]: 2026/09/20 08:07:21 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo5734lb # [ 150.566354] niks3-server[1112]: 2026/09/20 08:07:21 INFO Completed upload id=405735worker1 # [ 150.639497] nix-grpc-daemon[1284]: time=2026-09-20T08:07:21.044Z level=INFO msg="Upload complete. (323ms)"5736worker2 # [ 150.584045] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:21Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=05737worker1 # [ 150.653287] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54270 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=15738worker2 # [ 150.586000] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:21Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.3:50051 clients=15739worker1 # [ 150.674216] nix-daemon[895]: reaped child process 1411, status = succeeded5740worker1 # [ 150.702044] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542705741worker1 # [ 150.719252] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542705742worker1 # [ 150.736428] nix-grpc-daemon[1284]: time=2026-09-20T08:07:21.141Z level=INFO msg="All 2 paths already cached"5743client # copying 1 paths to 'lb:50051'...5744client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...5745worker1 # [ 150.748869] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:542705746worker1 # [ 150.765452] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)5747worker1 # [ 151.005863] nix-daemon[895]: accepted connection from pid 1435, user nix-grpc-daemon (trusted)5748worker1 # [ 151.028627] nix-daemon[895]: reaped child process 1438, status = succeeded5749worker1 # [ 151.230831] nix-daemon[895]: accepted connection from pid 1440, user nix-grpc-daemon (trusted)5750worker1 # [ 151.253195] nix-daemon[895]: reaped child process 1443, status = succeeded5751lb # [ 151.194415] niks3-server[1112]: 2026/09/20 08:07:22 INFO Received uploads request method=POST path=/api/pending_closures5752worker1 # [ 151.284646] nix-grpc-daemon[1284]: time=2026-09-20T08:07:21.689Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5753worker1 # [ 151.286270] nix-grpc-daemon[1284]: time=2026-09-20T08:07:21.689Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"5754lb # [ 151.241857] niks3-server[1112]: 2026/09/20 08:07:22 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst5755lb # [ 151.259031] niks3-server[1112]: 2026/09/20 08:07:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5756worker1 # [ 151.337713] nix-grpc-daemon[1284]: time=2026-09-20T08:07:21.742Z level=INFO msg="Uploading 1 narinfos"5757lb # [ 151.272984] niks3-server[1112]: 2026/09/20 08:07:22 INFO Signed narinfos id=41 count=15758lb # [ 151.279462] niks3-server[1112]: 2026/09/20 08:07:22 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls5759lb # [ 151.287944] niks3-server[1112]: 2026/09/20 08:07:22 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5760lb # [ 151.295216] niks3-server[1112]: 2026/09/20 08:07:22 INFO Completed upload id=415761worker1 # [ 151.368080] nix-grpc-daemon[1284]: time=2026-09-20T08:07:21.773Z level=INFO msg="Upload complete. (577ms)"5762lb # [ 151.298190] niks3-server[1112]: 2026/09/20 08:07:22 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo5763worker1 # [ 151.379999] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54270 duration_s=0 paths=1 nar_bytes_in=7685764worker1 # [ 151.395136] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542705765worker1 # [ 151.411207] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)5766worker1 # [ 151.418311] nix-daemon[895]: reaped child process 1433, status = succeeded5767client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...5768worker1 # [ 151.428923] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)5769client # farm-top> node-a: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5770client # farm-top> LOG-farm-top-during-drain5771worker1 # [ 152.673694] nix-daemon[895]: reaped child process 1447, status = succeeded5772worker1 # [ 152.863454] nix-daemon[895]: accepted connection from pid 1462, user nix-grpc-daemon (trusted)5773worker1 # [ 152.888151] nix-daemon[895]: reaped child process 1465, status = succeeded5774lb # [ 152.835614] niks3-server[1112]: 2026/09/20 08:07:24 INFO Received uploads request method=POST path=/api/pending_closures5775worker1 # [ 152.918974] nix-grpc-daemon[1284]: time=2026-09-20T08:07:23.323Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5776worker1 # [ 152.922326] nix-grpc-daemon[1284]: time=2026-09-20T08:07:23.323Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"5777lb # [ 152.896699] niks3-server[1112]: 2026/09/20 08:07:24 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5778lb # [ 152.911274] niks3-server[1112]: 2026/09/20 08:07:24 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst5779lb # [ 152.925522] niks3-server[1112]: 2026/09/20 08:07:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5780lb # [ 152.934057] niks3-server[1112]: 2026/09/20 08:07:24 INFO Signed narinfos id=42 count=15781worker1 # [ 153.007301] nix-grpc-daemon[1284]: time=2026-09-20T08:07:23.411Z level=INFO msg="Uploading 1 narinfos"5782lb # [ 152.939837] niks3-server[1112]: 2026/09/20 08:07:24 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls5783lb # [ 152.956925] niks3-server[1112]: 2026/09/20 08:07:24 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5784lb # [ 152.960519] niks3-server[1112]: 2026/09/20 08:07:24 INFO Completed upload id=425785lb # [ 152.962360] niks3-server[1112]: 2026/09/20 08:07:24 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo5786worker1 # [ 153.033416] nix-grpc-daemon[1284]: time=2026-09-20T08:07:23.438Z level=INFO msg="Upload complete. (389ms)"5787worker1 # [ 153.045420] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54270 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=15788worker1 # [ 153.070999] nix-daemon[895]: reaped child process 1445, status = succeeded5789client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain >&2, in 7.19 seconds)5790client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain outPath5791client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag during-drain outPath, in 0.28 seconds)5792worker2: must succeed: pkill -f 'read -t [9]0 x'5793worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.07 seconds)5794client: waiting for success: ! systemctl is-active sw5795worker2 # [ 153.407330] nix-daemon[842]: reaped child process 1753, status = succeeded5796worker2 # [ 153.580872] nix-daemon[842]: accepted connection from pid 1930, user nix-grpc-daemon (trusted)5797worker2 # [ 153.606022] nix-daemon[842]: reaped child process 1933, status = succeeded5798lb # [ 153.616281] niks3-server[1112]: 2026/09/20 08:07:25 INFO Received uploads request method=POST path=/api/pending_closures5799worker2 # [ 153.627749] nix-grpc-daemon[1682]: time=2026-09-20T08:07:25.037Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5800worker2 # [ 153.629695] nix-grpc-daemon[1682]: time=2026-09-20T08:07:25.037Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"5801lb # [ 153.675252] niks3-server[1112]: 2026/09/20 08:07:25 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5802lb # [ 153.685483] niks3-server[1112]: 2026/09/20 08:07:25 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5803lb # [ 153.694609] niks3-server[1112]: 2026/09/20 08:07:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5804worker2 # [ 153.698979] nix-grpc-daemon[1682]: time=2026-09-20T08:07:25.108Z level=INFO msg="Uploading 1 narinfos"5805lb # [ 153.701712] niks3-server[1112]: 2026/09/20 08:07:25 INFO Signed narinfos id=43 count=15806lb # [ 153.709323] niks3-server[1112]: 2026/09/20 08:07:25 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls5807lb # [ 153.723765] niks3-server[1112]: 2026/09/20 08:07:25 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5808worker2 # [ 153.726574] nix-grpc-daemon[1682]: time=2026-09-20T08:07:25.137Z level=INFO msg="Upload complete. (335ms)"5809lb # [ 153.731707] niks3-server[1112]: 2026/09/20 08:07:25 INFO Completed upload id=435810lb # [ 153.736669] niks3-server[1112]: 2026/09/20 08:07:25 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo5811worker2 # [ 153.745392] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41620 duration_s=13 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=15812worker2 # [ 153.765718] nix-daemon[842]: reaped child process 1751, status = succeeded5813client # [ 153.786924] systemd[1]: sw.service: Deactivated successfully.5814client # [ 153.794299] systemd[1]: sw.service: Consumed 175ms CPU time over 15.644s wall clock time, 37M memory peak, 8.7K incoming IP traffic, 9K outgoing IP traffic.5815worker2 # [ 153.823395] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:25Z level=info event=signal_exit5816worker2 # [ 154.049722] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:25Z level=info event=scheduler_yield5817lb # [ 154.057412] niks3-server[1112]: 2026/09/20 08:07:25 INFO lead: released remote=192.168.1.4:585085818worker1 # [ 154.129914] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:24Z level=info event=scheduler_restarting addr=lb:500515819worker2 # [ 154.055823] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:25Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:415845820worker2 # [ 154.061030] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:25Z level=info event=worker_gone addr=192.168.1.3:500515821worker2 # [ 154.068531] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:25Z level=info event=scheduler_restarting addr=lb:500515822worker2 # [ 154.075510] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:25Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:415845823worker2 # [ 154.080423] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:25Z level=info event=worker_gone addr=192.168.1.4:500515824worker1 # [ 154.329955] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:24Z level=info event=scheduler_connected addr=lb:500515825worker1 # [ 154.338638] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5826worker2 # [ 154.269491] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:25Z level=info event=scheduler_connected addr=lb:500515827worker2 # [ 154.282796] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5828worker1 # [ 154.543886] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:24Z level=info event=scheduler_connected addr=lb:500515829worker1 # [ 154.549823] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5830worker2 # [ 154.484109] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:25Z level=info event=scheduler_connected addr=lb:500515831lb # [ 154.497397] niks3-server[1112]: 2026/09/20 08:07:25 INFO lead: acquired remote=192.168.1.3:367945832worker2 # [ 154.492326] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5833worker1 # [ 154.570870] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:24Z level=info event=scheduler_take_over5834client: (finished: waiting for success: ! systemctl is-active sw, in 1.14 seconds)5835client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5836client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.07 seconds)5837worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5838worker1 # [ 154.750680] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:25Z level=info event=scheduler_connected addr=lb:500515839worker1 # [ 154.757252] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:25Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05840worker2 # [ 154.693248] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:26Z level=info event=scheduler_connected addr=lb:500515841worker2 # [ 154.698135] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5842worker2 # [ 154.901022] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:26Z level=info event=scheduler_connected addr=lb:500515843worker1 # [ 154.976549] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:25Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=0 running=05844worker2 # [ 155.057301] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:26Z level=info event=scheduler_restarting5845worker1 # [ 155.142308] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:25Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:393265846worker1 # [ 155.147953] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:25Z level=info event=worker_gone addr=192.168.1.4:500515847worker2 # [ 155.084976] nix-grpc-daemon[1603]: ts=2026-09-20T08:07:26Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5848worker2 # [ 155.106216] nix-daemon[842]: reaped child process 1654, status = succeeded5849lb # [ 155.243903] envoy[895]: conn peer=[2001:db8:1::1]:52898 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9542 tx=3837 ms=68875850lb # [ 155.244548] envoy[895]: conn peer=[2001:db8:1::1]:60180 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2952 tx=1377 ms=153585851lb # [ 155.244872] envoy[895]: conn peer=[2001:db8:1::4]:47392 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1414 tx=501 ms=282465852worker2 # [ 155.885510] nix-grpc-daemon[1603]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5853worker2 # [ 155.890613] nix-grpc-daemon[1603]: E0000 00:00:1789891647.295967 1646 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5854worker2 # [ 155.897607] nix-grpc-daemon[1603]: E0000 00:00:1789891647.296529 1646 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5855worker2 # [ 156.865169] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5856worker2 # [ 156.869968] systemd[1]: nix-grpc-daemon.service: Consumed 961ms CPU time over 30.472s wall clock time, 31.9M memory peak, 23.4K incoming IP traffic, 31.9K outgoing IP traffic.5857worker2 # [ 156.894501] systemd[1]: Starting Nix worker-protocol over gRPC...5858worker2 # [ 157.106457] nix-grpc-daemon[1947]: ts=2026-09-20T08:07:28Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5859worker2 # [ 157.109299] nix-grpc-daemon[1947]: ts=2026-09-20T08:07:28Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15860worker2 # [ 157.117371] nix-grpc-daemon[1947]: ts=2026-09-20T08:07:28Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5861worker2 # [ 157.119225] systemd[1]: Started Nix worker-protocol over gRPC.5862worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.55 seconds)5863lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5864lb: must succeed: curl -sf localhost:9901/clusters5865worker2 # [ 157.145808] nix-grpc-daemon[1947]: ts=2026-09-20T08:07:28Z level=info event=scheduler_connected addr=lb:500515866worker1 # [ 157.227366] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:27Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05867lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)5868lb: must succeed: curl -sf localhost:9901/clusters5869lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5870lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.21 seconds)5871lb: must succeed: curl -sf localhost:9901/clusters5872lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5873worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5874worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.10 seconds)5875(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 20.44 seconds)5876subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5877client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15878worker1 # [ 158.898413] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:29Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:542705879worker1 # [ 158.917764] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:29Z level=debug event=want client=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=05880worker1 # [ 158.926019] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:29Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=15881worker1 # [ 158.932482] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:29Z level=debug event=want client=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=05882worker1 # [ 158.937924] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:29Z level=debug event=want client=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=05883worker1 # [ 158.966533] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542705884worker1 # [ 158.986182] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542705885worker1 # [ 159.007212] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:542705886worker1 # [ 159.026467] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)5887worker1 # [ 159.271805] nix-daemon[895]: accepted connection from pid 1476, user nix-grpc-daemon (trusted)5888worker1 # [ 159.294938] nix-daemon[895]: reaped child process 1479, status = succeeded5889worker1 # [ 159.497976] nix-daemon[895]: accepted connection from pid 1481, user nix-grpc-daemon (trusted)5890worker1 # [ 159.520710] nix-daemon[895]: reaped child process 1484, status = succeeded5891lb # [ 159.463385] niks3-server[1112]: 2026/09/20 08:07:30 INFO Received uploads request method=POST path=/api/pending_closures5892worker1 # [ 159.547946] nix-grpc-daemon[1284]: time=2026-09-20T08:07:29.952Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5893worker1 # [ 159.549790] nix-grpc-daemon[1284]: time=2026-09-20T08:07:29.952Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"5894lb # [ 159.516530] niks3-server[1112]: 2026/09/20 08:07:30 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst5895worker1 # [ 159.602310] nix-grpc-daemon[1284]: time=2026-09-20T08:07:30.007Z level=INFO msg="Uploading 1 narinfos"5896lb # [ 159.529452] niks3-server[1112]: 2026/09/20 08:07:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5897lb # [ 159.538809] niks3-server[1112]: 2026/09/20 08:07:30 INFO Signed narinfos id=44 count=15898lb # [ 159.543769] niks3-server[1112]: 2026/09/20 08:07:30 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls5899lb # [ 159.551649] niks3-server[1112]: 2026/09/20 08:07:30 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5900lb # [ 159.563996] niks3-server[1112]: 2026/09/20 08:07:30 INFO Completed upload id=445901lb # [ 159.567431] niks3-server[1112]: 2026/09/20 08:07:30 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo5902worker1 # [ 159.635896] nix-grpc-daemon[1284]: time=2026-09-20T08:07:30.041Z level=INFO msg="Upload complete. (591ms)"5903worker1 # [ 159.648726] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54270 duration_s=0 paths=1 nar_bytes_in=5125904worker1 # [ 159.668466] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542705905worker1 # [ 159.682482] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)5906worker1 # [ 159.690121] nix-daemon[895]: reaped child process 1474, status = succeeded5907worker1 # [ 159.712520] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)5908worker1 # [ 160.740314] nix-daemon[895]: reaped child process 1488, status = succeeded5909worker1 # [ 160.939077] nix-daemon[895]: accepted connection from pid 1503, user nix-grpc-daemon (trusted)5910worker1 # [ 160.960373] nix-daemon[895]: reaped child process 1506, status = succeeded5911lb # [ 160.905062] niks3-server[1112]: 2026/09/20 08:07:32 INFO Received uploads request method=POST path=/api/pending_closures5912worker1 # [ 160.991996] nix-grpc-daemon[1284]: time=2026-09-20T08:07:31.394Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5913worker1 # [ 160.993697] nix-grpc-daemon[1284]: time=2026-09-20T08:07:31.394Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"5914lb # [ 160.961682] niks3-server[1112]: 2026/09/20 08:07:32 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5915lb # [ 160.977402] niks3-server[1112]: 2026/09/20 08:07:32 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv5916lb # [ 160.993165] niks3-server[1112]: 2026/09/20 08:07:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5917worker1 # [ 161.072543] nix-grpc-daemon[1284]: time=2026-09-20T08:07:31.477Z level=INFO msg="Uploading 1 narinfos"5918lb # [ 161.003136] niks3-server[1112]: 2026/09/20 08:07:32 INFO Signed narinfos id=45 count=15919lb # [ 161.009044] niks3-server[1112]: 2026/09/20 08:07:32 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls5920lb # [ 161.019178] niks3-server[1112]: 2026/09/20 08:07:32 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5921lb # [ 161.026450] niks3-server[1112]: 2026/09/20 08:07:32 INFO Completed upload id=455922worker1 # [ 161.099580] nix-grpc-daemon[1284]: time=2026-09-20T08:07:31.504Z level=INFO msg="Upload complete. (373ms)"5923lb # [ 161.029445] niks3-server[1112]: 2026/09/20 08:07:32 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo5924worker1 # [ 161.129697] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54270 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=1 outputs=15925worker1 # [ 161.147482] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:31Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=15926worker1 # [ 161.152885] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:31Z level=debug event=want client=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=05927worker1 # [ 161.158019] nix-daemon[895]: reaped child process 1486, status = succeeded5928worker1 # [ 161.172285] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542705929worker1 # [ 161.193673] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542705930worker1 # [ 161.212946] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:542705931worker1 # [ 161.231582] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)5932worker1 # [ 161.473350] nix-daemon[895]: accepted connection from pid 1512, user nix-grpc-daemon (trusted)5933worker1 # [ 161.500451] nix-daemon[895]: reaped child process 1515, status = succeeded5934worker1 # [ 161.703929] nix-daemon[895]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)5935worker1 # [ 161.728198] nix-daemon[895]: reaped child process 1520, status = succeeded5936lb # [ 161.666215] niks3-server[1112]: 2026/09/20 08:07:33 INFO Received uploads request method=POST path=/api/pending_closures5937worker1 # [ 161.750741] nix-grpc-daemon[1284]: time=2026-09-20T08:07:32.155Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5938worker1 # [ 161.752448] nix-grpc-daemon[1284]: time=2026-09-20T08:07:32.155Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"5939lb # [ 161.709036] niks3-server[1112]: 2026/09/20 08:07:33 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst5940lb # [ 161.727693] niks3-server[1112]: 2026/09/20 08:07:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5941worker1 # [ 161.807645] nix-grpc-daemon[1284]: time=2026-09-20T08:07:32.212Z level=INFO msg="Uploading 1 narinfos"5942lb # [ 161.742886] niks3-server[1112]: 2026/09/20 08:07:33 INFO Signed narinfos id=46 count=15943lb # [ 161.749036] niks3-server[1112]: 2026/09/20 08:07:33 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls5944lb # [ 161.758003] niks3-server[1112]: 2026/09/20 08:07:33 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5945lb # [ 161.766033] niks3-server[1112]: 2026/09/20 08:07:33 INFO Completed upload id=465946worker1 # [ 161.838820] nix-grpc-daemon[1284]: time=2026-09-20T08:07:32.243Z level=INFO msg="Upload complete. (583ms)"5947worker1 # [ 161.849436] nix-grpc-daemon[1284]: time=2026-09-20T08:07:32.243Z level=WARN msg="Failed to register uploaded object" key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo error="server returned 404: object is not pending upload\n"5948worker1 # [ 161.865088] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54270 duration_s=0 paths=1 nar_bytes_in=5125949worker1 # [ 161.876305] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542705950worker1 # [ 161.883942] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)5951worker1 # [ 161.887037] nix-daemon[895]: reaped child process 1510, status = succeeded5952worker1 # [ 161.897897] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)5953worker1 # [ 163.127429] nix-daemon[895]: reaped child process 1524, status = succeeded5954worker1 # [ 163.302704] nix-daemon[895]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)5955worker1 # [ 163.326040] nix-daemon[895]: reaped child process 1542, status = succeeded5956lb # [ 163.267174] niks3-server[1112]: 2026/09/20 08:07:34 INFO Received uploads request method=POST path=/api/pending_closures5957worker1 # [ 163.352532] nix-grpc-daemon[1284]: time=2026-09-20T08:07:33.756Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5958worker1 # [ 163.354139] nix-grpc-daemon[1284]: time=2026-09-20T08:07:33.756Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"5959lb # [ 163.323403] niks3-server[1112]: 2026/09/20 08:07:34 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5960lb # [ 163.343109] niks3-server[1112]: 2026/09/20 08:07:34 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv5961worker1 # [ 163.431502] nix-grpc-daemon[1284]: time=2026-09-20T08:07:33.836Z level=INFO msg="Uploading 1 narinfos"5962lb # [ 163.352326] niks3-server[1112]: 2026/09/20 08:07:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5963lb # [ 163.362378] niks3-server[1112]: 2026/09/20 08:07:34 INFO Signed narinfos id=47 count=15964lb # [ 163.370670] niks3-server[1112]: 2026/09/20 08:07:34 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls5965lb # [ 163.383081] niks3-server[1112]: 2026/09/20 08:07:34 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5966lb # [ 163.390928] niks3-server[1112]: 2026/09/20 08:07:34 INFO Completed upload id=475967lb # [ 163.395190] niks3-server[1112]: 2026/09/20 08:07:34 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo5968worker1 # [ 163.463981] nix-grpc-daemon[1284]: time=2026-09-20T08:07:33.869Z level=INFO msg="Upload complete. (350ms)"5969worker1 # [ 163.492415] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54270 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=2 outputs=15970worker1 # [ 163.504652] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:33Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=15971worker1 # [ 163.517030] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542705972worker1 # [ 163.523724] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:33Z level=debug event=want client=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=05973worker1 # [ 163.529109] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542705974worker1 # [ 163.532885] nix-daemon[895]: reaped child process 1522, status = succeeded5975worker1 # [ 163.536690] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:542705976worker1 # [ 163.547588] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)5977worker1 # [ 163.779417] nix-daemon[895]: accepted connection from pid 1548, user nix-grpc-daemon (trusted)5978worker1 # [ 163.803466] nix-daemon[895]: reaped child process 1551, status = succeeded5979worker1 # [ 164.004168] nix-daemon[895]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)5980worker1 # [ 164.024250] nix-daemon[895]: reaped child process 1556, status = succeeded5981lb # [ 163.968345] niks3-server[1112]: 2026/09/20 08:07:35 INFO Received uploads request method=POST path=/api/pending_closures5982worker1 # [ 164.054292] nix-grpc-daemon[1284]: time=2026-09-20T08:07:34.459Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5983worker1 # [ 164.055892] nix-grpc-daemon[1284]: time=2026-09-20T08:07:34.459Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"5984lb # [ 164.025735] niks3-server[1112]: 2026/09/20 08:07:35 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst5985lb # [ 164.050586] niks3-server[1112]: 2026/09/20 08:07:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5986worker1 # [ 164.129398] nix-grpc-daemon[1284]: time=2026-09-20T08:07:34.534Z level=INFO msg="Uploading 1 narinfos"5987lb # [ 164.067376] niks3-server[1112]: 2026/09/20 08:07:35 INFO Signed narinfos id=48 count=15988lb # [ 164.078433] niks3-server[1112]: 2026/09/20 08:07:35 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls5989lb # [ 164.093949] niks3-server[1112]: 2026/09/20 08:07:35 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5990lb # [ 164.119240] niks3-server[1112]: 2026/09/20 08:07:35 INFO Completed upload id=485991worker1 # [ 164.192555] nix-grpc-daemon[1284]: time=2026-09-20T08:07:34.597Z level=INFO msg="Upload complete. (631ms)"5992lb # [ 164.122911] niks3-server[1112]: 2026/09/20 08:07:35 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo5993worker1 # [ 164.204621] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54270 duration_s=0 paths=1 nar_bytes_in=5125994worker1 # [ 164.221062] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542705995worker1 # [ 164.243033] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)5996worker1 # [ 164.252501] nix-daemon[895]: reaped child process 1546, status = succeeded5997worker1 # [ 164.274409] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)5998worker1 # [ 165.516858] nix-daemon[895]: reaped child process 1560, status = succeeded5999worker1 # [ 165.720762] nix-daemon[895]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)6000worker1 # [ 165.743967] nix-daemon[895]: reaped child process 1578, status = succeeded6001lb # [ 165.695028] niks3-server[1112]: 2026/09/20 08:07:37 INFO Received uploads request method=POST path=/api/pending_closures6002worker1 # [ 165.781977] nix-grpc-daemon[1284]: time=2026-09-20T08:07:36.186Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6003worker1 # [ 165.784961] nix-grpc-daemon[1284]: time=2026-09-20T08:07:36.189Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"6004lb # [ 165.754736] niks3-server[1112]: 2026/09/20 08:07:37 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv6005lb # [ 165.770442] niks3-server[1112]: 2026/09/20 08:07:37 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6006lb # [ 165.785399] niks3-server[1112]: 2026/09/20 08:07:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6007worker1 # [ 165.864453] nix-grpc-daemon[1284]: time=2026-09-20T08:07:36.269Z level=INFO msg="Uploading 1 narinfos"6008lb # [ 165.794798] niks3-server[1112]: 2026/09/20 08:07:37 INFO Signed narinfos id=49 count=16009lb # [ 165.802445] niks3-server[1112]: 2026/09/20 08:07:37 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls6010lb # [ 165.815635] niks3-server[1112]: 2026/09/20 08:07:37 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6011lb # [ 165.824935] niks3-server[1112]: 2026/09/20 08:07:37 INFO Completed upload id=496012lb # [ 165.829054] niks3-server[1112]: 2026/09/20 08:07:37 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo6013worker1 # [ 165.897870] nix-grpc-daemon[1284]: time=2026-09-20T08:07:36.303Z level=INFO msg="Upload complete. (402ms)"6014worker1 # [ 165.921283] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54270 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=3 outputs=16015worker1 # [ 165.940452] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:36Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=16016worker1 # [ 165.956212] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542706017worker1 # [ 165.960559] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:36Z level=debug event=want client=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=06018worker1 # [ 165.966578] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542706019worker1 # [ 165.971215] nix-daemon[895]: reaped child process 1558, status = succeeded6020worker1 # [ 165.982338] nix-grpc-daemon[1284]: time=2026-09-20T08:07:36.387Z level=INFO msg="All 1 paths already cached"6021worker1 # [ 165.989991] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:542706022worker1 # [ 165.998405] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)6023worker1 # [ 166.204448] nix-daemon[895]: accepted connection from pid 1584, user nix-grpc-daemon (trusted)6024worker1 # [ 166.226924] nix-daemon[895]: reaped child process 1587, status = succeeded6025worker1 # [ 166.436100] nix-daemon[895]: accepted connection from pid 1589, user nix-grpc-daemon (trusted)6026worker1 # [ 166.460447] nix-daemon[895]: reaped child process 1592, status = succeeded6027lb # [ 166.404873] niks3-server[1112]: 2026/09/20 08:07:37 INFO Received uploads request method=POST path=/api/pending_closures6028worker1 # [ 166.493129] nix-grpc-daemon[1284]: time=2026-09-20T08:07:36.898Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6029worker1 # [ 166.494745] nix-grpc-daemon[1284]: time=2026-09-20T08:07:36.898Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"6030lb # [ 166.451766] niks3-server[1112]: 2026/09/20 08:07:37 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst6031worker1 # [ 166.539147] nix-grpc-daemon[1284]: time=2026-09-20T08:07:36.943Z level=INFO msg="Uploading 1 narinfos"6032lb # [ 166.469221] niks3-server[1112]: 2026/09/20 08:07:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6033lb # [ 166.477602] niks3-server[1112]: 2026/09/20 08:07:37 INFO Signed narinfos id=50 count=16034lb # [ 166.483061] niks3-server[1112]: 2026/09/20 08:07:37 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls6035lb # [ 166.492679] niks3-server[1112]: 2026/09/20 08:07:37 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6036lb # [ 166.498580] niks3-server[1112]: 2026/09/20 08:07:37 INFO Completed upload id=506037lb # [ 166.502007] niks3-server[1112]: 2026/09/20 08:07:37 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo6038worker1 # [ 166.570386] nix-grpc-daemon[1284]: time=2026-09-20T08:07:36.975Z level=INFO msg="Upload complete. (563ms)"6039worker1 # [ 166.584965] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54270 duration_s=0 paths=1 nar_bytes_in=6246040worker1 # [ 166.598820] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542706041worker1 # [ 166.612836] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)6042worker1 # [ 166.622219] nix-daemon[895]: reaped child process 1582, status = succeeded6043worker1 # [ 166.640862] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)6044worker1 # [ 167.668346] nix-daemon[895]: reaped child process 1596, status = succeeded6045worker1 # [ 167.855799] nix-daemon[895]: accepted connection from pid 1611, user nix-grpc-daemon (trusted)6046worker1 # [ 167.880697] nix-daemon[895]: reaped child process 1614, status = succeeded6047lb # [ 167.830795] niks3-server[1112]: 2026/09/20 08:07:39 INFO Received uploads request method=POST path=/api/pending_closures6048worker1 # [ 167.920578] nix-grpc-daemon[1284]: time=2026-09-20T08:07:38.323Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6049worker1 # [ 167.922130] nix-grpc-daemon[1284]: time=2026-09-20T08:07:38.323Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"6050lb # [ 167.914216] niks3-server[1112]: 2026/09/20 08:07:39 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst6051lb # [ 167.931445] niks3-server[1112]: 2026/09/20 08:07:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6052lb # [ 167.945705] niks3-server[1112]: 2026/09/20 08:07:39 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv6053lb # [ 167.954794] niks3-server[1112]: 2026/09/20 08:07:39 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls6054lb # [ 167.962039] niks3-server[1112]: 2026/09/20 08:07:39 INFO Signed narinfos id=51 count=16055worker1 # [ 168.035622] nix-grpc-daemon[1284]: time=2026-09-20T08:07:38.440Z level=INFO msg="Uploading 1 narinfos"6056lb # [ 167.973442] niks3-server[1112]: 2026/09/20 08:07:39 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6057lb # [ 167.983294] niks3-server[1112]: 2026/09/20 08:07:39 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo6058lb # [ 167.998033] niks3-server[1112]: 2026/09/20 08:07:39 INFO Completed upload id=516059worker1 # [ 168.070880] nix-grpc-daemon[1284]: time=2026-09-20T08:07:38.475Z level=INFO msg="Upload complete. (416ms)"6060worker1 # [ 168.087008] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54270 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=4 outputs=16061worker1 # [ 168.113708] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:38Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=16062worker1 # [ 168.124505] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542706063worker1 # [ 168.132789] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:38Z level=debug event=want client=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=06064worker1 # [ 168.141287] nix-daemon[895]: reaped child process 1594, status = succeeded6065worker1 # [ 168.143751] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542706066worker1 # [ 168.155207] nix-grpc-daemon[1284]: time=2026-09-20T08:07:38.560Z level=INFO msg="All 1 paths already cached"6067worker1 # [ 168.163679] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:542706068worker1 # [ 168.179049] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)6069worker1 # [ 168.404510] nix-daemon[895]: accepted connection from pid 1620, user nix-grpc-daemon (trusted)6070worker1 # [ 168.428507] nix-daemon[895]: reaped child process 1623, status = succeeded6071worker1 # [ 168.626906] nix-daemon[895]: accepted connection from pid 1625, user nix-grpc-daemon (trusted)6072worker1 # [ 168.649665] nix-daemon[895]: reaped child process 1628, status = succeeded6073lb # [ 168.589376] niks3-server[1112]: 2026/09/20 08:07:39 INFO Received uploads request method=POST path=/api/pending_closures6074worker1 # [ 168.679280] nix-grpc-daemon[1284]: time=2026-09-20T08:07:39.084Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6075worker1 # [ 168.681454] nix-grpc-daemon[1284]: time=2026-09-20T08:07:39.086Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"6076lb # [ 168.644366] niks3-server[1112]: 2026/09/20 08:07:40 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst6077lb # [ 168.663681] niks3-server[1112]: 2026/09/20 08:07:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6078worker1 # [ 168.742542] nix-grpc-daemon[1284]: time=2026-09-20T08:07:39.147Z level=INFO msg="Uploading 1 narinfos"6079lb # [ 168.680063] niks3-server[1112]: 2026/09/20 08:07:40 INFO Signed narinfos id=52 count=16080lb # [ 168.687676] niks3-server[1112]: 2026/09/20 08:07:40 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls6081lb # [ 168.703944] niks3-server[1112]: 2026/09/20 08:07:40 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6082lb # [ 168.712263] niks3-server[1112]: 2026/09/20 08:07:40 INFO Completed upload id=526083worker1 # [ 168.785256] nix-grpc-daemon[1284]: time=2026-09-20T08:07:39.190Z level=INFO msg="Upload complete. (592ms)"6084lb # [ 168.716194] niks3-server[1112]: 2026/09/20 08:07:40 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo6085worker1 # [ 168.796675] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54270 duration_s=0 paths=1 nar_bytes_in=6246086worker1 # [ 168.807040] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542706087worker1 # [ 168.812403] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)6088worker1 # [ 168.816430] nix-daemon[895]: reaped child process 1618, status = succeeded6089worker1 # [ 168.832273] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)6090worker1 # [ 170.090993] nix-daemon[895]: reaped child process 1632, status = succeeded6091worker1 # [ 170.310791] nix-daemon[895]: accepted connection from pid 1647, user nix-grpc-daemon (trusted)6092worker1 # [ 170.331018] nix-daemon[895]: reaped child process 1650, status = succeeded6093lb # [ 170.274776] niks3-server[1112]: 2026/09/20 08:07:41 INFO Received uploads request method=POST path=/api/pending_closures6094worker1 # [ 170.361279] nix-grpc-daemon[1284]: time=2026-09-20T08:07:40.764Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6095worker1 # [ 170.362866] nix-grpc-daemon[1284]: time=2026-09-20T08:07:40.764Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"6096lb # [ 170.326215] niks3-server[1112]: 2026/09/20 08:07:41 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst6097lb # [ 170.338717] niks3-server[1112]: 2026/09/20 08:07:41 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv6098lb # [ 170.348496] niks3-server[1112]: 2026/09/20 08:07:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6099worker1 # [ 170.427691] nix-grpc-daemon[1284]: time=2026-09-20T08:07:40.832Z level=INFO msg="Uploading 1 narinfos"6100lb # [ 170.357806] niks3-server[1112]: 2026/09/20 08:07:41 INFO Signed narinfos id=53 count=16101lb # [ 170.363011] niks3-server[1112]: 2026/09/20 08:07:41 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls6102lb # [ 170.374346] niks3-server[1112]: 2026/09/20 08:07:41 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6103lb # [ 170.383075] niks3-server[1112]: 2026/09/20 08:07:41 INFO Completed upload id=536104worker1 # [ 170.456373] nix-grpc-daemon[1284]: time=2026-09-20T08:07:40.861Z level=INFO msg="Upload complete. (411ms)"6105lb # [ 170.386066] niks3-server[1112]: 2026/09/20 08:07:41 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo6106worker1 # [ 170.477428] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54270 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=5 outputs=16107worker1 # [ 170.496507] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:40Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=16108worker1 # [ 170.513802] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542706109worker1 # [ 170.517425] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:40Z level=debug event=want client=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=06110worker1 # [ 170.522902] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542706111worker1 # [ 170.527266] nix-grpc-daemon[1284]: time=2026-09-20T08:07:40.911Z level=INFO msg="All 1 paths already cached"6112worker1 # [ 170.534323] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:542706113worker1 # [ 170.537712] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)6114worker1 # [ 170.539431] nix-daemon[895]: reaped child process 1630, status = succeeded6115worker1 # [ 170.757038] nix-daemon[895]: accepted connection from pid 1656, user nix-grpc-daemon (trusted)6116worker1 # [ 170.778528] nix-daemon[895]: reaped child process 1659, status = succeeded6117worker1 # [ 170.973977] nix-daemon[895]: accepted connection from pid 1661, user nix-grpc-daemon (trusted)6118worker1 # [ 170.994394] nix-daemon[895]: reaped child process 1664, status = succeeded6119lb # [ 170.933242] niks3-server[1112]: 2026/09/20 08:07:42 INFO Received uploads request method=POST path=/api/pending_closures6120worker1 # [ 171.017175] nix-grpc-daemon[1284]: time=2026-09-20T08:07:41.422Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6121worker1 # [ 171.018801] nix-grpc-daemon[1284]: time=2026-09-20T08:07:41.422Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"6122lb # [ 170.968916] niks3-server[1112]: 2026/09/20 08:07:42 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst6123lb # [ 170.987514] niks3-server[1112]: 2026/09/20 08:07:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6124worker1 # [ 171.069685] nix-grpc-daemon[1284]: time=2026-09-20T08:07:41.474Z level=INFO msg="Uploading 1 narinfos"6125lb # [ 170.998638] niks3-server[1112]: 2026/09/20 08:07:42 INFO Signed narinfos id=54 count=16126lb # [ 171.006235] niks3-server[1112]: 2026/09/20 08:07:42 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls6127lb # [ 171.021148] niks3-server[1112]: 2026/09/20 08:07:42 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6128lb # [ 171.031878] niks3-server[1112]: 2026/09/20 08:07:42 INFO Completed upload id=546129worker1 # [ 171.104905] nix-grpc-daemon[1284]: time=2026-09-20T08:07:41.510Z level=INFO msg="Upload complete. (556ms)"6130lb # [ 171.036814] niks3-server[1112]: 2026/09/20 08:07:42 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo6131worker1 # [ 171.116407] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54270 duration_s=0 paths=1 nar_bytes_in=6246132worker1 # [ 171.136467] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542706133worker1 # [ 171.147315] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)6134worker1 # [ 171.154513] nix-daemon[895]: reaped child process 1654, status = succeeded6135worker1 # [ 171.173360] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)6136worker1 # [ 172.233195] nix-daemon[895]: reaped child process 1668, status = succeeded6137worker1 # [ 172.438255] nix-daemon[895]: accepted connection from pid 1683, user nix-grpc-daemon (trusted)6138worker1 # [ 172.458880] nix-daemon[895]: reaped child process 1686, status = succeeded6139lb # [ 172.398814] niks3-server[1112]: 2026/09/20 08:07:43 INFO Received uploads request method=POST path=/api/pending_closures6140worker1 # [ 172.487865] nix-grpc-daemon[1284]: time=2026-09-20T08:07:42.890Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6141worker1 # [ 172.489603] nix-grpc-daemon[1284]: time=2026-09-20T08:07:42.890Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"6142lb # [ 172.451826] niks3-server[1112]: 2026/09/20 08:07:43 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst6143lb # [ 172.464798] niks3-server[1112]: 2026/09/20 08:07:43 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv6144lb # [ 172.471485] niks3-server[1112]: 2026/09/20 08:07:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6145worker1 # [ 172.549436] nix-grpc-daemon[1284]: time=2026-09-20T08:07:42.954Z level=INFO msg="Uploading 1 narinfos"6146lb # [ 172.479397] niks3-server[1112]: 2026/09/20 08:07:43 INFO Signed narinfos id=55 count=16147lb # [ 172.487055] niks3-server[1112]: 2026/09/20 08:07:43 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls6148lb # [ 172.495906] niks3-server[1112]: 2026/09/20 08:07:43 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6149lb # [ 172.507338] niks3-server[1112]: 2026/09/20 08:07:43 INFO Completed upload id=556150lb # [ 172.511314] niks3-server[1112]: 2026/09/20 08:07:43 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo6151worker1 # [ 172.580795] nix-grpc-daemon[1284]: time=2026-09-20T08:07:42.986Z level=INFO msg="Upload complete. (393ms)"6152worker1 # [ 172.607300] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54270 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=6 outputs=16153worker1 # [ 172.621381] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:42Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=16154worker1 # [ 172.632413] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542706155worker1 # [ 172.635447] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:43Z level=debug event=want client=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=06156worker1 # [ 172.641670] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542706157worker1 # [ 172.644503] nix-daemon[895]: reaped child process 1666, status = succeeded6158worker1 # [ 172.647222] nix-grpc-daemon[1284]: time=2026-09-20T08:07:43.051Z level=INFO msg="All 2 paths already cached"6159worker1 # [ 172.652451] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:542706160worker1 # [ 172.659333] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)6161worker1 # [ 172.857821] nix-daemon[895]: accepted connection from pid 1692, user nix-grpc-daemon (trusted)6162worker1 # [ 172.880220] nix-daemon[895]: reaped child process 1695, status = succeeded6163worker1 # [ 173.081521] nix-daemon[895]: accepted connection from pid 1697, user nix-grpc-daemon (trusted)6164worker1 # [ 173.102131] nix-daemon[895]: reaped child process 1700, status = succeeded6165lb # [ 173.040849] niks3-server[1112]: 2026/09/20 08:07:44 INFO Received uploads request method=POST path=/api/pending_closures6166worker1 # [ 173.126264] nix-grpc-daemon[1284]: time=2026-09-20T08:07:43.531Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6167worker1 # [ 173.127810] nix-grpc-daemon[1284]: time=2026-09-20T08:07:43.531Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"6168lb # [ 173.084707] niks3-server[1112]: 2026/09/20 08:07:44 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst6169lb # [ 173.099024] niks3-server[1112]: 2026/09/20 08:07:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6170worker1 # [ 173.179459] nix-grpc-daemon[1284]: time=2026-09-20T08:07:43.584Z level=INFO msg="Uploading 1 narinfos"6171lb # [ 173.111848] niks3-server[1112]: 2026/09/20 08:07:44 INFO Signed narinfos id=56 count=16172lb # [ 173.118923] niks3-server[1112]: 2026/09/20 08:07:44 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls6173lb # [ 173.130526] niks3-server[1112]: 2026/09/20 08:07:44 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6174lb # [ 173.139585] niks3-server[1112]: 2026/09/20 08:07:44 INFO Completed upload id=566175worker1 # [ 173.211831] nix-grpc-daemon[1284]: time=2026-09-20T08:07:43.617Z level=INFO msg="Upload complete. (544ms)"6176lb # [ 173.143875] niks3-server[1112]: 2026/09/20 08:07:44 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo6177worker1 # [ 173.222877] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54270 duration_s=0 paths=1 nar_bytes_in=7526178worker1 # [ 173.240778] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542706179worker1 # [ 173.250465] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)6180worker1 # [ 173.257283] nix-daemon[895]: reaped child process 1690, status = succeeded6181worker1 # [ 173.273738] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)6182worker1 # [ 174.501543] nix-daemon[895]: reaped child process 1704, status = succeeded6183worker1 # [ 174.683739] nix-daemon[895]: accepted connection from pid 1719, user nix-grpc-daemon (trusted)6184worker1 # [ 174.706414] nix-daemon[895]: reaped child process 1722, status = succeeded6185lb # [ 174.646810] niks3-server[1112]: 2026/09/20 08:07:46 INFO Received uploads request method=POST path=/api/pending_closures6186worker1 # [ 174.732447] nix-grpc-daemon[1284]: time=2026-09-20T08:07:45.137Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6187worker1 # [ 174.733971] nix-grpc-daemon[1284]: time=2026-09-20T08:07:45.137Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"6188lb # [ 174.704961] niks3-server[1112]: 2026/09/20 08:07:46 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst6189lb # [ 174.719613] niks3-server[1112]: 2026/09/20 08:07:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6190worker1 # [ 174.798151] nix-grpc-daemon[1284]: time=2026-09-20T08:07:45.202Z level=INFO msg="Uploading 1 narinfos"6191lb # [ 174.731769] niks3-server[1112]: 2026/09/20 08:07:46 INFO Signed narinfos id=57 count=16192lb # [ 174.737899] niks3-server[1112]: 2026/09/20 08:07:46 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv6193lb # [ 174.745385] niks3-server[1112]: 2026/09/20 08:07:46 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls6194lb # [ 174.755521] niks3-server[1112]: 2026/09/20 08:07:46 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6195lb # [ 174.759871] niks3-server[1112]: 2026/09/20 08:07:46 INFO Completed upload id=576196lb # [ 174.765146] niks3-server[1112]: 2026/09/20 08:07:46 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo6197worker1 # [ 174.828704] nix-grpc-daemon[1284]: time=2026-09-20T08:07:45.233Z level=INFO msg="Upload complete. (339ms)"6198worker1 # [ 174.845716] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54270 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=7 outputs=16199worker1 # [ 174.864392] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:45Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=16200worker1 # [ 174.871148] nix-daemon[895]: reaped child process 1702, status = succeeded6201worker1 # [ 174.890906] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542706202worker1 # [ 174.909616] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542706203worker1 # [ 174.929227] nix-grpc-daemon[1284]: time=2026-09-20T08:07:45.334Z level=INFO msg="All 2 paths already cached"6204worker1 # [ 174.940135] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:542706205worker1 # [ 174.956278] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)6206worker1 # [ 175.196200] nix-daemon[895]: accepted connection from pid 1726, user nix-grpc-daemon (trusted)6207worker1 # [ 175.219026] nix-daemon[895]: reaped child process 1729, status = succeeded6208worker1 # [ 175.415143] nix-daemon[895]: accepted connection from pid 1731, user nix-grpc-daemon (trusted)6209worker1 # [ 175.434886] nix-daemon[895]: reaped child process 1734, status = succeeded6210lb # [ 175.376672] niks3-server[1112]: 2026/09/20 08:07:46 INFO Received uploads request method=POST path=/api/pending_closures6211worker1 # [ 175.460064] nix-grpc-daemon[1284]: time=2026-09-20T08:07:45.864Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6212worker1 # [ 175.461594] nix-grpc-daemon[1284]: time=2026-09-20T08:07:45.865Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"6213lb # [ 175.412402] niks3-server[1112]: 2026/09/20 08:07:46 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst6214lb # [ 175.430349] niks3-server[1112]: 2026/09/20 08:07:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6215worker1 # [ 175.509693] nix-grpc-daemon[1284]: time=2026-09-20T08:07:45.914Z level=INFO msg="Uploading 1 narinfos"6216lb # [ 175.444998] niks3-server[1112]: 2026/09/20 08:07:46 INFO Signed narinfos id=58 count=16217lb # [ 175.452530] niks3-server[1112]: 2026/09/20 08:07:46 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls6218lb # [ 175.464268] niks3-server[1112]: 2026/09/20 08:07:46 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6219worker1 # [ 175.545834] nix-grpc-daemon[1284]: time=2026-09-20T08:07:45.951Z level=INFO msg="Upload complete. (570ms)"6220lb # [ 175.476411] niks3-server[1112]: 2026/09/20 08:07:46 INFO Completed upload id=586221lb # [ 175.481143] niks3-server[1112]: 2026/09/20 08:07:46 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo6222worker1 # [ 175.556404] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54270 duration_s=0 paths=1 nar_bytes_in=7526223worker1 # [ 175.576536] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542706224worker1 # [ 175.591217] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)6225worker1 # [ 175.595325] nix-daemon[895]: reaped child process 1724, status = succeeded6226worker1 # [ 175.617100] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)6227worker1 # [ 177.083767] nix-daemon[895]: reaped child process 1738, status = succeeded6228worker1 # [ 177.283142] nix-daemon[895]: accepted connection from pid 1753, user nix-grpc-daemon (trusted)6229worker1 # [ 177.306270] nix-daemon[895]: reaped child process 1756, status = succeeded6230lb # [ 177.248370] niks3-server[1112]: 2026/09/20 08:07:48 INFO Received uploads request method=POST path=/api/pending_closures6231worker1 # [ 177.334933] nix-grpc-daemon[1284]: time=2026-09-20T08:07:47.737Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6232worker1 # [ 177.336689] nix-grpc-daemon[1284]: time=2026-09-20T08:07:47.737Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"6233lb # [ 177.302443] niks3-server[1112]: 2026/09/20 08:07:48 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv6234lb # [ 177.312469] niks3-server[1112]: 2026/09/20 08:07:48 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst6235lb # [ 177.318685] niks3-server[1112]: 2026/09/20 08:07:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6236worker1 # [ 177.396608] nix-grpc-daemon[1284]: time=2026-09-20T08:07:47.801Z level=INFO msg="Uploading 1 narinfos"6237lb # [ 177.328354] niks3-server[1112]: 2026/09/20 08:07:48 INFO Signed narinfos id=59 count=16238lb # [ 177.336254] niks3-server[1112]: 2026/09/20 08:07:48 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls6239lb # [ 177.345795] niks3-server[1112]: 2026/09/20 08:07:48 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6240lb # [ 177.353702] niks3-server[1112]: 2026/09/20 08:07:48 INFO Completed upload id=596241worker1 # [ 177.424815] nix-grpc-daemon[1284]: time=2026-09-20T08:07:47.830Z level=INFO msg="Upload complete. (393ms)"6242lb # [ 177.356503] niks3-server[1112]: 2026/09/20 08:07:48 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo6243worker1 # [ 177.441377] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54270 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=8 outputs=16244worker1 # [ 177.459001] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:47Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=16245worker1 # [ 177.463944] nix-daemon[895]: reaped child process 1736, status = succeeded6246worker1 # [ 177.485507] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542706247worker1 # [ 177.503415] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:542706248worker1 # [ 177.523541] nix-grpc-daemon[1284]: time=2026-09-20T08:07:47.928Z level=INFO msg="All 2 paths already cached"6249worker1 # [ 177.534782] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:542706250worker1 # [ 177.550725] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)6251worker1 # [ 177.777138] nix-daemon[895]: accepted connection from pid 1760, user nix-grpc-daemon (trusted)6252worker1 # [ 177.799441] nix-daemon[895]: reaped child process 1763, status = succeeded6253worker1 # [ 177.991161] nix-daemon[895]: accepted connection from pid 1765, user nix-grpc-daemon (trusted)6254worker1 # [ 178.012777] nix-daemon[895]: reaped child process 1768, status = succeeded6255lb # [ 177.955339] niks3-server[1112]: 2026/09/20 08:07:49 INFO Received uploads request method=POST path=/api/pending_closures6256worker1 # [ 178.038544] nix-grpc-daemon[1284]: time=2026-09-20T08:07:48.443Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6257worker1 # [ 178.040189] nix-grpc-daemon[1284]: time=2026-09-20T08:07:48.443Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"6258lb # [ 177.991316] niks3-server[1112]: 2026/09/20 08:07:49 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst6259worker1 # [ 178.079670] nix-grpc-daemon[1284]: time=2026-09-20T08:07:48.484Z level=INFO msg="Uploading 1 narinfos"6260lb # [ 178.008661] niks3-server[1112]: 2026/09/20 08:07:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6261lb # [ 178.019271] niks3-server[1112]: 2026/09/20 08:07:49 INFO Signed narinfos id=60 count=16262lb # [ 178.025046] niks3-server[1112]: 2026/09/20 08:07:49 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls6263lb # [ 178.032429] niks3-server[1112]: 2026/09/20 08:07:49 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6264lb # [ 178.040467] niks3-server[1112]: 2026/09/20 08:07:49 INFO Completed upload id=606265worker1 # [ 178.113548] nix-grpc-daemon[1284]: time=2026-09-20T08:07:48.518Z level=INFO msg="Upload complete. (542ms)"6266lb # [ 178.043001] niks3-server[1112]: 2026/09/20 08:07:49 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo6267worker1 # [ 178.124221] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54270 duration_s=0 paths=1 nar_bytes_in=7526268worker1 # [ 178.139974] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:542706269worker1 # [ 178.150361] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)6270worker1 # [ 178.153277] nix-daemon[895]: reaped child process 1758, status = succeeded6271worker1 # [ 178.166447] nix-daemon[895]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)6272worker1 # [ 179.435249] nix-daemon[895]: reaped child process 1772, status = succeeded6273worker1 # [ 179.640720] nix-daemon[895]: accepted connection from pid 1787, user nix-grpc-daemon (trusted)6274worker1 # [ 179.662235] nix-daemon[895]: reaped child process 1790, status = succeeded6275lb # [ 179.606680] niks3-server[1112]: 2026/09/20 08:07:51 INFO Received uploads request method=POST path=/api/pending_closures6276worker1 # [ 179.691399] nix-grpc-daemon[1284]: time=2026-09-20T08:07:50.095Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6277worker1 # [ 179.693041] nix-grpc-daemon[1284]: time=2026-09-20T08:07:50.095Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"6278worker1 # [ 179.733198] nix-grpc-daemon[1284]: time=2026-09-20T08:07:50.138Z level=INFO msg="Uploading 1 narinfos"6279lb # [ 179.650987] niks3-server[1112]: 2026/09/20 08:07:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6280lb # [ 179.666951] niks3-server[1112]: 2026/09/20 08:07:51 INFO Signed narinfos id=61 count=16281lb # [ 179.675060] niks3-server[1112]: 2026/09/20 08:07:51 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst6282lb # [ 179.683393] niks3-server[1112]: 2026/09/20 08:07:51 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv6283lb # [ 179.692584] niks3-server[1112]: 2026/09/20 08:07:51 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls6284lb # [ 179.696480] niks3-server[1112]: 2026/09/20 08:07:51 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6285lb # [ 179.701206] niks3-server[1112]: 2026/09/20 08:07:51 INFO Completed upload id=616286worker1 # [ 179.773557] nix-grpc-daemon[1284]: time=2026-09-20T08:07:50.178Z level=INFO msg="Upload complete. (386ms)"6287lb # [ 179.704325] niks3-server[1112]: 2026/09/20 08:07:51 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo6288worker1 # [ 179.782978] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54270 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=9 outputs=16289worker1 # [ 179.799365] nix-daemon[895]: reaped child process 1770, status = succeeded6290client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 21.32 seconds)6291worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6292worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.09 seconds)6293client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16294worker2 # [ 180.190532] nix-grpc-daemon[1947]: ts=2026-09-20T08:07:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:497166295worker2 # [ 180.209234] nix-daemon[842]: accepted connection from pid 1947, user nix-grpc-daemon (trusted)6296worker1 # [ 180.317313] nix-grpc-daemon[1154]: ts=2026-09-20T08:07:50Z level=debug event=want client=2 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=06297lb # [ 185.240233] envoy[895]: conn peer=[2001:db8:1::1]:53536 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=26901 tx=10739 ms=209596298client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 120.39 seconds)6299(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 141.80 seconds)6300subtest: low disk drains a worker and builds go to the other6301worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6302worker1 # [ 301.663300] nix-grpc-daemon[1154]: ts=2026-09-20T08:09:52Z level=info event=unhealthy reason=min_free6303worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.27 seconds)6304worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6305worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 0.05 seconds)6306client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain >&26307worker1 # [ 302.047340] nix-grpc-daemon[1154]: ts=2026-09-20T08:09:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:542706308client # don't know how to build these paths:6309client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6310worker1 # [ 302.079409] nix-grpc-daemon[1154]: ts=2026-09-20T08:09:52Z level=debug event=want client=3 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=06311worker1 # [ 302.087037] nix-grpc-daemon[1154]: ts=2026-09-20T08:09:52Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=16312worker2 # [ 302.028571] nix-grpc-daemon[1947]: ts=2026-09-20T08:09:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:497166313worker2 # [ 302.057015] nix-grpc-daemon[1947]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 77 ms (attempt 1/5)6314worker2 # [ 302.142213] nix-grpc-daemon[1947]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 170 ms (attempt 2/5)6315worker2 # [ 302.321243] nix-grpc-daemon[1947]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 101 ms (attempt 3/5)6316worker2 # [ 302.422390] nix-grpc-daemon[1947]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 446 ms (attempt 4/5)6317worker2 # [ 302.879767] nix-grpc-daemon[1947]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6318worker2 # [ 302.927046] nix-grpc-daemon[1947]: ts=2026-09-20T08:09:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:497166319client # copying 1 paths to 'lb:50051'...6320client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...6321worker2 # [ 302.951535] nix-grpc-daemon[1947]: ts=2026-09-20T08:09:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:497166322worker2 # [ 302.978492] nix-daemon[842]: accepted connection from pid 1947, user nix-grpc-daemon (trusted)6323worker2 # [ 303.027745] nix-grpc-daemon[1947]: ts=2026-09-20T08:09:54Z level=info event=niks3_push_started pid=20036324worker2 # [ 303.506961] nix-daemon[842]: accepted connection from pid 2016, user nix-grpc-daemon (trusted)6325worker2 # [ 303.532252] nix-daemon[842]: reaped child process 2019, status = succeeded6326worker2 # [ 303.740174] nix-daemon[842]: accepted connection from pid 2021, user nix-grpc-daemon (trusted)6327worker2 # [ 303.763648] nix-daemon[842]: reaped child process 2024, status = succeeded6328lb # [ 303.785031] niks3-server[1112]: 2026/09/20 08:09:55 INFO Received uploads request method=POST path=/api/pending_closures6329worker2 # [ 303.804423] nix-grpc-daemon[2003]: time=2026-09-20T08:09:55.213Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6330worker2 # [ 303.806111] nix-grpc-daemon[2003]: time=2026-09-20T08:09:55.213Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6331lb # [ 303.855827] niks3-server[1112]: 2026/09/20 08:09:55 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6332worker2 # [ 303.878396] nix-grpc-daemon[2003]: time=2026-09-20T08:09:55.288Z level=INFO msg="Uploading 1 narinfos"6333lb # [ 303.879596] niks3-server[1112]: 2026/09/20 08:09:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6334lb # [ 303.884183] niks3-server[1112]: 2026/09/20 08:09:55 INFO Signed narinfos id=62 count=16335lb # [ 303.893176] niks3-server[1112]: 2026/09/20 08:09:55 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6336lb # [ 303.911000] niks3-server[1112]: 2026/09/20 08:09:55 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6337lb # [ 303.924397] niks3-server[1112]: 2026/09/20 08:09:55 INFO Completed upload id=626338worker2 # [ 303.923205] nix-grpc-daemon[2003]: time=2026-09-20T08:09:55.334Z level=INFO msg="Upload complete. (624ms)"6339lb # [ 303.928728] niks3-server[1112]: 2026/09/20 08:09:55 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6340worker2 # [ 303.938852] nix-grpc-daemon[1947]: ts=2026-09-20T08:09:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49716 duration_s=0 paths=1 nar_bytes_in=5126341worker2 # [ 303.956468] nix-grpc-daemon[1947]: ts=2026-09-20T08:09:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:497166342worker2 # [ 303.973922] nix-daemon[842]: accepted connection from pid 1947, user nix-grpc-daemon (trusted)6343worker2 # [ 303.988951] nix-daemon[842]: reaped child process 2001, status = succeeded6344client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6345client # farm-a> worker2-next: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6346worker2 # [ 304.004161] nix-daemon[842]: accepted connection from pid 1947, user nix-grpc-daemon (trusted)6347client # farm-a> LOG-farm-a-drain6348worker2 # [ 304.829715] nix-daemon[842]: reaped child process 2028, status = succeeded6349worker2 # [ 305.028713] nix-daemon[842]: accepted connection from pid 2043, user nix-grpc-daemon (trusted)6350worker2 # [ 305.053765] nix-daemon[842]: reaped child process 2046, status = succeeded6351lb # [ 305.076419] niks3-server[1112]: 2026/09/20 08:09:56 INFO Received uploads request method=POST path=/api/pending_closures6352worker2 # [ 305.092618] nix-grpc-daemon[2003]: time=2026-09-20T08:09:56.501Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6353worker2 # [ 305.094252] nix-grpc-daemon[2003]: time=2026-09-20T08:09:56.501Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6354lb # [ 305.140874] niks3-server[1112]: 2026/09/20 08:09:56 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6355lb # [ 305.155307] niks3-server[1112]: 2026/09/20 08:09:56 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6356lb # [ 305.177521] niks3-server[1112]: 2026/09/20 08:09:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6357worker2 # [ 305.176203] nix-grpc-daemon[2003]: time=2026-09-20T08:09:56.586Z level=INFO msg="Uploading 1 narinfos"6358lb # [ 305.185043] niks3-server[1112]: 2026/09/20 08:09:56 INFO Signed narinfos id=63 count=16359lb # [ 305.191159] niks3-server[1112]: 2026/09/20 08:09:56 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6360lb # [ 305.204281] niks3-server[1112]: 2026/09/20 08:09:56 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6361lb # [ 305.214717] niks3-server[1112]: 2026/09/20 08:09:56 INFO Completed upload id=636362worker2 # [ 305.212065] nix-grpc-daemon[2003]: time=2026-09-20T08:09:56.623Z level=INFO msg="Upload complete. (394ms)"6363lb # [ 305.218549] niks3-server[1112]: 2026/09/20 08:09:56 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6364worker2 # [ 305.228587] nix-grpc-daemon[1947]: ts=2026-09-20T08:09:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49716 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=10 outputs=16365worker1 # [ 305.317313] nix-grpc-daemon[1154]: ts=2026-09-20T08:09:55Z level=debug event=want client=3 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06366lb # [ 305.250394] envoy[895]: conn peer=[2001:db8:1::1]:44606 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=727 tx=457 ms=1200926367worker1 # [ 305.318255] nix-grpc-daemon[1154]: ts=2026-09-20T08:09:55Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16368worker2 # [ 305.255112] nix-daemon[842]: reaped child process 2026, status = succeeded6369worker2 # [ 305.292217] nix-grpc-daemon[1947]: ts=2026-09-20T08:09:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:497166370worker2 # [ 305.318818] nix-grpc-daemon[1947]: ts=2026-09-20T08:09:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:497166371worker2 # [ 305.338605] nix-grpc-daemon[2003]: time=2026-09-20T08:09:56.749Z level=INFO msg="All 1 paths already cached"6372client # copying 1 paths to 'lb:50051'...6373worker2 # [ 305.351787] nix-grpc-daemon[1947]: ts=2026-09-20T08:09:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:497166374client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6375worker2 # [ 305.373395] nix-daemon[842]: accepted connection from pid 1947, user nix-grpc-daemon (trusted)6376worker2 # [ 305.648192] nix-daemon[842]: accepted connection from pid 2050, user nix-grpc-daemon (trusted)6377worker2 # [ 305.671994] nix-daemon[842]: reaped child process 2053, status = succeeded6378worker2 # [ 305.887041] nix-daemon[842]: accepted connection from pid 2055, user nix-grpc-daemon (trusted)6379worker2 # [ 305.908241] nix-daemon[842]: reaped child process 2058, status = succeeded6380lb # [ 305.921639] niks3-server[1112]: 2026/09/20 08:09:57 INFO Received uploads request method=POST path=/api/pending_closures6381worker2 # [ 305.935159] nix-grpc-daemon[2003]: time=2026-09-20T08:09:57.345Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6382worker2 # [ 305.936950] nix-grpc-daemon[2003]: time=2026-09-20T08:09:57.345Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6383lb # [ 305.972658] niks3-server[1112]: 2026/09/20 08:09:57 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6384worker2 # [ 305.984140] nix-grpc-daemon[2003]: time=2026-09-20T08:09:57.394Z level=INFO msg="Uploading 1 narinfos"6385lb # [ 305.989609] niks3-server[1112]: 2026/09/20 08:09:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6386lb # [ 305.998123] niks3-server[1112]: 2026/09/20 08:09:57 INFO Signed narinfos id=64 count=16387lb # [ 306.003334] niks3-server[1112]: 2026/09/20 08:09:57 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6388lb # [ 306.013654] niks3-server[1112]: 2026/09/20 08:09:57 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6389worker2 # [ 306.018130] nix-grpc-daemon[2003]: time=2026-09-20T08:09:57.429Z level=INFO msg="Upload complete. (620ms)"6390lb # [ 306.022506] niks3-server[1112]: 2026/09/20 08:09:57 INFO Completed upload id=646391lb # [ 306.026876] niks3-server[1112]: 2026/09/20 08:09:57 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6392worker2 # [ 306.028408] nix-grpc-daemon[1947]: ts=2026-09-20T08:09:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49716 duration_s=0 paths=1 nar_bytes_in=6326393worker2 # [ 306.045522] nix-grpc-daemon[1947]: ts=2026-09-20T08:09:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:497166394worker2 # [ 306.061321] nix-daemon[842]: accepted connection from pid 1947, user nix-grpc-daemon (trusted)6395worker2 # [ 306.070161] nix-daemon[842]: reaped child process 2048, status = succeeded6396client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6397client # farm-b> worker2-next: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6398worker2 # [ 306.086089] nix-daemon[842]: accepted connection from pid 1947, user nix-grpc-daemon (trusted)6399client # farm-b> LOG-farm-b-drain6400worker2 # [ 307.341410] nix-daemon[842]: reaped child process 2062, status = succeeded6401worker2 # [ 307.512822] nix-daemon[842]: accepted connection from pid 2077, user nix-grpc-daemon (trusted)6402worker2 # [ 307.532411] nix-daemon[842]: reaped child process 2080, status = succeeded6403lb # [ 307.548288] niks3-server[1112]: 2026/09/20 08:09:58 INFO Received uploads request method=POST path=/api/pending_closures6404worker2 # [ 307.555794] nix-grpc-daemon[2003]: time=2026-09-20T08:09:58.965Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6405worker2 # [ 307.557666] nix-grpc-daemon[2003]: time=2026-09-20T08:09:58.965Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6406lb # [ 307.600344] niks3-server[1112]: 2026/09/20 08:09:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6407worker2 # [ 307.607664] nix-grpc-daemon[2003]: time=2026-09-20T08:09:59.018Z level=INFO msg="Uploading 1 narinfos"6408lb # [ 307.609299] niks3-server[1112]: 2026/09/20 08:09:59 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6409lb # [ 307.614125] niks3-server[1112]: 2026/09/20 08:09:59 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6410lb # [ 307.622536] niks3-server[1112]: 2026/09/20 08:09:59 INFO Signed narinfos id=65 count=16411lb # [ 307.625736] niks3-server[1112]: 2026/09/20 08:09:59 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6412lb # [ 307.631181] niks3-server[1112]: 2026/09/20 08:09:59 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6413lb # [ 307.637850] niks3-server[1112]: 2026/09/20 08:09:59 INFO Completed upload id=656414worker2 # [ 307.635500] nix-grpc-daemon[2003]: time=2026-09-20T08:09:59.046Z level=INFO msg="Upload complete. (334ms)"6415lb # [ 307.640831] niks3-server[1112]: 2026/09/20 08:09:59 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6416worker2 # [ 307.649174] nix-grpc-daemon[1947]: ts=2026-09-20T08:09:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49716 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=11 outputs=16417worker1 # [ 307.729680] nix-grpc-daemon[1154]: ts=2026-09-20T08:09:58Z level=debug event=want client=3 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06418worker1 # [ 307.730203] nix-grpc-daemon[1154]: ts=2026-09-20T08:09:58Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16419worker2 # [ 307.665733] nix-daemon[842]: reaped child process 2060, status = succeeded6420worker2 # [ 307.698757] nix-grpc-daemon[1947]: ts=2026-09-20T08:09:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:497166421worker2 # [ 307.714384] nix-grpc-daemon[1947]: ts=2026-09-20T08:09:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:497166422worker2 # [ 307.728367] nix-grpc-daemon[2003]: time=2026-09-20T08:09:59.139Z level=INFO msg="All 2 paths already cached"6423client # copying 1 paths to 'lb:50051'...6424client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6425worker2 # [ 307.739814] nix-grpc-daemon[1947]: ts=2026-09-20T08:09:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:497166426worker2 # [ 307.754484] nix-daemon[842]: accepted connection from pid 1947, user nix-grpc-daemon (trusted)6427worker2 # [ 307.953916] nix-daemon[842]: accepted connection from pid 2084, user nix-grpc-daemon (trusted)6428worker2 # [ 307.971274] nix-daemon[842]: reaped child process 2087, status = succeeded6429worker2 # [ 308.146415] nix-daemon[842]: accepted connection from pid 2089, user nix-grpc-daemon (trusted)6430worker2 # [ 308.164582] nix-daemon[842]: reaped child process 2092, status = succeeded6431lb # [ 308.179379] niks3-server[1112]: 2026/09/20 08:09:59 INFO Received uploads request method=POST path=/api/pending_closures6432worker2 # [ 308.187143] nix-grpc-daemon[2003]: time=2026-09-20T08:09:59.597Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6433worker2 # [ 308.188770] nix-grpc-daemon[2003]: time=2026-09-20T08:09:59.597Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6434lb # [ 308.210466] niks3-server[1112]: 2026/09/20 08:09:59 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6435worker2 # [ 308.217627] nix-grpc-daemon[2003]: time=2026-09-20T08:09:59.628Z level=INFO msg="Uploading 1 narinfos"6436lb # [ 308.223251] niks3-server[1112]: 2026/09/20 08:09:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6437lb # [ 308.236397] niks3-server[1112]: 2026/09/20 08:09:59 INFO Signed narinfos id=66 count=16438lb # [ 308.244840] niks3-server[1112]: 2026/09/20 08:09:59 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6439lb # [ 308.248802] niks3-server[1112]: 2026/09/20 08:09:59 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6440worker2 # [ 308.251114] nix-grpc-daemon[2003]: time=2026-09-20T08:09:59.662Z level=INFO msg="Upload complete. (479ms)"6441lb # [ 308.254204] niks3-server[1112]: 2026/09/20 08:09:59 INFO Completed upload id=666442lb # [ 308.257539] niks3-server[1112]: 2026/09/20 08:09:59 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6443worker2 # [ 308.260353] nix-grpc-daemon[1947]: ts=2026-09-20T08:09:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49716 duration_s=0 paths=1 nar_bytes_in=7606444worker2 # [ 308.270465] nix-grpc-daemon[1947]: ts=2026-09-20T08:09:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:497166445worker2 # [ 308.276977] nix-daemon[842]: accepted connection from pid 1947, user nix-grpc-daemon (trusted)6446worker2 # [ 308.281500] nix-daemon[842]: reaped child process 2082, status = succeeded6447client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6448client # farm-top> worker2-next: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6449worker2 # [ 308.296168] nix-daemon[842]: accepted connection from pid 1947, user nix-grpc-daemon (trusted)6450client # farm-top> LOG-farm-top-drain6451worker2 # [ 309.141286] nix-daemon[842]: reaped child process 2096, status = succeeded6452worker2 # [ 309.314805] nix-daemon[842]: accepted connection from pid 2111, user nix-grpc-daemon (trusted)6453worker2 # [ 309.333707] nix-daemon[842]: reaped child process 2114, status = succeeded6454lb # [ 309.349124] niks3-server[1112]: 2026/09/20 08:10:00 INFO Received uploads request method=POST path=/api/pending_closures6455worker2 # [ 309.357147] nix-grpc-daemon[2003]: time=2026-09-20T08:10:00.767Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6456worker2 # [ 309.360351] nix-grpc-daemon[2003]: time=2026-09-20T08:10:00.769Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6457lb # [ 309.384399] niks3-server[1112]: 2026/09/20 08:10:00 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6458lb # [ 309.405334] niks3-server[1112]: 2026/09/20 08:10:00 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6459lb # [ 309.413436] niks3-server[1112]: 2026/09/20 08:10:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6460worker2 # [ 309.417151] nix-grpc-daemon[2003]: time=2026-09-20T08:10:00.827Z level=INFO msg="Uploading 1 narinfos"6461lb # [ 309.426715] niks3-server[1112]: 2026/09/20 08:10:00 INFO Signed narinfos id=67 count=16462lb # [ 309.431345] niks3-server[1112]: 2026/09/20 08:10:00 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6463lb # [ 309.438872] niks3-server[1112]: 2026/09/20 08:10:00 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6464lb # [ 309.443909] niks3-server[1112]: 2026/09/20 08:10:00 INFO Completed upload id=676465worker2 # [ 309.442231] nix-grpc-daemon[2003]: time=2026-09-20T08:10:00.853Z level=INFO msg="Upload complete. (332ms)"6466lb # [ 309.446732] niks3-server[1112]: 2026/09/20 08:10:00 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6467worker2 # [ 309.453198] nix-grpc-daemon[1947]: ts=2026-09-20T08:10:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49716 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=12 outputs=16468worker2 # [ 309.472603] nix-daemon[842]: reaped child process 2094, status = succeeded6469client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain >&2, in 7.86 seconds)6470client: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain outPath6471client: (finished: must succeed: nix eval --raw -f /nix/store/3c79s1mhyz00j9rig3m7fz3did05wl5h-job.nix --argstr tag drain outPath, in 0.24 seconds)6472worker1: must succeed: rm /nix/.rw-store/fill6473worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.16 seconds)6474worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6475worker1 # [ 310.667604] nix-grpc-daemon[1154]: ts=2026-09-20T08:10:01Z level=info event=healthy reason=min_free6476worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds)6477(finished: subtest: low disk drains a worker and builds go to the other, in 10.82 seconds)6478(finished: run the VM test script, in 312.33 seconds)6479test script finished in 312.63s6480cleanup6481kill QemuMachine (pid 49)6482client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6483kill QemuMachine (pid 50)6484lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6485kill QemuMachine (pid 52)6486worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6487kill QemuMachine (pid 51)6488worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6489(finished: cleanup, in 1.32 seconds)6490additionally exposed symbols:6491 client, lb, worker1, worker2,6492 vlan1,6493 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh