vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #494
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12lb # Disk image does not exist, creating the virtualisation disk image...13lb # Formatting '/build/vm-state-lb/tmp.DA7SpoPFbi', fmt=raw size=107374182414lb: QEMU running (pid 50)15lb # mke2fs 1.47.4 (6-Mar-2025)16worker1 # Disk image does not exist, creating the virtualisation disk image...17client # Disk image does not exist, creating the virtualisation disk image...18worker1: QEMU running (pid 51)19worker2 # Disk image does not exist, creating the virtualisation disk image...20lb # Discarding device blocks: 0/262144 done21client # Formatting '/build/vm-state-client/tmp.DoBqKgHT9C', fmt=raw size=107374182422client: QEMU running (pid 49)23worker2: QEMU running (pid 52)24worker1 # Formatting '/build/vm-state-worker1/tmp.j4jzdnqcLd', fmt=raw size=107374182425worker2 # Formatting '/build/vm-state-worker2/tmp.n0XvmUK5SI', fmt=raw size=107374182426client # mke2fs 1.47.4 (6-Mar-2025)27lb # Creating filesystem with 262144 4k blocks and 65536 inodes28(finished: start all VMs, in 0.47 seconds)29client # Discarding device blocks: 0/262144 done30lb # Filesystem UUID: 07be956b-033a-4433-bc3a-3bfb8ecc4f1831client: waiting for unit network-addresses-eth1.service32client # Creating filesystem with 262144 4k blocks and 65536 inodes33lb # Superblock backups stored on blocks:34client: waiting for the VM to finish booting35client # Filesystem UUID: e826bce4-473b-4bd8-ab0f-c3dec2a8c8fb36lb # 32768, 98304, 163840, 22937637worker2 # mke2fs 1.47.4 (6-Mar-2025)38worker1 # mke2fs 1.47.4 (6-Mar-2025)39client # Superblock backups stored on blocks:40lb # 41worker2 # Discarding device blocks: 0/262144 done42worker1 # Discarding device blocks: 0/262144 done43client # 32768, 98304, 163840, 22937644lb # Allocating group tables: 0/8 done45worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes46worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes47client # 48lb # Writing inode tables: 0/8 done49worker2 # Filesystem UUID: 3cf632ec-4374-4eb2-a6a1-4d2b3561a9ea50worker1 # Filesystem UUID: d9abe3d5-0b18-48bb-86a5-64ba24c0fec751client # Allocating group tables: 0/8 done52lb # Creating journal (8192 blocks): done53worker2 # Superblock backups stored on blocks:54worker1 # Superblock backups stored on blocks:55client # Writing inode tables: 0/8 done56lb # Writing superblocks and filesystem accounting information: 0/8 done57worker2 # 32768, 98304, 163840, 22937658worker1 # 32768, 98304, 163840, 22937659client # Creating journal (8192 blocks): done60lb # 61worker2 # 62worker1 # 63client # Writing superblocks and filesystem accounting information: 0/8 done64lb # Virtualisation disk image created.65worker2 # Allocating group tables: 0/8 done66worker1 # Allocating group tables: 0/8 done67worker2 # Writing inode tables: 0/8 done68worker1 # Writing inode tables: 0/8 done69worker2 # Creating journal (8192 blocks): done70worker1 # Creating journal (8192 blocks): done71worker2 # Writing superblocks and filesystem accounting information: 0/8 done72worker1 # Writing superblocks and filesystem accounting information: 0/8 done73worker2 # 74worker1 # 75worker2 # Virtualisation disk image created.76worker1 # Virtualisation disk image created.77client # 78client # Virtualisation disk image created.79lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]80lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202681lb # [ 0.000000] KASLR enabled82lb # [ 0.000000] random: crng init done83lb # [ 0.000000] Machine model: linux,dummy-virt84lb # [ 0.000000] efi: UEFI not found.85lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT86lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]87lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]88lb # [ 0.000000] Zone ranges:89lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]90lb # [ 0.000000] DMA32 empty91lb # [ 0.000000] Normal empty92lb # [ 0.000000] Device empty93lb # [ 0.000000] Movable zone start for each node94lb # [ 0.000000] Early memory node ranges95lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]96lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]97lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c40000098lb # [ 0.000000] psci: probing for conduit method from DT.99lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.100lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs101lb # [ 0.000000] psci: Trusted OS migration not required102lb # [ 0.000000] psci: SMC Calling Convention v1.1103lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)104lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296105lb # [ 0.000000] Detected PIPT I-cache on CPU0106lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)107lb # [ 0.000000] CPU features: detected: GICv3 CPU interface108lb # [ 0.000000] CPU features: detected: Spectre-v4109lb # [ 0.000000] CPU features: detected: Spectre-BHB110lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38111lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23112lb # [ 0.000000] alternatives: applying boot alternatives113lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/mmnw0b9xdzgvlxb4mzaa4gjdldj887b1-nixos-system-lb-test/init regInfo=/nix/store/mmqsdvj4977m1gdgnvij2v3i1inliqqm-closure-info/registration console=ttyAMA0,115200n8 console=tty0114lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/mmqsdvj4977m1gdgnvij2v3i1inliqqm-closure-info/registration", will be passed to user space.115lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes116lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)117lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)118lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB119lb # [ 0.000000] software IO TLB: area num 1.120lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB121lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)122lb # [ 0.000000] Fallback order for Node 0: 0123lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216124lb # [ 0.000000] Policy zone: DMA125lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off126lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1127lb # [ 0.000000] allocated 3145728 bytes of page_ext128lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages129lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups130lb # [ 0.000000] rcu: Hierarchical RCU implementation.131lb # [ 0.000000] rcu: RCU event tracing is enabled.132lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.133lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.134lb # [ 0.000000] Rude variant of Tasks RCU enabled.135lb # [ 0.000000] Tracing variant of Tasks RCU enabled.136lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.137lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1138lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.139lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.140lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.141lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0142lb # [ 0.000000] GICv3: 256 SPIs implemented143lb # [ 0.000000] GICv3: 0 Extended SPIs implemented144lb # [ 0.000000] Root IRQ handler: gic_handle_irq145lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI146lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0147lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000148lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]149lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)150lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)151lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000152lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000153lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.154lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns155lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).156lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns157lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns158lb # [ 0.000034] arm-pv: using stolen time PV159lb # [ 0.000673] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)160lb # [ 0.000842] Console: colour dummy device 80x25161lb # [ 0.000850] printk: legacy console [tty0] enabled162lb # [ 0.001065] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)163lb # [ 0.001072] pid_max: default: 32768 minimum: 301164lb # [ 0.001143] LSM: initializing lsm=capability,landlock,yama,bpf,ima165lb # [ 0.001313] landlock: Up and running.166lb # [ 0.001316] Yama: becoming mindful.167lb # [ 0.001948] LSM support for eBPF active168lb # [ 0.002113] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)169lb # [ 0.002148] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)170lb # [ 0.003345] cacheinfo: Unable to detect cache hierarchy for CPU 0171worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]172lb # [ 0.004135] rcu: Hierarchical SRCU implementation.173lb # [ 0.004139] rcu: Max phase no-delay instances is 1000.174lb # [ 0.005375] fsl-mc MSI: its@8080000 domain created175worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026176worker1 # [ 0.000000] KASLR enabled177lb # [ 0.005472] EFI services will not be available.178worker1 # [ 0.000000] random: crng init done179lb # [ 0.005543] smp: Bringing up secondary CPUs ...180worker1 # [ 0.000000] Machine model: linux,dummy-virt181lb # [ 0.005551] smp: Brought up 1 node, 1 CPU182worker1 # [ 0.000000] efi: UEFI not found.183lb # [ 0.005554] SMP: Total of 1 processors activated.184worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT185lb # [ 0.005560] CPU: All CPU(s) started at EL1186lb # [ 0.005571] CPU features: detected: Branch Target Identification187worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]188lb # [ 0.005576] CPU features: detected: ARMv8.4 Translation Table Level189worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]190worker1 # [ 0.000000] Zone ranges:191worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]192lb # [ 0.005579] CPU features: detected: Instruction cache invalidation not required for I/D coherence193worker1 # [ 0.000000] DMA32 empty194worker1 # [ 0.000000] Normal empty195lb # [ 0.005582] CPU features: detected: Data cache clean to the PoU not required for I/D coherence196worker1 # [ 0.000000] Device empty197worker1 # [ 0.000000] Movable zone start for each node198lb # [ 0.005586] CPU features: detected: Common not Private translations199worker1 # [ 0.000000] Early memory node ranges200lb # [ 0.005589] CPU features: detected: CRC32 instructions201worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]202lb # [ 0.005592] CPU features: detected: Data cache clean to Point of Deep Persistence203worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]204lb # [ 0.005595] CPU features: detected: Data cache clean to Point of Persistence205worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000206worker1 # [ 0.000000] psci: probing for conduit method from DT.207lb # [ 0.005599] CPU features: detected: Data independent timing control (DIT)208lb # [ 0.005602] CPU features: detected: E0PD209worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.210worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs211lb # [ 0.005604] CPU features: detected: Enhanced Counter Virtualization212worker1 # [ 0.000000] psci: Trusted OS migration not required213lb # [ 0.005607] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)214worker1 # [ 0.000000] psci: SMC Calling Convention v1.1215lb # [ 0.005610] CPU features: detected: Enhanced Virtualization Traps216worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)217lb # [ 0.005613] CPU features: detected: Fine Grained Traps218worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296219lb # [ 0.005617] CPU features: detected: Generic authentication (architected QARMA5 algorithm)220worker1 # [ 0.000000] Detected PIPT I-cache on CPU0221lb # [ 0.005622] CPU features: detected: RCpc load-acquire (LDAPR)222client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]223worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)224lb # [ 0.005625] CPU features: detected: LSE atomic instructions225worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface226lb # [ 0.005628] CPU features: detected: Privileged Access Never227worker1 # [ 0.000000] CPU features: detected: Spectre-v4228client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026229client # [ 0.000000] KASLR enabled230worker1 # [ 0.000000] CPU features: detected: Spectre-BHB231client # [ 0.000000] random: crng init done232lb # [ 0.005631] CPU features: detected: PMUv3233worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38234client # [ 0.000000] Machine model: linux,dummy-virt235lb # [ 0.005634] CPU features: detected: RAS Extension Support236client # [ 0.000000] efi: UEFI not found.237worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23238lb # [ 0.005636] CPU features: detected: RASv1p1 Extension Support239worker1 # [ 0.000000] alternatives: applying boot alternatives240client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT241lb # [ 0.005639] CPU features: detected: Random Number Generator242worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]243client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]244lb # [ 0.005642] CPU features: detected: Speculation barrier (SB)245client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]246lb # [ 0.005645] CPU features: detected: Stage-2 Force Write-Back247client # [ 0.000000] Zone ranges:248worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026249lb # [ 0.005648] CPU features: detected: TLB range maintenance instructions250client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]251worker2 # [ 0.000000] KASLR enabled252client # [ 0.000000] DMA32 empty253worker2 # [ 0.000000] random: crng init done254client # [ 0.000000] Normal empty255lb # [ 0.005652] CPU features: detected: Speculative Store Bypassing Safe (SSBS)256worker2 # [ 0.000000] Machine model: linux,dummy-virt257client # [ 0.000000] Device empty258worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/jdhvrs825rsiy84pb0hh6xpn5y46nz5i-nixos-system-worker1-test/init regInfo=/nix/store/nqfwhwa8vic3p0f41m54yq7w2n4hzbsp-closure-info/registration console=ttyAMA0,115200n8 console=tty0259worker2 # [ 0.000000] efi: UEFI not found.260lb # [ 0.005693] alternatives: applying system-wide alternatives261client # [ 0.000000] Movable zone start for each node262client # [ 0.000000] Early memory node ranges263worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT264lb # [ 0.008606] CPU features: detected: BBM Level 2 without TLB conflict abort265client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]266worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]267client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]268worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/nqfwhwa8vic3p0f41m54yq7w2n4hzbsp-closure-info/registration", will be passed to user space.269worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]270lb # [ 0.008779] Memory: 1406552K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)271worker2 # [ 0.000000] Zone ranges:272client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000273lb # [ 0.009149] devtmpfs: initialized274worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes275worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]276client # [ 0.000000] psci: probing for conduit method from DT.277worker2 # [ 0.000000] DMA32 empty278lb # [ 0.011011] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)279worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)280client # [ 0.000000] psci: PSCIv1.3 detected in firmware.281worker2 # [ 0.000000] Normal empty282worker2 # [ 0.000000] Device empty283client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs284lb # [ 0.011035] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).285worker2 # [ 0.000000] Movable zone start for each node286worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)287client # [ 0.000000] psci: Trusted OS migration not required288worker2 # [ 0.000000] Early memory node ranges289lb # [ 0.011229] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL290client # [ 0.000000] psci: SMC Calling Convention v1.1291worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB292lb # [ 0.011234] 0 pages in range for non-PLT usage293worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]294worker1 # [ 0.000000] software IO TLB: area num 1.295lb # [ 0.011236] 508288 pages in range for PLT usage296client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)297worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB298worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]299lb # [ 0.011326] pinctrl core: initialized pinctrl subsystem300client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296301worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000302lb # [ 0.012135] DMI not present or invalid.303worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)304client # [ 0.000000] Detected PIPT I-cache on CPU0305worker2 # [ 0.000000] psci: probing for conduit method from DT.306worker1 # [ 0.000000] Fallback order for Node 0: 0307lb # [ 0.015844] NET: Registered PF_NETLINK/PF_ROUTE protocol family308worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.309client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)310worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216311lb # [ 0.018228] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations312worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs313worker1 # [ 0.000000] Policy zone: DMA314client # [ 0.000000] CPU features: detected: GICv3 CPU interface315worker2 # [ 0.000000] psci: Trusted OS migration not required316lb # [ 0.018408] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations317client # [ 0.000000] CPU features: detected: Spectre-v4318worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off319worker2 # [ 0.000000] psci: SMC Calling Convention v1.1320client # [ 0.000000] CPU features: detected: Spectre-BHB321worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1322lb # [ 0.018608] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations323client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38324worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)325worker1 # [ 0.000000] allocated 3145728 bytes of page_ext326lb # [ 0.018629] audit: initializing netlink subsys (disabled)327client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23328worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages329worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296330lb # [ 0.019202] thermal_sys: Registered thermal governor 'fair_share'331client # [ 0.000000] alternatives: applying boot alternatives332worker2 # [ 0.000000] Detected PIPT I-cache on CPU0333worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups334lb # [ 0.019204] thermal_sys: Registered thermal governor 'bang_bang'335worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.336worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)337lb # [ 0.019209] thermal_sys: Registered thermal governor 'step_wise'338worker1 # [ 0.000000] rcu: RCU event tracing is enabled.339worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface340lb # [ 0.019214] thermal_sys: Registered thermal governor 'user_space'341worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.342worker2 # [ 0.000000] CPU features: detected: Spectre-v4343lb # [ 0.019217] thermal_sys: Registered thermal governor 'power_allocator'344worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.345worker2 # [ 0.000000] CPU features: detected: Spectre-BHB346worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.347worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38348lb # [ 0.019243] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1349worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.350client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/6b5rml6i9p712zg1skvis9gaqm5x73y4-nixos-system-client-test/init regInfo=/nix/store/yks38jqxpxzi7f11m3wlfkip0a2p8bc5-closure-info/registration console=ttyAMA0,115200n8 console=tty0351lb # [ 0.019251] cpuidle: using governor ladder352worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23353lb # [ 0.019257] cpuidle: using governor menu354worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.355worker2 # [ 0.000000] alternatives: applying boot alternatives356lb # [ 0.019483] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.357worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1358client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/yks38jqxpxzi7f11m3wlfkip0a2p8bc5-closure-info/registration", will be passed to user space.359lb # [ 0.019500] ASID allocator initialised with 65536 entries360client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes361lb # [ 0.020770] Serial: AMBA PL011 UART driver362worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.363client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)364lb # [ 0.026221] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1365worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.366lb # [ 0.026356] printk: console [ttyAMA0] enabled367client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)368worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/9shj5vaqw4m1z3mafg6b2c3h4s6z6br5-nixos-system-worker2-test/init regInfo=/nix/store/m5hl72yawnbkmsmy22x935izz58i4hqr-closure-info/registration console=ttyAMA0,115200n8 console=tty0369worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.370worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0371client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB372worker1 # [ 0.000000] GICv3: 256 SPIs implemented373client # [ 0.000000] software IO TLB: area num 1.374worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented375worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/m5hl72yawnbkmsmy22x935izz58i4hqr-closure-info/registration", will be passed to user space.376worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq377client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB378worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI379client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)380worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes381worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0382client # [ 0.000000] Fallback order for Node 0: 0383worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000384worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)385client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216386worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]387client # [ 0.000000] Policy zone: DMA388worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)389client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off390worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)391worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB392worker2 # [ 0.000000] software IO TLB: area num 1.393client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1394worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)395client # [ 0.000000] allocated 3145728 bytes of page_ext396worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB397client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages398worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000399worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)400client # [ 0.000000] ftrace: allocated 294 pages with 4 groups401worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000402worker2 # [ 0.000000] Fallback order for Node 0: 0403lb # [ 0.149455] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages404client # [ 0.000000] rcu: Hierarchical RCU implementation.405worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.406client # [ 0.000000] rcu: RCU event tracing is enabled.407worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216408lb # [ 0.149473] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page409worker2 # [ 0.000000] Policy zone: DMA410client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.411lb # [ 0.149478] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages412worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns413worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off414client # [ 0.000000] Trampoline variant of Tasks RCU enabled.415lb # [ 0.149483] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page416client # [ 0.000000] Rude variant of Tasks RCU enabled.417worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1418worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).419client # [ 0.000000] Tracing variant of Tasks RCU enabled.420worker2 # [ 0.000000] allocated 3145728 bytes of page_ext421lb # [ 0.149487] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages422worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages423worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns424client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.425lb # [ 0.149492] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page426worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups427worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns428client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1429lb # [ 0.149496] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages430worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.431worker1 # [ 0.000031] arm-pv: using stolen time PV432worker2 # [ 0.000000] rcu: RCU event tracing is enabled.433lb # [ 0.149500] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page434client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.435worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.436worker1 # [ 0.000522] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)437client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.438worker1 # [ 0.000698] Console: colour dummy device 80x25439worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.440worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.441worker1 # [ 0.000705] printk: legacy console [tty0] enabled442lb # [ 0.156652] fbcon: Taking over console443client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.444worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.445lb # [ 0.156667] ACPI: Interpreter disabled.446client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0447worker1 # [ 0.000922] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)448worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.449client # [ 0.000000] GICv3: 256 SPIs implemented450lb # [ 0.158507] iommu: Default domain type: Translated451worker1 # [ 0.000929] pid_max: default: 32768 minimum: 301452client # [ 0.000000] GICv3: 0 Extended SPIs implemented453worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1454lb # [ 0.158516] iommu: DMA domain TLB invalidation policy: strict mode455worker1 # [ 0.001030] LSM: initializing lsm=capability,landlock,yama,bpf,ima456client # [ 0.000000] Root IRQ handler: gic_handle_irq457worker1 # [ 0.001181] landlock: Up and running.458worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.459client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI460lb # [ 0.160114] SCSI subsystem initialized461worker1 # [ 0.001183] Yama: becoming mindful.462client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0463worker1 # [ 0.001724] LSM support for eBPF active464worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.465client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000466worker1 # [ 0.001862] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)467client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]468worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.469worker1 # [ 0.001900] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)470worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0471client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)472worker1 # [ 0.003050] cacheinfo: Unable to detect cache hierarchy for CPU 0473worker2 # [ 0.000000] GICv3: 256 SPIs implemented474worker1 # [ 0.003794] rcu: Hierarchical SRCU implementation.475worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented476client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)477worker1 # [ 0.003799] rcu: Max phase no-delay instances is 1000.478worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq479client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000480worker1 # [ 0.005045] fsl-mc MSI: its@8080000 domain created481worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI482worker1 # [ 0.005137] EFI services will not be available.483worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0484client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000485worker1 # [ 0.005213] smp: Bringing up secondary CPUs ...486worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000487worker1 # [ 0.005221] smp: Brought up 1 node, 1 CPU488client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.489lb # [ 0.165682] usbcore: registered new interface driver usbfs490worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]491lb # [ 0.165714] usbcore: registered new interface driver hub492worker1 # [ 0.005225] SMP: Total of 1 processors activated.493worker1 # [ 0.005230] CPU: All CPU(s) started at EL1494lb # [ 0.165732] usbcore: registered new device driver usb495client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns496worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)497lb # [ 0.165996] pps_core: LinuxPPS API ver. 1 registered498worker1 # [ 0.005240] CPU features: detected: Branch Target Identification499client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).500worker1 # [ 0.005245] CPU features: detected: ARMv8.4 Translation Table Level501worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)502lb # [ 0.166002] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>503client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns504worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000505lb # [ 0.166011] PTP clock support registered506worker1 # [ 0.005248] CPU features: detected: Instruction cache invalidation not required for I/D coherence507lb # [ 0.166059] EDAC MC: Ver: 3.0.0508client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns509worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000510lb # [ 0.170429] scmi_core: SCMI protocol bus registered511worker1 # [ 0.005251] CPU features: detected: Data cache clean to the PoU not required for I/D coherence512client # [ 0.000028] arm-pv: using stolen time PV513worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.514worker1 # [ 0.005255] CPU features: detected: Common not Private translations515lb # [ 0.171354] FPGA manager framework516client # [ 0.000379] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)517worker1 # [ 0.005258] CPU features: detected: CRC32 instructions518lb # [ 0.172325] vgaarb: loaded519worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns520client # [ 0.000529] Console: colour dummy device 80x25521worker1 # [ 0.005261] CPU features: detected: Data cache clean to Point of Deep Persistence522worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).523client # [ 0.000536] printk: legacy console [tty0] enabled524lb # [ 0.172929] clocksource: Switched to clocksource arch_sys_counter525worker1 # [ 0.005264] CPU features: detected: Data cache clean to Point of Persistence526client # [ 0.000722] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)527worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns528worker1 # [ 0.005268] CPU features: detected: Data independent timing control (DIT)529client # [ 0.000729] pid_max: default: 32768 minimum: 301530worker1 # [ 0.005271] CPU features: detected: E0PD531worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns532client # [ 0.000804] LSM: initializing lsm=capability,landlock,yama,bpf,ima533worker1 # [ 0.005273] CPU features: detected: Enhanced Counter Virtualization534worker2 # [ 0.000029] arm-pv: using stolen time PV535client # [ 0.000934] landlock: Up and running.536client # [ 0.000937] Yama: becoming mindful.537worker1 # [ 0.005276] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)538client # [ 0.001363] LSM support for eBPF active539lb # [ 0.176611] VFS: Disk quotas dquot_6.6.0540worker2 # [ 0.000401] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)541worker1 # [ 0.005280] CPU features: detected: Enhanced Virtualization Traps542worker2 # [ 0.000574] Console: colour dummy device 80x25543client # [ 0.001512] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)544lb # [ 0.176644] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)545worker1 # [ 0.005283] CPU features: detected: Fine Grained Traps546worker2 # [ 0.000582] printk: legacy console [tty0] enabled547client # [ 0.001544] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)548worker1 # [ 0.005285] CPU features: detected: Generic authentication (architected QARMA5 algorithm)549client # [ 0.002706] cacheinfo: Unable to detect cache hierarchy for CPU 0550worker2 # [ 0.000779] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)551worker1 # [ 0.005290] CPU features: detected: RCpc load-acquire (LDAPR)552client # [ 0.003387] rcu: Hierarchical SRCU implementation.553worker2 # [ 0.000785] pid_max: default: 32768 minimum: 301554worker1 # [ 0.005293] CPU features: detected: LSE atomic instructions555client # [ 0.003391] rcu: Max phase no-delay instances is 1000.556lb # [ 0.180181] netfs: FS-Cache loaded557worker2 # [ 0.000862] LSM: initializing lsm=capability,landlock,yama,bpf,ima558worker1 # [ 0.005296] CPU features: detected: Privileged Access Never559lb # [ 0.180305] pnp: PnP ACPI: disabled560worker2 # [ 0.000991] landlock: Up and running.561client # [ 0.004615] fsl-mc MSI: its@8080000 domain created562worker1 # [ 0.005298] CPU features: detected: PMUv3563worker2 # [ 0.000994] Yama: becoming mindful.564client # [ 0.004706] EFI services will not be available.565worker2 # [ 0.001455] LSM support for eBPF active566worker1 # [ 0.005301] CPU features: detected: RAS Extension Support567client # [ 0.004770] smp: Bringing up secondary CPUs ...568client # [ 0.004778] smp: Brought up 1 node, 1 CPU569worker1 # [ 0.005304] CPU features: detected: RASv1p1 Extension Support570worker2 # [ 0.001608] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)571client # [ 0.004781] SMP: Total of 1 processors activated.572worker1 # [ 0.005306] CPU features: detected: Random Number Generator573client # [ 0.004787] CPU: All CPU(s) started at EL1574worker2 # [ 0.001640] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)575worker1 # [ 0.005309] CPU features: detected: Speculation barrier (SB)576client # [ 0.004797] CPU features: detected: Branch Target Identification577worker2 # [ 0.002719] cacheinfo: Unable to detect cache hierarchy for CPU 0578worker1 # [ 0.005311] CPU features: detected: Stage-2 Force Write-Back579worker2 # [ 0.003468] rcu: Hierarchical SRCU implementation.580client # [ 0.004802] CPU features: detected: ARMv8.4 Translation Table Level581lb # [ 0.184027] NET: Registered PF_INET protocol family582worker1 # [ 0.005314] CPU features: detected: TLB range maintenance instructions583worker2 # [ 0.003472] rcu: Max phase no-delay instances is 1000.584client # [ 0.004805] CPU features: detected: Instruction cache invalidation not required for I/D coherence585worker2 # [ 0.005068] fsl-mc MSI: its@8080000 domain created586lb # [ 0.184295] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)587worker1 # [ 0.005319] CPU features: detected: Speculative Store Bypassing Safe (SSBS)588worker2 # [ 0.005161] EFI services will not be available.589worker1 # [ 0.005360] alternatives: applying system-wide alternatives590client # [ 0.004809] CPU features: detected: Data cache clean to the PoU not required for I/D coherence591worker2 # [ 0.005241] smp: Bringing up secondary CPUs ...592worker2 # [ 0.005249] smp: Brought up 1 node, 1 CPU593worker1 # [ 0.008275] CPU features: detected: BBM Level 2 without TLB conflict abort594client # [ 0.004812] CPU features: detected: Common not Private translations595worker2 # [ 0.005252] SMP: Total of 1 processors activated.596client # [ 0.004815] CPU features: detected: CRC32 instructions597worker2 # [ 0.005257] CPU: All CPU(s) started at EL1598client # [ 0.004818] CPU features: detected: Data cache clean to Point of Deep Persistence599worker1 # [ 0.008507] Memory: 1406528K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)600worker2 # [ 0.005269] CPU features: detected: Branch Target Identification601worker1 # [ 0.008943] devtmpfs: initialized602client # [ 0.004822] CPU features: detected: Data cache clean to Point of Persistence603worker2 # [ 0.005274] CPU features: detected: ARMv8.4 Translation Table Level604worker1 # [ 0.010744] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)605client # [ 0.004825] CPU features: detected: Data independent timing control (DIT)606worker2 # [ 0.005278] CPU features: detected: Instruction cache invalidation not required for I/D coherence607client # [ 0.004828] CPU features: detected: E0PD608worker1 # [ 0.010765] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).609client # [ 0.004831] CPU features: detected: Enhanced Counter Virtualization610worker2 # [ 0.005281] CPU features: detected: Data cache clean to the PoU not required for I/D coherence611worker1 # [ 0.010953] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL612worker2 # [ 0.005285] CPU features: detected: Common not Private translations613client # [ 0.004834] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)614worker1 # [ 0.010957] 0 pages in range for non-PLT usage615worker2 # [ 0.005288] CPU features: detected: CRC32 instructions616client # [ 0.004837] CPU features: detected: Enhanced Virtualization Traps617worker1 # [ 0.010958] 508288 pages in range for PLT usage618worker1 # [ 0.011051] pinctrl core: initialized pinctrl subsystem619client # [ 0.004840] CPU features: detected: Fine Grained Traps620worker2 # [ 0.005291] CPU features: detected: Data cache clean to Point of Deep Persistence621worker1 # [ 0.011771] DMI not present or invalid.622client # [ 0.004843] CPU features: detected: Generic authentication (architected QARMA5 algorithm)623worker2 # [ 0.005295] CPU features: detected: Data cache clean to Point of Persistence624worker1 # [ 0.014814] NET: Registered PF_NETLINK/PF_ROUTE protocol family625client # [ 0.004848] CPU features: detected: RCpc load-acquire (LDAPR)626worker2 # [ 0.005298] CPU features: detected: Data independent timing control (DIT)627worker1 # [ 0.017112] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations628worker2 # [ 0.005301] CPU features: detected: E0PD629client # [ 0.004851] CPU features: detected: LSE atomic instructions630worker1 # [ 0.017305] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations631client # [ 0.004853] CPU features: detected: Privileged Access Never632worker2 # [ 0.005304] CPU features: detected: Enhanced Counter Virtualization633client # [ 0.004856] CPU features: detected: PMUv3634worker2 # [ 0.005307] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)635worker1 # [ 0.017504] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations636client # [ 0.004859] CPU features: detected: RAS Extension Support637worker1 # [ 0.017528] audit: initializing netlink subsys (disabled)638worker2 # [ 0.005310] CPU features: detected: Enhanced Virtualization Traps639client # [ 0.004861] CPU features: detected: RASv1p1 Extension Support640worker2 # [ 0.005313] CPU features: detected: Fine Grained Traps641worker1 # [ 0.018047] thermal_sys: Registered thermal governor 'fair_share'642client # [ 0.004864] CPU features: detected: Random Number Generator643client # [ 0.004867] CPU features: detected: Speculation barrier (SB)644worker2 # [ 0.005317] CPU features: detected: Generic authentication (architected QARMA5 algorithm)645client # [ 0.004869] CPU features: detected: Stage-2 Force Write-Back646worker2 # [ 0.005322] CPU features: detected: RCpc load-acquire (LDAPR)647worker2 # [ 0.005325] CPU features: detected: LSE atomic instructions648client # [ 0.004872] CPU features: detected: TLB range maintenance instructions649worker2 # [ 0.005328] CPU features: detected: Privileged Access Never650client # [ 0.004876] CPU features: detected: Speculative Store Bypassing Safe (SSBS)651worker2 # [ 0.005331] CPU features: detected: PMUv3652client # [ 0.004912] alternatives: applying system-wide alternatives653worker2 # [ 0.005334] CPU features: detected: RAS Extension Support654client # [ 0.007770] CPU features: detected: BBM Level 2 without TLB conflict abort655worker2 # [ 0.005336] CPU features: detected: RASv1p1 Extension Support656worker2 # [ 0.005339] CPU features: detected: Random Number Generator657worker2 # [ 0.005342] CPU features: detected: Speculation barrier (SB)658client # [ 0.007958] Memory: 1406512K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)659worker2 # [ 0.005345] CPU features: detected: Stage-2 Force Write-Back660client # [ 0.008337] devtmpfs: initialized661worker2 # [ 0.005348] CPU features: detected: TLB range maintenance instructions662client # [ 0.010110] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)663worker2 # [ 0.005352] CPU features: detected: Speculative Store Bypassing Safe (SSBS)664client # [ 0.010131] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).665worker1 # [ 0.018049] thermal_sys: Registered thermal governor 'bang_bang'666worker2 # [ 0.005389] alternatives: applying system-wide alternatives667worker1 # [ 0.018053] thermal_sys: Registered thermal governor 'step_wise'668client # [ 0.010302] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL669worker2 # [ 0.008402] CPU features: detected: BBM Level 2 without TLB conflict abort670client # [ 0.010307] 0 pages in range for non-PLT usage671worker1 # [ 0.018058] thermal_sys: Registered thermal governor 'user_space'672client # [ 0.010308] 508288 pages in range for PLT usage673worker1 # [ 0.018061] thermal_sys: Registered thermal governor 'power_allocator'674client # [ 0.010414] pinctrl core: initialized pinctrl subsystem675worker2 # [ 0.008559] Memory: 1406536K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)676client # [ 0.011200] DMI not present or invalid.677worker1 # [ 0.018093] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1678worker2 # [ 0.008920] devtmpfs: initialized679client # [ 0.014252] NET: Registered PF_NETLINK/PF_ROUTE protocol family680worker1 # [ 0.018102] cpuidle: using governor ladder681worker2 # [ 0.010713] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)682worker1 # [ 0.018108] cpuidle: using governor menu683client # [ 0.016570] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations684worker1 # [ 0.018300] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.685worker2 # [ 0.010736] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).686worker1 # [ 0.018315] ASID allocator initialised with 65536 entries687worker2 # [ 0.010909] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL688worker1 # [ 0.019513] Serial: AMBA PL011 UART driver689worker2 # [ 0.010913] 0 pages in range for non-PLT usage690worker2 # [ 0.010914] 508288 pages in range for PLT usage691worker1 # [ 0.024657] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1692worker2 # [ 0.011020] pinctrl core: initialized pinctrl subsystem693worker1 # [ 0.024778] printk: console [ttyAMA0] enabled694worker2 # [ 0.011761] DMI not present or invalid.695worker1 # [ 0.144654] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages696worker2 # [ 0.014971] NET: Registered PF_NETLINK/PF_ROUTE protocol family697worker1 # [ 0.144672] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page698worker2 # [ 0.017202] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations699worker1 # [ 0.144677] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages700worker2 # [ 0.017386] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations701worker1 # [ 0.144681] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page702worker2 # [ 0.017584] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations703worker1 # [ 0.144685] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages704worker2 # [ 0.017606] audit: initializing netlink subsys (disabled)705worker1 # [ 0.144690] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page706worker2 # [ 0.018209] thermal_sys: Registered thermal governor 'fair_share'707client # [ 0.016758] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations708worker1 # [ 0.144694] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages709worker2 # [ 0.018211] thermal_sys: Registered thermal governor 'bang_bang'710lb # [ 0.213110] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)711worker1 # [ 0.144698] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page712client # [ 0.016956] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations713worker2 # [ 0.018215] thermal_sys: Registered thermal governor 'step_wise'714lb # [ 0.213155] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)715client # [ 0.016978] audit: initializing netlink subsys (disabled)716worker2 # [ 0.018220] thermal_sys: Registered thermal governor 'user_space'717client # [ 0.017564] thermal_sys: Registered thermal governor 'fair_share'718lb # [ 0.213182] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)719worker2 # [ 0.018223] thermal_sys: Registered thermal governor 'power_allocator'720client # [ 0.017566] thermal_sys: Registered thermal governor 'bang_bang'721worker1 # [ 0.152047] fbcon: Taking over console722lb # [ 0.213251] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)723worker1 # [ 0.152062] ACPI: Interpreter disabled.724client # [ 0.017570] thermal_sys: Registered thermal governor 'step_wise'725lb # [ 0.213395] TCP: Hash tables configured (established 16384 bind 16384)726worker1 # [ 0.153937] iommu: Default domain type: Translated727client # [ 0.017575] thermal_sys: Registered thermal governor 'user_space'728lb # [ 0.213472] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)729worker1 # [ 0.153948] iommu: DMA domain TLB invalidation policy: strict mode730client # [ 0.017577] thermal_sys: Registered thermal governor 'power_allocator'731lb # [ 0.213506] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)732worker1 # [ 0.155593] SCSI subsystem initialized733client # [ 0.017602] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1734client # [ 0.017611] cpuidle: using governor ladder735lb # [ 0.213541] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)736client # [ 0.017617] cpuidle: using governor menu737lb # [ 0.213631] NET: Registered PF_UNIX/PF_LOCAL protocol family738lb # [ 0.213659] NET: Registered PF_XDP protocol family739client # [ 0.017816] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.740lb # [ 0.213675] PCI: CLS 0 bytes, default 64741client # [ 0.017830] ASID allocator initialised with 65536 entries742client # [ 0.019042] Serial: AMBA PL011 UART driver743lb # [ 0.213910] Trying to unpack rootfs image as initramfs...744client # [ 0.024183] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1745client # [ 0.024304] printk: console [ttyAMA0] enabled746worker2 # [ 0.018247] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1747client # [ 0.143747] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages748worker2 # [ 0.018255] cpuidle: using governor ladder749worker1 # [ 0.161050] usbcore: registered new interface driver usbfs750lb # [ 0.230448] kvm [1]: HYP mode not available751worker2 # [ 0.018261] cpuidle: using governor menu752client # [ 0.143766] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page753worker1 # [ 0.161082] usbcore: registered new interface driver hub754worker2 # [ 0.018444] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.755worker1 # [ 0.161107] usbcore: registered new device driver usb756client # [ 0.143771] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages757worker1 # [ 0.161364] pps_core: LinuxPPS API ver. 1 registered758worker2 # [ 0.018459] ASID allocator initialised with 65536 entries759client # [ 0.143776] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page760worker2 # [ 0.019619] Serial: AMBA PL011 UART driver761worker1 # [ 0.161370] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>762client # [ 0.143780] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages763worker1 # [ 0.161380] PTP clock support registered764worker2 # [ 0.024906] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1765client # [ 0.143784] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page766worker1 # [ 0.161433] EDAC MC: Ver: 3.0.0767worker2 # [ 0.025025] printk: console [ttyAMA0] enabled768client # [ 0.143789] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages769worker1 # [ 0.165930] scmi_core: SCMI protocol bus registered770worker2 # [ 0.145073] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages771client # [ 0.143793] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page772worker1 # [ 0.166879] FPGA manager framework773worker2 # [ 0.145092] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page774worker1 # [ 0.167855] vgaarb: loaded775worker2 # [ 0.145098] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages776worker1 # [ 0.168489] clocksource: Switched to clocksource arch_sys_counter777worker2 # [ 0.145102] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page778client # [ 0.151127] fbcon: Taking over console779client # [ 0.151141] ACPI: Interpreter disabled.780worker2 # [ 0.145106] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages781client # [ 0.152991] iommu: Default domain type: Translated782worker2 # [ 0.145111] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page783client # [ 0.153001] iommu: DMA domain TLB invalidation policy: strict mode784worker2 # [ 0.145115] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages785client # [ 0.154726] SCSI subsystem initialized786worker1 # [ 0.172083] VFS: Disk quotas dquot_6.6.0787worker2 # [ 0.145119] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page788worker1 # [ 0.172123] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)789worker2 # [ 0.152720] fbcon: Taking over console790worker2 # [ 0.152734] ACPI: Interpreter disabled.791worker2 # [ 0.154579] iommu: Default domain type: Translated792worker1 # [ 0.175879] netfs: FS-Cache loaded793worker1 # [ 0.175986] pnp: PnP ACPI: disabled794worker2 # [ 0.154589] iommu: DMA domain TLB invalidation policy: strict mode795worker2 # [ 0.156304] SCSI subsystem initialized796client # [ 0.161827] usbcore: registered new interface driver usbfs797client # [ 0.161859] usbcore: registered new interface driver hub798worker1 # [ 0.179847] NET: Registered PF_INET protocol family799client # [ 0.161878] usbcore: registered new device driver usb800worker1 # [ 0.180103] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)801client # [ 0.162172] pps_core: LinuxPPS API ver. 1 registered802client # [ 0.162178] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>803client # [ 0.162188] PTP clock support registered804client # [ 0.162256] EDAC MC: Ver: 3.0.0805client # [ 0.166856] scmi_core: SCMI protocol bus registered806client # [ 0.167824] FPGA manager framework807worker2 # [ 0.163861] usbcore: registered new interface driver usbfs808client # [ 0.168791] vgaarb: loaded809worker2 # [ 0.163894] usbcore: registered new interface driver hub810worker2 # [ 0.163912] usbcore: registered new device driver usb811client # [ 0.169423] clocksource: Switched to clocksource arch_sys_counter812worker2 # [ 0.164170] pps_core: LinuxPPS API ver. 1 registered813worker2 # [ 0.164176] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>814client # [ 0.171233] VFS: Disk quotas dquot_6.6.0815worker2 # [ 0.164186] PTP clock support registered816client # [ 0.171261] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)817worker2 # [ 0.164233] EDAC MC: Ver: 3.0.0818worker2 # [ 0.168867] scmi_core: SCMI protocol bus registered819worker2 # [ 0.169839] FPGA manager framework820worker2 # [ 0.170805] vgaarb: loaded821client # [ 0.174873] netfs: FS-Cache loaded822client # [ 0.174978] pnp: PnP ACPI: disabled823worker2 # [ 0.171443] clocksource: Switched to clocksource arch_sys_counter824worker2 # [ 0.172067] VFS: Disk quotas dquot_6.6.0825worker2 # [ 0.172092] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)826worker2 # [ 0.174407] netfs: FS-Cache loaded827worker2 # [ 0.174536] pnp: PnP ACPI: disabled828client # [ 0.178761] NET: Registered PF_INET protocol family829client # [ 0.179027] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)830worker2 # [ 0.180411] NET: Registered PF_INET protocol family831worker2 # [ 0.180668] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)832worker1 # [ 0.208679] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)833worker1 # [ 0.208723] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)834worker1 # [ 0.208751] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)835worker1 # [ 0.208821] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)836worker1 # [ 0.208964] TCP: Hash tables configured (established 16384 bind 16384)837worker1 # [ 0.209052] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)838worker1 # [ 0.209087] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)839worker1 # [ 0.209122] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)840worker1 # [ 0.209225] NET: Registered PF_UNIX/PF_LOCAL protocol family841worker1 # [ 0.209248] NET: Registered PF_XDP protocol family842worker1 # [ 0.209265] PCI: CLS 0 bytes, default 64843worker1 # [ 0.209508] Trying to unpack rootfs image as initramfs...844client # [ 0.207867] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)845client # [ 0.207915] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)846worker1 # [ 0.226119] kvm [1]: HYP mode not available847client # [ 0.207941] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)848client # [ 0.208010] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)849client # [ 0.208152] TCP: Hash tables configured (established 16384 bind 16384)850client # [ 0.208238] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)851client # [ 0.208276] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)852worker2 # [ 0.209996] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)853client # [ 0.208312] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)854client # [ 0.208406] NET: Registered PF_UNIX/PF_LOCAL protocol family855worker2 # [ 0.210044] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)856client # [ 0.208432] NET: Registered PF_XDP protocol family857client # [ 0.208449] PCI: CLS 0 bytes, default 64858worker2 # [ 0.210074] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)859client # [ 0.208708] Trying to unpack rootfs image as initramfs...860worker2 # [ 0.210146] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)861worker2 # [ 0.210289] TCP: Hash tables configured (established 16384 bind 16384)862worker2 # [ 0.210373] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)863worker2 # [ 0.210406] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)864client # [ 0.223015] kvm [1]: HYP mode not available865worker2 # [ 0.210442] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)866worker2 # [ 0.210530] NET: Registered PF_UNIX/PF_LOCAL protocol family867lb # [ 0.315241] Initialise system trusted keyrings868worker2 # [ 0.210555] NET: Registered PF_XDP protocol family869worker2 # [ 0.210573] PCI: CLS 0 bytes, default 64870worker2 # [ 0.210823] Trying to unpack rootfs image as initramfs...871lb # [ 0.320986] workingset: timestamp_bits=42 max_order=19 bucket_order=0872lb # [ 0.322383] squashfs: version 4.0 (2009/01/31) Phillip Lougher873worker2 # [ 0.225182] kvm [1]: HYP mode not available874lb # [ 0.323144] 9p: Installing v9fs 9p2000 file system support875lb # [ 0.343722] Key type asymmetric registered876lb # [ 0.343743] Asymmetric key parser 'x509' registered877lb # [ 0.343817] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)878lb # [ 0.348973] io scheduler mq-deadline registered879lb # [ 0.348990] io scheduler kyber registered880lb # [ 0.357076] pl061_gpio 9030000.pl061: PL061 GPIO chip registered881lb # [ 0.358419] ledtrig-cpu: registered to indicate activity on CPUs882lb # [ 0.358804] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:883lb # [ 0.358822] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000884lb # [ 0.358834] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000885lb # [ 0.358842] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000886lb # [ 0.358861] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits887lb # [ 0.358884] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]888lb # [ 0.358959] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00889lb # [ 0.358968] pci_bus 0000:00: root bus resource [bus 00-ff]890lb # [ 0.358974] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]891lb # [ 0.358979] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]892lb # [ 0.358984] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]893lb # [ 0.359039] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint894lb # [ 0.359471] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint895lb # [ 0.359652] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]896lb # [ 0.359670] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]897lb # [ 0.359699] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]898lb # [ 0.359715] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]899lb # [ 0.360184] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint900lb # [ 0.360365] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]901lb # [ 0.360381] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]902lb # [ 0.360410] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]903lb # [ 0.360853] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint904worker1 # [ 0.317038] Initialise system trusted keyrings905worker1 # [ 0.317762] workingset: timestamp_bits=42 max_order=19 bucket_order=0906worker1 # [ 0.319026] squashfs: version 4.0 (2009/01/31) Phillip Lougher907worker1 # [ 0.319811] 9p: Installing v9fs 9p2000 file system support908lb # [ 0.389102] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]909lb # [ 0.389133] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]910lb # [ 0.389163] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]911lb # [ 0.389670] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint912lb # [ 0.389857] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]913lb # [ 0.389873] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]914lb # [ 0.389904] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]915lb # [ 0.390359] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint916lb # [ 0.390541] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]917lb # [ 0.390558] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]918lb # [ 0.390587] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]919client # [ 0.316394] Initialise system trusted keyrings920lb # [ 0.391068] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint921client # [ 0.317137] workingset: timestamp_bits=42 max_order=19 bucket_order=0922lb # [ 0.391246] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]923client # [ 0.318449] squashfs: version 4.0 (2009/01/31) Phillip Lougher924lb # [ 0.391262] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]925lb # [ 0.391292] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]926lb # [ 0.391740] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint927lb # [ 0.391923] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]928lb # [ 0.391939] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]929lb # [ 0.391968] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]930worker1 # [ 0.340416] Key type asymmetric registered931lb # [ 0.391985] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]932worker1 # [ 0.340441] Asymmetric key parser 'x509' registered933worker2 # [ 0.320029] Initialise system trusted keyrings934lb # [ 0.392462] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint935worker2 # [ 0.320748] workingset: timestamp_bits=42 max_order=19 bucket_order=0936lb # [ 0.392648] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]937client # [ 0.319226] 9p: Installing v9fs 9p2000 file system support938worker2 # [ 0.321995] squashfs: version 4.0 (2009/01/31) Phillip Lougher939lb # [ 0.392677] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]940lb # [ 0.393133] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint941worker2 # [ 0.322768] 9p: Installing v9fs 9p2000 file system support942lb # [ 0.393319] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]943lb # [ 0.393349] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]944lb # [ 0.393728] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint945lb # [ 0.393908] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]946lb # [ 0.394166] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint947worker1 # [ 0.348564] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)948lb # [ 0.394438] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]949worker1 # [ 0.349633] io scheduler mq-deadline registered950lb # [ 0.394456] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]951worker1 # [ 0.349644] io scheduler kyber registered952lb # [ 0.394485] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]953lb # [ 0.394945] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint954lb # [ 0.395129] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]955lb # [ 0.395145] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]956lb # [ 0.395174] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]957lb # [ 0.395748] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned958lb # [ 0.395760] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned959client # [ 0.339134] Key type asymmetric registered960lb # [ 0.395765] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned961client # [ 0.339157] Asymmetric key parser 'x509' registered962lb # [ 0.395809] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned963client # [ 0.339232] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)964lb # [ 0.395859] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned965lb # [ 0.395905] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned966lb # [ 0.395950] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned967worker1 # [ 0.360627] pl061_gpio 9030000.pl061: PL061 GPIO chip registered968lb # [ 0.395996] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned969lb # [ 0.396042] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned970client # [ 0.345469] io scheduler mq-deadline registered971client # [ 0.345485] io scheduler kyber registered972lb # [ 0.396088] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned973lb # [ 0.396134] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned974worker2 # [ 0.343381] Key type asymmetric registered975worker1 # [ 0.361995] ledtrig-cpu: registered to indicate activity on CPUs976worker2 # [ 0.343407] Asymmetric key parser 'x509' registered977lb # [ 0.396200] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned978worker1 # [ 0.362368] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:979lb # [ 0.396276] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned980worker1 # [ 0.362384] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000981lb # [ 0.396322] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned982worker1 # [ 0.362396] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000983lb # [ 0.396343] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned984lb # [ 0.396364] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned985worker1 # [ 0.362404] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000986lb # [ 0.396386] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned987worker1 # [ 0.362425] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits988lb # [ 0.396410] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned989worker1 # [ 0.362448] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]990lb # [ 0.396432] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned991worker1 # [ 0.362521] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00992lb # [ 0.396454] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned993worker1 # [ 0.362531] pci_bus 0000:00: root bus resource [bus 00-ff]994lb # [ 0.396477] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned995worker1 # [ 0.362537] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]996worker2 # [ 0.351511] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)997lb # [ 0.396499] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned998worker2 # [ 0.352547] io scheduler mq-deadline registered999worker1 # [ 0.362541] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1000worker2 # [ 0.352558] io scheduler kyber registered1001lb # [ 0.396522] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1002worker1 # [ 0.362546] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1003lb # [ 0.396544] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1004client # [ 0.357573] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1005worker1 # [ 0.362602] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1006lb # [ 0.396566] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1007worker1 # [ 0.363032] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1008lb # [ 0.396588] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1009worker1 # [ 0.363217] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1010lb # [ 0.396609] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1011worker1 # [ 0.363234] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1012lb # [ 0.396630] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1013worker1 # [ 0.363269] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1014client # [ 0.358922] ledtrig-cpu: registered to indicate activity on CPUs1015lb # [ 0.396652] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1016worker1 # [ 0.363286] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1017lb # [ 0.396673] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1018client # [ 0.359283] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1019lb # [ 0.396694] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1020worker1 # [ 0.363752] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1021client # [ 0.359300] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001022lb # [ 0.396716] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1023worker1 # [ 0.363937] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1024client # [ 0.359312] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001025worker1 # [ 0.363953] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1026lb # [ 0.396737] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1027lb # [ 0.396759] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1028worker1 # [ 0.363982] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1029client # [ 0.359320] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001030lb # [ 0.396785] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1031worker1 # [ 0.364427] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1032client # [ 0.359340] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1033lb # [ 0.396795] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1034worker1 # [ 0.384317] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1035lb # [ 0.396800] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1036client # [ 0.359362] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1037worker1 # [ 0.384336] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1038worker2 # [ 0.363576] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1039client # [ 0.359433] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001040worker1 # [ 0.384366] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1041client # [ 0.359442] pci_bus 0000:00: root bus resource [bus 00-ff]1042client # [ 0.359448] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1043client # [ 0.359454] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1044client # [ 0.359459] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1045worker2 # [ 0.364961] ledtrig-cpu: registered to indicate activity on CPUs1046worker1 # [ 0.386906] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1047worker1 # [ 0.387090] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1048worker2 # [ 0.365349] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1049client # [ 0.359517] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1050worker1 # [ 0.387106] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1051client # [ 0.359967] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1052worker2 # [ 0.365367] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001053worker1 # [ 0.387137] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1054client # [ 0.360153] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1055worker2 # [ 0.365380] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001056worker1 # [ 0.387593] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1057client # [ 0.360170] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1058worker1 # [ 0.387773] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1059lb # [ 0.462026] pci 0000:00:0a.0: enabling device (0000 -> 0002)1060client # [ 0.360200] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1061worker2 # [ 0.365388] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001062worker1 # [ 0.387789] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1063client # [ 0.360216] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1064worker2 # [ 0.365409] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1065worker1 # [ 0.387819] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1066client # [ 0.360681] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1067worker2 # [ 0.365434] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1068worker1 # [ 0.388265] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1069client # [ 0.360866] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1070worker1 # [ 0.388446] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1071worker2 # [ 0.365509] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001072client # [ 0.360882] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1073worker2 # [ 0.365519] pci_bus 0000:00: root bus resource [bus 00-ff]1074worker1 # [ 0.388462] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1075client # [ 0.360912] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1076worker2 # [ 0.365525] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1077client # [ 0.361360] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1078worker2 # [ 0.365530] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1079worker2 # [ 0.365535] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1080client # [ 0.380943] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1081client # [ 0.380963] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1082worker2 # [ 0.365621] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1083client # [ 0.380992] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1084worker2 # [ 0.366051] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1085worker2 # [ 0.366235] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1086worker2 # [ 0.366252] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1087worker2 # [ 0.366282] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1088worker2 # [ 0.366298] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1089worker2 # [ 0.366750] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1090worker1 # [ 0.400513] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1091worker2 # [ 0.366931] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1092worker1 # [ 0.401014] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1093worker2 # [ 0.366947] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1094worker1 # [ 0.401205] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1095worker2 # [ 0.366977] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1096worker1 # [ 0.401222] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1097worker2 # [ 0.367424] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1098worker1 # [ 0.401251] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1099worker2 # [ 0.387395] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1100worker1 # [ 0.401267] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1101worker2 # [ 0.387414] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1102worker1 # [ 0.401747] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1103worker1 # [ 0.401933] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1104worker1 # [ 0.401962] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1105worker1 # [ 0.402409] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1106worker2 # [ 0.388830] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1107worker1 # [ 0.402595] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1108worker1 # [ 0.402624] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1109worker2 # [ 0.389296] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1110worker2 # [ 0.389480] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1111worker1 # [ 0.403019] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1112client # [ 0.389494] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1113worker2 # [ 0.389497] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1114worker1 # [ 0.403199] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1115client # [ 0.389690] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1116worker2 # [ 0.389532] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1117client # [ 0.389707] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1118worker1 # [ 0.403450] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1119worker2 # [ 0.390005] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1120worker1 # [ 0.403720] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1121client # [ 0.389740] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1122worker2 # [ 0.390197] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1123worker1 # [ 0.403739] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1124client # [ 0.390215] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1125lb # [ 0.487140] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1126worker2 # [ 0.390213] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1127worker1 # [ 0.403769] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1128client # [ 0.390397] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1129worker2 # [ 0.390243] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1130worker1 # [ 0.404221] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1131client # [ 0.390413] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1132worker2 # [ 0.390688] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1133worker1 # [ 0.404403] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1134client # [ 0.390443] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1135worker2 # [ 0.390870] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1136worker1 # [ 0.404418] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1137client # [ 0.390892] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1138worker2 # [ 0.390885] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1139worker1 # [ 0.404448] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1140client # [ 0.391075] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1141lb # [ 0.490081] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1142worker2 # [ 0.390914] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1143client # [ 0.391091] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1144lb # [ 0.492207] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1145worker2 # [ 0.391362] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1146client # [ 0.391120] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1147client # [ 0.391613] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1148client # [ 0.391804] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1149client # [ 0.391821] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1150client # [ 0.391850] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1151client # [ 0.391866] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1152client # [ 0.392319] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1153client # [ 0.392505] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1154client # [ 0.392535] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1155client # [ 0.392981] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1156client # [ 0.393166] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1157client # [ 0.393195] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1158client # [ 0.393625] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1159worker1 # [ 0.429135] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1160client # [ 0.393811] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1161lb # [ 0.502272] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1162worker1 # [ 0.429162] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1163lb # [ 0.504209] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1164client # [ 0.394064] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1165worker1 # [ 0.429168] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1166client # [ 0.394319] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1167worker1 # [ 0.429219] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1168client # [ 0.394336] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1169worker2 # [ 0.407579] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1170worker1 # [ 0.429268] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1171client # [ 0.394365] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1172worker2 # [ 0.407604] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1173worker1 # [ 0.429314] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1174client # [ 0.394824] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1175worker2 # [ 0.407633] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1176client # [ 0.395006] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1177worker1 # [ 0.429365] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1178worker2 # [ 0.407649] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1179client # [ 0.395022] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1180worker2 # [ 0.408276] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1181worker1 # [ 0.429412] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1182client # [ 0.395051] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1183worker2 # [ 0.408466] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1184worker1 # [ 0.429459] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1185client # [ 0.395627] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1186worker2 # [ 0.408496] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1187worker1 # [ 0.429506] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1188client # [ 0.395638] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1189worker2 # [ 0.408954] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1190worker1 # [ 0.429553] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1191client # [ 0.395644] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1192worker2 # [ 0.409140] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1193worker1 # [ 0.429600] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1194client # [ 0.395689] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1195worker2 # [ 0.409169] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1196worker1 # [ 0.429731] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1197client # [ 0.395747] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1198worker2 # [ 0.409576] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1199worker1 # [ 0.429782] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1200client # [ 0.395794] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1201worker2 # [ 0.409758] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1202worker1 # [ 0.429803] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1203worker2 # [ 0.410010] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1204client # [ 0.395840] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1205lb # [ 0.514709] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1206worker1 # [ 0.429825] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1207worker2 # [ 0.410286] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1208lb # [ 0.516824] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1209client # [ 0.395886] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1210worker1 # [ 0.429847] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1211worker2 # [ 0.410304] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1212worker1 # [ 0.429874] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1213client # [ 0.395933] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1214worker2 # [ 0.410334] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1215client # [ 0.395979] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1216worker1 # [ 0.429896] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1217worker2 # [ 0.410795] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1218lb # [ 0.520348] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1219worker1 # [ 0.429918] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1220worker2 # [ 0.410981] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1221client # [ 0.396026] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1222worker1 # [ 0.429939] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1223worker2 # [ 0.410997] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1224client # [ 0.396072] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1225worker1 # [ 0.429961] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1226worker2 # [ 0.411026] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1227client # [ 0.396147] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1228worker1 # [ 0.429983] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1229worker2 # [ 0.411622] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1230client # [ 0.396193] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1231worker1 # [ 0.430008] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1232worker2 # [ 0.411634] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1233client # [ 0.396215] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1234worker1 # [ 0.430030] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1235worker2 # [ 0.411640] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1236client # [ 0.396236] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1237worker1 # [ 0.430053] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1238worker2 # [ 0.411686] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1239client # [ 0.396258] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1240worker1 # [ 0.430075] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1241client # [ 0.396282] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1242worker1 # [ 0.430096] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1243worker2 # [ 0.411732] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1244client # [ 0.396304] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1245worker1 # [ 0.430117] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1246worker2 # [ 0.411778] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1247worker1 # [ 0.430138] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1248client # [ 0.396325] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1249worker2 # [ 0.411833] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1250worker1 # [ 0.430159] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1251client # [ 0.396347] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1252lb # [ 0.528807] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1253worker1 # [ 0.430180] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1254worker2 # [ 0.411880] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1255client # [ 0.396369] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1256worker1 # [ 0.430202] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1257worker2 # [ 0.411926] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1258client # [ 0.396391] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1259worker1 # [ 0.430223] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1260client # [ 0.396413] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1261worker2 # [ 0.411973] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1262worker1 # [ 0.430249] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1263client # [ 0.396436] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1264worker1 # [ 0.430259] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1265worker2 # [ 0.412019] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1266client # [ 0.396457] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1267worker1 # [ 0.430264] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1268worker2 # [ 0.412065] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1269client # [ 0.396478] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1270worker1 # [ 0.431424] pci 0000:00:0a.0: enabling device (0000 -> 0002)1271client # [ 0.396499] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1272worker2 # [ 0.412148] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1273client # [ 0.396520] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1274worker2 # [ 0.412193] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1275client # [ 0.396542] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1276worker2 # [ 0.412215] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1277client # [ 0.396563] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1278worker2 # [ 0.412236] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1279client # [ 0.396585] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1280worker2 # [ 0.412258] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1281client # [ 0.396607] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1282worker2 # [ 0.412283] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1283client # [ 0.396629] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1284worker2 # [ 0.412305] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1285client # [ 0.396655] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1286client # [ 0.396665] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1287worker2 # [ 0.412327] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1288client # [ 0.396670] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1289worker2 # [ 0.412349] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1290lb # [ 0.538415] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1291worker2 # [ 0.412371] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1292worker2 # [ 0.412393] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1293worker2 # [ 0.412415] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1294worker2 # [ 0.412438] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1295lb # [ 0.542967] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1296worker2 # [ 0.412459] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1297worker2 # [ 0.412488] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1298worker2 # [ 0.412509] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1299worker2 # [ 0.412531] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1300worker2 # [ 0.412552] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1301worker2 # [ 0.412574] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1302worker2 # [ 0.412596] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1303worker2 # [ 0.412618] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1304worker2 # [ 0.412640] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1305worker2 # [ 0.412666] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1306client # [ 0.461882] pci 0000:00:0a.0: enabling device (0000 -> 0002)1307worker2 # [ 0.412675] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1308worker2 # [ 0.412680] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1309worker2 # [ 0.413833] pci 0000:00:0a.0: enabling device (0000 -> 0002)1310worker1 # [ 0.481856] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1311worker1 # [ 0.483947] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1312lb # [ 0.558125] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1313lb # [ 0.560570] msm_serial: driver initialized1314lb # [ 0.560713] SuperH (H)SCI(F) driver initialized1315lb # [ 0.560767] STM32 USART driver initialized1316worker1 # [ 0.494089] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1317worker1 # [ 0.496045] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1318client # [ 0.482537] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1319client # [ 0.484661] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1320worker2 # [ 0.485982] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1321worker1 # [ 0.506380] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1322worker1 # [ 0.508411] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1323client # [ 0.495741] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1324worker1 # [ 0.519261] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1325worker2 # [ 0.496104] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1326lb # [ 0.591694] loop: module loaded1327lb # [ 0.591868] virtio_blk virtio5: 1/0/0 default/read/poll queues1328lb # [ 0.592622] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1329worker1 # [ 0.522293] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1330worker1 # [ 0.524277] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1331worker2 # [ 0.503601] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1332worker2 # [ 0.505575] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1333lb # [ 0.597490] megasas: 07.734.00.00-rc11334client # [ 0.505601] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1335lb # [ 0.598172] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1336client # [ 0.509469] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1337client # [ 0.511440] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1338worker1 # [ 0.533961] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1339worker1 # [ 0.536256] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1340client # [ 0.521551] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1341lb # [ 0.609568] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001342lb # [ 0.609612] Intel/Sharp Extended Query Table at 0x00311343client # [ 0.524373] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1344lb # [ 0.611216] Using buffer write method1345worker2 # [ 0.515534] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1346lb # [ 0.611278] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1347worker2 # [ 0.518221] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1348worker2 # [ 0.520228] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1349worker2 # [ 0.522384] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1350worker1 # [ 0.553623] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1351client # [ 0.534338] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1352client # [ 0.536190] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1353worker1 # [ 0.556060] msm_serial: driver initialized1354worker1 # [ 0.556206] SuperH (H)SCI(F) driver initialized1355worker2 # [ 0.532893] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1356worker1 # [ 0.556259] STM32 USART driver initialized1357lb # [ 0.626228] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001358worker2 # [ 0.534749] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1359lb # [ 0.626261] Intel/Sharp Extended Query Table at 0x00311360lb # [ 0.628004] Using buffer write method1361client # [ 0.540062] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1362lb # [ 0.628029] Concatenating MTD devices:1363lb # [ 0.628032] (0): "0.flash"1364lb # [ 0.628036] (1): "0.flash"1365lb # [ 0.628039] into device "0.flash"1366worker2 # [ 0.546529] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1367client # [ 0.554593] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1368client # [ 0.557132] msm_serial: driver initialized1369client # [ 0.557279] SuperH (H)SCI(F) driver initialized1370client # [ 0.557330] STM32 USART driver initialized1371worker2 # [ 0.560692] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1372worker2 # [ 0.563183] msm_serial: driver initialized1373worker2 # [ 0.563391] SuperH (H)SCI(F) driver initialized1374worker1 # [ 0.587614] loop: module loaded1375worker1 # [ 0.587796] virtio_blk virtio5: 1/0/0 default/read/poll queues1376worker1 # [ 0.588584] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1377worker2 # [ 0.564529] STM32 USART driver initialized1378worker1 # [ 0.593064] megasas: 07.734.00.00-rc11379worker1 # [ 0.593695] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1380worker1 # [ 0.605815] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001381client # [ 0.590857] loop: module loaded1382worker1 # [ 0.605848] Intel/Sharp Extended Query Table at 0x00311383worker1 # [ 0.607682] Using buffer write method1384client # [ 0.591036] virtio_blk virtio5: 1/0/0 default/read/poll queues1385worker1 # [ 0.607747] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1386client # [ 0.591784] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1387client # [ 0.597994] megasas: 07.734.00.00-rc11388worker2 # [ 0.597447] loop: module loaded1389client # [ 0.598692] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1390worker2 # [ 0.597619] virtio_blk virtio5: 1/0/0 default/read/poll queues1391worker1 # [ 0.618717] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001392client # [ 0.601153] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001393worker2 # [ 0.598297] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1394worker1 # [ 0.618750] Intel/Sharp Extended Query Table at 0x00311395client # [ 0.601210] Intel/Sharp Extended Query Table at 0x00311396worker1 # [ 0.620254] Using buffer write method1397worker1 # [ 0.620281] Concatenating MTD devices:1398worker1 # [ 0.620285] (0): "0.flash"1399worker1 # [ 0.620289] (1): "0.flash"1400worker1 # [ 0.620292] into device "0.flash"1401worker2 # [ 0.604094] megasas: 07.734.00.00-rc11402worker2 # [ 0.604826] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1403client # [ 0.610421] Using buffer write method1404worker2 # [ 0.607060] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001405client # [ 0.610497] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1406worker2 # [ 0.607111] Intel/Sharp Extended Query Table at 0x00311407client # [ 0.612161] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001408client # [ 0.612188] Intel/Sharp Extended Query Table at 0x00311409worker2 # [ 0.616424] Using buffer write method1410client # [ 0.623956] Using buffer write method1411worker2 # [ 0.616492] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1412client # [ 0.623982] Concatenating MTD devices:1413client # [ 0.623986] (0): "0.flash"1414client # [ 0.623990] (1): "0.flash"1415worker2 # [ 0.619422] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001416client # [ 0.623993] into device "0.flash"1417worker2 # [ 0.627487] Intel/Sharp Extended Query Table at 0x00311418worker2 # [ 0.628944] Using buffer write method1419worker2 # [ 0.628973] Concatenating MTD devices:1420worker2 # [ 0.628976] (0): "0.flash"1421worker2 # [ 0.628980] (1): "0.flash"1422worker2 # [ 0.628984] into device "0.flash"1423lb # [ 0.850446] Freeing initrd memory: 26140K1424lb # [ 0.856425] tun: Universal TUN/TAP device driver, 1.61425lb # [ 0.860040] thunder_xcv, ver 1.01426lb # [ 0.860085] thunder_bgx, ver 1.01427lb # [ 0.860107] nicpf, ver 1.01428lb # [ 0.860663] e1000: Intel(R) PRO/1000 Network Driver1429lb # [ 0.860670] e1000: Copyright (c) 1999-2006 Intel Corporation.1430lb # [ 0.860695] e1000e: Intel(R) PRO/1000 Network Driver1431lb # [ 0.860703] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1432lb # [ 0.860733] igb: Intel(R) Gigabit Ethernet Network Driver1433lb # [ 0.860739] igb: Copyright (c) 2007-2014 Intel Corporation.1434lb # [ 0.860762] igbvf: Intel(R) Gigabit Virtual Function Network Driver1435lb # [ 0.860767] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1436lb # [ 0.860899] sky2: driver version 1.301437lb # [ 0.869471] usbcore: registered new interface driver usb-storage1438lb # [ 0.869593] usbcore: registered new interface driver usbserial_generic1439lb # [ 0.869612] usbserial: USB Serial support registered for generic1440lb # [ 0.870195] hv_vmbus: registering driver hyperv_keyboard1441lb # [ 0.874331] ehci-pci 0000:00:0a.0: EHCI Host Controller1442lb # [ 0.874361] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11443lb # [ 0.874599] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001444lb # [ 0.877264] rtc-pl031 9010000.pl031: registered as rtc01445lb # [ 0.877289] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T11:21:36 UTC (1790076096)1446lb # [ 0.877613] i2c_dev: i2c /dev entries driver1447lb # [ 0.882447] sdhci: Secure Digital Host Controller Interface driver1448lb # [ 0.882457] sdhci: Copyright(c) Pierre Ossman1449lb # [ 0.882724] Synopsys Designware Multimedia Card Interface Driver1450lb # [ 0.883092] sdhci-pltfm: SDHCI platform and OF driver helper1451lb # [ 0.884787] hid: raw HID events driver (C) Jiri Kosina1452lb # [ 0.884965] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001453lb # [ 0.885278] hub 1-0:1.0: USB hub found1454lb # [ 0.885296] hub 1-0:1.0: 6 ports detected1455lb # [ 0.890721] usbcore: registered new interface driver usbhid1456lb # [ 0.890732] usbhid: USB HID core driver1457lb # [ 0.892996] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1458lb # [ 0.894485] drop_monitor: Initializing network drop monitor service1459lb # [ 0.894642] NET: Registered PF_INET6 protocol family1460lb # [ 0.897673] Segment Routing with IPv61461lb # [ 0.897690] In-situ OAM (IOAM) with IPv61462lb # [ 0.897719] NET: Registered PF_PACKET protocol family1463lb # [ 0.899380] 9pnet: Installing 9P2000 support1464lb # [ 0.902042] Key type dns_resolver registered1465lb # [ 0.908295] registered taskstats version 11466lb # [ 0.908455] Loading compiled-in X.509 certificates1467lb # [ 0.917103] Demotion targets for Node 0: null1468lb # [ 0.917207] Key type .fscrypt registered1469lb # [ 0.917213] Key type fscrypt-provisioning registered1470lb # [ 0.917302] ima: No TPM chip found, activating TPM-bypass!1471lb # [ 0.917321] ima: Allocated hash algorithm: sha11472worker1 # [ 0.847476] Freeing initrd memory: 26148K1473lb # [ 0.917343] ima: No architecture policies found1474lb # [ 0.921495] input: gpio-keys as /devices/platform/gpio-keys/input/input01475worker1 # [ 0.853349] tun: Universal TUN/TAP device driver, 1.61476worker1 # [ 0.856903] thunder_xcv, ver 1.01477worker1 # [ 0.856942] thunder_bgx, ver 1.01478worker1 # [ 0.856965] nicpf, ver 1.01479worker1 # [ 0.857509] e1000: Intel(R) PRO/1000 Network Driver1480client # [ 0.844220] Freeing initrd memory: 26160K1481worker1 # [ 0.857516] e1000: Copyright (c) 1999-2006 Intel Corporation.1482worker1 # [ 0.857550] e1000e: Intel(R) PRO/1000 Network Driver1483worker1 # [ 0.857558] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1484worker1 # [ 0.857586] igb: Intel(R) Gigabit Ethernet Network Driver1485worker1 # [ 0.857591] igb: Copyright (c) 2007-2014 Intel Corporation.1486worker1 # [ 0.857614] igbvf: Intel(R) Gigabit Virtual Function Network Driver1487worker1 # [ 0.857620] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1488client # [ 0.850176] tun: Universal TUN/TAP device driver, 1.61489worker1 # [ 0.857750] sky2: driver version 1.301490worker1 # [ 0.859283] usbcore: registered new interface driver usb-storage1491worker1 # [ 0.859330] usbcore: registered new interface driver usbserial_generic1492lb # [ 0.939164] clk: Disabling unused clocks1493worker1 # [ 0.859345] usbserial: USB Serial support registered for generic1494lb # [ 0.939190] PM: genpd: Disabling unused power domains1495worker1 # [ 0.859914] hv_vmbus: registering driver hyperv_keyboard1496worker1 # [ 0.861246] ehci-pci 0000:00:0a.0: EHCI Host Controller1497worker1 # [ 0.861270] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11498lb # [ 0.943428] Freeing unused kernel memory: 4736K1499lb # [ 0.943630] Run /init as init process1500worker1 # [ 0.861503] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001501worker1 # [ 0.872961] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001502worker1 # [ 0.873294] hub 1-0:1.0: USB hub found1503worker1 # [ 0.873308] hub 1-0:1.0: 6 ports detected1504client # [ 0.853847] thunder_xcv, ver 1.01505client # [ 0.853886] thunder_bgx, ver 1.01506client # [ 0.853908] nicpf, ver 1.01507worker1 # [ 0.876195] rtc-pl031 9010000.pl031: registered as rtc01508worker2 # [ 0.854578] Freeing initrd memory: 26148K1509client # [ 0.854439] e1000: Intel(R) PRO/1000 Network Driver1510worker1 # [ 0.876229] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T11:21:36 UTC (1790076096)1511client # [ 0.854446] e1000: Copyright (c) 1999-2006 Intel Corporation.1512client # [ 0.854470] e1000e: Intel(R) PRO/1000 Network Driver1513worker1 # [ 0.878270] i2c_dev: i2c /dev entries driver1514client # [ 0.854478] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1515client # [ 0.854507] igb: Intel(R) Gigabit Ethernet Network Driver1516client # [ 0.854513] igb: Copyright (c) 2007-2014 Intel Corporation.1517client # [ 0.854534] igbvf: Intel(R) Gigabit Virtual Function Network Driver1518client # [ 0.854540] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1519worker2 # [ 0.860584] tun: Universal TUN/TAP device driver, 1.61520client # [ 0.854673] sky2: driver version 1.301521client # [ 0.856267] usbcore: registered new interface driver usb-storage1522client # [ 0.856374] usbcore: registered new interface driver usbserial_generic1523client # [ 0.856388] usbserial: USB Serial support registered for generic1524worker1 # [ 0.881357] sdhci: Secure Digital Host Controller Interface driver1525client # [ 0.856969] hv_vmbus: registering driver hyperv_keyboard1526worker1 # [ 0.881366] sdhci: Copyright(c) Pierre Ossman1527client # [ 0.858281] ehci-pci 0000:00:0a.0: EHCI Host Controller1528worker1 # [ 0.881624] Synopsys Designware Multimedia Card Interface Driver1529worker1 # [ 0.881980] sdhci-pltfm: SDHCI platform and OF driver helper1530client # [ 0.858308] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11531worker1 # [ 0.883595] hid: raw HID events driver (C) Jiri Kosina1532client # [ 0.858581] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001533worker1 # [ 0.883826] usbcore: registered new interface driver usbhid1534lb # [ 0.959097] systemd[1]: Successfully made /usr/ read-only.1535worker1 # [ 0.883833] usbhid: USB HID core driver1536client # [ 0.870683] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001537client # [ 0.871021] hub 1-0:1.0: USB hub found1538worker2 # [ 0.864267] thunder_xcv, ver 1.01539client # [ 0.871042] hub 1-0:1.0: 6 ports detected1540worker2 # [ 0.864312] thunder_bgx, ver 1.01541worker2 # [ 0.864335] nicpf, ver 1.01542client # [ 0.873350] rtc-pl031 9010000.pl031: registered as rtc01543worker2 # [ 0.864908] e1000: Intel(R) PRO/1000 Network Driver1544worker2 # [ 0.864915] e1000: Copyright (c) 1999-2006 Intel Corporation.1545worker1 # [ 0.889376] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1546client # [ 0.873376] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T11:21:36 UTC (1790076096)1547worker2 # [ 0.864940] e1000e: Intel(R) PRO/1000 Network Driver1548worker1 # [ 0.890816] drop_monitor: Initializing network drop monitor service1549worker2 # [ 0.864948] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1550worker1 # [ 0.890988] NET: Registered PF_INET6 protocol family1551client # [ 0.875419] i2c_dev: i2c /dev entries driver1552worker2 # [ 0.864977] igb: Intel(R) Gigabit Ethernet Network Driver1553worker1 # [ 0.893971] Segment Routing with IPv61554worker2 # [ 0.864983] igb: Copyright (c) 2007-2014 Intel Corporation.1555worker1 # [ 0.893990] In-situ OAM (IOAM) with IPv61556worker2 # [ 0.865006] igbvf: Intel(R) Gigabit Virtual Function Network Driver1557worker1 # [ 0.894017] NET: Registered PF_PACKET protocol family1558worker2 # [ 0.865012] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1559worker2 # [ 0.865149] sky2: driver version 1.301560worker1 # [ 0.895648] 9pnet: Installing 9P2000 support1561worker2 # [ 0.866759] usbcore: registered new interface driver usb-storage1562worker2 # [ 0.866938] usbcore: registered new interface driver usbserial_generic1563worker2 # [ 0.866953] usbserial: USB Serial support registered for generic1564client # [ 0.878571] sdhci: Secure Digital Host Controller Interface driver1565worker2 # [ 0.868245] ehci-pci 0000:00:0a.0: EHCI Host Controller1566client # [ 0.878581] sdhci: Copyright(c) Pierre Ossman1567worker2 # [ 0.868273] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11568client # [ 0.878841] Synopsys Designware Multimedia Card Interface Driver1569worker1 # [ 0.898534] Key type dns_resolver registered1570worker2 # [ 0.868546] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001571client # [ 0.879204] sdhci-pltfm: SDHCI platform and OF driver helper1572client # [ 0.880821] hid: raw HID events driver (C) Jiri Kosina1573client # [ 0.881074] usbcore: registered new interface driver usbhid1574worker2 # [ 0.880089] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001575client # [ 0.881081] usbhid: USB HID core driver1576worker2 # [ 0.880399] hub 1-0:1.0: USB hub found1577worker2 # [ 0.880415] hub 1-0:1.0: 6 ports detected1578worker2 # [ 0.882562] hv_vmbus: registering driver hyperv_keyboard1579client # [ 0.886552] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1580worker2 # [ 0.884125] rtc-pl031 9010000.pl031: registered as rtc01581client # [ 0.888040] drop_monitor: Initializing network drop monitor service1582worker2 # [ 0.884148] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T11:21:36 UTC (1790076096)1583client # [ 0.888189] NET: Registered PF_INET6 protocol family1584worker2 # [ 0.884452] i2c_dev: i2c /dev entries driver1585client # [ 0.891176] Segment Routing with IPv61586worker1 # [ 0.904785] registered taskstats version 11587client # [ 0.891196] In-situ OAM (IOAM) with IPv61588worker1 # [ 0.904943] Loading compiled-in X.509 certificates1589client # [ 0.891236] NET: Registered PF_PACKET protocol family1590client # [ 0.892879] 9pnet: Installing 9P2000 support1591worker2 # [ 0.889311] sdhci: Secure Digital Host Controller Interface driver1592worker2 # [ 0.889321] sdhci: Copyright(c) Pierre Ossman1593worker1 # [ 0.913324] Demotion targets for Node 0: null1594worker2 # [ 0.889590] Synopsys Designware Multimedia Card Interface Driver1595worker1 # [ 0.913428] Key type .fscrypt registered1596client # [ 0.895743] Key type dns_resolver registered1597worker2 # [ 0.889965] sdhci-pltfm: SDHCI platform and OF driver helper1598worker1 # [ 0.913434] Key type fscrypt-provisioning registered1599worker1 # [ 0.913529] ima: No TPM chip found, activating TPM-bypass!1600worker1 # [ 0.913547] ima: Allocated hash algorithm: sha11601worker1 # [ 0.913568] ima: No architecture policies found1602worker2 # [ 0.894443] hid: raw HID events driver (C) Jiri Kosina1603worker2 # [ 0.894703] usbcore: registered new interface driver usbhid1604worker2 # [ 0.894709] usbhid: USB HID core driver1605worker1 # [ 0.917518] input: gpio-keys as /devices/platform/gpio-keys/input/input01606worker2 # [ 0.897607] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1607worker2 # [ 0.899150] drop_monitor: Initializing network drop monitor service1608worker2 # [ 0.899282] NET: Registered PF_INET6 protocol family1609client # [ 0.902010] registered taskstats version 11610client # [ 0.902164] Loading compiled-in X.509 certificates1611worker2 # [ 0.902467] Segment Routing with IPv61612worker2 # [ 0.902485] In-situ OAM (IOAM) with IPv61613worker2 # [ 0.902516] NET: Registered PF_PACKET protocol family1614client # [ 0.910705] Demotion targets for Node 0: null1615worker2 # [ 0.904349] 9pnet: Installing 9P2000 support1616client # [ 0.910811] Key type .fscrypt registered1617worker2 # [ 0.906479] Key type dns_resolver registered1618client # [ 0.910817] Key type fscrypt-provisioning registered1619client # [ 0.910908] ima: No TPM chip found, activating TPM-bypass!1620client # [ 0.910927] ima: Allocated hash algorithm: sha11621client # [ 0.910948] ima: No architecture policies found1622client # [ 0.914872] input: gpio-keys as /devices/platform/gpio-keys/input/input01623worker1 # [ 0.934990] clk: Disabling unused clocks1624worker2 # [ 0.913244] registered taskstats version 11625worker1 # [ 0.935013] PM: genpd: Disabling unused power domains1626worker2 # [ 0.913390] Loading compiled-in X.509 certificates1627worker1 # [ 0.939165] Freeing unused kernel memory: 4736K1628worker1 # [ 0.939362] Run /init as init process1629worker2 # [ 0.921668] Demotion targets for Node 0: null1630worker2 # [ 0.921775] Key type .fscrypt registered1631worker2 # [ 0.921781] Key type fscrypt-provisioning registered1632worker2 # [ 0.921872] ima: No TPM chip found, activating TPM-bypass!1633worker2 # [ 0.921891] ima: Allocated hash algorithm: sha11634worker2 # [ 0.921912] ima: No architecture policies found1635worker2 # [ 0.925978] input: gpio-keys as /devices/platform/gpio-keys/input/input01636client # [ 0.932428] clk: Disabling unused clocks1637client # [ 0.932455] PM: genpd: Disabling unused power domains1638client # [ 0.936735] Freeing unused kernel memory: 4736K1639worker1 # [ 0.954736] systemd[1]: Successfully made /usr/ read-only.1640client # [ 0.936933] Run /init as init process1641worker2 # [ 0.944126] clk: Disabling unused clocks1642worker2 # [ 0.944150] PM: genpd: Disabling unused power domains1643client # [ 0.951603] systemd[1]: Successfully made /usr/ read-only.1644worker2 # [ 0.948356] Freeing unused kernel memory: 4736K1645worker2 # [ 0.948564] Run /init as init process1646worker2 # [ 0.965610] systemd[1]: Successfully made /usr/ read-only.1647lb # [ 1.132982] usb 1-1: new high-speed USB device number 2 using ehci-pci1648worker1 # [ 1.120573] usb 1-1: new high-speed USB device number 2 using ehci-pci1649client # [ 1.117503] usb 1-1: new high-speed USB device number 2 using ehci-pci1650worker2 # [ 1.127518] usb 1-1: new high-speed USB device number 2 using ehci-pci1651lb # [ 1.282601] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11652lb # [ 1.293935] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1653lb # [ 1.306001] systemd[1]: Detected virtualization qemu.1654lb # [ 1.308031] systemd[1]: Detected architecture arm64.1655lb # [ 1.310069] systemd[1]: Running in initrd.1656lb # [ 1.312602] systemd[1]: Initializing machine ID from random generator.1657lb # [ 1.315556] systemd[1]: Hostname set to <lb>.1658worker1 # [ 1.272803] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11659client # [ 1.269642] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11660lb # [ 1.365219] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01661worker2 # [ 1.277301] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11662worker1 # [ 1.289569] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1663worker1 # [ 1.301565] systemd[1]: Detected virtualization qemu.1664worker1 # [ 1.303529] systemd[1]: Detected architecture arm64.1665worker1 # [ 1.305491] systemd[1]: Running in initrd.1666worker1 # [ 1.308015] systemd[1]: Initializing machine ID from random generator.1667worker1 # [ 1.310903] systemd[1]: Hostname set to <worker1>.1668client # [ 1.286509] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1669client # [ 1.286580] systemd[1]: Detected virtualization qemu.1670client # [ 1.286666] systemd[1]: Detected architecture arm64.1671client # [ 1.286689] systemd[1]: Running in initrd.1672client # [ 1.287658] systemd[1]: Initializing machine ID from random generator.1673client # [ 1.287956] systemd[1]: Hostname set to <client>.1674worker2 # [ 1.300469] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1675worker2 # [ 1.312567] systemd[1]: Detected virtualization qemu.1676worker2 # [ 1.314553] systemd[1]: Detected architecture arm64.1677worker2 # [ 1.316540] systemd[1]: Running in initrd.1678worker2 # [ 1.319094] systemd[1]: Initializing machine ID from random generator.1679worker2 # [ 1.321956] systemd[1]: Hostname set to <worker2>.1680worker1 # [ 1.360761] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01681client # [ 1.353705] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01682worker2 # [ 1.367749] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01683lb # [ 1.489026] usb 1-2: new high-speed USB device number 3 using ehci-pci1684worker1 # [ 1.484539] usb 1-2: new high-speed USB device number 3 using ehci-pci1685client # [ 1.477465] usb 1-2: new high-speed USB device number 3 using ehci-pci1686worker2 # [ 1.491533] usb 1-2: new high-speed USB device number 3 using ehci-pci1687lb # [ 1.603126] systemd[1]: bpf-restrict-fs: LSM BPF program attached1688lb # [ 1.645245] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21689lb # [ 1.647824] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01690lb # [ 1.685139] systemd[1]: Queued start job for default target Initrd Default Target.1691worker1 # [ 1.615230] systemd[1]: bpf-restrict-fs: LSM BPF program attached1692lb # [ 1.695209] systemd[1]: Created slice Slice /system/modprobe.1693lb # [ 1.696390] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1694lb # [ 1.697693] systemd[1]: Expecting device /dev/disk/by-label/nixos...1695lb # [ 1.698689] systemd[1]: Reached target Path Units.1696lb # [ 1.699447] systemd[1]: Reached target Slice Units.1697lb # [ 1.700218] systemd[1]: Reached target Swaps.1698lb # [ 1.700909] systemd[1]: Reached target Timer Units.1699lb # [ 1.701950] systemd[1]: Listening on D-Bus System Message Bus Socket.1700lb # [ 1.703138] systemd[1]: Listening on Journal Socket (/dev/log).1701lb # [ 1.704215] systemd[1]: Listening on Journal Sockets.1702lb # [ 1.705173] systemd[1]: Listening on udev Control Socket.1703lb # [ 1.706126] systemd[1]: Listening on udev Kernel Socket.1704lb # [ 1.706967] systemd[1]: Reached target Socket Units.1705lb # [ 1.709333] systemd[1]: Starting Create List of Static Device Nodes...1706client # [ 1.626273] systemd[1]: bpf-restrict-fs: LSM BPF program attached1707worker2 # [ 1.622726] systemd[1]: bpf-restrict-fs: LSM BPF program attached1708lb # [ 1.717096] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1709lb # [ 1.718149] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1710worker1 # [ 1.647097] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21711lb # [ 1.724014] systemd[1]: Mounting Kernel Configuration File System...1712worker1 # [ 1.652322] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01713client # [ 1.640922] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21714client # [ 1.646582] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01715lb # [ 1.739193] systemd[1]: Starting Journal Service...1716worker2 # [ 1.652226] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21717worker2 # [ 1.659770] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01718lb # [ 1.771260] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1719lb # [ 1.773174] systemd[1]: Starting Load Kernel Modules...1720lb # [ 1.773279] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1721lb # [ 1.774410] systemd[1]: Starting Coldplug All udev Devices...1722lb # [ 1.781017] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1723lb # [ 1.785649] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01724lb # [ 1.785878] [drm] features: -virgl +edid -resource_blob -host_visible1725lb # [ 1.785887] [drm] features: -context_init1726lb # [ 1.786566] [drm] number of scanouts: 11727lb # [ 1.786583] [drm] number of cap sets: 01728lb # [ 1.790907] systemd[1]: Finished Create List of Static Device Nodes.1729lb # [ 1.791856] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1730lb # [ 1.792155] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1731lb # [ 1.797209] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1732worker1 # [ 1.731636] systemd[1]: Queued start job for default target Initrd Default Target.1733lb # [ 1.801393] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1734lb # [ 1.801414] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01735lb # [ 1.809408] systemd[1]: Mounted Kernel Configuration File System.1736worker1 # [ 1.742347] systemd[1]: Created slice Slice /system/modprobe.1737worker1 # [ 1.743264] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1738worker1 # [ 1.744248] systemd[1]: Expecting device /dev/disk/by-label/nixos...1739worker1 # [ 1.745121] systemd[1]: Reached target Path Units.1740worker1 # [ 1.745768] systemd[1]: Reached target Slice Units.1741worker1 # [ 1.746400] systemd[1]: Reached target Swaps.1742worker1 # [ 1.746961] systemd[1]: Reached target Timer Units.1743worker1 # [ 1.747731] systemd[1]: Listening on D-Bus System Message Bus Socket.1744client # [ 1.730936] systemd[1]: Queued start job for default target Initrd Default Target.1745worker1 # [ 1.748698] systemd[1]: Listening on Journal Socket (/dev/log).1746worker1 # [ 1.749572] systemd[1]: Listening on Journal Sockets.1747worker1 # [ 1.750341] systemd[1]: Listening on udev Control Socket.1748worker1 # [ 1.751119] systemd[1]: Listening on udev Kernel Socket.1749worker1 # [ 1.751798] systemd[1]: Reached target Socket Units.1750worker1 # [ 1.753702] systemd[1]: Starting Create List of Static Device Nodes...1751client # [ 1.739758] systemd[1]: Created slice Slice /system/modprobe.1752worker2 # [ 1.737022] systemd[1]: Queued start job for default target Initrd Default Target.1753client # [ 1.740888] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1754client # [ 1.742236] systemd[1]: Expecting device /dev/disk/by-label/nixos...1755worker1 # [ 1.760221] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1756client # [ 1.743240] systemd[1]: Reached target Path Units.1757client # [ 1.744033] systemd[1]: Reached target Slice Units.1758worker1 # [ 1.761259] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1759client # [ 1.744831] systemd[1]: Reached target Swaps.1760client # [ 1.745581] systemd[1]: Reached target Timer Units.1761client # [ 1.746532] systemd[1]: Listening on D-Bus System Message Bus Socket.1762client # [ 1.747785] systemd[1]: Listening on Journal Socket (/dev/log).1763client # [ 1.748856] systemd[1]: Listening on Journal Sockets.1764worker2 # [ 1.745800] systemd[1]: Created slice Slice /system/modprobe.1765client # [ 1.749836] systemd[1]: Listening on udev Control Socket.1766worker2 # [ 1.746958] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1767lb # [ 1.833348] Console: switching to colour frame buffer device 160x501768client # [ 1.749949] systemd[1]: Listening on udev Kernel Socket.1769worker2 # [ 1.748357] systemd[1]: Expecting device /dev/disk/by-label/nixos...1770client # [ 1.749972] systemd[1]: Reached target Socket Units.1771worker2 # [ 1.749405] systemd[1]: Reached target Path Units.1772worker2 # [ 1.750203] systemd[1]: Reached target Slice Units.1773client # [ 1.753893] systemd[1]: Starting Create List of Static Device Nodes...1774worker2 # [ 1.751016] systemd[1]: Reached target Swaps.1775worker2 # [ 1.751796] systemd[1]: Reached target Timer Units.1776worker2 # [ 1.752781] systemd[1]: Listening on D-Bus System Message Bus Socket.1777worker2 # [ 1.753992] systemd[1]: Listening on Journal Socket (/dev/log).1778lb # [ 1.845522] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1779worker1 # [ 1.774079] systemd[1]: Mounting Kernel Configuration File System...1780worker2 # [ 1.755102] systemd[1]: Listening on Journal Sockets.1781lb # [ 1.847877] systemd[1]: Starting Create Static Device Nodes in /dev...1782worker2 # [ 1.756149] systemd[1]: Listening on udev Control Socket.1783client # [ 1.761578] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1784worker2 # [ 1.756271] systemd[1]: Listening on udev Kernel Socket.1785worker2 # [ 1.756294] systemd[1]: Reached target Socket Units.1786client # [ 1.762668] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1787worker2 # [ 1.760423] systemd[1]: Starting Create List of Static Device Nodes...1788client # [ 1.769689] systemd[1]: Mounting Kernel Configuration File System...1789worker1 # [ 1.788730] systemd[1]: Starting Journal Service...1790lb # [ 1.862333] systemd-journald[73]: Collecting audit messages is disabled.1791worker2 # [ 1.770790] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1792worker2 # [ 1.772119] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1793worker1 # [ 1.796765] systemd[1]: Starting Load Kernel Modules...1794worker1 # [ 1.797573] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1795lb # [ 1.869620] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1796worker2 # [ 1.784954] systemd[1]: Mounting Kernel Configuration File System...1797worker1 # [ 1.809636] systemd[1]: Starting Coldplug All udev Devices...1798lb # [ 1.882163] systemd[1]: Finished Load Kernel Modules.1799lb # [ 1.885027] systemd[1]: Starting Apply Kernel Variables...1800client # [ 1.799952] systemd[1]: Starting Journal Service...1801client # [ 1.806569] systemd[1]: Starting Load Kernel Modules...1802client # [ 1.807467] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1803worker2 # [ 1.807699] systemd[1]: Starting Journal Service...1804client # [ 1.813471] systemd[1]: Starting Coldplug All udev Devices...1805worker1 # [ 1.828644] systemd[1]: Finished Create List of Static Device Nodes.1806worker1 # [ 1.829735] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1807worker1 # [ 1.830028] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1808worker2 # [ 1.811661] systemd[1]: Starting Load Kernel Modules...1809worker1 # [ 1.830239] systemd[1]: Mounted Kernel Configuration File System.1810worker2 # [ 1.812580] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1811worker2 # [ 1.816659] systemd[1]: Starting Coldplug All udev Devices...1812lb # [ 1.909280] systemd[1]: Finished Create Static Device Nodes in /dev.1813lb # [ 1.909535] systemd[1]: Reached target Preparation for Local File Systems.1814lb # [ 1.909572] systemd[1]: Reached target Local File Systems.1815worker1 # [ 1.840952] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1816lb # [ 1.914339] systemd[1]: Starting Rule-based Manager for Device Events and Files...1817client # [ 1.825869] systemd[1]: Finished Create List of Static Device Nodes.1818client # [ 1.826710] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1819client # [ 1.829405] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1820worker2 # [ 1.827675] systemd[1]: Finished Create List of Static Device Nodes.1821worker2 # [ 1.829463] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1822worker1 # [ 1.850831] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1823worker1 # [ 1.858674] systemd-journald[73]: Collecting audit messages is disabled.1824client # [ 1.838217] systemd[1]: Mounted Kernel Configuration File System.1825client # [ 1.839424] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1826worker2 # [ 1.839721] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1827lb # [ 1.933674] systemd[1]: Finished Apply Kernel Variables.1828worker1 # [ 1.872626] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1829worker1 # [ 1.877210] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01830client # [ 1.857275] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1831worker1 # [ 1.877475] [drm] features: -virgl +edid -resource_blob -host_visible1832worker1 # [ 1.877485] [drm] features: -context_init1833worker1 # [ 1.878191] [drm] number of scanouts: 11834worker2 # [ 1.860176] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1835worker1 # [ 1.878208] [drm] number of cap sets: 01836worker2 # [ 1.863760] systemd[1]: Mounted Kernel Configuration File System.1837client # [ 1.869679] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1838worker1 # [ 1.893728] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1839client # [ 1.878092] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1840worker1 # [ 1.893751] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01841client # [ 1.880637] systemd[1]: Starting Create Static Device Nodes in /dev...1842worker1 # [ 1.900634] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1843worker2 # [ 1.881138] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1844worker1 # [ 1.904893] systemd[1]: Starting Create Static Device Nodes in /dev...1845client # [ 1.888532] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01846client # [ 1.888779] [drm] features: -virgl +edid -resource_blob -host_visible1847worker2 # [ 1.886623] systemd-journald[73]: Collecting audit messages is disabled.1848client # [ 1.888787] [drm] features: -context_init1849client # [ 1.892910] systemd-journald[73]: Collecting audit messages is disabled.1850worker2 # [ 1.892135] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1851client # [ 1.901593] [drm] number of scanouts: 11852client # [ 1.901622] [drm] number of cap sets: 01853worker2 # [ 1.899529] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1854worker2 # [ 1.901817] systemd[1]: Starting Create Static Device Nodes in /dev...1855client # [ 1.903122] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1856client # [ 1.903139] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01857worker2 # [ 1.907410] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01858worker1 # [ 1.924761] Console: switching to colour frame buffer device 160x501859lb # [ 2.004566] systemd[1]: Started Journal Service.1860worker2 # [ 1.919836] [drm] features: -virgl +edid -resource_blob -host_visible1861worker2 # [ 1.919853] [drm] features: -context_init1862worker2 # [ 1.920610] [drm] number of scanouts: 11863worker2 # [ 1.920628] [drm] number of cap sets: 01864client # [ 1.930092] systemd[1]: Finished Create Static Device Nodes in /dev.1865lb # [ 2.002908] systemd-modules-load[74]: Inserted module 'dm_mod'1866client # [ 1.930279] systemd[1]: Reached target Preparation for Local File Systems.1867lb # [ 2.004117] systemd-modules-load[74]: Module 'virtio_balloon' is built in1868client # [ 1.930306] systemd[1]: Reached target Local File Systems.1869lb # [ 2.005236] systemd-modules-load[74]: Module 'virtio_console' is built in1870client # [ 1.934189] systemd[1]: Starting Rule-based Manager for Device Events and Files...1871worker1 # [ 1.953113] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1872lb # [ 2.012278] systemd-modules-load[74]: Inserted module 'virtio_gpu'1873lb # [ 2.014586] systemd-modules-load[74]: Module 'virtio_rng' is built in1874lb # [ 2.017517] systemd-udevd[81]: Using default interface naming scheme 'v261'.1875worker2 # [ 1.935660] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1876worker2 # [ 1.935679] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01877worker1 # [ 1.964693] systemd[1]: Finished Load Kernel Modules.1878lb # [ 2.020891] systemd[1]: Starting Create System Files and Directories...1879worker1 # [ 1.968882] systemd[1]: Starting Apply Kernel Variables...1880client # [ 1.945857] Console: switching to colour frame buffer device 160x501881client # [ 1.952417] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1882worker1 # [ 1.984694] systemd[1]: Finished Create Static Device Nodes in /dev.1883worker1 # [ 1.984925] systemd[1]: Reached target Preparation for Local File Systems.1884worker1 # [ 1.984960] systemd[1]: Reached target Local File Systems.1885worker2 # [ 1.971596] systemd[1]: Finished Create Static Device Nodes in /dev.1886worker2 # [ 1.971801] systemd[1]: Reached target Preparation for Local File Systems.1887worker2 # [ 1.971825] systemd[1]: Reached target Local File Systems.1888client # [ 1.978127] systemd[1]: Finished Load Kernel Modules.1889client # [ 1.981319] systemd[1]: Starting Apply Kernel Variables...1890lb # [ 2.054114] systemd[1]: Finished Create System Files and Directories.1891worker2 # [ 1.975780] systemd[1]: Starting Rule-based Manager for Device Events and Files...1892lb # [ 2.055745] systemd[1]: Started Rule-based Manager for Device Events and Files.1893worker1 # [ 2.000910] systemd[1]: Starting Rule-based Manager for Device Events and Files...1894worker2 # [ 1.987513] Console: switching to colour frame buffer device 160x501895worker2 # [ 1.988216] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1896worker1 # [ 2.028846] systemd[1]: Finished Apply Kernel Variables.1897worker2 # [ 2.007709] systemd[1]: Finished Load Kernel Modules.1898worker2 # [ 2.010920] systemd[1]: Starting Apply Kernel Variables...1899worker1 # [ 2.024520] systemd-modules-load[74]: Inserted module 'dm_mod'1900worker1 # [ 2.038045] systemd[1]: Started Journal Service.1901worker1 # [ 2.028683] systemd-modules-load[74]: Module 'virtio_balloon' is built in1902client # [ 2.034082] systemd[1]: Finished Apply Kernel Variables.1903worker1 # [ 2.040299] systemd-modules-load[74]: Module 'virtio_console' is built in1904worker1 # [ 2.044354] systemd-modules-load[74]: Inserted module 'virtio_gpu'1905worker1 # [ 2.045520] systemd-modules-load[74]: Module 'virtio_rng' is built in1906lb # [ 2.120257] systemd[1]: Starting Virtual Console Setup...1907worker1 # [ 2.056345] systemd[1]: Starting Create System Files and Directories...1908client # [ 2.062561] systemd[1]: Started Journal Service.1909worker2 # [ 2.060187] systemd[1]: Finished Apply Kernel Variables.1910worker1 # [ 2.078471] systemd[1]: Finished Create System Files and Directories.1911client # [ 2.056297] systemd-modules-load[74]: Inserted module 'dm_mod'1912client # [ 2.057418] systemd-modules-load[74]: Module 'virtio_balloon' is built in1913client # [ 2.058519] systemd-modules-load[74]: Module 'virtio_console' is built in1914worker2 # [ 2.070371] systemd[1]: Started Journal Service.1915client # [ 2.059743] systemd-modules-load[74]: Inserted module 'virtio_gpu'1916worker1 # [ 2.086250] systemd-udevd[81]: Using default interface naming scheme 'v261'.1917client # [ 2.064354] systemd-modules-load[74]: Module 'virtio_rng' is built in1918worker2 # [ 2.064330] systemd-modules-load[74]: Inserted module 'dm_mod'1919worker2 # [ 2.065633] systemd-modules-load[74]: Module 'virtio_balloon' is built in1920worker2 # [ 2.066719] systemd-modules-load[74]: Module 'virtio_console' is built in1921client # [ 2.068559] systemd-udevd[80]: Using default interface naming scheme 'v261'.1922worker2 # [ 2.067769] systemd-modules-load[74]: Inserted module 'virtio_gpu'1923lb # [ 2.164495] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1924client # [ 2.076359] systemd[1]: Starting Create System Files and Directories...1925lb # [ 2.167965] systemd[1]: Finished Virtual Console Setup.1926worker2 # [ 2.077057] systemd-modules-load[74]: Module 'virtio_rng' is built in1927worker2 # [ 2.080538] systemd-udevd[80]: Using default interface naming scheme 'v261'.1928worker2 # [ 2.088507] systemd[1]: Starting Create System Files and Directories...1929worker1 # [ 2.113645] systemd[1]: Started Rule-based Manager for Device Events and Files.1930client # [ 2.104748] systemd[1]: Started Rule-based Manager for Device Events and Files.1931client # [ 2.106337] systemd[1]: Finished Create System Files and Directories.1932worker2 # [ 2.123308] systemd[1]: Started Rule-based Manager for Device Events and Files.1933worker2 # [ 2.125237] systemd[1]: Finished Create System Files and Directories.1934worker1 # [ 2.168090] systemd[1]: Starting Virtual Console Setup...1935client # [ 2.164135] systemd[1]: Starting Virtual Console Setup...1936worker2 # [ 2.180128] systemd[1]: Starting Virtual Console Setup...1937worker1 # [ 2.216469] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1938worker1 # [ 2.219800] systemd[1]: Finished Virtual Console Setup.1939client # [ 2.217151] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1940client # [ 2.219808] systemd[1]: Finished Virtual Console Setup.1941worker2 # [ 2.228443] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1942worker2 # [ 2.231822] systemd[1]: Finished Virtual Console Setup.1943lb # [ 2.768074] systemd[1]: Finished Coldplug All udev Devices.1944lb # [ 2.769026] systemd[1]: Reached target System Initialization.1945lb # [ 2.770116] systemd[1]: Reached target Basic System.1946worker1 # [ 2.804745] systemd[1]: Finished Coldplug All udev Devices.1947worker1 # [ 2.805688] systemd[1]: Reached target System Initialization.1948worker1 # [ 2.806487] systemd[1]: Reached target Basic System.1949lb # [ 2.907762] (udev-worker)[101]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1950client # [ 2.823412] systemd[1]: Finished Coldplug All udev Devices.1951client # [ 2.824421] systemd[1]: Reached target System Initialization.1952client # [ 2.825255] systemd[1]: Reached target Basic System.1953worker2 # [ 2.834197] systemd[1]: Finished Coldplug All udev Devices.1954worker2 # [ 2.835168] systemd[1]: Reached target System Initialization.1955worker2 # [ 2.840096] systemd[1]: Reached target Basic System.1956lb # [ 2.933018] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line.1957lb # [ 2.951404] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line.1958worker1 # [ 2.930791] (udev-worker)[99]: Network interface NamePolicy= disabled on kernel command line.1959lb # [ 3.005992] systemd[1]: Found device /dev/disk/by-label/nixos.1960lb # [ 3.012530] systemd[1]: Reached target Initrd Root Device.1961lb # [ 3.020104] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1962worker1 # [ 2.974230] (udev-worker)[102]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1963worker1 # [ 2.978612] (udev-worker)[102]: Network interface NamePolicy= disabled on kernel command line.1964lb # [ 3.070439] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1965lb # [ 3.075521] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1966lb # [ 3.087228] systemd[1]: Mounting /sysroot...1967client # [ 2.998199] (udev-worker)[102]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1968worker2 # [ 3.001562] (udev-worker)[106]: Network interface NamePolicy= disabled on kernel command line.1969worker1 # [ 3.027985] systemd[1]: Found device /dev/disk/by-label/nixos.1970worker1 # [ 3.032606] systemd[1]: Reached target Initrd Root Device.1971worker1 # [ 3.036191] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1972client # [ 3.016436] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line.1973client # [ 3.019250] (udev-worker)[102]: Network interface NamePolicy= disabled on kernel command line.1974worker2 # [ 3.025694] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1975worker2 # [ 3.029676] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line.1976lb # [ 3.136296] EXT4-fs (vda): mounted filesystem 07be956b-033a-4433-bc3a-3bfb8ecc4f18 r/w with ordered data mode. Quota mode: none.1977lb # [ 3.125456] systemd[1]: Mounted /sysroot.1978lb # [ 3.127815] systemd[1]: Reached target Initrd Root File System.1979lb # [ 3.132098] systemd[1]: Starting Mountpoints Configured in the Real Root...1980worker1 # [ 3.087956] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1981lb # [ 3.159379] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload.1982worker1 # [ 3.098474] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1983worker1 # [ 3.100453] systemd[1]: Mounting /sysroot...1984lb # [ 3.167931] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)...1985lb # [ 3.171245] systemd[1]: Reloading...1986worker2 # [ 3.084854] systemd[1]: Found device /dev/disk/by-label/nixos.1987worker2 # [ 3.091716] systemd[1]: Reached target Initrd Root Device.1988client # [ 3.097647] systemd[1]: Found device /dev/disk/by-label/nixos.1989worker2 # [ 3.096091] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1990client # [ 3.100556] systemd[1]: Reached target Initrd Root Device.1991client # [ 3.102900] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1992worker1 # [ 3.150050] EXT4-fs (vda): mounted filesystem d9abe3d5-0b18-48bb-86a5-64ba24c0fec7 r/w with ordered data mode. Quota mode: none.1993worker1 # [ 3.142609] systemd[1]: Mounted /sysroot.1994worker1 # [ 3.148135] systemd[1]: Reached target Initrd Root File System.1995worker1 # [ 3.149083] systemd[1]: Starting Mountpoints Configured in the Real Root...1996client # [ 3.144858] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1997worker1 # [ 3.171661] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload.1998worker2 # [ 3.150465] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1999client # [ 3.152215] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.2000worker1 # [ 3.176281] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)...
loading 2,226 hidden lines…
4227lb # [ 50.636201] niks3-server[1015]: 2026/09/22 11:22:26 INFO Completed upload id=54228lb # [ 50.639281] niks3-server[1015]: 2026/09/22 11:22:26 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo4229worker2 # [ 50.556659] nix-grpc-daemon[777]: ts=2026-09-22T11:22:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39942 duration_s=0 paths=1 nar_bytes_in=7524230worker2 # [ 50.567028] nix-grpc-daemon[777]: ts=2026-09-22T11:22:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:399424231worker2 # [ 50.574490] nix-daemon[863]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4232worker2 # [ 50.579458] nix-daemon[863]: reaped child process 964, status = succeeded4233client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...4234worker2 # [ 50.590884] nix-daemon[863]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4235client # farm-top> worker2: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4236client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds4237client # farm-top> LOG-farm-top-t14238worker2 # [ 51.427742] nix-daemon[863]: reaped child process 978, status = succeeded4239worker2 # [ 51.601676] nix-daemon[863]: accepted connection from pid 994, user nix-grpc-daemon (trusted)4240worker2 # [ 51.618702] nix-daemon[863]: reaped child process 997, status = succeeded4241lb # [ 51.721949] niks3-server[1015]: 2026/09/22 11:22:27 INFO Received uploads request method=POST path=/api/pending_closures4242worker2 # [ 51.643513] nix-grpc-daemon[878]: time=2026-09-22T11:22:27.273Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4243worker2 # [ 51.645148] nix-grpc-daemon[878]: time=2026-09-22T11:22:27.273Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"4244lb # [ 51.760841] niks3-server[1015]: 2026/09/22 11:22:27 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst4245lb # [ 51.773908] niks3-server[1015]: 2026/09/22 11:22:27 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4246worker2 # [ 51.698444] nix-grpc-daemon[878]: time=2026-09-22T11:22:27.329Z level=INFO msg="Uploading 1 narinfos"4247lb # [ 51.783126] niks3-server[1015]: 2026/09/22 11:22:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4248lb # [ 51.793709] niks3-server[1015]: 2026/09/22 11:22:27 INFO Signed narinfos id=6 count=14249lb # [ 51.798734] niks3-server[1015]: 2026/09/22 11:22:27 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls4250lb # [ 51.809607] niks3-server[1015]: 2026/09/22 11:22:27 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4251lb # [ 51.816097] niks3-server[1015]: 2026/09/22 11:22:27 INFO Completed upload id=64252worker2 # [ 51.724512] nix-grpc-daemon[878]: time=2026-09-22T11:22:27.355Z level=INFO msg="Upload complete. (322ms)"4253lb # [ 51.819866] niks3-server[1015]: 2026/09/22 11:22:27 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo4254lb # [ 51.829550] envoy[913]: conn peer=[2001:db8:1::1]:46390 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=19304255lb # [ 51.834615] envoy[913]: conn peer=[2001:db8:1::1]:46392 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=894256worker2 # [ 51.740560] nix-grpc-daemon[777]: ts=2026-09-22T11:22:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39942 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=14257lb # [ 51.838584] envoy[913]: conn peer=[2001:db8:1::1]:46402 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=134258lb # [ 51.842013] envoy[913]: conn peer=[2001:db8:1::1]:46412 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=134259worker2 # [ 51.756183] nix-daemon[863]: reaped child process 976, status = succeeded4260client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 7.67 seconds)4261client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4262client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.26 seconds)4263client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4264client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.02 seconds)4265client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4266client # copying 3 paths...4267client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...4268client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...4269client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...4270client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.29 seconds)4271(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 8.35 seconds)4272subtest: repeat is answered Cached by the scheduler without building4273worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4274worker1 # finding garbage collector roots...4275worker1 # deleting specified paths...4276worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4277worker1 # deleting unused links...4278worker1 # note: hard linking is currently saving 0.0 KiB4279worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.29 seconds)4280worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4281worker2 # finding garbage collector roots...4282worker2 # deleting specified paths...4283worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4284worker2 # deleting unused links...4285worker2 # note: hard linking is currently saving 0.0 KiB4286worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.28 seconds)4287client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&24288worker2 # [ 53.331995] nix-grpc-daemon[777]: ts=2026-09-22T11:22:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:399424289client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):4290client # /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4291worker1 # [ 53.375701] nix-grpc-daemon[866]: ts=2026-09-22T11:22:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:609284292worker2 # [ 53.381848] nix-grpc-daemon[777]: ts=2026-09-22T11:22:29Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=14293client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.37 seconds)4294client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4295client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.21 seconds)4296lb: must succeed: curl -sf localhost:9901/clusters4297lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4298lb: must succeed: curl -sf localhost:9901/clusters4299lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4300worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4301worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)4302(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.46 seconds)4303subtest: inputs already in the cache are not sent to the scheduler4304lb: must succeed: curl -sf localhost:9901/clusters4305lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4306lb: must succeed: curl -sf localhost:9901/clusters4307lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4308worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4309worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds)4310client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&24311worker1 # [ 54.421177] nix-grpc-daemon[866]: ts=2026-09-22T11:22:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:609284312client # don't know how to build these paths:4313client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4314worker1 # [ 54.431290] nix-grpc-daemon[866]: ts=2026-09-22T11:22:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:609284315worker2 # [ 54.427393] nix-grpc-daemon[777]: ts=2026-09-22T11:22:30Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=04316worker2 # [ 54.427690] nix-grpc-daemon[777]: ts=2026-09-22T11:22:30Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.4:50051 clients=14317worker2 # [ 54.469736] nix-grpc-daemon[777]: ts=2026-09-22T11:22:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:399424318worker2 # [ 54.484683] nix-grpc-daemon[777]: ts=2026-09-22T11:22:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:399424319client # copying 1 paths to 'lb:50051'...4320worker2 # [ 54.501660] nix-grpc-daemon[878]: time=2026-09-22T11:22:30.130Z level=INFO msg="All 2 paths already cached"4321client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'...4322worker2 # [ 54.507939] nix-grpc-daemon[777]: ts=2026-09-22T11:22:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:399424323worker2 # [ 54.526456] nix-daemon[863]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4324worker2 # [ 54.721598] nix-daemon[863]: accepted connection from pid 1026, user nix-grpc-daemon (trusted)4325worker2 # [ 54.741483] nix-daemon[863]: reaped child process 1029, status = succeeded4326worker2 # [ 54.912632] nix-daemon[863]: accepted connection from pid 1031, user nix-grpc-daemon (trusted)4327worker2 # [ 54.930559] nix-daemon[863]: reaped child process 1034, status = succeeded4328lb # [ 55.033751] niks3-server[1015]: 2026/09/22 11:22:30 INFO Received uploads request method=POST path=/api/pending_closures4329worker2 # [ 54.952719] nix-grpc-daemon[878]: time=2026-09-22T11:22:30.583Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4330worker2 # [ 54.954155] nix-grpc-daemon[878]: time=2026-09-22T11:22:30.583Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)"4331lb # [ 55.062038] niks3-server[1015]: 2026/09/22 11:22:30 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst4332lb # [ 55.076219] niks3-server[1015]: 2026/09/22 11:22:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4333worker2 # [ 54.991094] nix-grpc-daemon[878]: time=2026-09-22T11:22:30.622Z level=INFO msg="Uploading 1 narinfos"4334lb # [ 55.086183] niks3-server[1015]: 2026/09/22 11:22:30 INFO Signed narinfos id=7 count=14335lb # [ 55.092287] niks3-server[1015]: 2026/09/22 11:22:30 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls4336lb # [ 55.100994] niks3-server[1015]: 2026/09/22 11:22:30 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4337lb # [ 55.107820] niks3-server[1015]: 2026/09/22 11:22:30 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo4338lb # [ 55.111882] niks3-server[1015]: 2026/09/22 11:22:30 INFO Completed upload id=74339worker2 # [ 55.021307] nix-grpc-daemon[878]: time=2026-09-22T11:22:30.652Z level=INFO msg="Upload complete. (478ms)"4340worker2 # [ 55.028213] nix-grpc-daemon[777]: ts=2026-09-22T11:22:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39942 duration_s=0 paths=1 nar_bytes_in=7524341worker2 # [ 55.042052] nix-grpc-daemon[777]: ts=2026-09-22T11:22:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:399424342worker2 # [ 55.051786] nix-daemon[863]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4343worker2 # [ 55.054780] nix-daemon[863]: reaped child process 1024, status = succeeded4344client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051...4345worker2 # [ 55.066386] nix-daemon[863]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4346client # farm-top> worker2: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4347client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds4348client # farm-top> LOG-farm-top-t1b4349worker2 # [ 56.488866] nix-daemon[863]: reaped child process 1038, status = succeeded4350worker2 # [ 56.645374] nix-daemon[863]: accepted connection from pid 1054, user nix-grpc-daemon (trusted)4351worker2 # [ 56.663687] nix-daemon[863]: reaped child process 1057, status = succeeded4352lb # [ 56.766884] niks3-server[1015]: 2026/09/22 11:22:32 INFO Received uploads request method=POST path=/api/pending_closures4353worker2 # [ 56.687932] nix-grpc-daemon[878]: time=2026-09-22T11:22:32.316Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4354worker2 # [ 56.689570] nix-grpc-daemon[878]: time=2026-09-22T11:22:32.316Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)"4355lb # [ 56.805741] niks3-server[1015]: 2026/09/22 11:22:32 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst4356worker2 # [ 56.728424] nix-grpc-daemon[878]: time=2026-09-22T11:22:32.359Z level=INFO msg="Uploading 1 narinfos"4357lb # [ 56.820129] niks3-server[1015]: 2026/09/22 11:22:32 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4358lb # [ 56.829946] niks3-server[1015]: 2026/09/22 11:22:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4359lb # [ 56.838828] niks3-server[1015]: 2026/09/22 11:22:32 INFO Signed narinfos id=8 count=14360worker2 # [ 56.751287] nix-grpc-daemon[878]: time=2026-09-22T11:22:32.382Z level=INFO msg="Upload complete. (272ms)"4361lb # [ 56.842723] niks3-server[1015]: 2026/09/22 11:22:32 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls4362lb # [ 56.848129] niks3-server[1015]: 2026/09/22 11:22:32 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4363lb # [ 56.852383] niks3-server[1015]: 2026/09/22 11:22:32 INFO Completed upload id=84364worker2 # [ 56.760785] nix-grpc-daemon[777]: ts=2026-09-22T11:22:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39942 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=14365lb # [ 56.854389] niks3-server[1015]: 2026/09/22 11:22:32 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo4366worker2 # [ 56.773832] nix-daemon[863]: reaped child process 1036, status = succeeded4367client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.67 seconds)4368client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath4369client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.23 seconds)4370lb: must succeed: curl -sf localhost:9901/clusters4371lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.12 seconds)4372lb: must succeed: curl -sf localhost:9901/clusters4373lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4374worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4375worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds)4376(finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.32 seconds)4377subtest: outputs read back through any worker carry the cache signature4378client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag sig >&24379client # don't know how to build these paths:4380client # /nix/store/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv4381worker2 # [ 57.536411] nix-grpc-daemon[777]: ts=2026-09-22T11:22:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:399424382worker1 # [ 57.565119] nix-grpc-daemon[866]: ts=2026-09-22T11:22:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:609284383worker2 # [ 57.563655] nix-grpc-daemon[777]: ts=2026-09-22T11:22:33Z level=debug event=want client=4 drv=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv cached=04384worker2 # [ 57.569743] nix-grpc-daemon[777]: ts=2026-09-22T11:22:33Z level=debug event=assigned drv=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv worker=192.168.1.3:50051 clients=14385worker1 # [ 57.596923] nix-grpc-daemon[866]: ts=2026-09-22T11:22:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609284386worker1 # [ 57.617346] nix-grpc-daemon[866]: ts=2026-09-22T11:22:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:609284387client # copying 1 paths to 'lb:50051'...4388client # copying path '/nix/store/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv' to 'lb:50051'...4389worker1 # [ 57.633248] nix-grpc-daemon[866]: ts=2026-09-22T11:22:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:609284390worker1 # [ 57.649251] nix-daemon[932]: accepted connection from pid 866, user nix-grpc-daemon (trusted)4391worker1 # [ 57.677466] nix-grpc-daemon[866]: ts=2026-09-22T11:22:33Z level=info event=niks3_push_started pid=9594392worker1 # [ 57.931350] nix-grpc-daemon[959]: time=2026-09-22T11:22:33.566Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca=""4393worker1 # [ 58.116905] nix-daemon[932]: accepted connection from pid 972, user nix-grpc-daemon (trusted)4394worker1 # [ 58.135056] nix-daemon[932]: reaped child process 975, status = succeeded4395worker1 # [ 58.308369] nix-daemon[932]: accepted connection from pid 977, user nix-grpc-daemon (trusted)4396worker1 # [ 58.323649] nix-daemon[932]: reaped child process 980, status = succeeded4397lb # [ 58.402873] niks3-server[1015]: 2026/09/22 11:22:34 INFO Received uploads request method=POST path=/api/pending_closures4398worker1 # [ 58.347048] nix-grpc-daemon[959]: time=2026-09-22T11:22:33.983Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4399worker1 # [ 58.350586] nix-grpc-daemon[959]: time=2026-09-22T11:22:33.985Z level=INFO msg="Uploading 3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv (512B)"4400lb # [ 58.439155] niks3-server[1015]: 2026/09/22 11:22:34 INFO Registered completed upload object_key=nar/13mhmmy2qay13imbbdi287vhryz1hwnyg0w6agd9s0ph37wnsqll.nar.zst4401worker1 # [ 58.387431] nix-grpc-daemon[959]: time=2026-09-22T11:22:34.023Z level=INFO msg="Uploading 1 narinfos"4402lb # [ 58.453654] niks3-server[1015]: 2026/09/22 11:22:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4403lb # [ 58.465744] niks3-server[1015]: 2026/09/22 11:22:34 INFO Signed narinfos id=9 count=14404lb # [ 58.472485] niks3-server[1015]: 2026/09/22 11:22:34 INFO Registered completed upload object_key=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y.ls4405lb # [ 58.485887] niks3-server[1015]: 2026/09/22 11:22:34 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4406lb # [ 58.492418] niks3-server[1015]: 2026/09/22 11:22:34 INFO Completed upload id=94407worker1 # [ 58.425438] nix-grpc-daemon[959]: time=2026-09-22T11:22:34.061Z level=INFO msg="Upload complete. (486ms)"4408lb # [ 58.495824] niks3-server[1015]: 2026/09/22 11:22:34 INFO Registered completed upload object_key=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y.narinfo4409worker1 # [ 58.436430] nix-grpc-daemon[866]: ts=2026-09-22T11:22:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60928 duration_s=0 paths=1 nar_bytes_in=5124410worker1 # [ 58.446997] nix-grpc-daemon[866]: ts=2026-09-22T11:22:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609284411worker1 # [ 58.453744] nix-daemon[932]: accepted connection from pid 866, user nix-grpc-daemon (trusted)4412worker1 # [ 58.458472] nix-daemon[932]: reaped child process 957, status = succeeded4413client # building '/nix/store/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv' on lb:50051...4414client # farm-a> node-a: building 3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv4415worker1 # [ 58.470994] nix-daemon[932]: accepted connection from pid 866, user nix-grpc-daemon (trusted)4416client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds4417client # farm-a> LOG-farm-a-sig4418worker1 # [ 59.718575] nix-daemon[932]: reaped child process 984, status = succeeded4419worker1 # [ 59.889717] nix-daemon[932]: accepted connection from pid 1000, user nix-grpc-daemon (trusted)4420worker1 # [ 59.907400] nix-daemon[932]: reaped child process 1003, status = succeeded4421lb # [ 59.986784] niks3-server[1015]: 2026/09/22 11:22:35 INFO Received uploads request method=POST path=/api/pending_closures4422worker1 # [ 59.932153] nix-grpc-daemon[959]: time=2026-09-22T11:22:35.566Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4423worker1 # [ 59.934367] nix-grpc-daemon[959]: time=2026-09-22T11:22:35.566Z level=INFO msg="Uploading 2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a (128B)"4424lb # [ 60.025277] niks3-server[1015]: 2026/09/22 11:22:35 INFO Registered completed upload object_key=log/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv4425lb # [ 60.039668] niks3-server[1015]: 2026/09/22 11:22:35 INFO Registered completed upload object_key=nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst4426lb # [ 60.055485] niks3-server[1015]: 2026/09/22 11:22:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4427worker1 # [ 59.990584] nix-grpc-daemon[959]: time=2026-09-22T11:22:35.625Z level=INFO msg="Uploading 1 narinfos"4428lb # [ 60.063711] niks3-server[1015]: 2026/09/22 11:22:35 INFO Signed narinfos id=10 count=14429lb # [ 60.069223] niks3-server[1015]: 2026/09/22 11:22:35 INFO Registered completed upload object_key=2ykckkv44ccpw95ad66fm21ggp6krwj9.ls4430lb # [ 60.077963] niks3-server[1015]: 2026/09/22 11:22:35 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4431lb # [ 60.085189] niks3-server[1015]: 2026/09/22 11:22:35 INFO Completed upload id=104432worker1 # [ 60.017995] nix-grpc-daemon[959]: time=2026-09-22T11:22:35.654Z level=INFO msg="Upload complete. (333ms)"4433lb # [ 60.087816] niks3-server[1015]: 2026/09/22 11:22:35 INFO Registered completed upload object_key=2ykckkv44ccpw95ad66fm21ggp6krwj9.narinfo4434worker1 # [ 60.029124] nix-grpc-daemon[866]: ts=2026-09-22T11:22:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60928 duration_s=1 drv=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv assign_id=5 outputs=14435worker2 # [ 60.011193] nix-grpc-daemon[777]: ts=2026-09-22T11:22:35Z level=debug event=want client=4 drv=z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv cached=04436worker2 # [ 60.017075] nix-grpc-daemon[777]: ts=2026-09-22T11:22:35Z level=debug event=assigned drv=z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv worker=192.168.1.3:50051 clients=14437worker1 # [ 60.050164] nix-daemon[932]: reaped child process 982, status = succeeded4438worker1 # [ 60.081988] nix-grpc-daemon[866]: ts=2026-09-22T11:22:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609284439worker1 # [ 60.097192] nix-grpc-daemon[866]: ts=2026-09-22T11:22:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:609284440worker1 # [ 60.111960] nix-grpc-daemon[959]: time=2026-09-22T11:22:35.748Z level=INFO msg="All 1 paths already cached"4441client # copying 1 paths to 'lb:50051'...4442client # copying path '/nix/store/z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv' to 'lb:50051'...4443worker1 # [ 60.122749] nix-grpc-daemon[866]: ts=2026-09-22T11:22:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:609284444worker1 # [ 60.140140] nix-daemon[932]: accepted connection from pid 866, user nix-grpc-daemon (trusted)4445worker1 # [ 60.335855] nix-daemon[932]: accepted connection from pid 1007, user nix-grpc-daemon (trusted)4446worker1 # [ 60.353951] nix-daemon[932]: reaped child process 1010, status = succeeded4447worker1 # [ 60.522316] nix-daemon[932]: accepted connection from pid 1012, user nix-grpc-daemon (trusted)4448worker1 # [ 60.537130] nix-daemon[932]: reaped child process 1015, status = succeeded4449lb # [ 60.615323] niks3-server[1015]: 2026/09/22 11:22:36 INFO Received uploads request method=POST path=/api/pending_closures4450worker1 # [ 60.557931] nix-grpc-daemon[959]: time=2026-09-22T11:22:36.193Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4451worker1 # [ 60.559402] nix-grpc-daemon[959]: time=2026-09-22T11:22:36.193Z level=INFO msg="Uploading z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv (624B)"4452lb # [ 60.642641] niks3-server[1015]: 2026/09/22 11:22:36 INFO Registered completed upload object_key=nar/0cnhkgsbmxv5hj7zw3fa59qfxikw6251mlhz2gz1v6pgn8c8shwp.nar.zst4453lb # [ 60.654886] niks3-server[1015]: 2026/09/22 11:22:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4454worker1 # [ 60.595352] nix-grpc-daemon[959]: time=2026-09-22T11:22:36.231Z level=INFO msg="Uploading 1 narinfos"4455lb # [ 60.663550] niks3-server[1015]: 2026/09/22 11:22:36 INFO Signed narinfos id=11 count=14456lb # [ 60.670482] niks3-server[1015]: 2026/09/22 11:22:36 INFO Registered completed upload object_key=z8kadp39h0myij9ln0hpxb61ldn71h4i.ls4457lb # [ 60.682402] niks3-server[1015]: 2026/09/22 11:22:36 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4458lb # [ 60.690494] niks3-server[1015]: 2026/09/22 11:22:36 INFO Registered completed upload object_key=z8kadp39h0myij9ln0hpxb61ldn71h4i.narinfo4459lb # [ 60.695166] niks3-server[1015]: 2026/09/22 11:22:36 INFO Completed upload id=114460worker1 # [ 60.628738] nix-grpc-daemon[959]: time=2026-09-22T11:22:36.264Z level=INFO msg="Upload complete. (476ms)"4461worker1 # [ 60.636740] nix-grpc-daemon[866]: ts=2026-09-22T11:22:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60928 duration_s=0 paths=1 nar_bytes_in=6244462worker1 # [ 60.644676] nix-grpc-daemon[866]: ts=2026-09-22T11:22:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609284463worker1 # [ 60.655513] nix-daemon[932]: accepted connection from pid 866, user nix-grpc-daemon (trusted)4464worker1 # [ 60.660159] nix-daemon[932]: reaped child process 1005, status = succeeded4465client # building '/nix/store/z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv' on lb:50051...4466client # farm-b> node-a: building z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv4467worker1 # [ 60.673837] nix-daemon[932]: accepted connection from pid 866, user nix-grpc-daemon (trusted)4468client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds4469client # farm-b> LOG-farm-b-sig4470worker1 # [ 61.501881] nix-daemon[932]: reaped child process 1019, status = succeeded4471worker1 # [ 61.663222] nix-daemon[932]: accepted connection from pid 1035, user nix-grpc-daemon (trusted)4472worker1 # [ 61.678536] nix-daemon[932]: reaped child process 1038, status = succeeded4473lb # [ 61.757643] niks3-server[1015]: 2026/09/22 11:22:37 INFO Received uploads request method=POST path=/api/pending_closures4474worker1 # [ 61.701337] nix-grpc-daemon[959]: time=2026-09-22T11:22:37.336Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4475worker1 # [ 61.702788] nix-grpc-daemon[959]: time=2026-09-22T11:22:37.336Z level=INFO msg="Uploading h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b (176B)"4476worker1 # [ 61.742646] nix-grpc-daemon[959]: time=2026-09-22T11:22:37.378Z level=INFO msg="Uploading 1 narinfos"4477lb # [ 61.800836] niks3-server[1015]: 2026/09/22 11:22:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4478lb # [ 61.815800] niks3-server[1015]: 2026/09/22 11:22:37 INFO Registered completed upload object_key=log/z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv4479lb # [ 61.827196] niks3-server[1015]: 2026/09/22 11:22:37 INFO Signed narinfos id=12 count=14480worker1 # [ 61.769370] nix-grpc-daemon[959]: time=2026-09-22T11:22:37.405Z level=INFO msg="Upload complete. (285ms)"4481lb # [ 61.836793] niks3-server[1015]: 2026/09/22 11:22:37 INFO Registered completed upload object_key=nar/0f75gpfkjj0g9xi2113yvvpdw0l16spc2f1xik1ifnzfbrvx4pfk.nar.zst4482lb # [ 61.842632] niks3-server[1015]: 2026/09/22 11:22:37 INFO Registered completed upload object_key=h1r17djqpb9gp4y7v8nzx65ns9vdr50c.ls4483lb # [ 61.846548] niks3-server[1015]: 2026/09/22 11:22:37 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4484worker1 # [ 61.780834] nix-grpc-daemon[866]: ts=2026-09-22T11:22:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60928 duration_s=1 drv=z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv assign_id=6 outputs=14485lb # [ 61.852595] niks3-server[1015]: 2026/09/22 11:22:37 INFO Completed upload id=124486lb # [ 61.855661] niks3-server[1015]: 2026/09/22 11:22:37 INFO Registered completed upload object_key=h1r17djqpb9gp4y7v8nzx65ns9vdr50c.narinfo4487worker1 # [ 61.792748] nix-daemon[932]: reaped child process 1017, status = succeeded4488worker2 # [ 61.765135] nix-grpc-daemon[777]: ts=2026-09-22T11:22:37Z level=debug event=want client=4 drv=knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv cached=04489lb # [ 61.860567] envoy[913]: conn peer=[2001:db8:1::1]:46428 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9549 tx=4444 ms=74024490lb # [ 61.863875] envoy[913]: conn peer=[2001:db8:1::1]:37100 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=734491worker2 # [ 61.765521] nix-grpc-daemon[777]: ts=2026-09-22T11:22:37Z level=debug event=assigned drv=knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv worker=192.168.1.3:50051 clients=14492lb # [ 61.867274] envoy[913]: conn peer=[2001:db8:1::1]:37110 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4185 tx=1896 ms=23794493worker1 # [ 61.834176] nix-grpc-daemon[866]: ts=2026-09-22T11:22:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609284494worker1 # [ 61.849078] nix-grpc-daemon[866]: ts=2026-09-22T11:22:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:609284495worker1 # [ 61.864249] nix-grpc-daemon[959]: time=2026-09-22T11:22:37.500Z level=INFO msg="All 2 paths already cached"4496client # copying 1 paths to 'lb:50051'...4497client # copying path '/nix/store/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv' to 'lb:50051'...4498worker1 # [ 61.875143] nix-grpc-daemon[866]: ts=2026-09-22T11:22:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:609284499worker1 # [ 61.888902] nix-daemon[932]: accepted connection from pid 866, user nix-grpc-daemon (trusted)4500worker1 # [ 62.087382] nix-daemon[932]: accepted connection from pid 1042, user nix-grpc-daemon (trusted)4501worker1 # [ 62.106435] nix-daemon[932]: reaped child process 1045, status = succeeded4502worker1 # [ 62.281397] nix-daemon[932]: accepted connection from pid 1047, user nix-grpc-daemon (trusted)4503worker1 # [ 62.297967] nix-daemon[932]: reaped child process 1050, status = succeeded4504lb # [ 62.377242] niks3-server[1015]: 2026/09/22 11:22:38 INFO Received uploads request method=POST path=/api/pending_closures4505worker1 # [ 62.320253] nix-grpc-daemon[959]: time=2026-09-22T11:22:37.956Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4506worker1 # [ 62.321697] nix-grpc-daemon[959]: time=2026-09-22T11:22:37.956Z level=INFO msg="Uploading knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv (752B)"4507lb # [ 62.407438] niks3-server[1015]: 2026/09/22 11:22:38 INFO Registered completed upload object_key=nar/0lpagyrngav67x80d1hq0njjlkmqdkvqawraz8dsp36ag50v6iwf.nar.zst4508lb # [ 62.423173] niks3-server[1015]: 2026/09/22 11:22:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4509worker1 # [ 62.362883] nix-grpc-daemon[959]: time=2026-09-22T11:22:37.998Z level=INFO msg="Uploading 1 narinfos"4510lb # [ 62.436411] niks3-server[1015]: 2026/09/22 11:22:38 INFO Signed narinfos id=13 count=14511lb # [ 62.441811] niks3-server[1015]: 2026/09/22 11:22:38 INFO Registered completed upload object_key=knvx2sz45j0sdqm3fnbdrv7m887k7a6x.ls4512worker1 # [ 62.383726] nix-grpc-daemon[959]: time=2026-09-22T11:22:38.019Z level=INFO msg="Upload complete. (477ms)"4513lb # [ 62.450755] niks3-server[1015]: 2026/09/22 11:22:38 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4514lb # [ 62.456182] niks3-server[1015]: 2026/09/22 11:22:38 INFO Completed upload id=134515worker1 # [ 62.392218] nix-grpc-daemon[866]: ts=2026-09-22T11:22:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60928 duration_s=0 paths=1 nar_bytes_in=7524516lb # [ 62.459467] niks3-server[1015]: 2026/09/22 11:22:38 INFO Registered completed upload object_key=knvx2sz45j0sdqm3fnbdrv7m887k7a6x.narinfo4517worker1 # [ 62.403378] nix-grpc-daemon[866]: ts=2026-09-22T11:22:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609284518worker1 # [ 62.410226] nix-daemon[932]: accepted connection from pid 866, user nix-grpc-daemon (trusted)4519worker1 # [ 62.414891] nix-daemon[932]: reaped child process 1040, status = succeeded4520client # building '/nix/store/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv' on lb:50051...4521worker1 # [ 62.426028] nix-daemon[932]: accepted connection from pid 866, user nix-grpc-daemon (trusted)4522client # farm-top> node-a: building knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv4523client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds4524client # farm-top> LOG-farm-top-sig4525worker1 # [ 63.047428] nix-daemon[932]: reaped child process 1054, status = succeeded4526worker1 # [ 63.204699] nix-daemon[932]: accepted connection from pid 1070, user nix-grpc-daemon (trusted)4527worker1 # [ 63.221616] nix-daemon[932]: reaped child process 1073, status = succeeded4528lb # [ 63.302259] niks3-server[1015]: 2026/09/22 11:22:38 INFO Received uploads request method=POST path=/api/pending_closures4529worker1 # [ 63.247010] nix-grpc-daemon[959]: time=2026-09-22T11:22:38.881Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4530worker1 # [ 63.248618] nix-grpc-daemon[959]: time=2026-09-22T11:22:38.881Z level=INFO msg="Uploading 4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top (232B)"4531lb # [ 63.338478] niks3-server[1015]: 2026/09/22 11:22:38 INFO Registered completed upload object_key=log/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv4532lb # [ 63.350809] niks3-server[1015]: 2026/09/22 11:22:38 INFO Registered completed upload object_key=nar/07ar364rwqqniwi2nkdpqlgv7ws7702n5lqz703ackfmssrh40v8.nar.zst4533worker1 # [ 63.296700] nix-grpc-daemon[959]: time=2026-09-22T11:22:38.932Z level=INFO msg="Uploading 1 narinfos"4534lb # [ 63.363467] niks3-server[1015]: 2026/09/22 11:22:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4535lb # [ 63.372093] niks3-server[1015]: 2026/09/22 11:22:39 INFO Signed narinfos id=14 count=14536lb # [ 63.377749] niks3-server[1015]: 2026/09/22 11:22:39 INFO Registered completed upload object_key=4s2wbz2hg55lpb7s5vn3ynd342bs09lw.ls4537lb # [ 63.386021] niks3-server[1015]: 2026/09/22 11:22:39 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4538lb # [ 63.395455] niks3-server[1015]: 2026/09/22 11:22:39 INFO Completed upload id=144539worker1 # [ 63.329079] nix-grpc-daemon[959]: time=2026-09-22T11:22:38.965Z level=INFO msg="Upload complete. (292ms)"4540lb # [ 63.399525] niks3-server[1015]: 2026/09/22 11:22:39 INFO Registered completed upload object_key=4s2wbz2hg55lpb7s5vn3ynd342bs09lw.narinfo4541worker1 # [ 63.341041] nix-grpc-daemon[866]: ts=2026-09-22T11:22:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60928 duration_s=0 drv=knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv assign_id=7 outputs=14542worker1 # [ 63.355420] nix-daemon[932]: reaped child process 1052, status = succeeded4543client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag sig >&2, in 6.14 seconds)4544client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag sig outPath4545client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag sig outPath, in 0.23 seconds)4546client: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&ca-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top4547worker1 # [ 63.865683] nix-grpc-daemon[866]: ts=2026-09-22T11:22:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:523444548worker1 # [ 63.873715] nix-grpc-daemon[866]: ts=2026-09-22T11:22:39Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:523444549client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&ca-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top, in 0.28 seconds)4550client: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&ca-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top4551worker2 # [ 64.137621] nix-grpc-daemon[777]: ts=2026-09-22T11:22:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:458804552client # these 3 paths will be fetched (0.0 KiB download, 0.5 KiB unpacked):4553client # /nix/store/2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a4554client # /nix/store/h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b4555client # /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top4556worker2 # [ 64.166366] nix-grpc-daemon[777]: ts=2026-09-22T11:22:39Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:458804557worker2 # [ 64.177165] nix-grpc-daemon[777]: copying path '/nix/store/2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a' from 'http://lb:5751'...4558worker2 # [ 64.198005] nix-grpc-daemon[777]: copying path '/nix/store/h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b' from 'http://lb:5751'...4559worker2 # [ 64.213004] nix-grpc-daemon[777]: copying path '/nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top' from 'http://lb:5751'...4560client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&ca-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top, in 0.34 seconds)4561client: must succeed: nix-store --delete /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top4562client # finding garbage collector roots...4563client # removing stale temporary roots file "/nix/var/nix/temproots/836"4564client # removing stale temporary roots file "/nix/var/nix/temproots/892"4565client # removing stale temporary roots file "/nix/var/nix/temproots/799"4566client # removing stale temporary roots file "/nix/var/nix/temproots/815"4567client # removing stale temporary roots file "/nix/var/nix/temproots/877"4568client # removing stale temporary roots file "/nix/var/nix/temproots/869"4569client # removing stale temporary roots file "/nix/var/nix/temproots/856"4570client # removing stale temporary roots file "/nix/var/nix/temproots/848"4571client # deleting specified paths...4572client # deleting '/nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top'4573client # deleting unused links...4574client # note: hard linking is currently saving 0.0 KiB4575worker1 # [ 64.745409] nix-grpc-daemon[866]: ts=2026-09-22T11:22:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:609284576worker2 # [ 64.730985] nix-grpc-daemon[777]: ts=2026-09-22T11:22:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:399424577worker2 # [ 64.741814] nix-grpc-daemon[878]: time=2026-09-22T11:22:40.372Z level=INFO msg="All 1 paths already cached"4578worker1 # [ 64.774386] nix-grpc-daemon[866]: ts=2026-09-22T11:22:40Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:609284579worker2 # [ 64.759633] nix-grpc-daemon[777]: ts=2026-09-22T11:22:40Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:399424580client # copying 3 paths...4581worker1 # [ 64.798263] nix-grpc-daemon[866]: ts=2026-09-22T11:22:40Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:609284582client # copying path '/nix/store/2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a' from 'grpc://lb:50051'...4583worker1 # [ 64.826733] nix-grpc-daemon[866]: ts=2026-09-22T11:22:40Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:609284584worker1 # [ 64.835320] nix-grpc-daemon[866]: ts=2026-09-22T11:22:40Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60928 duration_s=0 paths=1 nar_bytes_out=2324585worker2 # [ 64.817793] nix-grpc-daemon[777]: ts=2026-09-22T11:22:40Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:399424586worker2 # [ 64.826201] nix-grpc-daemon[777]: ts=2026-09-22T11:22:40Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:39942 duration_s=0 paths=1 nar_bytes_out=1764587worker2 # [ 64.834823] nix-grpc-daemon[777]: ts=2026-09-22T11:22:40Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:399424588worker2 # [ 64.839883] nix-grpc-daemon[777]: ts=2026-09-22T11:22:40Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:39942 duration_s=0 paths=1 nar_bytes_out=1284589client # copying path '/nix/store/h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b' from 'grpc://lb:50051'...4590client # copying path '/nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top' from 'grpc://lb:50051'...4591client: (finished: must succeed: nix-store --delete /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top, in 0.68 seconds)4592(finished: subtest: outputs read back through any worker carry the cache signature, in 7.68 seconds)4593subtest: two clients wanting the same drv build it once4594client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4595client # [ 65.003762] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4596client # Running as unit: dedup1.service; invocation ID: f051ce45d4a04d559efc1540fc4e03c04597client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.07 seconds)4598client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4599worker1 # [ 65.279111] nix-grpc-daemon[866]: ts=2026-09-22T11:22:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:609284600client # [ 65.264867] nix[945]: don't know how to build these paths:4601client # [ 65.265974] nix[945]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4602worker2 # [ 65.274510] nix-grpc-daemon[777]: ts=2026-09-22T11:22:40Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04603worker2 # [ 65.279909] nix-grpc-daemon[777]: ts=2026-09-22T11:22:40Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=14604worker2 # [ 65.317299] nix-grpc-daemon[777]: ts=2026-09-22T11:22:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:399424605worker2 # [ 65.332273] nix-grpc-daemon[777]: ts=2026-09-22T11:22:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:399424606client # [ 65.348156] nix[945]: copying 1 paths to 'lb:50051'...4607worker2 # [ 65.346409] nix-grpc-daemon[777]: ts=2026-09-22T11:22:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:399424608client # [ 65.350365] nix[945]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4609worker2 # [ 65.362882] nix-daemon[863]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4610worker2 # [ 65.574143] nix-daemon[863]: accepted connection from pid 1077, user nix-grpc-daemon (trusted)4611worker2 # [ 65.592166] nix-daemon[863]: reaped child process 1080, status = succeeded4612worker2 # [ 65.764379] nix-daemon[863]: accepted connection from pid 1082, user nix-grpc-daemon (trusted)4613worker2 # [ 65.781356] nix-daemon[863]: reaped child process 1085, status = succeeded4614lb # [ 65.884898] niks3-server[1015]: 2026/09/22 11:22:41 INFO Received uploads request method=POST path=/api/pending_closures4615worker2 # [ 65.803721] nix-grpc-daemon[878]: time=2026-09-22T11:22:41.434Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4616worker2 # [ 65.805325] nix-grpc-daemon[878]: time=2026-09-22T11:22:41.434Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4617lb # [ 65.910828] niks3-server[1015]: 2026/09/22 11:22:41 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4618lb # [ 65.927008] niks3-server[1015]: 2026/09/22 11:22:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4619worker2 # [ 65.842762] nix-grpc-daemon[878]: time=2026-09-22T11:22:41.473Z level=INFO msg="Uploading 1 narinfos"4620lb # [ 65.939238] niks3-server[1015]: 2026/09/22 11:22:41 INFO Signed narinfos id=15 count=14621lb # [ 65.946483] niks3-server[1015]: 2026/09/22 11:22:41 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4622worker2 # [ 65.865296] nix-grpc-daemon[878]: time=2026-09-22T11:22:41.496Z level=INFO msg="Upload complete. (485ms)"4623lb # [ 65.957054] niks3-server[1015]: 2026/09/22 11:22:41 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4624lb # [ 65.961866] niks3-server[1015]: 2026/09/22 11:22:41 INFO Completed upload id=154625lb # [ 65.965058] niks3-server[1015]: 2026/09/22 11:22:41 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4626worker2 # [ 65.872400] nix-grpc-daemon[777]: ts=2026-09-22T11:22:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39942 duration_s=0 paths=1 nar_bytes_in=4324627worker2 # [ 65.886125] nix-grpc-daemon[777]: ts=2026-09-22T11:22:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:399424628worker2 # [ 65.895393] nix-daemon[863]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4629worker2 # [ 65.897866] nix-daemon[863]: reaped child process 1075, status = succeeded4630client # [ 65.909152] nix[945]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4631worker2 # [ 65.910726] nix-daemon[863]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4632client # [ 66.107269] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4633client # Running as unit: dedup2.service; invocation ID: 8ac936e1e3f74f1f867421e481da95d94634client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.12 seconds)4635worker1 # [ 66.454573] nix-grpc-daemon[866]: ts=2026-09-22T11:22:42Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:609284636client # [ 66.439446] nix[961]: don't know how to build these paths:4637client # [ 66.441551] nix[961]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4638worker2 # [ 66.449223] nix-grpc-daemon[777]: ts=2026-09-22T11:22:42Z level=debug event=want client=6 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04639client # [ 66.459290] nix[961]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4640worker2 # [ 66.455974] nix-grpc-daemon[777]: ts=2026-09-22T11:22:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:399424641client: must succeed: sleep 24642client: (finished: must succeed: sleep 2, in 2.06 seconds)4643client: waiting for success: ! systemctl is-active dedup1 dedup24644worker2 # [ 69.734914] nix-daemon[863]: reaped child process 1089, status = succeeded4645worker2 # [ 69.894077] nix-daemon[863]: accepted connection from pid 1121, user nix-grpc-daemon (trusted)4646worker2 # [ 69.912118] nix-daemon[863]: reaped child process 1124, status = succeeded4647lb # [ 70.018332] niks3-server[1015]: 2026/09/22 11:22:45 INFO Received uploads request method=POST path=/api/pending_closures4648worker2 # [ 69.940184] nix-grpc-daemon[878]: time=2026-09-22T11:22:45.568Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4649worker2 # [ 69.941639] nix-grpc-daemon[878]: time=2026-09-22T11:22:45.568Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4650lb # [ 70.049061] niks3-server[1015]: 2026/09/22 11:22:45 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4651worker2 # [ 69.978609] nix-grpc-daemon[878]: time=2026-09-22T11:22:45.609Z level=INFO msg="Uploading 1 narinfos"4652lb # [ 70.069061] niks3-server[1015]: 2026/09/22 11:22:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4653lb # [ 70.079092] niks3-server[1015]: 2026/09/22 11:22:45 INFO Signed narinfos id=16 count=14654lb # [ 70.086784] niks3-server[1015]: 2026/09/22 11:22:45 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4655lb # [ 70.095513] niks3-server[1015]: 2026/09/22 11:22:45 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4656worker2 # [ 70.015726] nix-grpc-daemon[878]: time=2026-09-22T11:22:45.646Z level=INFO msg="Upload complete. (292ms)"4657lb # [ 70.106394] niks3-server[1015]: 2026/09/22 11:22:45 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4658lb # [ 70.111097] niks3-server[1015]: 2026/09/22 11:22:45 INFO Completed upload id=164659lb # [ 70.115192] niks3-server[1015]: 2026/09/22 11:22:45 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4660worker2 # [ 70.025676] nix-grpc-daemon[777]: ts=2026-09-22T11:22:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39942 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=8 outputs=14661worker2 # [ 70.043150] nix-grpc-daemon[777]: ts=2026-09-22T11:22:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39942 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=8 outputs=14662worker2 # [ 70.049174] nix-daemon[863]: reaped child process 1087, status = succeeded4663client # [ 70.085167] systemd[1]: dedup2.service: Deactivated successfully.4664client # [ 70.093407] systemd[1]: dedup2.service: Consumed 199ms CPU time over 3.982s wall clock time, 33.2M memory peak, 5.9K incoming IP traffic, 5.6K outgoing IP traffic.4665client # [ 70.135872] systemd[1]: dedup1.service: Deactivated successfully.4666client # [ 70.140145] systemd[1]: dedup1.service: Consumed 171ms CPU time over 5.134s wall clock time, 41.3M memory peak, 7.4K incoming IP traffic, 8.4K outgoing IP traffic.4667client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.14 seconds)4668client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4669client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.08 seconds)4670worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4671worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4672worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4673worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4674worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4675worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)4676worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4677worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)4678(finished: subtest: two clients wanting the same drv build it once, in 6.29 seconds)4679subtest: --timeout and --max-silent-time reach the builder4680worker2 # [ 71.498129] nix-grpc-daemon[777]: ts=2026-09-22T11:22:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:399424681worker2 # [ 71.516139] nix-grpc-daemon[777]: ts=2026-09-22T11:22:47Z level=debug event=want client=7 drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv cached=04682worker2 # [ 71.522926] nix-grpc-daemon[777]: ts=2026-09-22T11:22:47Z level=debug event=assigned drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv worker=192.168.1.3:50051 clients=14683worker1 # [ 71.554267] nix-grpc-daemon[866]: ts=2026-09-22T11:22:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609284684worker1 # [ 71.566560] nix-grpc-daemon[866]: ts=2026-09-22T11:22:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:609284685worker1 # [ 71.581625] nix-grpc-daemon[866]: ts=2026-09-22T11:22:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:609284686worker1 # [ 71.596872] nix-daemon[932]: accepted connection from pid 866, user nix-grpc-daemon (trusted)4687lb # [ 71.828401] envoy[913]: conn peer=[2001:db8:1::1]:37126 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9515 tx=4420 ms=58354688lb # [ 71.828676] envoy[913]: conn peer=[2001:db8:1::1]:47664 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=410 ms=1104689lb # [ 71.828782] envoy[913]: conn peer=[2001:db8:1::1]:47648 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1051 tx=2887 ms=1934690lb # [ 71.828880] envoy[913]: conn peer=[2001:db8:1::1]:47678 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=375 ms=974691lb # [ 71.829044] envoy[913]: conn peer=[2001:db8:1::1]:47682 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=408 tx=329 ms=824692lb # [ 71.829150] envoy[913]: conn peer=[2001:db8:1::1]:47698 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1430 tx=1197 ms=36234693lb # [ 71.829299] envoy[913]: conn peer=[2001:db8:1::1]:47692 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3018 tx=1565 ms=48384694worker1 # [ 71.798152] nix-daemon[932]: accepted connection from pid 1098, user nix-grpc-daemon (trusted)4695worker1 # [ 71.817504] nix-daemon[932]: reaped child process 1101, status = succeeded4696worker1 # [ 71.989917] nix-daemon[932]: accepted connection from pid 1103, user nix-grpc-daemon (trusted)4697worker1 # [ 72.005301] nix-daemon[932]: reaped child process 1106, status = succeeded4698lb # [ 72.086092] niks3-server[1015]: 2026/09/22 11:22:47 INFO Received uploads request method=POST path=/api/pending_closures4699worker1 # [ 72.027508] nix-grpc-daemon[959]: time=2026-09-22T11:22:47.663Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4700worker1 # [ 72.029145] nix-grpc-daemon[959]: time=2026-09-22T11:22:47.663Z level=INFO msg="Uploading sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv (424B)"4701lb # [ 72.111951] niks3-server[1015]: 2026/09/22 11:22:47 INFO Registered completed upload object_key=nar/1m12xmj6yzmb9y2j8ly0yvh5fyzy1nqk7ajhqwr4wn3b5h0bsch5.nar.zst4702worker1 # [ 72.058533] nix-grpc-daemon[959]: time=2026-09-22T11:22:47.694Z level=INFO msg="Uploading 1 narinfos"4703lb # [ 72.128286] niks3-server[1015]: 2026/09/22 11:22:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4704lb # [ 72.139401] niks3-server[1015]: 2026/09/22 11:22:47 INFO Signed narinfos id=17 count=14705lb # [ 72.144821] niks3-server[1015]: 2026/09/22 11:22:47 INFO Registered completed upload object_key=sfkglm39i7dsf4k91pn9ij8xz5mkgirx.ls4706lb # [ 72.153192] niks3-server[1015]: 2026/09/22 11:22:47 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4707worker1 # [ 72.091672] nix-grpc-daemon[959]: time=2026-09-22T11:22:47.727Z level=INFO msg="Upload complete. (478ms)"4708lb # [ 72.158280] niks3-server[1015]: 2026/09/22 11:22:47 INFO Completed upload id=174709lb # [ 72.161328] niks3-server[1015]: 2026/09/22 11:22:47 INFO Registered completed upload object_key=sfkglm39i7dsf4k91pn9ij8xz5mkgirx.narinfo4710worker1 # [ 72.100482] nix-grpc-daemon[866]: ts=2026-09-22T11:22:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60928 duration_s=0 paths=1 nar_bytes_in=4244711worker1 # [ 72.113113] nix-grpc-daemon[866]: ts=2026-09-22T11:22:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609284712worker1 # [ 72.121399] nix-daemon[932]: accepted connection from pid 866, user nix-grpc-daemon (trusted)4713worker1 # [ 72.124165] nix-daemon[932]: reaped child process 1096, status = succeeded4714worker1 # [ 72.136207] nix-daemon[932]: accepted connection from pid 866, user nix-grpc-daemon (trusted)4715worker1 # [ 78.753749] nix-grpc-daemon[866]: ts=2026-09-22T11:22:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60928 duration_s=6 drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv assign_id=9 outputs=04716worker1 # [ 78.793908] nix-daemon[932]: reaped child process 1108, status = succeeded4717worker1 # [ 78.797344] nix-daemon[932]: reaped child process 1110, status = succeeded4718worker1 # [ 79.062696] nix-grpc-daemon[866]: ts=2026-09-22T11:22:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:609284719worker2 # [ 79.057432] nix-grpc-daemon[777]: ts=2026-09-22T11:22:54Z level=debug event=want client=8 drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv cached=04720worker2 # [ 79.066390] nix-grpc-daemon[777]: ts=2026-09-22T11:22:54Z level=debug event=assigned drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv worker=192.168.1.4:50051 clients=14721worker2 # [ 79.074895] nix-grpc-daemon[777]: ts=2026-09-22T11:22:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:399424722worker2 # [ 79.082552] nix-grpc-daemon[777]: ts=2026-09-22T11:22:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:399424723worker2 # [ 79.093355] nix-grpc-daemon[777]: ts=2026-09-22T11:22:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:399424724worker2 # [ 79.108911] nix-daemon[863]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4725worker2 # [ 79.309460] nix-daemon[863]: accepted connection from pid 1141, user nix-grpc-daemon (trusted)4726worker2 # [ 79.329646] nix-daemon[863]: reaped child process 1144, status = succeeded4727worker2 # [ 79.499074] nix-daemon[863]: accepted connection from pid 1146, user nix-grpc-daemon (trusted)4728worker2 # [ 79.516726] nix-daemon[863]: reaped child process 1149, status = succeeded4729lb # [ 79.622307] niks3-server[1015]: 2026/09/22 11:22:55 INFO Received uploads request method=POST path=/api/pending_closures4730worker2 # [ 79.541164] nix-grpc-daemon[878]: time=2026-09-22T11:22:55.171Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4731worker2 # [ 79.542610] nix-grpc-daemon[878]: time=2026-09-22T11:22:55.171Z level=INFO msg="Uploading pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv (424B)"4732lb # [ 79.657929] niks3-server[1015]: 2026/09/22 11:22:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4733worker2 # [ 79.573552] nix-grpc-daemon[878]: time=2026-09-22T11:22:55.204Z level=INFO msg="Uploading 1 narinfos"4734lb # [ 79.673713] niks3-server[1015]: 2026/09/22 11:22:55 INFO Signed narinfos id=18 count=14735lb # [ 79.679427] niks3-server[1015]: 2026/09/22 11:22:55 INFO Registered completed upload object_key=nar/14f5yrnllfav3svmw4v4svw15r4zlf5yv1p972jy14mmq6gdw943.nar.zst4736lb # [ 79.685716] niks3-server[1015]: 2026/09/22 11:22:55 INFO Registered completed upload object_key=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s.ls4737lb # [ 79.696853] niks3-server[1015]: 2026/09/22 11:22:55 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4738worker2 # [ 79.611998] nix-grpc-daemon[878]: time=2026-09-22T11:22:55.243Z level=INFO msg="Upload complete. (488ms)"4739lb # [ 79.702647] niks3-server[1015]: 2026/09/22 11:22:55 INFO Registered completed upload object_key=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s.narinfo4740lb # [ 79.707210] niks3-server[1015]: 2026/09/22 11:22:55 INFO Completed upload id=184741worker2 # [ 79.620147] nix-grpc-daemon[777]: ts=2026-09-22T11:22:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39942 duration_s=0 paths=1 nar_bytes_in=4244742worker2 # [ 79.634888] nix-grpc-daemon[777]: ts=2026-09-22T11:22:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:399424743worker2 # [ 79.641747] nix-daemon[863]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4744worker2 # [ 79.646469] nix-daemon[863]: reaped child process 1139, status = succeeded4745worker2 # [ 79.658516] nix-daemon[863]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4746lb # [ 81.832290] envoy[913]: conn peer=[2001:db8:1::1]:49504 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3001 tx=952 ms=72614747worker2 # [ 86.076828] nix-grpc-daemon[777]: ts=2026-09-22T11:23:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39942 duration_s=6 drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv assign_id=10 outputs=04748worker2 # [ 86.098681] nix-daemon[863]: reaped child process 1153, status = succeeded4749worker2 # [ 86.099868] nix-daemon[863]: reaped child process 1151, status = succeeded4750(finished: subtest: --timeout and --max-silent-time reach the builder, in 15.07 seconds)4751subtest: the first client leaving does not fail the second4752client: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag share4753client # [ 86.375676] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag share.4754client # Running as unit: share1.service; invocation ID: 23585611f398413782b1114c1e1c742f4755client: (finished: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag share, in 0.10 seconds)4756client: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag share4757worker2 # [ 86.651657] nix-grpc-daemon[777]: ts=2026-09-22T11:23:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:399424758client # [ 86.661536] nix[1034]: don't know how to build these paths:4759client # [ 86.662613] nix[1034]: /nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv4760worker2 # [ 86.672821] nix-grpc-daemon[777]: ts=2026-09-22T11:23:02Z level=debug event=want client=9 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv cached=04761worker2 # [ 86.679241] nix-grpc-daemon[777]: ts=2026-09-22T11:23:02Z level=debug event=assigned drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv worker=192.168.1.3:50051 clients=14762worker1 # [ 86.710179] nix-grpc-daemon[866]: ts=2026-09-22T11:23:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609284763worker1 # [ 86.721661] nix-grpc-daemon[866]: ts=2026-09-22T11:23:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:609284764client # [ 86.711450] nix[1034]: copying 1 paths to 'lb:50051'...4765client # [ 86.716253] nix[1034]: copying path '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' to 'lb:50051'...4766worker1 # [ 86.737972] nix-grpc-daemon[866]: ts=2026-09-22T11:23:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:609284767worker1 # [ 86.753030] nix-daemon[932]: accepted connection from pid 866, user nix-grpc-daemon (trusted)4768worker1 # [ 86.973929] nix-daemon[932]: accepted connection from pid 1133, user nix-grpc-daemon (trusted)4769worker1 # [ 86.991199] nix-daemon[932]: reaped child process 1136, status = succeeded4770worker1 # [ 87.171688] nix-daemon[932]: accepted connection from pid 1138, user nix-grpc-daemon (trusted)4771worker1 # [ 87.188309] nix-daemon[932]: reaped child process 1141, status = succeeded4772lb # [ 87.271756] niks3-server[1015]: 2026/09/22 11:23:02 INFO Received uploads request method=POST path=/api/pending_closures4773worker1 # [ 87.216411] nix-grpc-daemon[959]: time=2026-09-22T11:23:02.851Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4774worker1 # [ 87.217930] nix-grpc-daemon[959]: time=2026-09-22T11:23:02.851Z level=INFO msg="Uploading rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv (432B)"4775lb # [ 87.308833] niks3-server[1015]: 2026/09/22 11:23:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4776worker1 # [ 87.251156] nix-grpc-daemon[959]: time=2026-09-22T11:23:02.887Z level=INFO msg="Uploading 1 narinfos"4777lb # [ 87.321779] niks3-server[1015]: 2026/09/22 11:23:02 INFO Signed narinfos id=19 count=14778lb # [ 87.331447] niks3-server[1015]: 2026/09/22 11:23:02 INFO Registered completed upload object_key=nar/0chdjpc9an2ckdblh08lnyrmzvw3h8qs76cn5ydwjwvgwkrm731l.nar.zst4779lb # [ 87.343498] niks3-server[1015]: 2026/09/22 11:23:02 INFO Registered completed upload object_key=rxafkggp1xca5h7p0r6gwpq3qqp2kn63.ls4780worker1 # [ 87.281963] nix-grpc-daemon[959]: time=2026-09-22T11:23:02.918Z level=INFO msg="Upload complete. (510ms)"4781lb # [ 87.349422] niks3-server[1015]: 2026/09/22 11:23:02 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4782worker1 # [ 87.287619] nix-grpc-daemon[866]: ts=2026-09-22T11:23:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60928 duration_s=0 paths=1 nar_bytes_in=4324783lb # [ 87.354603] niks3-server[1015]: 2026/09/22 11:23:02 INFO Completed upload id=194784worker1 # [ 87.291389] nix-grpc-daemon[866]: ts=2026-09-22T11:23:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609284785lb # [ 87.357679] niks3-server[1015]: 2026/09/22 11:23:02 INFO Registered completed upload object_key=rxafkggp1xca5h7p0r6gwpq3qqp2kn63.narinfo4786worker1 # [ 87.299723] nix-daemon[932]: accepted connection from pid 866, user nix-grpc-daemon (trusted)4787worker1 # [ 87.304147] nix-daemon[932]: reaped child process 1131, status = succeeded4788worker1 # [ 87.313477] nix-daemon[932]: accepted connection from pid 866, user nix-grpc-daemon (trusted)4789client # [ 87.290505] nix[1034]: building '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' on lb:50051...4790client # [ 87.501477] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag share.4791client # Running as unit: share2.service; invocation ID: 4846e690079045c28f4f552cf6e3fab44792client: (finished: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag share, in 1.14 seconds)4793worker2 # [ 87.789191] nix-grpc-daemon[777]: ts=2026-09-22T11:23:03Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:399424794client # [ 87.799119] nix[1050]: don't know how to build these paths:4795client # [ 87.800332] nix[1050]: /nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv4796worker2 # [ 87.805766] nix-grpc-daemon[777]: ts=2026-09-22T11:23:03Z level=debug event=want client=10 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv cached=04797worker1 # [ 87.835339] nix-grpc-daemon[866]: ts=2026-09-22T11:23:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609284798client # [ 87.820089] nix[1050]: building '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' on lb:50051...4799client: must succeed: sleep 2; systemctl kill -s INT share14800client # [ 90.959516] systemd[1]: share1.service: Sent signal SIGINT to main process 1034 (nix) on client request.4801client: (finished: must succeed: sleep 2; systemctl kill -s INT share1, in 2.10 seconds)4802client: waiting for success: ! systemctl is-active share14803client # [ 90.970100] nix[1034]: shutting downrxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)4804client # [ 90.971116] nix[1034]: error: interrupted by the user4805client # [ 91.023358] systemd[1]: share1.service: Main process exited, code=exited, status=1/FAILURE4806client # [ 91.031620] systemd[1]: share1.service: Failed with result 'exit-code'.4807client # [ 91.034025] systemd[1]: share1.service: Consumed 180ms CPU time over 4.654s wall clock time, 39.4M memory peak, 6.2K incoming IP traffic, 8.2K outgoing IP traffic.4808client: (finished: waiting for success: ! systemctl is-active share1, in 0.08 seconds)4809worker1 # [ 91.338264] nix-daemon[932]: reaped child process 1145, status = succeeded4810client: waiting for success: ! systemctl is-active share24811worker1 # [ 91.500940] nix-daemon[932]: accepted connection from pid 1179, user nix-grpc-daemon (trusted)4812worker1 # [ 91.520911] nix-daemon[932]: reaped child process 1182, status = succeeded4813lb # [ 91.600707] niks3-server[1015]: 2026/09/22 11:23:07 INFO Received uploads request method=POST path=/api/pending_closures4814worker1 # [ 91.547164] nix-grpc-daemon[959]: time=2026-09-22T11:23:07.180Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4815worker1 # [ 91.548837] nix-grpc-daemon[959]: time=2026-09-22T11:23:07.180Z level=INFO msg="Uploading fjww0fd4rwk1s35jav3cyal62l24n356-slow-share (120B)"4816lb # [ 91.648094] niks3-server[1015]: 2026/09/22 11:23:07 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst4817worker1 # [ 91.594821] nix-grpc-daemon[959]: time=2026-09-22T11:23:07.230Z level=INFO msg="Uploading 1 narinfos"4818lb # [ 91.663660] niks3-server[1015]: 2026/09/22 11:23:07 INFO Registered completed upload object_key=log/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv4819lb # [ 91.672851] niks3-server[1015]: 2026/09/22 11:23:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4820lb # [ 91.677356] niks3-server[1015]: 2026/09/22 11:23:07 INFO Signed narinfos id=20 count=14821lb # [ 91.684547] niks3-server[1015]: 2026/09/22 11:23:07 INFO Registered completed upload object_key=fjww0fd4rwk1s35jav3cyal62l24n356.ls4822worker1 # [ 91.622168] nix-grpc-daemon[959]: time=2026-09-22T11:23:07.258Z level=INFO msg="Upload complete. (296ms)"4823lb # [ 91.689182] niks3-server[1015]: 2026/09/22 11:23:07 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4824lb # [ 91.693541] niks3-server[1015]: 2026/09/22 11:23:07 INFO Completed upload id=204825lb # [ 91.696581] niks3-server[1015]: 2026/09/22 11:23:07 INFO Registered completed upload object_key=fjww0fd4rwk1s35jav3cyal62l24n356.narinfo4826worker1 # [ 91.633063] nix-grpc-daemon[866]: ts=2026-09-22T11:23:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60928 duration_s=4 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv assign_id=11 outputs=14827worker1 # [ 91.646914] nix-grpc-daemon[866]: ts=2026-09-22T11:23:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60928 duration_s=3 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv assign_id=11 outputs=14828worker1 # [ 91.652905] nix-daemon[932]: reaped child process 1143, status = succeeded4829client # [ 91.683064] systemd[1]: share2.service: Deactivated successfully.4830client # [ 91.685856] systemd[1]: share2.service: Consumed 179ms CPU time over 4.185s wall clock time, 33.2M memory peak, 6K incoming IP traffic, 5.7K outgoing IP traffic.4831lb # [ 91.836385] envoy[913]: conn peer=[2001:db8:1::1]:49510 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2989 tx=978 ms=70594832lb # [ 91.841950] envoy[913]: conn peer=[2001:db8:1::1]:47756 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2977 tx=788 ms=43304833lb # [ 91.847236] envoy[913]: conn peer=[2001:db8:1::1]:47764 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1443 tx=1197 ms=38754834client: (finished: waiting for success: ! systemctl is-active share2, in 1.15 seconds)4835client: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }4836client: (finished: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }, in 0.06 seconds)4837(finished: subtest: the first client leaving does not fail the second, in 6.27 seconds)4838subtest: build hook: nix-daemon with builders = grpc://lb4839client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log4840client # [ 92.778880] systemd[1]: Started Nix Daemon.4841client # [ 92.974756] nix-daemon[1097]: accepted connection from pid 1094, user root (trusted)4842worker2 # [ 93.204595] nix-grpc-daemon[777]: ts=2026-09-22T11:23:08Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:399424843worker2 # [ 93.211197] nix-grpc-daemon[777]: ts=2026-09-22T11:23:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:399424844worker2 # [ 93.237087] nix-grpc-daemon[777]: ts=2026-09-22T11:23:08Z level=debug event=want client=11 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04845worker2 # [ 93.244810] nix-grpc-daemon[777]: ts=2026-09-22T11:23:08Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.4:50051 clients=14846worker2 # [ 93.253919] nix-grpc-daemon[777]: ts=2026-09-22T11:23:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:399424847worker2 # [ 93.266900] nix-grpc-daemon[777]: ts=2026-09-22T11:23:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:399424848worker2 # [ 93.282637] nix-grpc-daemon[777]: ts=2026-09-22T11:23:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:399424849worker2 # [ 93.299367] nix-daemon[863]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4850worker2 # [ 93.508952] nix-daemon[863]: accepted connection from pid 1198, user nix-grpc-daemon (trusted)4851worker2 # [ 93.529511] nix-daemon[863]: reaped child process 1201, status = succeeded4852worker2 # [ 93.705092] nix-daemon[863]: accepted connection from pid 1203, user nix-grpc-daemon (trusted)4853worker2 # [ 93.723234] nix-daemon[863]: reaped child process 1206, status = succeeded4854lb # [ 93.825886] niks3-server[1015]: 2026/09/22 11:23:09 INFO Received uploads request method=POST path=/api/pending_closures4855worker2 # [ 93.747133] nix-grpc-daemon[878]: time=2026-09-22T11:23:09.377Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4856worker2 # [ 93.748716] nix-grpc-daemon[878]: time=2026-09-22T11:23:09.377Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4857lb # [ 93.857635] niks3-server[1015]: 2026/09/22 11:23:09 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4858lb # [ 93.872490] niks3-server[1015]: 2026/09/22 11:23:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4859worker2 # [ 93.789219] nix-grpc-daemon[878]: time=2026-09-22T11:23:09.420Z level=INFO msg="Uploading 1 narinfos"4860lb # [ 93.885640] niks3-server[1015]: 2026/09/22 11:23:09 INFO Signed narinfos id=21 count=14861lb # [ 93.892577] niks3-server[1015]: 2026/09/22 11:23:09 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4862lb # [ 93.903354] niks3-server[1015]: 2026/09/22 11:23:09 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4863lb # [ 93.908566] niks3-server[1015]: 2026/09/22 11:23:09 INFO Completed upload id=214864worker2 # [ 93.818004] nix-grpc-daemon[878]: time=2026-09-22T11:23:09.449Z level=INFO msg="Upload complete. (502ms)"4865lb # [ 93.911871] niks3-server[1015]: 2026/09/22 11:23:09 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4866worker2 # [ 93.828511] nix-grpc-daemon[777]: ts=2026-09-22T11:23:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39942 duration_s=0 paths=1 nar_bytes_in=5124867worker2 # [ 93.844350] nix-grpc-daemon[777]: ts=2026-09-22T11:23:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:399424868worker2 # [ 93.850795] nix-daemon[863]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4869worker2 # [ 93.857056] nix-daemon[863]: reaped child process 1196, status = succeeded4870worker2 # [ 93.868985] nix-daemon[863]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4871worker2 # [ 94.698045] nix-daemon[863]: reaped child process 1210, status = succeeded4872worker2 # [ 94.857013] nix-daemon[863]: accepted connection from pid 1226, user nix-grpc-daemon (trusted)4873worker2 # [ 94.875644] nix-daemon[863]: reaped child process 1229, status = succeeded4874lb # [ 94.978105] niks3-server[1015]: 2026/09/22 11:23:10 INFO Received uploads request method=POST path=/api/pending_closures4875worker2 # [ 94.900088] nix-grpc-daemon[878]: time=2026-09-22T11:23:10.528Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4876worker2 # [ 94.901716] nix-grpc-daemon[878]: time=2026-09-22T11:23:10.528Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4877lb # [ 95.010588] niks3-server[1015]: 2026/09/22 11:23:10 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4878lb # [ 95.025860] niks3-server[1015]: 2026/09/22 11:23:10 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4879lb # [ 95.038823] niks3-server[1015]: 2026/09/22 11:23:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4880worker2 # [ 94.953200] nix-grpc-daemon[878]: time=2026-09-22T11:23:10.583Z level=INFO msg="Uploading 1 narinfos"4881lb # [ 95.049451] niks3-server[1015]: 2026/09/22 11:23:10 INFO Signed narinfos id=22 count=14882lb # [ 95.055565] niks3-server[1015]: 2026/09/22 11:23:10 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4883lb # [ 95.066276] niks3-server[1015]: 2026/09/22 11:23:10 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4884lb # [ 95.071765] niks3-server[1015]: 2026/09/22 11:23:10 INFO Completed upload id=224885worker2 # [ 94.980540] nix-grpc-daemon[878]: time=2026-09-22T11:23:10.611Z level=INFO msg="Upload complete. (295ms)"4886lb # [ 95.075016] niks3-server[1015]: 2026/09/22 11:23:10 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4887worker2 # [ 94.992865] nix-grpc-daemon[777]: ts=2026-09-22T11:23:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39942 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=12 outputs=14888worker1 # [ 95.023008] nix-grpc-daemon[866]: ts=2026-09-22T11:23:10Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:609284889worker2 # [ 95.011826] nix-daemon[863]: reaped child process 1208, status = succeeded4890worker1 # [ 95.045861] nix-grpc-daemon[866]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4891worker1 # [ 95.095427] nix-grpc-daemon[866]: ts=2026-09-22T11:23:10Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:609284892worker1 # [ 95.103036] nix-grpc-daemon[866]: ts=2026-09-22T11:23:10Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60928 duration_s=0 paths=1 nar_bytes_out=1284893worker1 # [ 95.426105] nix-grpc-daemon[866]: ts=2026-09-22T11:23:11Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:609284894worker1 # [ 95.434214] nix-grpc-daemon[866]: ts=2026-09-22T11:23:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:609284895worker1 # [ 95.442152] nix-grpc-daemon[959]: time=2026-09-22T11:23:11.076Z level=INFO msg="All 1 paths already cached"4896worker2 # [ 95.431271] nix-grpc-daemon[777]: ts=2026-09-22T11:23:11Z level=debug event=want client=12 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04897worker2 # [ 95.440885] nix-grpc-daemon[777]: ts=2026-09-22T11:23:11Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.4:50051 clients=14898worker2 # [ 95.447639] nix-grpc-daemon[777]: ts=2026-09-22T11:23:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:399424899worker2 # [ 95.459057] nix-grpc-daemon[777]: ts=2026-09-22T11:23:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:399424900worker2 # [ 95.473855] nix-grpc-daemon[878]: time=2026-09-22T11:23:11.104Z level=INFO msg="All 1 paths already cached"4901worker2 # [ 95.483873] nix-grpc-daemon[777]: ts=2026-09-22T11:23:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:399424902worker2 # [ 95.498353] nix-daemon[863]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4903worker2 # [ 95.699613] nix-daemon[863]: accepted connection from pid 1235, user nix-grpc-daemon (trusted)4904worker2 # [ 95.721465] nix-daemon[863]: reaped child process 1238, status = succeeded4905worker2 # [ 95.893311] nix-daemon[863]: accepted connection from pid 1240, user nix-grpc-daemon (trusted)4906worker2 # [ 95.911833] nix-daemon[863]: reaped child process 1243, status = succeeded4907lb # [ 96.014556] niks3-server[1015]: 2026/09/22 11:23:11 INFO Received uploads request method=POST path=/api/pending_closures4908worker2 # [ 95.934790] nix-grpc-daemon[878]: time=2026-09-22T11:23:11.565Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4909worker2 # [ 95.936437] nix-grpc-daemon[878]: time=2026-09-22T11:23:11.565Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4910lb # [ 96.044125] niks3-server[1015]: 2026/09/22 11:23:11 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4911lb # [ 96.059026] niks3-server[1015]: 2026/09/22 11:23:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4912worker2 # [ 95.974965] nix-grpc-daemon[878]: time=2026-09-22T11:23:11.605Z level=INFO msg="Uploading 1 narinfos"4913lb # [ 96.071445] niks3-server[1015]: 2026/09/22 11:23:11 INFO Signed narinfos id=23 count=14914lb # [ 96.078879] niks3-server[1015]: 2026/09/22 11:23:11 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4915worker2 # [ 95.998147] nix-grpc-daemon[878]: time=2026-09-22T11:23:11.629Z level=INFO msg="Upload complete. (481ms)"4916lb # [ 96.089397] niks3-server[1015]: 2026/09/22 11:23:11 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4917lb # [ 96.095512] niks3-server[1015]: 2026/09/22 11:23:11 INFO Completed upload id=234918lb # [ 96.099496] niks3-server[1015]: 2026/09/22 11:23:11 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4919worker2 # [ 96.009100] nix-grpc-daemon[777]: ts=2026-09-22T11:23:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39942 duration_s=0 paths=1 nar_bytes_in=6244920worker2 # [ 96.020358] nix-grpc-daemon[777]: ts=2026-09-22T11:23:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:399424921worker2 # [ 96.026974] nix-daemon[863]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4922worker2 # [ 96.031746] nix-daemon[863]: reaped child process 1233, status = succeeded4923worker2 # [ 96.042845] nix-daemon[863]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4924worker2 # [ 97.294612] nix-daemon[863]: reaped child process 1247, status = succeeded4925worker2 # [ 97.477404] nix-daemon[863]: accepted connection from pid 1263, user nix-grpc-daemon (trusted)4926worker2 # [ 97.495258] nix-daemon[863]: reaped child process 1266, status = succeeded4927lb # [ 97.598234] niks3-server[1015]: 2026/09/22 11:23:13 INFO Received uploads request method=POST path=/api/pending_closures4928worker2 # [ 97.520518] nix-grpc-daemon[878]: time=2026-09-22T11:23:13.150Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4929worker2 # [ 97.522582] nix-grpc-daemon[878]: time=2026-09-22T11:23:13.150Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4930lb # [ 97.651779] niks3-server[1015]: 2026/09/22 11:23:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4931worker2 # [ 97.573092] nix-grpc-daemon[878]: time=2026-09-22T11:23:13.203Z level=INFO msg="Uploading 1 narinfos"4932lb # [ 97.670661] niks3-server[1015]: 2026/09/22 11:23:13 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4933lb # [ 97.681173] niks3-server[1015]: 2026/09/22 11:23:13 INFO Signed narinfos id=24 count=14934lb # [ 97.684001] niks3-server[1015]: 2026/09/22 11:23:13 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4935lb # [ 97.695941] niks3-server[1015]: 2026/09/22 11:23:13 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4936lb # [ 97.699600] niks3-server[1015]: 2026/09/22 11:23:13 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4937lb # [ 97.705371] niks3-server[1015]: 2026/09/22 11:23:13 INFO Completed upload id=244938worker2 # [ 97.614969] nix-grpc-daemon[878]: time=2026-09-22T11:23:13.246Z level=INFO msg="Upload complete. (357ms)"4939lb # [ 97.708987] niks3-server[1015]: 2026/09/22 11:23:13 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4940worker2 # [ 97.629229] nix-grpc-daemon[777]: ts=2026-09-22T11:23:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39942 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=13 outputs=14941worker2 # [ 97.650514] nix-daemon[863]: reaped child process 1245, status = succeeded4942worker1 # [ 97.701038] nix-grpc-daemon[866]: ts=2026-09-22T11:23:13Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:609284943worker1 # [ 97.717611] nix-grpc-daemon[866]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4944worker1 # [ 97.766627] nix-grpc-daemon[866]: ts=2026-09-22T11:23:13Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:609284945worker1 # [ 97.774923] nix-grpc-daemon[866]: ts=2026-09-22T11:23:13Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60928 duration_s=0 paths=1 nar_bytes_out=1764946worker2 # [ 98.096616] nix-grpc-daemon[777]: ts=2026-09-22T11:23:13Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:399424947worker1 # [ 98.127322] nix-grpc-daemon[866]: ts=2026-09-22T11:23:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:609284948worker1 # [ 98.143211] nix-grpc-daemon[959]: time=2026-09-22T11:23:13.776Z level=INFO msg="All 2 paths already cached"4949worker2 # [ 98.138062] nix-grpc-daemon[777]: ts=2026-09-22T11:23:13Z level=debug event=want client=13 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04950worker2 # [ 98.145903] nix-grpc-daemon[777]: ts=2026-09-22T11:23:13Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.4:50051 clients=14951worker2 # [ 98.187974] nix-grpc-daemon[777]: ts=2026-09-22T11:23:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:399424952worker2 # [ 98.207225] nix-grpc-daemon[777]: ts=2026-09-22T11:23:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:399424953worker2 # [ 98.224800] nix-grpc-daemon[878]: time=2026-09-22T11:23:13.855Z level=INFO msg="All 2 paths already cached"4954worker2 # [ 98.237898] nix-grpc-daemon[777]: ts=2026-09-22T11:23:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:399424955worker2 # [ 98.254452] nix-daemon[863]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4956worker2 # [ 98.475962] nix-daemon[863]: accepted connection from pid 1272, user nix-grpc-daemon (trusted)4957worker2 # [ 98.500472] nix-daemon[863]: reaped child process 1275, status = succeeded4958worker2 # [ 98.685196] nix-daemon[863]: accepted connection from pid 1277, user nix-grpc-daemon (trusted)4959worker2 # [ 98.706528] nix-daemon[863]: reaped child process 1280, status = succeeded4960lb # [ 98.809253] niks3-server[1015]: 2026/09/22 11:23:14 INFO Received uploads request method=POST path=/api/pending_closures4961worker2 # [ 98.731414] nix-grpc-daemon[878]: time=2026-09-22T11:23:14.361Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4962worker2 # [ 98.733349] nix-grpc-daemon[878]: time=2026-09-22T11:23:14.361Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4963lb # [ 98.845131] niks3-server[1015]: 2026/09/22 11:23:14 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4964lb # [ 98.861031] niks3-server[1015]: 2026/09/22 11:23:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4965worker2 # [ 98.777117] nix-grpc-daemon[878]: time=2026-09-22T11:23:14.407Z level=INFO msg="Uploading 1 narinfos"4966lb # [ 98.873996] niks3-server[1015]: 2026/09/22 11:23:14 INFO Signed narinfos id=25 count=14967lb # [ 98.881190] niks3-server[1015]: 2026/09/22 11:23:14 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4968lb # [ 98.894615] niks3-server[1015]: 2026/09/22 11:23:14 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4969worker2 # [ 98.810514] nix-grpc-daemon[878]: time=2026-09-22T11:23:14.441Z level=INFO msg="Upload complete. (537ms)"4970lb # [ 98.901865] niks3-server[1015]: 2026/09/22 11:23:14 INFO Completed upload id=254971lb # [ 98.905183] niks3-server[1015]: 2026/09/22 11:23:14 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4972worker2 # [ 98.821207] nix-grpc-daemon[777]: ts=2026-09-22T11:23:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39942 duration_s=0 paths=1 nar_bytes_in=7524973worker2 # [ 98.836934] nix-grpc-daemon[777]: ts=2026-09-22T11:23:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:399424974worker2 # [ 98.847020] nix-daemon[863]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4975worker2 # [ 98.854243] nix-daemon[863]: reaped child process 1270, status = succeeded4976worker2 # [ 98.872522] nix-daemon[863]: accepted connection from pid 777, user nix-grpc-daemon (trusted)4977worker2 # [ 100.326292] nix-daemon[863]: reaped child process 1284, status = succeeded4978worker2 # [ 100.532193] nix-daemon[863]: accepted connection from pid 1300, user nix-grpc-daemon (trusted)4979worker2 # [ 100.554951] nix-daemon[863]: reaped child process 1303, status = succeeded4980lb # [ 100.662269] niks3-server[1015]: 2026/09/22 11:23:16 INFO Received uploads request method=POST path=/api/pending_closures4981worker2 # [ 100.584525] nix-grpc-daemon[878]: time=2026-09-22T11:23:16.212Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4982worker2 # [ 100.586152] nix-grpc-daemon[878]: time=2026-09-22T11:23:16.212Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4983lb # [ 100.710896] niks3-server[1015]: 2026/09/22 11:23:16 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4984lb # [ 100.722467] niks3-server[1015]: 2026/09/22 11:23:16 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4985lb # [ 100.732197] niks3-server[1015]: 2026/09/22 11:23:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4986worker2 # [ 100.646877] nix-grpc-daemon[878]: time=2026-09-22T11:23:16.277Z level=INFO msg="Uploading 1 narinfos"4987lb # [ 100.740556] niks3-server[1015]: 2026/09/22 11:23:16 INFO Signed narinfos id=26 count=14988lb # [ 100.745416] niks3-server[1015]: 2026/09/22 11:23:16 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4989lb # [ 100.752272] niks3-server[1015]: 2026/09/22 11:23:16 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4990lb # [ 100.759412] niks3-server[1015]: 2026/09/22 11:23:16 INFO Completed upload id=264991worker2 # [ 100.667155] nix-grpc-daemon[878]: time=2026-09-22T11:23:16.298Z level=INFO msg="Upload complete. (381ms)"4992lb # [ 100.762386] niks3-server[1015]: 2026/09/22 11:23:16 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4993worker2 # [ 100.681336] nix-grpc-daemon[777]: ts=2026-09-22T11:23:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39942 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=14 outputs=14994worker1 # [ 100.710214] nix-grpc-daemon[866]: ts=2026-09-22T11:23:16Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:609284995worker2 # [ 100.702088] nix-daemon[863]: reaped child process 1282, status = succeeded4996worker1 # [ 100.725176] nix-grpc-daemon[866]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...4997worker1 # [ 100.768452] nix-grpc-daemon[866]: ts=2026-09-22T11:23:16Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:609284998worker1 # [ 100.775850] nix-grpc-daemon[866]: ts=2026-09-22T11:23:16Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60928 duration_s=0 paths=1 nar_bytes_out=2324999client # [ 100.892610] nix-daemon[1097]: reaped child process 1099, status = succeeded5000client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.34 seconds)5001client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top5002client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.05 seconds)5003client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }5004client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.06 seconds)5005client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }5006client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.04 seconds)5007(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 8.49 seconds)5008subtest: an input only one worker has still reaches the builder5009client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only5010client # this derivation will be built:5011client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv5012client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...5013client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.50 seconds)5014client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure5015lb # [ 101.834414] envoy[913]: conn peer=[2001:db8:1::1]:52218 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3414 tx=1969 ms=19435016lb # [ 101.839474] envoy[913]: conn peer=[2001:db8:1::1]:52228 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=333 ms=765017lb # [ 101.844396] envoy[913]: conn peer=[2001:db8:1::1]:52238 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=375 ms=725018lb # [ 101.849042] envoy[913]: conn peer=[2001:db8:1::1]:52234 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3929 tx=2195 ms=24095019lb # [ 101.854182] envoy[913]: conn peer=[2001:db8:1::1]:52246 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4398 tx=2450 ms=27175020lb # [ 101.859038] envoy[913]: conn peer=[2001:db8:1::1]:52260 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=406 ms=735021client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.22 seconds)5022worker1: must succeed: nix-store --import < /tmp/shared/inp.closure5023worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.27 seconds)5024worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only5025worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds)5026client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&25027client # [ 102.338414] nix-daemon[1097]: accepted connection from pid 1179, user root (trusted)5028client # this derivation will be built:5029client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv5030client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'...5031worker2 # [ 102.573355] nix-grpc-daemon[777]: ts=2026-09-22T11:23:18Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:399425032worker1 # [ 102.606377] nix-grpc-daemon[866]: ts=2026-09-22T11:23:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:609285033worker1 # [ 102.800291] nix-daemon[932]: accepted connection from pid 1192, user nix-grpc-daemon (trusted)5034worker1 # [ 102.821946] nix-daemon[932]: reaped child process 1195, status = succeeded5035lb # [ 102.906078] niks3-server[1015]: 2026/09/22 11:23:18 INFO Received uploads request method=POST path=/api/pending_closures5036worker1 # [ 102.847454] nix-grpc-daemon[959]: time=2026-09-22T11:23:18.482Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5037worker1 # [ 102.849309] nix-grpc-daemon[959]: time=2026-09-22T11:23:18.482Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"5038lb # [ 102.940173] niks3-server[1015]: 2026/09/22 11:23:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5039worker1 # [ 102.880899] nix-grpc-daemon[959]: time=2026-09-22T11:23:18.516Z level=INFO msg="Uploading 1 narinfos"5040lb # [ 102.950763] niks3-server[1015]: 2026/09/22 11:23:18 INFO Signed narinfos id=27 count=15041lb # [ 102.958583] niks3-server[1015]: 2026/09/22 11:23:18 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst5042lb # [ 102.974285] niks3-server[1015]: 2026/09/22 11:23:18 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5043lb # [ 102.977834] niks3-server[1015]: 2026/09/22 11:23:18 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls5044lb # [ 102.982862] niks3-server[1015]: 2026/09/22 11:23:18 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo5045lb # [ 102.986913] niks3-server[1015]: 2026/09/22 11:23:18 INFO Completed upload id=275046worker1 # [ 102.920663] nix-grpc-daemon[959]: time=2026-09-22T11:23:18.556Z level=INFO msg="Upload complete. (306ms)"5047worker2 # [ 102.925660] nix-grpc-daemon[777]: ts=2026-09-22T11:23:18Z level=debug event=want client=14 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=05048worker2 # [ 102.932611] nix-grpc-daemon[777]: ts=2026-09-22T11:23:18Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=15049worker1 # [ 102.998981] nix-grpc-daemon[866]: ts=2026-09-22T11:23:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609285050worker1 # [ 103.016166] nix-grpc-daemon[866]: ts=2026-09-22T11:23:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:609285051client # copying 2 paths to 'lb:50051'...5052client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...5053worker1 # [ 103.038326] nix-grpc-daemon[866]: ts=2026-09-22T11:23:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:609285054client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...5055worker1 # [ 103.053938] nix-daemon[932]: accepted connection from pid 866, user nix-grpc-daemon (trusted)5056worker1 # [ 103.276653] nix-daemon[932]: accepted connection from pid 1199, user nix-grpc-daemon (trusted)5057worker1 # [ 103.302020] nix-daemon[932]: reaped child process 1202, status = succeeded5058worker1 # [ 103.483367] nix-daemon[932]: accepted connection from pid 1204, user nix-grpc-daemon (trusted)5059worker1 # [ 103.504615] nix-daemon[932]: reaped child process 1207, status = succeeded5060lb # [ 103.581901] niks3-server[1015]: 2026/09/22 11:23:19 INFO Received uploads request method=POST path=/api/pending_closures5061lb # [ 103.594271] niks3-server[1015]: 2026/09/22 11:23:19 INFO Received uploads request method=POST path=/api/pending_closures5062worker1 # [ 103.537604] nix-grpc-daemon[959]: time=2026-09-22T11:23:19.172Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5063worker1 # [ 103.539431] nix-grpc-daemon[959]: time=2026-09-22T11:23:19.173Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"5064worker1 # [ 103.541634] nix-grpc-daemon[959]: time=2026-09-22T11:23:19.173Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"5065lb # [ 103.651204] niks3-server[1015]: 2026/09/22 11:23:19 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst5066lb # [ 103.661942] niks3-server[1015]: 2026/09/22 11:23:19 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst5067lb # [ 103.667083] niks3-server[1015]: 2026/09/22 11:23:19 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls5068lb # [ 103.673247] niks3-server[1015]: 2026/09/22 11:23:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5069lb # [ 103.678822] niks3-server[1015]: 2026/09/22 11:23:19 INFO Signed narinfos id=28 count=15070worker1 # [ 103.613421] nix-grpc-daemon[959]: time=2026-09-22T11:23:19.248Z level=INFO msg="Uploading 3 narinfos"5071lb # [ 103.682751] niks3-server[1015]: 2026/09/22 11:23:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5072lb # [ 103.688331] niks3-server[1015]: 2026/09/22 11:23:19 INFO Signed narinfos id=29 count=25073lb # [ 103.690541] niks3-server[1015]: 2026/09/22 11:23:19 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls5074lb # [ 103.711833] niks3-server[1015]: 2026/09/22 11:23:19 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5075lb # [ 103.721960] niks3-server[1015]: 2026/09/22 11:23:19 INFO Completed upload id=285076lb # [ 103.724239] niks3-server[1015]: 2026/09/22 11:23:19 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5077lb # [ 103.728839] niks3-server[1015]: 2026/09/22 11:23:19 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo5078lb # [ 103.731304] niks3-server[1015]: 2026/09/22 11:23:19 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo5079lb # [ 103.734922] niks3-server[1015]: 2026/09/22 11:23:19 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo5080lb # [ 103.737822] niks3-server[1015]: 2026/09/22 11:23:19 INFO Completed upload id=295081worker1 # [ 103.671594] nix-grpc-daemon[959]: time=2026-09-22T11:23:19.307Z level=INFO msg="Upload complete. (596ms)"5082worker1 # [ 103.685371] nix-grpc-daemon[866]: ts=2026-09-22T11:23:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60928 duration_s=0 paths=2 nar_bytes_in=9845083worker1 # [ 103.704811] nix-grpc-daemon[866]: ts=2026-09-22T11:23:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609285084worker1 # [ 103.715265] nix-daemon[932]: accepted connection from pid 866, user nix-grpc-daemon (trusted)5085worker1 # [ 103.722547] nix-daemon[932]: reaped child process 1197, status = succeeded5086client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...5087client # uses-input-w1onlya> node-a: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv5088worker1 # [ 103.741057] nix-daemon[932]: accepted connection from pid 866, user nix-grpc-daemon (trusted)5089client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds5090worker1 # [ 104.589757] nix-daemon[932]: reaped child process 1211, status = succeeded5091worker1 # [ 104.774435] nix-daemon[932]: accepted connection from pid 1227, user nix-grpc-daemon (trusted)5092worker1 # [ 104.798192] nix-daemon[932]: reaped child process 1230, status = succeeded5093lb # [ 104.878122] niks3-server[1015]: 2026/09/22 11:23:20 INFO Received uploads request method=POST path=/api/pending_closures5094worker1 # [ 104.820371] nix-grpc-daemon[959]: time=2026-09-22T11:23:20.456Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5095lb # [ 104.911165] niks3-server[1015]: 2026/09/22 11:23:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5096worker1 # [ 104.852355] nix-grpc-daemon[959]: time=2026-09-22T11:23:20.488Z level=INFO msg="Uploading 1 narinfos"5097lb # [ 104.924606] niks3-server[1015]: 2026/09/22 11:23:20 INFO Signed narinfos id=30 count=15098lb # [ 104.935903] niks3-server[1015]: 2026/09/22 11:23:20 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls5099lb # [ 104.944366] niks3-server[1015]: 2026/09/22 11:23:20 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv5100lb # [ 104.953180] niks3-server[1015]: 2026/09/22 11:23:20 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5101lb # [ 104.959615] niks3-server[1015]: 2026/09/22 11:23:20 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo5102lb # [ 104.965413] niks3-server[1015]: 2026/09/22 11:23:20 INFO Completed upload id=305103worker1 # [ 104.899139] nix-grpc-daemon[959]: time=2026-09-22T11:23:20.535Z level=INFO msg="Upload complete. (343ms)"5104client # copying 1 paths...5105worker1 # [ 104.913354] nix-grpc-daemon[866]: ts=2026-09-22T11:23:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60928 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=15 outputs=15106client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...5107worker1 # [ 104.935434] nix-grpc-daemon[866]: ts=2026-09-22T11:23:20Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:609285108worker1 # [ 104.940913] nix-daemon[932]: reaped child process 1209, status = succeeded5109worker2 # [ 104.934318] nix-grpc-daemon[777]: ts=2026-09-22T11:23:20Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:399425110worker2 # [ 104.948223] nix-grpc-daemon[777]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'...5111worker2 # [ 104.970917] nix-grpc-daemon[777]: ts=2026-09-22T11:23:20Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:39942 duration_s=0 paths=1 nar_bytes_out=1205112client # [ 105.110732] nix-daemon[1097]: reaped child process 1182, status = succeeded5113client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.03 seconds)5114client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&25115client # [ 105.344113] nix-daemon[1097]: accepted connection from pid 1200, user root (trusted)5116client # this derivation will be built:5117client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv5118worker2 # [ 105.573441] nix-grpc-daemon[777]: ts=2026-09-22T11:23:21Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:399425119client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'...5120worker2 # [ 105.580767] nix-grpc-daemon[777]: ts=2026-09-22T11:23:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:399425121worker2 # [ 105.609055] nix-grpc-daemon[777]: ts=2026-09-22T11:23:21Z level=debug event=want client=15 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=05122worker2 # [ 105.617100] nix-grpc-daemon[777]: ts=2026-09-22T11:23:21Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=15123worker2 # [ 105.654037] nix-grpc-daemon[777]: ts=2026-09-22T11:23:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:399425124worker2 # [ 105.671242] nix-grpc-daemon[777]: ts=2026-09-22T11:23:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:399425125client # copying 1 paths to 'lb:50051'...5126client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...5127worker2 # [ 105.696178] nix-grpc-daemon[777]: ts=2026-09-22T11:23:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:399425128worker2 # [ 105.712241] nix-daemon[863]: accepted connection from pid 777, user nix-grpc-daemon (trusted)5129worker2 # [ 105.737706] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 44 ms (attempt 1/5)5130worker2 # [ 105.788976] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 184 ms (attempt 2/5)5131worker2 # [ 105.974457] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 204 ms (attempt 3/5)5132worker2 # [ 106.186292] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 620 ms (attempt 4/5)5133worker2 # [ 106.814802] nix-grpc-daemon[777]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5134worker2 # [ 106.819530] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5135worker2 # [ 106.829324] nix-grpc-daemon[777]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...5136worker2 # [ 107.074012] nix-daemon[863]: accepted connection from pid 1320, user nix-grpc-daemon (trusted)5137worker2 # [ 107.097571] nix-daemon[863]: reaped child process 1323, status = succeeded5138worker2 # [ 107.280914] nix-daemon[863]: accepted connection from pid 1325, user nix-grpc-daemon (trusted)5139worker2 # [ 107.304861] nix-daemon[863]: reaped child process 1328, status = succeeded5140lb # [ 107.409700] niks3-server[1015]: 2026/09/22 11:23:23 INFO Received uploads request method=POST path=/api/pending_closures5141worker2 # [ 107.331228] nix-grpc-daemon[878]: time=2026-09-22T11:23:22.961Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5142worker2 # [ 107.333438] nix-grpc-daemon[878]: time=2026-09-22T11:23:22.964Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"5143lb # [ 107.447119] niks3-server[1015]: 2026/09/22 11:23:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5144worker2 # [ 107.366458] nix-grpc-daemon[878]: time=2026-09-22T11:23:22.997Z level=INFO msg="Uploading 1 narinfos"5145lb # [ 107.462538] niks3-server[1015]: 2026/09/22 11:23:23 INFO Signed narinfos id=31 count=15146lb # [ 107.469004] niks3-server[1015]: 2026/09/22 11:23:23 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst5147lb # [ 107.481333] niks3-server[1015]: 2026/09/22 11:23:23 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls5148lb # [ 107.493051] niks3-server[1015]: 2026/09/22 11:23:23 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5149worker2 # [ 107.410394] nix-grpc-daemon[878]: time=2026-09-22T11:23:23.041Z level=INFO msg="Upload complete. (556ms)"5150lb # [ 107.502682] niks3-server[1015]: 2026/09/22 11:23:23 INFO Completed upload id=315151lb # [ 107.506468] niks3-server[1015]: 2026/09/22 11:23:23 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo5152worker2 # [ 107.421203] nix-grpc-daemon[777]: ts=2026-09-22T11:23:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39942 duration_s=1 paths=1 nar_bytes_in=5685153worker2 # [ 107.434365] nix-grpc-daemon[777]: ts=2026-09-22T11:23:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:399425154worker2 # [ 107.448691] nix-daemon[863]: accepted connection from pid 777, user nix-grpc-daemon (trusted)5155worker2 # [ 107.455039] nix-daemon[863]: reaped child process 1313, status = succeeded5156worker2 # [ 107.465592] nix-grpc-daemon[777]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...5157client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...5158worker2 # [ 107.485100] nix-daemon[863]: accepted connection from pid 777, user nix-grpc-daemon (trusted)5159client # uses-input-w1onlyb> worker2: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv5160client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds5161worker2 # [ 108.525414] nix-daemon[863]: reaped child process 1333, status = succeeded5162worker2 # [ 108.699090] nix-daemon[863]: accepted connection from pid 1349, user nix-grpc-daemon (trusted)5163worker2 # [ 108.724004] nix-daemon[863]: reaped child process 1352, status = succeeded5164lb # [ 108.829547] niks3-server[1015]: 2026/09/22 11:23:24 INFO Received uploads request method=POST path=/api/pending_closures5165worker2 # [ 108.785230] nix-grpc-daemon[878]: time=2026-09-22T11:23:24.412Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5166lb # [ 108.892596] niks3-server[1015]: 2026/09/22 11:23:24 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls5167lb # [ 108.906766] niks3-server[1015]: 2026/09/22 11:23:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5168worker2 # [ 108.823817] nix-grpc-daemon[878]: time=2026-09-22T11:23:24.454Z level=INFO msg="Uploading 1 narinfos"5169lb # [ 108.920132] niks3-server[1015]: 2026/09/22 11:23:24 INFO Signed narinfos id=32 count=15170lb # [ 108.923834] niks3-server[1015]: 2026/09/22 11:23:24 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv5171lb # [ 108.944357] niks3-server[1015]: 2026/09/22 11:23:24 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5172lb # [ 108.951819] niks3-server[1015]: 2026/09/22 11:23:24 INFO Completed upload id=325173worker2 # [ 108.861490] nix-grpc-daemon[878]: time=2026-09-22T11:23:24.492Z level=INFO msg="Upload complete. (360ms)"5174lb # [ 108.955709] niks3-server[1015]: 2026/09/22 11:23:24 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo5175client # copying 1 paths...5176worker2 # [ 108.877371] nix-grpc-daemon[777]: ts=2026-09-22T11:23:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39942 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=16 outputs=15177worker1 # [ 108.905230] nix-grpc-daemon[866]: ts=2026-09-22T11:23:24Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:609285178worker2 # [ 108.897587] nix-daemon[863]: reaped child process 1330, status = succeeded5179worker1 # [ 108.921123] nix-grpc-daemon[866]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'...5180client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...5181worker1 # [ 108.966446] nix-grpc-daemon[866]: ts=2026-09-22T11:23:24Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:609285182worker1 # [ 108.974103] nix-grpc-daemon[866]: ts=2026-09-22T11:23:24Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60928 duration_s=0 paths=1 nar_bytes_out=1205183client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.97 seconds)5184client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&25185client # [ 109.138550] nix-daemon[1097]: reaped child process 1203, status = succeeded5186client # [ 109.331507] nix-daemon[1097]: accepted connection from pid 1221, user root (trusted)5187client # this derivation will be built:5188client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv5189worker2 # [ 109.559670] nix-grpc-daemon[777]: ts=2026-09-22T11:23:25Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:399425190client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'...5191worker2 # [ 109.566650] nix-grpc-daemon[777]: ts=2026-09-22T11:23:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:399425192worker2 # [ 109.579391] nix-grpc-daemon[878]: time=2026-09-22T11:23:25.210Z level=INFO msg="All 1 paths already cached"5193worker2 # [ 109.599359] nix-grpc-daemon[777]: ts=2026-09-22T11:23:25Z level=debug event=want client=16 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=05194worker2 # [ 109.606785] nix-grpc-daemon[777]: ts=2026-09-22T11:23:25Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=15195worker1 # [ 109.634836] nix-grpc-daemon[866]: ts=2026-09-22T11:23:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609285196worker1 # [ 109.652724] nix-grpc-daemon[866]: ts=2026-09-22T11:23:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:609285197worker1 # [ 109.671891] nix-grpc-daemon[959]: time=2026-09-22T11:23:25.306Z level=INFO msg="All 1 paths already cached"5198client # copying 1 paths to 'lb:50051'...5199client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...5200worker1 # [ 109.685357] nix-grpc-daemon[866]: ts=2026-09-22T11:23:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:609285201worker1 # [ 109.701639] nix-daemon[932]: accepted connection from pid 866, user nix-grpc-daemon (trusted)5202worker1 # [ 109.925393] nix-daemon[932]: accepted connection from pid 1235, user nix-grpc-daemon (trusted)5203worker1 # [ 109.948716] nix-daemon[932]: reaped child process 1238, status = succeeded5204worker1 # [ 110.132914] nix-daemon[932]: accepted connection from pid 1240, user nix-grpc-daemon (trusted)5205worker1 # [ 110.155789] nix-daemon[932]: reaped child process 1243, status = succeeded5206lb # [ 110.235697] niks3-server[1015]: 2026/09/22 11:23:25 INFO Received uploads request method=POST path=/api/pending_closures5207worker1 # [ 110.184417] nix-grpc-daemon[959]: time=2026-09-22T11:23:25.820Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5208worker1 # [ 110.186106] nix-grpc-daemon[959]: time=2026-09-22T11:23:25.820Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"5209lb # [ 110.270650] niks3-server[1015]: 2026/09/22 11:23:25 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst5210lb # [ 110.286847] niks3-server[1015]: 2026/09/22 11:23:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5211worker1 # [ 110.226166] nix-grpc-daemon[959]: time=2026-09-22T11:23:25.862Z level=INFO msg="Uploading 1 narinfos"5212lb # [ 110.299711] niks3-server[1015]: 2026/09/22 11:23:25 INFO Signed narinfos id=33 count=15213lb # [ 110.309445] niks3-server[1015]: 2026/09/22 11:23:25 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls5214lb # [ 110.316112] niks3-server[1015]: 2026/09/22 11:23:25 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5215lb # [ 110.326377] niks3-server[1015]: 2026/09/22 11:23:25 INFO Completed upload id=335216worker1 # [ 110.260210] nix-grpc-daemon[959]: time=2026-09-22T11:23:25.896Z level=INFO msg="Upload complete. (539ms)"5217lb # [ 110.329138] niks3-server[1015]: 2026/09/22 11:23:25 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo5218worker1 # [ 110.271727] nix-grpc-daemon[866]: ts=2026-09-22T11:23:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60928 duration_s=0 paths=1 nar_bytes_in=5685219worker1 # [ 110.287428] nix-grpc-daemon[866]: ts=2026-09-22T11:23:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:609285220worker1 # [ 110.293919] nix-daemon[932]: accepted connection from pid 866, user nix-grpc-daemon (trusted)5221worker1 # [ 110.299466] nix-daemon[932]: reaped child process 1233, status = succeeded5222client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...5223worker1 # [ 110.316473] nix-daemon[932]: accepted connection from pid 866, user nix-grpc-daemon (trusted)5224client # uses-input-w1onlyc> node-a: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv5225client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds5226worker1 # [ 111.746711] nix-daemon[932]: reaped child process 1247, status = succeeded5227lb # [ 111.830885] envoy[913]: conn peer=[2001:db8:1::1]:36972 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3876 tx=2086 ms=24595228lb # [ 111.837354] envoy[913]: conn peer=[2001:db8:1::1]:36982 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=1035229lb # [ 111.842801] envoy[913]: conn peer=[2001:db8:1::1]:36986 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3756 tx=2168 ms=34375230lb # [ 111.848062] envoy[913]: conn peer=[2001:db8:1::1]:36994 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=715231worker1 # [ 111.938609] nix-daemon[932]: accepted connection from pid 1263, user nix-grpc-daemon (trusted)5232worker1 # [ 111.962408] nix-daemon[932]: reaped child process 1266, status = succeeded5233lb # [ 112.037062] niks3-server[1015]: 2026/09/22 11:23:27 INFO Received uploads request method=POST path=/api/pending_closures5234worker1 # [ 111.981104] nix-grpc-daemon[959]: time=2026-09-22T11:23:27.615Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5235lb # [ 112.068409] niks3-server[1015]: 2026/09/22 11:23:27 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls5236lb # [ 112.075154] niks3-server[1015]: 2026/09/22 11:23:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5237worker1 # [ 112.013986] nix-grpc-daemon[959]: time=2026-09-22T11:23:27.649Z level=INFO msg="Uploading 1 narinfos"5238lb # [ 112.086455] niks3-server[1015]: 2026/09/22 11:23:27 INFO Signed narinfos id=34 count=15239lb # [ 112.092588] niks3-server[1015]: 2026/09/22 11:23:27 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv5240lb # [ 112.102740] niks3-server[1015]: 2026/09/22 11:23:27 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5241lb # [ 112.108905] niks3-server[1015]: 2026/09/22 11:23:27 INFO Completed upload id=345242worker1 # [ 112.041581] nix-grpc-daemon[959]: time=2026-09-22T11:23:27.677Z level=INFO msg="Upload complete. (310ms)"5243lb # [ 112.111786] niks3-server[1015]: 2026/09/22 11:23:27 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo5244worker1 # [ 112.052975] nix-grpc-daemon[866]: ts=2026-09-22T11:23:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60928 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=17 outputs=15245worker1 # [ 112.065955] nix-daemon[932]: reaped child process 1245, status = succeeded5246client # copying 1 paths...5247worker1 # [ 112.098776] nix-grpc-daemon[866]: ts=2026-09-22T11:23:27Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:609285248client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...5249worker1 # [ 112.135559] nix-grpc-daemon[866]: ts=2026-09-22T11:23:27Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:609285250worker1 # [ 112.142873] nix-grpc-daemon[866]: ts=2026-09-22T11:23:27Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60928 duration_s=0 paths=1 nar_bytes_out=1205251client # [ 112.260427] nix-daemon[1097]: reaped child process 1224, status = succeeded5252client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 3.18 seconds)5253(finished: subtest: an input only one worker has still reaches the builder, in 11.21 seconds)5254subtest: upload whose reference the worker lacks is completed from the cache5255client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache5256client # this derivation will be built:5257client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv5258client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...5259client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.49 seconds)5260client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache5261client # this derivation will be built:5262client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv5263client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...5264client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.49 seconds)5265client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure5266client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.23 seconds)5267worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5268worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.26 seconds)5269worker2 # [ 113.809643] systemd[1]: Stopping Nix worker-protocol over gRPC...5270worker2 # [ 114.232893] nix-grpc-daemon[777]: ts=2026-09-22T11:23:29Z level=info event=signal_exit5271lb # [ 114.621342] niks3-server[1015]: 2026/09/22 11:23:30 INFO lead: released remote=192.168.1.4:526445272worker2 # [ 115.527291] nix-grpc-daemon[777]: ts=2026-09-22T11:23:31Z level=info event=scheduler_restarting5273worker1 # [ 115.553378] nix-grpc-daemon[866]: ts=2026-09-22T11:23:31Z level=info event=scheduler_restarting addr=lb:500515274worker2 # [ 115.541927] nix-grpc-daemon[777]: ts=2026-09-22T11:23:31Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:487665275worker2 # [ 115.547171] nix-grpc-daemon[777]: ts=2026-09-22T11:23:31Z level=info event=worker_gone addr=192.168.1.3:500515276worker2 # [ 115.554545] nix-grpc-daemon[777]: ts=2026-09-22T11:23:31Z level=info event=scheduler_restarting addr=lb:500515277worker2 # [ 115.559076] nix-grpc-daemon[777]: ts=2026-09-22T11:23:31Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:487665278worker2 # [ 115.564073] nix-grpc-daemon[777]: ts=2026-09-22T11:23:31Z level=info event=worker_gone addr=192.168.1.4:500515279worker2 # [ 115.589346] nix-daemon[863]: reaped child process 865, status = succeeded5280worker1 # [ 115.753681] nix-grpc-daemon[866]: ts=2026-09-22T11:23:31Z level=info event=scheduler_connected addr=lb:500515281worker1 # [ 115.759336] nix-grpc-daemon[866]: ts=2026-09-22T11:23:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5282worker2 # [ 115.764892] nix-grpc-daemon[777]: ts=2026-09-22T11:23:31Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5283worker1 # [ 115.960414] nix-grpc-daemon[866]: ts=2026-09-22T11:23:31Z level=info event=scheduler_connected addr=lb:500515284worker1 # [ 115.965942] nix-grpc-daemon[866]: ts=2026-09-22T11:23:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5285worker1 # [ 116.166795] nix-grpc-daemon[866]: ts=2026-09-22T11:23:31Z level=info event=scheduler_connected addr=lb:500515286worker1 # [ 116.172505] nix-grpc-daemon[866]: ts=2026-09-22T11:23:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5287worker1 # [ 116.373317] nix-grpc-daemon[866]: ts=2026-09-22T11:23:32Z level=info event=scheduler_connected addr=lb:500515288worker1 # [ 116.379241] nix-grpc-daemon[866]: ts=2026-09-22T11:23:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5289worker2 # [ 116.409926] nix-grpc-daemon[777]: E0000 00:00:1790076212.040647 822 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 18, started true, shutdown true5290worker2 # [ 116.443027] nix-grpc-daemon[777]: E0000 00:00:1790076212.074076 822 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5291worker1 # [ 116.582991] nix-grpc-daemon[866]: ts=2026-09-22T11:23:32Z level=info event=scheduler_connected addr=lb:500515292worker1 # [ 116.587818] nix-grpc-daemon[866]: ts=2026-09-22T11:23:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5293worker1 # [ 116.788700] nix-grpc-daemon[866]: ts=2026-09-22T11:23:32Z level=info event=scheduler_connected addr=lb:500515294worker1 # [ 116.794378] nix-grpc-daemon[866]: ts=2026-09-22T11:23:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5295worker1 # [ 116.995140] nix-grpc-daemon[866]: ts=2026-09-22T11:23:32Z level=info event=scheduler_connected addr=lb:500515296worker1 # [ 117.000354] nix-grpc-daemon[866]: ts=2026-09-22T11:23:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5297worker1 # [ 117.201252] nix-grpc-daemon[866]: ts=2026-09-22T11:23:32Z level=info event=scheduler_connected addr=lb:500515298worker1 # [ 117.206760] nix-grpc-daemon[866]: ts=2026-09-22T11:23:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5299worker2 # [ 117.331738] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5300worker2 # [ 117.337339] systemd[1]: Stopped Nix worker-protocol over gRPC.5301worker2 # [ 117.339774] systemd[1]: nix-grpc-daemon.service: Consumed 4.449s CPU time over 1min 35.438s wall clock time, 71.2M memory peak, 112.4K incoming IP traffic, 281.1K outgoing IP traffic.5302worker2 # [ 117.358001] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5303worker2 # [ 117.361583] systemd[1]: Closed Nix worker-protocol over gRPC.5304worker2 # [ 117.364366] systemd[1]: nix-grpc-daemon.socket: Consumed 615us CPU time over 1min 45.461s wall clock time, 256K memory peak, 126.6K incoming IP traffic, 105.5K outgoing IP traffic.5305lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy5306lb: must succeed: curl -sf localhost:9901/clusters5307worker1 # [ 117.407465] nix-grpc-daemon[866]: ts=2026-09-22T11:23:33Z level=info event=scheduler_connected addr=lb:500515308worker1 # [ 117.413338] nix-grpc-daemon[866]: ts=2026-09-22T11:23:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5309lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5310lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)5311client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&25312worker1 # [ 117.616427] nix-grpc-daemon[866]: ts=2026-09-22T11:23:33Z level=info event=scheduler_connected addr=lb:500515313worker1 # [ 117.620717] nix-grpc-daemon[866]: ts=2026-09-22T11:23:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5314worker1 # [ 117.770853] nix-grpc-daemon[866]: ts=2026-09-22T11:23:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:609285315worker1 # [ 117.782820] nix-grpc-daemon[866]: ts=2026-09-22T11:23:33Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:609285316client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache5317worker1 # [ 117.817299] nix-grpc-daemon[866]: ts=2026-09-22T11:23:33Z level=info event=scheduler_connected addr=lb:500515318worker1 # [ 117.823018] nix-grpc-daemon[866]: ts=2026-09-22T11:23:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5319client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.34 seconds)5320worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache5321worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)5322worker2 # [ 117.919650] systemd[1]: Listening on Nix worker-protocol over gRPC.5323worker1 # [ 118.025870] nix-grpc-daemon[866]: ts=2026-09-22T11:23:33Z level=info event=scheduler_connected addr=lb:500515324worker1 # [ 118.037912] nix-grpc-daemon[866]: ts=2026-09-22T11:23:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5325worker1 # [ 118.049202] systemd[1]: Stopping Nix worker-protocol over gRPC...5326worker1 # [ 118.133268] nix-grpc-daemon[866]: ts=2026-09-22T11:23:33Z level=info event=signal_exit5327worker1 # [ 118.227066] nix-grpc-daemon[866]: ts=2026-09-22T11:23:33Z level=info event=scheduler_connected addr=lb:500515328worker1 # [ 118.233045] nix-grpc-daemon[866]: ts=2026-09-22T11:23:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5329worker2 # [ 118.321059] systemd[1]: Starting scheduler-token.service...5330worker1 # [ 118.434102] nix-grpc-daemon[866]: ts=2026-09-22T11:23:34Z level=info event=scheduler_connected addr=lb:500515331worker1 # [ 118.440304] nix-grpc-daemon[866]: ts=2026-09-22T11:23:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5332worker2 # [ 118.457784] systemd[1]: scheduler-token.service: Deactivated successfully.5333worker2 # [ 118.464296] systemd[1]: Finished scheduler-token.service.5334worker2 # [ 118.466060] systemd[1]: scheduler-token.service: Consumed 62ms CPU time over 141ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5335worker2 # [ 118.476338] systemd[1]: Starting Nix worker-protocol over gRPC...5336worker1 # [ 118.642571] nix-grpc-daemon[866]: ts=2026-09-22T11:23:34Z level=info event=scheduler_connected addr=lb:500515337worker1 # [ 118.648331] nix-grpc-daemon[866]: ts=2026-09-22T11:23:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5338worker2 # [ 118.689465] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:34Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5339worker2 # [ 118.692772] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:34Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5340worker2 # [ 118.697601] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:34Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15341worker2 # [ 118.708154] nix-grpc-daemon[1378]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5342worker2 # [ 118.709803] nix-grpc-daemon[1378]: E0000 00:00:1790076214.336923 1378 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5343worker2 # [ 118.729168] nix-grpc-daemon[1378]: E0000 00:00:1790076214.344381 1378 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5344lb # [ 118.822718] niks3-server[1015]: 2026/09/22 11:23:34 INFO lead: acquired remote=192.168.1.4:589005345worker2 # [ 118.734705] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:34Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5346worker2 # [ 118.737003] systemd[1]: Started Nix worker-protocol over gRPC.5347worker2 # [ 118.741234] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:34Z level=info event=scheduler_take_over5348worker2 # [ 118.747000] nix-grpc-daemon[1378]: E0000 00:00:1790076214.375297 1420 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5349worker2 # [ 118.776294] nix-grpc-daemon[1378]: E0000 00:00:1790076214.394466 1420 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5350worker2 # [ 118.783191] nix-grpc-daemon[1378]: E0000 00:00:1790076214.394839 1420 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5351worker2 # [ 118.786958] nix-grpc-daemon[1378]: E0000 00:00:1790076214.413059 1420 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5352worker2 # [ 118.798484] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:34Z level=info event=scheduler_connected addr=lb:500515353worker2 # [ 118.808967] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:34Z level=info event=oidc_jwks provider=mock keys=15354worker2 # [ 118.810450] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:34Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:471465355worker2 # [ 118.812640] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:34Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05356worker2 # [ 118.822715] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:34Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:471465357worker1 # [ 118.845164] nix-grpc-daemon[866]: ts=2026-09-22T11:23:34Z level=info event=scheduler_connected addr=lb:500515358worker2 # [ 118.824700] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:34Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05359worker1 # [ 119.415783] nix-grpc-daemon[866]: ts=2026-09-22T11:23:35Z level=info event=scheduler_restarting5360worker2 # [ 119.404267] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:35Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:471465361worker2 # [ 119.406203] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:35Z level=info event=worker_gone addr=192.168.1.3:500515362worker1 # [ 119.461680] nix-grpc-daemon[866]: ts=2026-09-22T11:23:35Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5363worker1 # [ 119.481504] nix-daemon[932]: reaped child process 934, status = succeeded5364worker1 # [ 120.261261] nix-grpc-daemon[866]: E0000 00:00:1790076215.895889 911 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true5365worker1 # [ 120.349590] nix-grpc-daemon[866]: E0000 00:00:1790076215.985494 911 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5366worker1 # [ 121.280877] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5367worker1 # [ 121.281359] systemd[1]: Stopped Nix worker-protocol over gRPC.5368worker1 # [ 121.281579] systemd[1]: nix-grpc-daemon.service: Consumed 3.358s CPU time over 1min 39.508s wall clock time, 57.4M memory peak, 89.5K incoming IP traffic, 160.3K outgoing IP traffic.5369lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy5370lb: must succeed: curl -sf localhost:9901/clusters5371lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5372lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)5373client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&25374worker2 # [ 121.682671] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:421545375worker2 # [ 121.697022] nix-daemon[863]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5376worker2 # [ 121.732499] nix-grpc-daemon[1378]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 96 ms (attempt 1/5)5377lb # [ 121.836543] envoy[913]: conn peer=[2001:db8:1::1]:37000 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3738 tx=2099 ms=26205378lb # [ 121.843096] envoy[913]: conn peer=[2001:db8:1::1]:34154 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=725379lb # [ 121.848246] envoy[913]: conn peer=[2001:db8:1::4]:60238 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=66178 tx=3797 ms=934815380lb # [ 121.853350] envoy[913]: conn peer=[2001:db8:1::1]:34156 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=520 ms=405381lb # [ 121.858569] envoy[913]: conn peer=[2001:db8:1::3]:59830 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=15345 tx=4099 ms=972765382worker2 # [ 121.836588] nix-grpc-daemon[1378]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 39 ms (attempt 2/5)5383worker2 # [ 121.884189] nix-grpc-daemon[1378]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 148 ms (attempt 3/5)5384worker1 # [ 121.299883] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5385worker1 # [ 121.302127] systemd[1]: Closed Nix worker-protocol over gRPC.5386worker1 # [ 121.302329] systemd[1]: nix-grpc-daemon.socket: Consumed 621us CPU time over 1min 49.465s wall clock time, 256K memory peak, 103.2K incoming IP traffic, 91.2K outgoing IP traffic.5387worker2 # [ 122.032703] nix-grpc-daemon[1378]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 646 ms (attempt 4/5)5388worker2 # [ 122.687408] nix-grpc-daemon[1378]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5389worker2 # [ 122.690994] nix-grpc-daemon[1378]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5390client # copying 2 paths...5391client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...5392worker2 # [ 122.718326] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:421545393client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...5394worker2 # [ 122.734419] nix-daemon[863]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5395worker2 # [ 122.775469] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:38Z level=info event=niks3_push_started pid=14385396worker2 # [ 123.027954] nix-grpc-daemon[1438]: time=2026-09-22T11:23:38.657Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca=""5397worker2 # [ 123.208064] nix-daemon[863]: accepted connection from pid 1451, user nix-grpc-daemon (trusted)5398worker2 # [ 123.231235] nix-daemon[863]: reaped child process 1454, status = succeeded5399lb # [ 123.334454] niks3-server[1015]: 2026/09/22 11:23:38 INFO Received uploads request method=POST path=/api/pending_closures5400lb # [ 123.344303] niks3-server[1015]: 2026/09/22 11:23:38 INFO Received uploads request method=POST path=/api/pending_closures5401worker2 # [ 123.263992] nix-grpc-daemon[1438]: time=2026-09-22T11:23:38.893Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5402worker2 # [ 123.265602] nix-grpc-daemon[1438]: time=2026-09-22T11:23:38.893Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"5403worker2 # [ 123.267406] nix-grpc-daemon[1438]: time=2026-09-22T11:23:38.894Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"5404lb # [ 123.399563] niks3-server[1015]: 2026/09/22 11:23:39 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5405lb # [ 123.413918] niks3-server[1015]: 2026/09/22 11:23:39 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst5406lb # [ 123.426211] niks3-server[1015]: 2026/09/22 11:23:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5407lb # [ 123.433936] niks3-server[1015]: 2026/09/22 11:23:39 INFO Signed narinfos id=35 count=15408worker2 # [ 123.342868] nix-grpc-daemon[1438]: time=2026-09-22T11:23:38.972Z level=INFO msg="Uploading 3 narinfos"5409lb # [ 123.440533] niks3-server[1015]: 2026/09/22 11:23:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5410lb # [ 123.446926] niks3-server[1015]: 2026/09/22 11:23:39 INFO Signed narinfos id=36 count=25411lb # [ 123.451293] niks3-server[1015]: 2026/09/22 11:23:39 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls5412lb # [ 123.457911] niks3-server[1015]: 2026/09/22 11:23:39 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls5413lb # [ 123.475513] niks3-server[1015]: 2026/09/22 11:23:39 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5414lb # [ 123.484265] niks3-server[1015]: 2026/09/22 11:23:39 INFO Completed upload id=355415lb # [ 123.485668] niks3-server[1015]: 2026/09/22 11:23:39 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5416lb # [ 123.494561] niks3-server[1015]: 2026/09/22 11:23:39 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo5417worker2 # [ 123.402621] nix-grpc-daemon[1438]: time=2026-09-22T11:23:39.033Z level=INFO msg="Upload complete. (374ms)"5418lb # [ 123.499574] niks3-server[1015]: 2026/09/22 11:23:39 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo5419lb # [ 123.505261] niks3-server[1015]: 2026/09/22 11:23:39 INFO Completed upload id=365420worker2 # [ 123.416490] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42154 duration_s=0 paths=2 nar_bytes_in=3125421lb # [ 123.515856] niks3-server[1015]: 2026/09/22 11:23:39 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo5422worker2 # [ 123.435108] nix-daemon[863]: reaped child process 1436, status = succeeded5423client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 2.08 seconds)5424worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache5425worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.04 seconds)5426worker1 # [ 123.619328] systemd[1]: Listening on Nix worker-protocol over gRPC.5427worker1 # [ 123.629064] systemd[1]: Starting Nix worker-protocol over gRPC...5428worker1 # [ 123.836557] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:39Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5429worker1 # [ 123.839592] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:39Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5430worker1 # [ 123.844487] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:39Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15431worker1 # [ 123.852083] nix-grpc-daemon[1289]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5432worker1 # [ 123.863296] nix-grpc-daemon[1289]: E0000 00:00:1790076219.487956 1289 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5433worker1 # [ 123.869907] nix-grpc-daemon[1289]: E0000 00:00:1790076219.492141 1289 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5434lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5435lb: must succeed: curl -sf localhost:9901/clusters5436worker1 # [ 123.884229] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:39Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5437worker1 # [ 123.907941] systemd[1]: Started Nix worker-protocol over gRPC.5438worker1 # [ 123.909022] nix-grpc-daemon[1289]: E0000 00:00:1790076219.510803 1329 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5439worker1 # [ 123.912695] nix-grpc-daemon[1289]: E0000 00:00:1790076219.529027 1329 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5440worker1 # [ 123.915694] nix-grpc-daemon[1289]: E0000 00:00:1790076219.529304 1329 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5441worker1 # [ 123.918413] nix-grpc-daemon[1289]: E0000 00:00:1790076219.543902 1329 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5442worker1 # [ 123.930132] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:39Z level=info event=scheduler_connected addr=lb:500515443worker2 # [ 123.909439] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:39Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:471465444worker2 # [ 123.914592] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:39Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05445lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)5446lb: must succeed: curl -sf localhost:9901/clusters5447lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5448lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.19 seconds)5449(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 12.77 seconds)5450subtest: a niks3 restart does not cost the leader its role5451lb: must succeed: curl -sf localhost:9901/clusters5452lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5453lb: must succeed: curl -sf localhost:9901/clusters5454lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5455lb # [ 125.289877] niks3-server[1015]: 2026/09/22 11:23:40 INFO Shutdown signal received, draining in-flight requests timeout=10s5456worker1 # [ 125.229365] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:40Z level=info event=scheduler_lock_lost status=2005457worker2 # [ 125.206028] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:40Z level=info event=scheduler_lock_lost status=2005458lb # [ 125.294758] systemd[1]: Stopping niks3 server...5459lb # [ 125.300520] niks3-server[1015]: 2026/09/22 11:23:40 INFO lead: released remote=192.168.1.4:589005460lb # [ 125.321242] systemd[1]: niks3.service: Deactivated successfully.5461lb # [ 125.327059] systemd[1]: Stopped niks3 server.5462lb # [ 125.327882] systemd[1]: niks3.service: Consumed 706ms CPU time over 1min 36.679s wall clock time, 23.9M memory peak, 97.7K incoming IP traffic, 140.3K outgoing IP traffic.5463lb # [ 125.338429] systemd[1]: Starting niks3 server...5464lb # [ 125.423082] niks3-server[1155]: 2026/09/22 11:23:41 goose: no migrations to run. current version: 202609200000005465lb # [ 125.430610] niks3-server[1155]: 2026/09/22 11:23:41 OK 1_commit_pending_closure.sql (9.51ms)5466lb # [ 125.435168] niks3-server[1155]: 2026/09/22 11:23:41 OK 2_object_stats_trigger.sql (2.54ms)5467lb # [ 125.436973] niks3-server[1155]: 2026/09/22 11:23:41 goose: up to current file version: 25468lb # [ 125.439289] niks3-server[1155]: 2026/09/22 11:23:41 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key5469lb # [ 125.453175] niks3-server[1155]: 2026/09/22 11:23:41 INFO Read proxy enabled — serving cache objects from S35470lb # [ 125.454739] niks3-server[1155]: 2026/09/22 11:23:41 INFO Using socket-activated listener address=0.0.0.0:57515471lb # [ 125.459800] niks3-server[1155]: 2026/09/22 11:23:41 INFO systemd watchdog enabled interval=15s5472lb # [ 125.461267] niks3-server[1155]: 2026/09/22 11:23:41 INFO Starting HTTP server address=0.0.0.0:57515473lb # [ 125.462523] systemd[1]: Started niks3 server.5474lb: waiting for unit niks3.service5475lb: (finished: waiting for unit niks3.service, in 0.05 seconds)5476lb: must succeed: curl -sf localhost:9901/clusters5477lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5478worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5479worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5480lb: must succeed: curl -sf localhost:9901/clusters5481lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5482lb: must succeed: curl -sf localhost:9901/clusters5483lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5484worker2: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield5485worker2: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.08 seconds)5486client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag after-niks3-restart >&25487client # don't know how to build these paths:5488client # /nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv5489worker2 # [ 126.035460] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:421545490worker1 # [ 126.071328] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:506545491worker1 # [ 126.085276] nix-daemon[932]: accepted connection from pid 1289, user nix-grpc-daemon (trusted)5492worker1 # [ 126.117554] nix-grpc-daemon[1289]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 27 ms (attempt 1/5)5493worker1 # [ 126.152220] nix-grpc-daemon[1289]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 24 ms (attempt 2/5)5494worker1 # [ 126.176637] nix-grpc-daemon[1289]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 320 ms (attempt 3/5)5495lb # [ 126.305948] niks3-server[1155]: 2026/09/22 11:23:41 INFO lead: acquired remote=192.168.1.4:360865496worker1 # [ 126.498436] nix-grpc-daemon[1289]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 397 ms (attempt 4/5)5497worker1 # [ 126.903910] nix-grpc-daemon[1289]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5498worker1 # [ 126.911151] nix-grpc-daemon[1289]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5499worker2 # [ 126.945995] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:42Z level=debug event=want client=1 drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv cached=05500worker2 # [ 126.946418] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:42Z level=debug event=assigned drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv worker=192.168.1.4:50051 clients=15501worker2 # [ 126.992259] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:421545502worker2 # [ 127.012503] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:421545503client # copying 1 paths to 'lb:50051'...5504client # copying path '/nix/store/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv' to 'lb:50051'...5505worker2 # [ 127.031555] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:421545506worker2 # [ 127.049666] nix-daemon[863]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5507worker2 # [ 127.282395] nix-daemon[863]: accepted connection from pid 1473, user nix-grpc-daemon (trusted)5508worker2 # [ 127.305064] nix-daemon[863]: reaped child process 1476, status = succeeded5509worker2 # [ 127.502942] nix-daemon[863]: accepted connection from pid 1478, user nix-grpc-daemon (trusted)5510worker2 # [ 127.525008] nix-daemon[863]: reaped child process 1481, status = succeeded5511lb # [ 127.630065] niks3-server[1155]: 2026/09/22 11:23:43 INFO Received uploads request method=POST path=/api/pending_closures5512worker2 # [ 127.561838] nix-grpc-daemon[1438]: time=2026-09-22T11:23:43.191Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5513worker2 # [ 127.563684] nix-grpc-daemon[1438]: time=2026-09-22T11:23:43.192Z level=INFO msg="Uploading mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv (544B)"5514lb # [ 127.697043] niks3-server[1155]: 2026/09/22 11:23:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5515lb # [ 127.709276] niks3-server[1155]: 2026/09/22 11:23:43 INFO Registered completed upload object_key=nar/0hn539w6achi7azzyhpihsi61g85x9f535dxv438yq5y50ksrp1d.nar.zst5516lb # [ 127.746688] niks3-server[1155]: 2026/09/22 11:23:43 INFO Signed narinfos id=37 count=15517worker2 # [ 127.661142] nix-grpc-daemon[1438]: time=2026-09-22T11:23:43.291Z level=INFO msg="Uploading 1 narinfos"5518lb # [ 127.757477] niks3-server[1155]: 2026/09/22 11:23:43 INFO Registered completed upload object_key=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z.ls5519lb # [ 127.767312] niks3-server[1155]: 2026/09/22 11:23:43 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5520lb # [ 127.783267] niks3-server[1155]: 2026/09/22 11:23:43 INFO Completed upload id=375521worker2 # [ 127.693326] nix-grpc-daemon[1438]: time=2026-09-22T11:23:43.324Z level=INFO msg="Upload complete. (624ms)"5522lb # [ 127.791602] niks3-server[1155]: 2026/09/22 11:23:43 INFO Registered completed upload object_key=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z.narinfo5523worker2 # [ 127.704667] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42154 duration_s=0 paths=1 nar_bytes_in=5445524worker2 # [ 127.732266] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:421545525worker2 # [ 127.740435] nix-daemon[863]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5526worker2 # [ 127.762056] nix-daemon[863]: reaped child process 1471, status = succeeded5527client # building '/nix/store/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv' on lb:50051...5528client # farm-a> worker2: building mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv5529worker2 # [ 127.774293] nix-daemon[863]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5530client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds5531client # farm-a> LOG-farm-a-after-niks3-restart5532worker2 # [ 129.209767] nix-daemon[863]: reaped child process 1485, status = succeeded5533worker2 # [ 129.390400] nix-daemon[863]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)5534worker2 # [ 129.417435] nix-daemon[863]: reaped child process 1504, status = succeeded5535lb # [ 129.521473] niks3-server[1155]: 2026/09/22 11:23:45 INFO Received uploads request method=POST path=/api/pending_closures5536worker2 # [ 129.448577] nix-grpc-daemon[1438]: time=2026-09-22T11:23:45.077Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5537worker2 # [ 129.450229] nix-grpc-daemon[1438]: time=2026-09-22T11:23:45.077Z level=INFO msg="Uploading j3iswx3ynilvcycpyw0z667966c9kpzx-farm-a (144B)"5538lb # [ 129.565955] niks3-server[1155]: 2026/09/22 11:23:45 INFO Registered completed upload object_key=log/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv5539lb # [ 129.576649] niks3-server[1155]: 2026/09/22 11:23:45 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst5540lb # [ 129.591526] niks3-server[1155]: 2026/09/22 11:23:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5541worker2 # [ 129.502126] nix-grpc-daemon[1438]: time=2026-09-22T11:23:45.132Z level=INFO msg="Uploading 1 narinfos"5542lb # [ 129.598665] niks3-server[1155]: 2026/09/22 11:23:45 INFO Signed narinfos id=38 count=15543lb # [ 129.610971] niks3-server[1155]: 2026/09/22 11:23:45 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5544lb # [ 129.619476] niks3-server[1155]: 2026/09/22 11:23:45 INFO Registered completed upload object_key=j3iswx3ynilvcycpyw0z667966c9kpzx.ls5545lb # [ 129.623518] niks3-server[1155]: 2026/09/22 11:23:45 INFO Completed upload id=385546worker2 # [ 129.532934] nix-grpc-daemon[1438]: time=2026-09-22T11:23:45.164Z level=INFO msg="Upload complete. (339ms)"5547lb # [ 129.626122] niks3-server[1155]: 2026/09/22 11:23:45 INFO Registered completed upload object_key=j3iswx3ynilvcycpyw0z667966c9kpzx.narinfo5548worker2 # [ 129.560534] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42154 duration_s=1 drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv assign_id=1 outputs=15549worker2 # [ 129.572489] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:45Z level=debug event=want client=1 drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv cached=05550worker2 # [ 129.575940] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:45Z level=debug event=assigned drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv worker=192.168.1.4:50051 clients=15551worker2 # [ 129.582790] nix-daemon[863]: reaped child process 1483, status = succeeded5552worker2 # [ 129.603542] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:421545553worker2 # [ 129.621944] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:421545554worker2 # [ 129.642073] nix-grpc-daemon[1438]: time=2026-09-22T11:23:45.273Z level=INFO msg="All 1 paths already cached"5555client # copying 1 paths to 'lb:50051'...5556client # copying path '/nix/store/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv' to 'lb:50051'...5557worker2 # [ 129.653784] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:421545558worker2 # [ 129.670855] nix-daemon[863]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5559worker2 # [ 129.903537] nix-daemon[863]: accepted connection from pid 1510, user nix-grpc-daemon (trusted)5560worker2 # [ 129.928563] nix-daemon[863]: reaped child process 1513, status = succeeded5561worker2 # [ 130.115747] nix-daemon[863]: accepted connection from pid 1515, user nix-grpc-daemon (trusted)5562worker2 # [ 130.136774] nix-daemon[863]: reaped child process 1518, status = succeeded5563lb # [ 130.240485] niks3-server[1155]: 2026/09/22 11:23:45 INFO Received uploads request method=POST path=/api/pending_closures5564worker2 # [ 130.159039] nix-grpc-daemon[1438]: time=2026-09-22T11:23:45.789Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5565worker2 # [ 130.160834] nix-grpc-daemon[1438]: time=2026-09-22T11:23:45.789Z level=INFO msg="Uploading 5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv (656B)"5566lb # [ 130.270771] niks3-server[1155]: 2026/09/22 11:23:45 INFO Registered completed upload object_key=nar/1xpcisa10g5by3yknnrs1xwhxhf4s243h7gwzjii0799pwbhfjfa.nar.zst5567lb # [ 130.282260] niks3-server[1155]: 2026/09/22 11:23:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5568worker2 # [ 130.197187] nix-grpc-daemon[1438]: time=2026-09-22T11:23:45.828Z level=INFO msg="Uploading 1 narinfos"5569lb # [ 130.293231] niks3-server[1155]: 2026/09/22 11:23:45 INFO Signed narinfos id=39 count=15570lb # [ 130.299620] niks3-server[1155]: 2026/09/22 11:23:45 INFO Registered completed upload object_key=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.ls5571lb # [ 130.308181] niks3-server[1155]: 2026/09/22 11:23:45 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5572lb # [ 130.315007] niks3-server[1155]: 2026/09/22 11:23:45 INFO Completed upload id=395573worker2 # [ 130.224500] nix-grpc-daemon[1438]: time=2026-09-22T11:23:45.855Z level=INFO msg="Upload complete. (534ms)"5574lb # [ 130.317784] niks3-server[1155]: 2026/09/22 11:23:45 INFO Registered completed upload object_key=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.narinfo5575worker2 # [ 130.232359] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42154 duration_s=0 paths=1 nar_bytes_in=6565576worker2 # [ 130.248539] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:421545577worker2 # [ 130.255524] nix-daemon[863]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5578worker2 # [ 130.261088] nix-daemon[863]: reaped child process 1508, status = succeeded5579client # building '/nix/store/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv' on lb:50051...5580worker2 # [ 130.273649] nix-daemon[863]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5581client # farm-b> worker2: building 5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv5582client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds5583client # farm-b> LOG-farm-b-after-niks3-restart5584worker2 # [ 131.336480] nix-daemon[863]: reaped child process 1522, status = succeeded5585worker2 # [ 131.516120] nix-daemon[863]: accepted connection from pid 1538, user nix-grpc-daemon (trusted)5586worker2 # [ 131.542015] nix-daemon[863]: reaped child process 1541, status = succeeded5587lb # [ 131.644852] niks3-server[1155]: 2026/09/22 11:23:47 INFO Received uploads request method=POST path=/api/pending_closures5588worker2 # [ 131.566946] nix-grpc-daemon[1438]: time=2026-09-22T11:23:47.196Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5589worker2 # [ 131.569254] nix-grpc-daemon[1438]: time=2026-09-22T11:23:47.196Z level=INFO msg="Uploading myar0ljvsqm9h7fxyh6qrqkg0175r3xn-farm-b (192B)"5590lb # [ 131.693257] niks3-server[1155]: 2026/09/22 11:23:47 INFO Registered completed upload object_key=nar/0zvv5rxmyk9afay83j52m7ipyhrqivhg6h6a0ksjd658pxzwi78w.nar.zst5591lb # [ 131.706882] niks3-server[1155]: 2026/09/22 11:23:47 INFO Registered completed upload object_key=log/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv5592lb # [ 131.717149] niks3-server[1155]: 2026/09/22 11:23:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5593worker2 # [ 131.632256] nix-grpc-daemon[1438]: time=2026-09-22T11:23:47.262Z level=INFO msg="Uploading 1 narinfos"5594lb # [ 131.725901] niks3-server[1155]: 2026/09/22 11:23:47 INFO Signed narinfos id=40 count=15595lb # [ 131.730574] niks3-server[1155]: 2026/09/22 11:23:47 INFO Registered completed upload object_key=myar0ljvsqm9h7fxyh6qrqkg0175r3xn.ls5596lb # [ 131.738228] niks3-server[1155]: 2026/09/22 11:23:47 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5597lb # [ 131.752539] niks3-server[1155]: 2026/09/22 11:23:47 INFO Completed upload id=405598lb # [ 131.755731] niks3-server[1155]: 2026/09/22 11:23:47 INFO Registered completed upload object_key=myar0ljvsqm9h7fxyh6qrqkg0175r3xn.narinfo5599worker2 # [ 131.662208] nix-grpc-daemon[1438]: time=2026-09-22T11:23:47.293Z level=INFO msg="Upload complete. (372ms)"5600worker2 # [ 131.684734] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42154 duration_s=1 drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv assign_id=2 outputs=15601worker2 # [ 131.706903] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:47Z level=debug event=want client=1 drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv cached=05602worker2 # [ 131.711702] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:47Z level=debug event=assigned drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv worker=192.168.1.4:50051 clients=15603worker2 # [ 131.716849] nix-daemon[863]: reaped child process 1520, status = succeeded5604worker2 # [ 131.727473] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:421545605worker2 # [ 131.747462] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:421545606lb # [ 131.840495] envoy[913]: conn peer=[2001:db8:1::1]:40948 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1004 tx=282 ms=17535607worker2 # [ 131.766357] nix-grpc-daemon[1438]: time=2026-09-22T11:23:47.397Z level=INFO msg="All 2 paths already cached"5608client # copying 1 paths to 'lb:50051'...5609client # copying path '/nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv' to 'lb:50051'...5610worker2 # [ 131.780745] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:421545611worker2 # [ 131.798339] nix-daemon[863]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5612worker2 # [ 132.013315] nix-daemon[863]: accepted connection from pid 1547, user nix-grpc-daemon (trusted)5613worker2 # [ 132.038063] nix-daemon[863]: reaped child process 1550, status = succeeded5614worker2 # [ 132.224330] nix-daemon[863]: accepted connection from pid 1552, user nix-grpc-daemon (trusted)5615worker2 # [ 132.245924] nix-daemon[863]: reaped child process 1555, status = succeeded5616lb # [ 132.350965] niks3-server[1155]: 2026/09/22 11:23:47 INFO Received uploads request method=POST path=/api/pending_closures5617worker2 # [ 132.273105] nix-grpc-daemon[1438]: time=2026-09-22T11:23:47.903Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5618worker2 # [ 132.274691] nix-grpc-daemon[1438]: time=2026-09-22T11:23:47.903Z level=INFO msg="Uploading 6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv (784B)"5619lb # [ 132.389275] niks3-server[1155]: 2026/09/22 11:23:48 INFO Registered completed upload object_key=nar/1fnvw3c0v6n1j60nd5iagl3bggzcvixsw103w98mwhnpmnmgb248.nar.zst5620lb # [ 132.405296] niks3-server[1155]: 2026/09/22 11:23:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5621worker2 # [ 132.322341] nix-grpc-daemon[1438]: time=2026-09-22T11:23:47.953Z level=INFO msg="Uploading 1 narinfos"5622lb # [ 132.418592] niks3-server[1155]: 2026/09/22 11:23:48 INFO Signed narinfos id=41 count=15623lb # [ 132.426606] niks3-server[1155]: 2026/09/22 11:23:48 INFO Registered completed upload object_key=6j7gr603xfslr5lxcbh72430f5q1r4b0.ls5624lb # [ 132.439834] niks3-server[1155]: 2026/09/22 11:23:48 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5625lb # [ 132.447323] niks3-server[1155]: 2026/09/22 11:23:48 INFO Completed upload id=415626lb # [ 132.450651] niks3-server[1155]: 2026/09/22 11:23:48 INFO Registered completed upload object_key=6j7gr603xfslr5lxcbh72430f5q1r4b0.narinfo5627worker2 # [ 132.356175] nix-grpc-daemon[1438]: time=2026-09-22T11:23:47.987Z level=INFO msg="Upload complete. (538ms)"5628worker2 # [ 132.368866] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42154 duration_s=0 paths=1 nar_bytes_in=7845629worker2 # [ 132.381059] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:421545630worker2 # [ 132.394586] nix-daemon[863]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5631worker2 # [ 132.404618] nix-daemon[863]: reaped child process 1545, status = succeeded5632client # building '/nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv' on lb:50051...5633worker2 # [ 132.416051] nix-daemon[863]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5634client # farm-top> worker2: building 6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv5635client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds5636client # farm-top> LOG-farm-top-after-niks3-restart5637worker2 # [ 133.474823] nix-daemon[863]: reaped child process 1559, status = succeeded5638worker2 # [ 133.664886] nix-daemon[863]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5639worker2 # [ 133.689434] nix-daemon[863]: reaped child process 1578, status = succeeded5640lb # [ 133.792955] niks3-server[1155]: 2026/09/22 11:23:49 INFO Received uploads request method=POST path=/api/pending_closures5641worker2 # [ 133.715704] nix-grpc-daemon[1438]: time=2026-09-22T11:23:49.344Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5642worker2 # [ 133.717945] nix-grpc-daemon[1438]: time=2026-09-22T11:23:49.344Z level=INFO msg="Uploading z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc-farm-top (248B)"5643lb # [ 133.829179] niks3-server[1155]: 2026/09/22 11:23:49 INFO Registered completed upload object_key=log/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv5644lb # [ 133.849224] niks3-server[1155]: 2026/09/22 11:23:49 INFO Registered completed upload object_key=nar/0cypkbh15calmx90jgh2waxpq661jalf4c99dgb7j606z61xh0ld.nar.zst5645lb # [ 133.863900] niks3-server[1155]: 2026/09/22 11:23:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5646worker2 # [ 133.781226] nix-grpc-daemon[1438]: time=2026-09-22T11:23:49.411Z level=INFO msg="Uploading 1 narinfos"5647lb # [ 133.873823] niks3-server[1155]: 2026/09/22 11:23:49 INFO Signed narinfos id=42 count=15648lb # [ 133.880535] niks3-server[1155]: 2026/09/22 11:23:49 INFO Registered completed upload object_key=z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.ls5649lb # [ 133.891578] niks3-server[1155]: 2026/09/22 11:23:49 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5650lb # [ 133.900231] niks3-server[1155]: 2026/09/22 11:23:49 INFO Completed upload id=425651worker2 # [ 133.807850] nix-grpc-daemon[1438]: time=2026-09-22T11:23:49.438Z level=INFO msg="Upload complete. (374ms)"5652lb # [ 133.903655] niks3-server[1155]: 2026/09/22 11:23:49 INFO Registered completed upload object_key=z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.narinfo5653worker2 # [ 133.821898] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42154 duration_s=1 drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv assign_id=3 outputs=15654worker2 # [ 133.847051] nix-daemon[863]: reaped child process 1557, status = succeeded5655client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag after-niks3-restart >&2, in 8.13 seconds)5656client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag after-niks3-restart outPath5657client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag after-niks3-restart outPath, in 0.26 seconds)5658(finished: subtest: a niks3 restart does not cost the leader its role, in 9.10 seconds)5659subtest: scheduler down: the other node takes the lock and keeps it5660lb: must succeed: curl -sf localhost:9901/clusters5661lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5662lb: must succeed: curl -sf localhost:9901/clusters5663lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5664lb: must succeed: curl -sf localhost:9901/clusters5665lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5666lb: must succeed: curl -sf localhost:9901/clusters5667lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5668worker2 # [ 134.477620] systemd[1]: Stopping Nix worker-protocol over gRPC...5669worker2 # [ 134.735995] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:50Z level=info event=signal_exit5670lb # [ 135.513358] niks3-server[1155]: 2026/09/22 11:23:51 INFO lead: released remote=192.168.1.4:360865671lb # [ 136.305343] niks3-server[1155]: 2026/09/22 11:23:51 INFO lead: acquired remote=192.168.1.3:448825672worker1 # [ 136.245098] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:51Z level=info event=scheduler_take_over5673worker1 # [ 136.447480] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:52Z level=info event=scheduler_restarting addr=lb:500515674worker2 # [ 136.430084] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:52Z level=info event=scheduler_restarting5675worker2 # [ 136.435428] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:52Z level=info event=scheduler_restarting addr=lb:500515676worker2 # [ 136.441134] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:52Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:471465677worker2 # [ 136.446567] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:52Z level=info event=worker_gone addr=192.168.1.4:500515678worker2 # [ 136.453133] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:52Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:471465679worker2 # [ 136.458208] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:52Z level=info event=worker_gone addr=192.168.1.3:500515680worker2 # [ 136.482447] nix-daemon[863]: reaped child process 1430, status = succeeded5681worker1 # [ 136.648901] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:52Z level=info event=scheduler_connected addr=lb:500515682worker1 # [ 136.659686] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:52Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:491145683worker1 # [ 136.665522] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:52Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05684worker2 # [ 136.648932] nix-grpc-daemon[1378]: ts=2026-09-22T11:23:52Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5685worker2 # [ 136.803057] nix-grpc-daemon[1378]: E0000 00:00:1790076232.433813 1423 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5686worker2 # [ 136.810046] nix-grpc-daemon[1378]: E0000 00:00:1790076232.434070 1423 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5687worker2 # [ 137.610613] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5688worker2 # [ 137.617114] systemd[1]: Stopped Nix worker-protocol over gRPC.5689worker2 # [ 137.619712] systemd[1]: nix-grpc-daemon.service: Consumed 1.788s CPU time over 19.133s wall clock time, 36M memory peak, 45K incoming IP traffic, 76.4K outgoing IP traffic.5690worker2 # [ 137.637069] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5691worker2 # [ 137.639222] systemd[1]: Closed Nix worker-protocol over gRPC.5692worker2 # [ 137.644690] systemd[1]: nix-grpc-daemon.socket: Consumed 1ms CPU time over 19.728s wall clock time, 256K memory peak, 40K incoming IP traffic, 30.1K outgoing IP traffic.5693worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5694worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.09 seconds)5695worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5696worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)5697client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&25698worker1 # [ 138.114822] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:506545699client # don't know how to build these paths:5700client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5701worker1 # [ 138.126169] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:506545702worker1 # [ 138.157492] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:53Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=05703worker1 # [ 138.165709] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:53Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=15704worker1 # [ 138.207147] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:506545705worker1 # [ 138.226196] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:506545706client # copying 1 paths to 'lb:50051'...5707client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...5708worker1 # [ 138.244159] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:506545709worker1 # [ 138.260870] nix-daemon[932]: accepted connection from pid 1289, user nix-grpc-daemon (trusted)5710worker1 # [ 138.291128] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:53Z level=info event=niks3_push_started pid=13625711worker1 # [ 138.528454] nix-grpc-daemon[1362]: time=2026-09-22T11:23:54.162Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca=""5712worker1 # [ 138.715573] nix-daemon[932]: accepted connection from pid 1375, user nix-grpc-daemon (trusted)5713worker1 # [ 138.737101] nix-daemon[932]: reaped child process 1378, status = succeeded5714worker1 # [ 138.930309] nix-daemon[932]: accepted connection from pid 1380, user nix-grpc-daemon (trusted)5715worker1 # [ 138.952352] nix-daemon[932]: reaped child process 1383, status = succeeded5716lb # [ 139.030732] niks3-server[1155]: 2026/09/22 11:23:54 INFO Received uploads request method=POST path=/api/pending_closures5717worker1 # [ 138.975933] nix-grpc-daemon[1362]: time=2026-09-22T11:23:54.610Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5718worker1 # [ 138.978053] nix-grpc-daemon[1362]: time=2026-09-22T11:23:54.610Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"5719lb # [ 139.066748] niks3-server[1155]: 2026/09/22 11:23:54 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst5720lb # [ 139.083565] niks3-server[1155]: 2026/09/22 11:23:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5721worker1 # [ 139.025081] nix-grpc-daemon[1362]: time=2026-09-22T11:23:54.660Z level=INFO msg="Uploading 1 narinfos"5722lb # [ 139.093485] niks3-server[1155]: 2026/09/22 11:23:54 INFO Signed narinfos id=43 count=15723lb # [ 139.103793] niks3-server[1155]: 2026/09/22 11:23:54 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls5724lb # [ 139.117237] niks3-server[1155]: 2026/09/22 11:23:54 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5725lb # [ 139.127054] niks3-server[1155]: 2026/09/22 11:23:54 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo5726lb # [ 139.132953] niks3-server[1155]: 2026/09/22 11:23:54 INFO Completed upload id=435727worker1 # [ 139.066812] nix-grpc-daemon[1362]: time=2026-09-22T11:23:54.702Z level=INFO msg="Upload complete. (538ms)"5728worker1 # [ 139.076485] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50654 duration_s=0 paths=1 nar_bytes_in=5205729worker1 # [ 139.096303] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:506545730worker1 # [ 139.103002] nix-daemon[932]: accepted connection from pid 1289, user nix-grpc-daemon (trusted)5731worker1 # [ 139.109052] nix-daemon[932]: reaped child process 1360, status = succeeded5732client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...5733worker1 # [ 139.121785] nix-daemon[932]: accepted connection from pid 1289, user nix-grpc-daemon (trusted)5734client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5735client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds5736client # farm-a> LOG-farm-a-on-standby5737worker1 # [ 140.749563] nix-daemon[932]: reaped child process 1387, status = succeeded5738worker1 # [ 140.923668] nix-daemon[932]: accepted connection from pid 1403, user nix-grpc-daemon (trusted)5739worker1 # [ 140.947168] nix-daemon[932]: reaped child process 1406, status = succeeded5740lb # [ 141.027995] niks3-server[1155]: 2026/09/22 11:23:56 INFO Received uploads request method=POST path=/api/pending_closures5741worker1 # [ 140.980611] nix-grpc-daemon[1362]: time=2026-09-22T11:23:56.614Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5742worker1 # [ 140.982200] nix-grpc-daemon[1362]: time=2026-09-22T11:23:56.614Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"5743lb # [ 141.087295] niks3-server[1155]: 2026/09/22 11:23:56 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5744lb # [ 141.098111] niks3-server[1155]: 2026/09/22 11:23:56 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5745worker1 # [ 141.045752] nix-grpc-daemon[1362]: time=2026-09-22T11:23:56.680Z level=INFO msg="Uploading 1 narinfos"5746lb # [ 141.113448] niks3-server[1155]: 2026/09/22 11:23:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5747lb # [ 141.122119] niks3-server[1155]: 2026/09/22 11:23:56 INFO Signed narinfos id=44 count=15748lb # [ 141.128396] niks3-server[1155]: 2026/09/22 11:23:56 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls5749lb # [ 141.136512] niks3-server[1155]: 2026/09/22 11:23:56 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5750worker1 # [ 141.076737] nix-grpc-daemon[1362]: time=2026-09-22T11:23:56.712Z level=INFO msg="Upload complete. (339ms)"5751lb # [ 141.145255] niks3-server[1155]: 2026/09/22 11:23:56 INFO Completed upload id=445752lb # [ 141.148535] niks3-server[1155]: 2026/09/22 11:23:56 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo5753worker1 # [ 141.107035] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50654 duration_s=2 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=15754worker1 # [ 141.124503] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:56Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=05755worker1 # [ 141.130902] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:56Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=15756worker1 # [ 141.135123] nix-daemon[932]: reaped child process 1385, status = succeeded5757worker1 # [ 141.150688] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:506545758worker1 # [ 141.167670] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:506545759worker1 # [ 141.187175] nix-grpc-daemon[1362]: time=2026-09-22T11:23:56.823Z level=INFO msg="All 1 paths already cached"5760client # copying 1 paths to 'lb:50051'...5761client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...5762worker1 # [ 141.200153] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:506545763worker1 # [ 141.215361] nix-daemon[932]: accepted connection from pid 1289, user nix-grpc-daemon (trusted)5764worker1 # [ 141.432766] nix-daemon[932]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)5765worker1 # [ 141.455686] nix-daemon[932]: reaped child process 1415, status = succeeded5766worker1 # [ 141.637372] nix-daemon[932]: accepted connection from pid 1417, user nix-grpc-daemon (trusted)5767worker1 # [ 141.658248] nix-daemon[932]: reaped child process 1420, status = succeeded5768lb # [ 141.735752] niks3-server[1155]: 2026/09/22 11:23:57 INFO Received uploads request method=POST path=/api/pending_closures5769worker1 # [ 141.680906] nix-grpc-daemon[1362]: time=2026-09-22T11:23:57.316Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5770worker1 # [ 141.682477] nix-grpc-daemon[1362]: time=2026-09-22T11:23:57.316Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"5771lb # [ 141.769389] niks3-server[1155]: 2026/09/22 11:23:57 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst5772worker1 # [ 141.718851] nix-grpc-daemon[1362]: time=2026-09-22T11:23:57.354Z level=INFO msg="Uploading 1 narinfos"5773lb # [ 141.785926] niks3-server[1155]: 2026/09/22 11:23:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5774lb # [ 141.794890] niks3-server[1155]: 2026/09/22 11:23:57 INFO Signed narinfos id=45 count=15775lb # [ 141.800705] niks3-server[1155]: 2026/09/22 11:23:57 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls5776lb # [ 141.810206] niks3-server[1155]: 2026/09/22 11:23:57 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5777lb # [ 141.819040] niks3-server[1155]: 2026/09/22 11:23:57 INFO Completed upload id=455778worker1 # [ 141.752903] nix-grpc-daemon[1362]: time=2026-09-22T11:23:57.388Z level=INFO msg="Upload complete. (519ms)"5779lb # [ 141.822131] niks3-server[1155]: 2026/09/22 11:23:57 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo5780worker1 # [ 141.764081] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50654 duration_s=0 paths=1 nar_bytes_in=6405781lb # [ 141.839079] envoy[913]: conn peer=[2001:db8:1::1]:40954 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9753 tx=4472 ms=78065782lb # [ 141.843864] envoy[913]: conn peer=[2001:db8:1::4]:59114 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=1665 tx=425 ms=178395783worker1 # [ 141.779312] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:506545784worker1 # [ 141.786285] nix-daemon[932]: accepted connection from pid 1289, user nix-grpc-daemon (trusted)5785worker1 # [ 141.791471] nix-daemon[932]: reaped child process 1410, status = succeeded5786client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...5787client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5788worker1 # [ 141.807489] nix-daemon[932]: accepted connection from pid 1289, user nix-grpc-daemon (trusted)5789client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds5790client # farm-b> LOG-farm-b-on-standby5791worker1 # [ 142.853013] nix-daemon[932]: reaped child process 1424, status = succeeded5792worker1 # [ 143.043523] nix-daemon[932]: accepted connection from pid 1440, user nix-grpc-daemon (trusted)5793worker1 # [ 143.063904] nix-daemon[932]: reaped child process 1443, status = succeeded5794lb # [ 143.146176] niks3-server[1155]: 2026/09/22 11:23:58 INFO Received uploads request method=POST path=/api/pending_closures5795worker1 # [ 143.088333] nix-grpc-daemon[1362]: time=2026-09-22T11:23:58.723Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5796worker1 # [ 143.092287] nix-grpc-daemon[1362]: time=2026-09-22T11:23:58.727Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"5797lb # [ 143.185160] niks3-server[1155]: 2026/09/22 11:23:58 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5798lb # [ 143.198468] niks3-server[1155]: 2026/09/22 11:23:58 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst5799worker1 # [ 143.149572] nix-grpc-daemon[1362]: time=2026-09-22T11:23:58.785Z level=INFO msg="Uploading 1 narinfos"5800lb # [ 143.209680] niks3-server[1155]: 2026/09/22 11:23:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5801lb # [ 143.219364] niks3-server[1155]: 2026/09/22 11:23:58 INFO Signed narinfos id=46 count=15802lb # [ 143.224766] niks3-server[1155]: 2026/09/22 11:23:58 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls5803lb # [ 143.235956] niks3-server[1155]: 2026/09/22 11:23:58 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5804lb # [ 143.241823] niks3-server[1155]: 2026/09/22 11:23:58 INFO Completed upload id=465805worker1 # [ 143.175466] nix-grpc-daemon[1362]: time=2026-09-22T11:23:58.811Z level=INFO msg="Upload complete. (356ms)"5806lb # [ 143.245034] niks3-server[1155]: 2026/09/22 11:23:58 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo5807worker1 # [ 143.189087] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50654 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=15808worker1 # [ 143.207705] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:58Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=05809worker1 # [ 143.211371] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:58Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=15810worker1 # [ 143.215482] nix-daemon[932]: reaped child process 1422, status = succeeded5811worker1 # [ 143.242738] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:506545812worker1 # [ 143.260003] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:506545813worker1 # [ 143.273421] nix-grpc-daemon[1362]: time=2026-09-22T11:23:58.909Z level=INFO msg="All 2 paths already cached"5814client # copying 1 paths to 'lb:50051'...5815client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...5816worker1 # [ 143.282665] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:506545817worker1 # [ 143.297459] nix-daemon[932]: accepted connection from pid 1289, user nix-grpc-daemon (trusted)5818worker1 # [ 143.508300] nix-daemon[932]: accepted connection from pid 1449, user nix-grpc-daemon (trusted)5819worker1 # [ 143.532347] nix-daemon[932]: reaped child process 1452, status = succeeded5820worker1 # [ 143.733295] nix-daemon[932]: accepted connection from pid 1454, user nix-grpc-daemon (trusted)5821worker1 # [ 143.753590] nix-daemon[932]: reaped child process 1457, status = succeeded5822lb # [ 143.831392] niks3-server[1155]: 2026/09/22 11:23:59 INFO Received uploads request method=POST path=/api/pending_closures5823worker1 # [ 143.776164] nix-grpc-daemon[1362]: time=2026-09-22T11:23:59.412Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5824worker1 # [ 143.777710] nix-grpc-daemon[1362]: time=2026-09-22T11:23:59.412Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"5825lb # [ 143.869091] niks3-server[1155]: 2026/09/22 11:23:59 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst5826lb # [ 143.878572] niks3-server[1155]: 2026/09/22 11:23:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5827worker1 # [ 143.818642] nix-grpc-daemon[1362]: time=2026-09-22T11:23:59.454Z level=INFO msg="Uploading 1 narinfos"5828lb # [ 143.893923] niks3-server[1155]: 2026/09/22 11:23:59 INFO Signed narinfos id=47 count=15829lb # [ 143.901194] niks3-server[1155]: 2026/09/22 11:23:59 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls5830lb # [ 143.908117] niks3-server[1155]: 2026/09/22 11:23:59 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5831lb # [ 143.919085] niks3-server[1155]: 2026/09/22 11:23:59 INFO Completed upload id=475832worker1 # [ 143.851973] nix-grpc-daemon[1362]: time=2026-09-22T11:23:59.488Z level=INFO msg="Upload complete. (536ms)"5833lb # [ 143.922936] niks3-server[1155]: 2026/09/22 11:23:59 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo5834worker1 # [ 143.865099] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50654 duration_s=0 paths=1 nar_bytes_in=7685835worker1 # [ 143.880875] nix-grpc-daemon[1289]: ts=2026-09-22T11:23:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:506545836worker1 # [ 143.887303] nix-daemon[932]: accepted connection from pid 1289, user nix-grpc-daemon (trusted)5837worker1 # [ 143.893099] nix-daemon[932]: reaped child process 1447, status = succeeded5838client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...5839client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5840worker1 # [ 143.908896] nix-daemon[932]: accepted connection from pid 1289, user nix-grpc-daemon (trusted)5841client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds5842client # farm-top> LOG-farm-top-on-standby5843worker1 # [ 144.753428] nix-daemon[932]: reaped child process 1461, status = succeeded5844worker1 # [ 144.944498] nix-daemon[932]: accepted connection from pid 1477, user nix-grpc-daemon (trusted)5845worker1 # [ 144.966553] nix-daemon[932]: reaped child process 1480, status = succeeded5846lb # [ 145.046095] niks3-server[1155]: 2026/09/22 11:24:00 INFO Received uploads request method=POST path=/api/pending_closures5847worker1 # [ 144.992606] nix-grpc-daemon[1362]: time=2026-09-22T11:24:00.628Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5848worker1 # [ 144.997209] nix-grpc-daemon[1362]: time=2026-09-22T11:24:00.631Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"5849lb # [ 145.096197] niks3-server[1155]: 2026/09/22 11:24:00 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst5850worker1 # [ 145.040810] nix-grpc-daemon[1362]: time=2026-09-22T11:24:00.676Z level=INFO msg="Uploading 1 narinfos"5851lb # [ 145.108187] niks3-server[1155]: 2026/09/22 11:24:00 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5852lb # [ 145.119415] niks3-server[1155]: 2026/09/22 11:24:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5853lb # [ 145.126966] niks3-server[1155]: 2026/09/22 11:24:00 INFO Signed narinfos id=48 count=15854lb # [ 145.135470] niks3-server[1155]: 2026/09/22 11:24:00 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls5855lb # [ 145.139575] niks3-server[1155]: 2026/09/22 11:24:00 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5856lb # [ 145.145211] niks3-server[1155]: 2026/09/22 11:24:00 INFO Completed upload id=485857worker1 # [ 145.077837] nix-grpc-daemon[1362]: time=2026-09-22T11:24:00.713Z level=INFO msg="Upload complete. (357ms)"5858lb # [ 145.148239] niks3-server[1155]: 2026/09/22 11:24:00 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo5859worker1 # [ 145.093261] nix-grpc-daemon[1289]: ts=2026-09-22T11:24:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50654 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=15860worker1 # [ 145.112303] nix-daemon[932]: reaped child process 1459, status = succeeded5861client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 7.32 seconds)5862client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath5863client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.25 seconds)5864worker2 # [ 145.467879] systemd[1]: Listening on Nix worker-protocol over gRPC.5865worker2 # [ 145.479267] systemd[1]: Starting scheduler-token.service...5866worker2 # [ 145.583621] systemd[1]: scheduler-token.service: Deactivated successfully.5867worker2 # [ 145.588714] systemd[1]: Finished scheduler-token.service.5868worker2 # [ 145.589869] systemd[1]: scheduler-token.service: Consumed 43ms CPU time over 107ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5869worker2 # [ 145.597191] systemd[1]: Starting Nix worker-protocol over gRPC...5870worker2 # [ 145.783804] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:01Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5871worker2 # [ 145.786606] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:01Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5872worker2 # [ 145.790939] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:01Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15873worker2 # [ 145.800120] nix-grpc-daemon[1599]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5874worker2 # [ 145.801652] nix-grpc-daemon[1599]: E0000 00:00:1790076241.428829 1599 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5875worker2 # [ 145.803981] nix-grpc-daemon[1599]: E0000 00:00:1790076241.431231 1599 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5876worker2 # [ 145.823643] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:01Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5877worker2 # [ 145.828313] systemd[1]: Started Nix worker-protocol over gRPC.5878worker2 # [ 145.832455] nix-grpc-daemon[1599]: E0000 00:00:1790076241.461472 1638 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5879lb: must succeed: curl -sf localhost:9901/clusters5880worker2 # [ 145.860106] nix-grpc-daemon[1599]: E0000 00:00:1790076241.480442 1638 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5881worker2 # [ 145.862618] nix-grpc-daemon[1599]: E0000 00:00:1790076241.480679 1638 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5882worker2 # [ 145.871010] nix-grpc-daemon[1599]: E0000 00:00:1790076241.501142 1638 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5883worker2 # [ 145.887731] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:01Z level=info event=scheduler_connected addr=lb:500515884worker1 # [ 145.921430] nix-grpc-daemon[1289]: ts=2026-09-22T11:24:01Z level=info event=oidc_jwks provider=mock keys=15885worker1 # [ 145.928165] nix-grpc-daemon[1289]: ts=2026-09-22T11:24:01Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:491145886worker1 # [ 145.933715] nix-grpc-daemon[1289]: ts=2026-09-22T11:24:01Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05887lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5888worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5889worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5890lb: must succeed: curl -sf localhost:9901/clusters5891lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5892lb: must succeed: curl -sf localhost:9901/clusters5893lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5894worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5895worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5896(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.08 seconds)5897subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5898client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs5899client # [ 146.296181] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.5900client # Running as unit: rs.service; invocation ID: a17693cb2a764c30b9295471a3a5bbf65901client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.09 seconds)5902worker2 # [ 146.578102] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:527345903worker2 # [ 146.593509] nix-daemon[863]: accepted connection from pid 1599, user nix-grpc-daemon (trusted)5904client # [ 146.613684] nix[1347]: don't know how to build these paths:5905client # [ 146.615969] nix[1347]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5906worker1 # [ 146.650737] nix-grpc-daemon[1289]: ts=2026-09-22T11:24:02Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=05907worker1 # [ 146.651139] nix-grpc-daemon[1289]: ts=2026-09-22T11:24:02Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=15908worker1 # [ 146.695804] nix-grpc-daemon[1289]: ts=2026-09-22T11:24:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:506545909worker1 # [ 146.712876] nix-grpc-daemon[1289]: ts=2026-09-22T11:24:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:506545910client # [ 146.704159] nix[1347]: copying 1 paths to 'lb:50051'...5911client # [ 146.709903] nix[1347]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...5912worker1 # [ 146.731876] nix-grpc-daemon[1289]: ts=2026-09-22T11:24:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:506545913worker1 # [ 146.748574] nix-daemon[932]: accepted connection from pid 1289, user nix-grpc-daemon (trusted)5914worker1 # [ 146.968184] nix-daemon[932]: accepted connection from pid 1493, user nix-grpc-daemon (trusted)5915worker1 # [ 146.990055] nix-daemon[932]: reaped child process 1496, status = succeeded5916worker1 # [ 147.174526] nix-daemon[932]: accepted connection from pid 1498, user nix-grpc-daemon (trusted)5917worker1 # [ 147.194104] nix-daemon[932]: reaped child process 1501, status = succeeded5918lb # [ 147.274012] niks3-server[1155]: 2026/09/22 11:24:02 INFO Received uploads request method=POST path=/api/pending_closures5919worker1 # [ 147.219300] nix-grpc-daemon[1362]: time=2026-09-22T11:24:02.854Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5920worker1 # [ 147.220964] nix-grpc-daemon[1362]: time=2026-09-22T11:24:02.854Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"5921lb # [ 147.310698] niks3-server[1155]: 2026/09/22 11:24:02 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst5922worker1 # [ 147.264049] nix-grpc-daemon[1362]: time=2026-09-22T11:24:02.899Z level=INFO msg="Uploading 1 narinfos"5923lb # [ 147.324434] niks3-server[1155]: 2026/09/22 11:24:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5924lb # [ 147.334754] niks3-server[1155]: 2026/09/22 11:24:02 INFO Signed narinfos id=49 count=15925lb # [ 147.340109] niks3-server[1155]: 2026/09/22 11:24:02 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls5926lb # [ 147.348381] niks3-server[1155]: 2026/09/22 11:24:02 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5927worker1 # [ 147.287653] nix-grpc-daemon[1362]: time=2026-09-22T11:24:02.923Z level=INFO msg="Upload complete. (521ms)"5928lb # [ 147.355974] niks3-server[1155]: 2026/09/22 11:24:02 INFO Completed upload id=495929lb # [ 147.358411] niks3-server[1155]: 2026/09/22 11:24:02 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5930worker1 # [ 147.296397] nix-grpc-daemon[1289]: ts=2026-09-22T11:24:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50654 duration_s=0 paths=1 nar_bytes_in=4165931worker1 # [ 147.312613] nix-grpc-daemon[1289]: ts=2026-09-22T11:24:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:506545932worker1 # [ 147.320559] nix-daemon[932]: accepted connection from pid 1289, user nix-grpc-daemon (trusted)5933worker1 # [ 147.325828] nix-daemon[932]: reaped child process 1491, status = succeeded5934client # [ 147.313689] nix[1347]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5935worker1 # [ 147.339395] nix-daemon[932]: accepted connection from pid 1289, user nix-grpc-daemon (trusted)5936lb: must succeed: curl -sf localhost:9901/clusters5937lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5938lb: must succeed: curl -sf localhost:9901/clusters5939lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5940lb: must succeed: curl -sf localhost:9901/clusters5941lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5942lb: must succeed: curl -sf localhost:9901/clusters5943lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5944worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5945worker2 # [ 149.298659] systemd-journald[275]: Received client request to rotate journal, rotating.5946worker2 # [ 149.323725] systemd-journald[275]: Vacuuming done, freed 0B of archived journals from /var/log/journal/9df0ae23cb36437e8c44d1d90eaf7f3f.5947worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.10 seconds)5948worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5949worker1 # [ 149.403038] systemd[1]: Stopping Nix worker-protocol over gRPC...5950worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.05 seconds)5951client: must succeed: sleep 5.05952worker1 # [ 149.874729] nix-grpc-daemon[1289]: ts=2026-09-22T11:24:05Z level=info event=draining5953lb # [ 151.836683] envoy[913]: conn peer=[2001:db8:1::1]:42862 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9636 tx=4454 ms=69925954client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5955worker1 # [ 154.773998] nix-daemon[932]: reaped child process 1505, status = succeeded5956worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5957worker1 # [ 154.938023] nix-daemon[932]: accepted connection from pid 1546, user nix-grpc-daemon (trusted)5958worker1 # [ 154.958030] nix-daemon[932]: reaped child process 1549, status = succeeded5959lb # [ 155.038333] niks3-server[1155]: 2026/09/22 11:24:10 INFO Received uploads request method=POST path=/api/pending_closures5960worker1 # [ 154.984711] nix-grpc-daemon[1362]: time=2026-09-22T11:24:10.618Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5961worker1 # [ 154.986222] nix-grpc-daemon[1362]: time=2026-09-22T11:24:10.619Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5962lb # [ 155.081233] niks3-server[1155]: 2026/09/22 11:24:10 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5963lb # [ 155.094843] niks3-server[1155]: 2026/09/22 11:24:10 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5964lb # [ 155.103500] niks3-server[1155]: 2026/09/22 11:24:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5965worker1 # [ 155.042869] nix-grpc-daemon[1362]: time=2026-09-22T11:24:10.678Z level=INFO msg="Uploading 1 narinfos"5966lb # [ 155.114125] niks3-server[1155]: 2026/09/22 11:24:10 INFO Signed narinfos id=50 count=15967lb # [ 155.119873] niks3-server[1155]: 2026/09/22 11:24:10 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5968lb # [ 155.128083] niks3-server[1155]: 2026/09/22 11:24:10 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5969lb # [ 155.134811] niks3-server[1155]: 2026/09/22 11:24:10 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5970lb # [ 155.140482] niks3-server[1155]: 2026/09/22 11:24:10 INFO Completed upload id=505971worker1 # [ 155.074140] nix-grpc-daemon[1362]: time=2026-09-22T11:24:10.710Z level=INFO msg="Upload complete. (316ms)"5972worker1 # [ 155.089252] nix-grpc-daemon[1289]: ts=2026-09-22T11:24:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50654 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15973worker1 # [ 155.106106] nix-daemon[932]: reaped child process 1503, status = succeeded5974client # [ 155.105824] systemd[1]: rs.service: Deactivated successfully.5975client # [ 155.110241] systemd[1]: rs.service: Consumed 199ms CPU time over 8.813s wall clock time, 43.2M memory peak, 7.2K incoming IP traffic, 8.4K outgoing IP traffic.5976worker1 # [ 155.877171] nix-grpc-daemon[1289]: ts=2026-09-22T11:24:11Z level=info event=signal_exit5977lb # [ 156.309304] niks3-server[1155]: 2026/09/22 11:24:11 INFO lead: released remote=192.168.1.3:448825978worker2 # [ 157.219786] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:12Z level=info event=scheduler_restarting addr=lb:500515979worker1 # [ 157.247451] nix-grpc-daemon[1289]: ts=2026-09-22T11:24:12Z level=info event=scheduler_restarting5980worker1 # [ 157.252608] nix-grpc-daemon[1289]: ts=2026-09-22T11:24:12Z level=info event=scheduler_restarting addr=lb:500515981worker1 # [ 157.257002] nix-grpc-daemon[1289]: ts=2026-09-22T11:24:12Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:491145982worker1 # [ 157.262002] nix-grpc-daemon[1289]: ts=2026-09-22T11:24:12Z level=info event=worker_gone addr=192.168.1.4:500515983worker1 # [ 157.266593] nix-grpc-daemon[1289]: ts=2026-09-22T11:24:12Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:491145984worker1 # [ 157.271512] nix-grpc-daemon[1289]: ts=2026-09-22T11:24:12Z level=info event=worker_gone addr=192.168.1.3:500515985worker1 # [ 157.295980] nix-daemon[932]: reaped child process 1341, status = succeeded5986worker1 # [ 157.354064] nix-grpc-daemon[1289]: E0000 00:00:1790076252.989774 1334 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true5987worker1 # [ 157.360726] nix-grpc-daemon[1289]: E0000 00:00:1790076252.990127 1334 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5988worker2 # [ 157.419924] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:13Z level=info event=scheduler_connected addr=lb:500515989worker2 # [ 157.425483] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5990worker1 # [ 157.467244] nix-grpc-daemon[1289]: ts=2026-09-22T11:24:13Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5991worker2 # [ 157.626626] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:13Z level=info event=scheduler_connected addr=lb:500515992worker2 # [ 157.631903] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5993worker2 # [ 157.832930] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:13Z level=info event=scheduler_connected addr=lb:500515994worker2 # [ 157.838070] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5995worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 3.28 seconds)5996client: waiting for success: ! systemctl is-active rs5997worker2 # [ 158.039091] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:13Z level=info event=scheduler_connected addr=lb:500515998worker2 # [ 158.042482] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5999worker1 # [ 158.079629] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6000worker1 # [ 158.086861] systemd[1]: Stopped Nix worker-protocol over gRPC.6001worker1 # [ 158.092751] systemd[1]: nix-grpc-daemon.service: Consumed 1.997s CPU time over 34.448s wall clock time, 37.2M memory peak, 44.4K incoming IP traffic, 85.4K outgoing IP traffic.6002worker1 # [ 158.105723] systemd[1]: Starting Nix worker-protocol over gRPC...6003client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds)6004client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }6005client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.06 seconds)6006client: must fail: journalctl -u rs | grep -q 'reconnecting'6007client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.04 seconds)6008lb: must succeed: curl -sf localhost:9901/clusters6009worker2 # [ 158.245011] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:13Z level=info event=scheduler_connected addr=lb:500516010worker2 # [ 158.250140] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6011worker1 # [ 158.303488] nix-grpc-daemon[1556]: ts=2026-09-22T11:24:13Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6012worker1 # [ 158.306168] nix-grpc-daemon[1556]: ts=2026-09-22T11:24:13Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6013lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)6014worker1 # [ 158.310218] nix-grpc-daemon[1556]: ts=2026-09-22T11:24:13Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=16015worker1 # [ 158.318701] nix-grpc-daemon[1556]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6016worker1 # [ 158.323093] nix-grpc-daemon[1556]: E0000 00:00:1790076253.952606 1556 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6017worker1 # [ 158.326552] nix-grpc-daemon[1556]: E0000 00:00:1790076253.954738 1556 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6018worker1 # [ 158.330464] nix-grpc-daemon[1556]: ts=2026-09-22T11:24:13Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6019worker1 # [ 158.332962] systemd[1]: Started Nix worker-protocol over gRPC.6020worker1 # [ 158.334904] nix-grpc-daemon[1556]: ts=2026-09-22T11:24:13Z level=info event=scheduler_take_over6021lb # [ 158.403047] niks3-server[1155]: 2026/09/22 11:24:14 INFO lead: acquired remote=192.168.1.3:585366022worker1 # [ 158.339355] nix-grpc-daemon[1556]: E0000 00:00:1790076253.973981 1595 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6023worker1 # [ 158.368151] nix-grpc-daemon[1556]: E0000 00:00:1790076253.991639 1595 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6024worker1 # [ 158.370461] nix-grpc-daemon[1556]: E0000 00:00:1790076253.991806 1595 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6025worker1 # [ 158.375869] nix-grpc-daemon[1556]: E0000 00:00:1790076254.011009 1595 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6026worker1 # [ 158.389474] nix-grpc-daemon[1556]: ts=2026-09-22T11:24:14Z level=info event=scheduler_connected addr=lb:500516027worker1 # [ 158.391078] nix-grpc-daemon[1556]: ts=2026-09-22T11:24:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6028worker2 # [ 158.451227] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:14Z level=info event=scheduler_connected addr=lb:500516029worker2 # [ 158.456455] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6030worker1 # [ 158.592507] nix-grpc-daemon[1556]: ts=2026-09-22T11:24:14Z level=info event=scheduler_connected addr=lb:500516031worker1 # [ 158.597453] nix-grpc-daemon[1556]: ts=2026-09-22T11:24:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6032worker2 # [ 158.657617] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:14Z level=info event=scheduler_connected addr=lb:500516033worker2 # [ 158.662732] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6034worker1 # [ 158.798195] nix-grpc-daemon[1556]: ts=2026-09-22T11:24:14Z level=info event=scheduler_connected addr=lb:500516035worker1 # [ 158.803498] nix-grpc-daemon[1556]: ts=2026-09-22T11:24:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6036worker2 # [ 158.863788] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:14Z level=info event=scheduler_connected addr=lb:500516037worker2 # [ 158.869043] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6038worker1 # [ 159.004438] nix-grpc-daemon[1556]: ts=2026-09-22T11:24:14Z level=info event=scheduler_connected addr=lb:500516039worker1 # [ 159.009546] nix-grpc-daemon[1556]: ts=2026-09-22T11:24:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6040worker2 # [ 159.070087] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:14Z level=info event=scheduler_connected addr=lb:500516041worker1 # [ 159.107561] nix-grpc-daemon[1556]: ts=2026-09-22T11:24:14Z level=info event=oidc_jwks provider=mock keys=16042worker1 # [ 159.112206] nix-grpc-daemon[1556]: ts=2026-09-22T11:24:14Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:599606043worker1 # [ 159.117525] nix-grpc-daemon[1556]: ts=2026-09-22T11:24:14Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=06044worker1 # [ 159.210356] nix-grpc-daemon[1556]: ts=2026-09-22T11:24:14Z level=info event=scheduler_connected addr=lb:500516045worker1 # [ 159.216933] nix-grpc-daemon[1556]: ts=2026-09-22T11:24:14Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:599606046worker1 # [ 159.222408] nix-grpc-daemon[1556]: ts=2026-09-22T11:24:14Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=06047lb: must succeed: curl -sf localhost:9901/clusters6048lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.12 seconds)6049worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6050worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)6051(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.26 seconds)6052subtest: scheduler restart mid-build: build finishes, no double build6053client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid6054client # [ 159.554015] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.6055client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.09 seconds)6056worker1 # [ 159.837229] nix-grpc-daemon[1556]: ts=2026-09-22T11:24:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:599726057worker1 # [ 159.852879] nix-daemon[932]: accepted connection from pid 1556, user nix-grpc-daemon (trusted)6058client # Running as unit: mid.service; invocation ID: 3a6431b2728c4ae0a738f299476c04e56059client # [ 159.848518] nix[1383]: don't know how to build these paths:6060client # [ 159.852419] nix[1383]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv6061worker1 # [ 159.887820] nix-grpc-daemon[1556]: ts=2026-09-22T11:24:15Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=06062worker1 # [ 159.894782] nix-grpc-daemon[1556]: ts=2026-09-22T11:24:15Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=16063worker2 # [ 159.923472] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:527346064worker2 # [ 159.939092] nix-grpc-daemon[1599]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 50 ms (attempt 1/5)6065worker2 # [ 159.989327] nix-grpc-daemon[1599]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 124 ms (attempt 2/5)6066worker2 # [ 160.120996] nix-grpc-daemon[1599]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 280 ms (attempt 3/5)6067worker2 # [ 160.408671] nix-grpc-daemon[1599]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 380 ms (attempt 4/5)6068worker2 # [ 160.798735] nix-grpc-daemon[1599]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6069worker2 # [ 160.804598] nix-grpc-daemon[1599]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6070worker2 # [ 160.820715] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:527346071client # [ 160.836241] nix[1383]: copying 1 paths to 'lb:50051'...6072client # [ 160.839533] nix[1383]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...6073worker2 # [ 160.835803] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:527346074worker2 # [ 160.856823] nix-daemon[863]: accepted connection from pid 1599, user nix-grpc-daemon (trusted)6075worker2 # [ 160.892353] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:16Z level=info event=niks3_push_started pid=17236076worker2 # [ 161.117434] nix-grpc-daemon[1723]: time=2026-09-22T11:24:16.748Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca=""6077worker2 # [ 161.298267] nix-daemon[863]: accepted connection from pid 1736, user nix-grpc-daemon (trusted)6078worker2 # [ 161.316407] nix-daemon[863]: reaped child process 1739, status = succeeded6079worker2 # [ 161.496082] nix-daemon[863]: accepted connection from pid 1741, user nix-grpc-daemon (trusted)6080worker2 # [ 161.512168] nix-daemon[863]: reaped child process 1744, status = succeeded6081lb # [ 161.619208] niks3-server[1155]: 2026/09/22 11:24:17 INFO Received uploads request method=POST path=/api/pending_closures6082worker2 # [ 161.541949] nix-grpc-daemon[1723]: time=2026-09-22T11:24:17.171Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6083worker2 # [ 161.543474] nix-grpc-daemon[1723]: time=2026-09-22T11:24:17.171Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"6084lb # [ 161.661556] niks3-server[1155]: 2026/09/22 11:24:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6085lb # [ 161.677262] niks3-server[1155]: 2026/09/22 11:24:17 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst6086lb # [ 161.693240] niks3-server[1155]: 2026/09/22 11:24:17 INFO Signed narinfos id=51 count=16087worker2 # [ 161.603286] nix-grpc-daemon[1723]: time=2026-09-22T11:24:17.233Z level=INFO msg="Uploading 1 narinfos"6088lb # [ 161.705945] niks3-server[1155]: 2026/09/22 11:24:17 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6089lb # [ 161.713147] niks3-server[1155]: 2026/09/22 11:24:17 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls6090lb # [ 161.719361] niks3-server[1155]: 2026/09/22 11:24:17 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo6091lb # [ 161.724907] niks3-server[1155]: 2026/09/22 11:24:17 INFO Completed upload id=516092worker2 # [ 161.634635] nix-grpc-daemon[1723]: time=2026-09-22T11:24:17.265Z level=INFO msg="Upload complete. (512ms)"6093worker2 # [ 161.647261] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52734 duration_s=0 paths=1 nar_bytes_in=4246094worker2 # [ 161.664760] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:527346095worker2 # [ 161.672681] nix-daemon[863]: accepted connection from pid 1599, user nix-grpc-daemon (trusted)6096worker2 # [ 161.677913] nix-daemon[863]: reaped child process 1720, status = succeeded6097client # [ 161.690851] nix[1383]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...6098worker2 # [ 161.691626] nix-daemon[863]: accepted connection from pid 1599, user nix-grpc-daemon (trusted)6099lb # [ 161.840995] envoy[913]: conn peer=[2001:db8:1::1]:40336 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2979 tx=1517 ms=85016100lb # [ 161.844736] envoy[913]: conn peer=[2001:db8:1::3]:42108 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1455 tx=580 ms=335296101lb: must succeed: curl -sf localhost:9901/clusters6102lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)6103lb: must succeed: curl -sf localhost:9901/clusters6104lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)6105worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service6106worker1 # [ 163.653813] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1556 (nix-grpc-daemon) on client request.6107lb # [ 163.730599] niks3-server[1155]: 2026/09/22 11:24:19 INFO lead: released remote=192.168.1.3:585366108worker1 # [ 163.665062] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.6109worker2 # [ 163.652394] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:19Z level=info event=scheduler_disconnected addr=lb:50051 error="Stream removed (RST_STREAM (Received RST_STREAM with error code 2))"6110client # [ 163.655496] nix[1383]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting6111worker1 # [ 163.703183] nix-daemon[932]: reaped child process 1615, status = succeeded6112worker1 # [ 163.708531] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL6113worker1 # [ 163.714819] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.6114worker1 # [ 163.719900] systemd[1]: nix-grpc-daemon.service: Consumed 227ms CPU time over 5.606s wall clock time, 14.4M memory peak, 9.4K incoming IP traffic, 11.7K outgoing IP traffic.6115worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.13 seconds)6116client: must succeed: sleep 5.06117worker2 # [ 163.852652] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:19Z level=info event=scheduler_connected addr=lb:500516118worker1 # [ 163.880888] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.6119worker1 # [ 163.893500] systemd[1]: Starting Nix worker-protocol over gRPC...6120worker1 # [ 164.097813] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:19Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6121worker1 # [ 164.100374] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:19Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6122worker1 # [ 164.104368] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:19Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=16123worker1 # [ 164.111458] nix-grpc-daemon[1643]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6124worker1 # [ 164.127704] nix-grpc-daemon[1643]: E0000 00:00:1790076259.746837 1643 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6125worker1 # [ 164.130776] nix-grpc-daemon[1643]: E0000 00:00:1790076259.750539 1643 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6126lb # [ 164.197368] niks3-server[1155]: 2026/09/22 11:24:19 INFO lead: acquired remote=192.168.1.3:434346127worker1 # [ 164.133410] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:19Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6128worker1 # [ 164.135894] systemd[1]: Started Nix worker-protocol over gRPC.6129worker1 # [ 164.164255] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:19Z level=info event=scheduler_take_over6130worker1 # [ 164.165413] nix-grpc-daemon[1643]: E0000 00:00:1790076259.773274 1683 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6131worker1 # [ 164.167891] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:19Z level=info event=oidc_jwks provider=mock keys=16132worker1 # [ 164.175969] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:19Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:498626133worker1 # [ 164.178252] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:19Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=16134worker1 # [ 164.180173] nix-grpc-daemon[1643]: E0000 00:00:1790076259.791745 1683 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6135worker1 # [ 164.182397] nix-grpc-daemon[1643]: E0000 00:00:1790076259.791870 1683 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6136client # [ 164.162925] nix[1383]: scheduler at lb:50051: no healthy upstream, reconnecting6137worker1 # [ 164.187509] nix-grpc-daemon[1643]: E0000 00:00:1790076259.811517 1683 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6138worker1 # [ 164.191832] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:19Z level=info event=scheduler_connected addr=lb:500516139worker1 # [ 164.193252] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6140worker1 # [ 164.392838] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:20Z level=info event=scheduler_connected addr=lb:500516141worker1 # [ 164.398007] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6142worker1 # [ 164.598594] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:20Z level=info event=scheduler_connected addr=lb:500516143worker1 # [ 164.603673] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6144worker1 # [ 164.804488] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:20Z level=info event=scheduler_connected addr=lb:500516145worker1 # [ 164.809471] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6146worker1 # [ 165.010177] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:20Z level=info event=scheduler_connected addr=lb:500516147worker1 # [ 165.015249] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6148client # [ 165.166571] nix[1383]: scheduler at lb:50051: no healthy upstream, reconnecting6149worker1 # [ 165.217763] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:20Z level=info event=scheduler_connected addr=lb:500516150worker1 # [ 165.221938] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6151worker1 # [ 165.418068] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:21Z level=info event=scheduler_connected addr=lb:500516152worker1 # [ 165.423388] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6153worker1 # [ 165.624267] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:21Z level=info event=scheduler_connected addr=lb:500516154worker1 # [ 165.629584] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6155worker1 # [ 165.830378] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:21Z level=info event=scheduler_connected addr=lb:500516156worker1 # [ 165.835749] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6157worker1 # [ 166.036617] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:21Z level=info event=scheduler_connected addr=lb:500516158worker1 # [ 166.041879] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6159worker1 # [ 166.245678] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:21Z level=info event=scheduler_connected addr=lb:500516160worker1 # [ 166.250021] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:21Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:498626161worker1 # [ 166.254950] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:21Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=06162client: (finished: must succeed: sleep 5.0, in 5.06 seconds)6163client: waiting for success: ! systemctl is-active mid6164worker2 # [ 169.117880] nix-daemon[863]: reaped child process 1748, status = succeeded6165worker2 # [ 169.284409] nix-daemon[863]: accepted connection from pid 1785, user nix-grpc-daemon (trusted)6166worker2 # [ 169.304228] nix-daemon[863]: reaped child process 1788, status = succeeded6167lb # [ 169.410269] niks3-server[1155]: 2026/09/22 11:24:25 INFO Received uploads request method=POST path=/api/pending_closures6168worker2 # [ 169.332573] nix-grpc-daemon[1723]: time=2026-09-22T11:24:24.962Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6169worker2 # [ 169.337477] nix-grpc-daemon[1723]: time=2026-09-22T11:24:24.962Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"6170lb # [ 169.461470] niks3-server[1155]: 2026/09/22 11:24:25 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst6171lb # [ 169.472845] niks3-server[1155]: 2026/09/22 11:24:25 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv6172worker2 # [ 169.391806] nix-grpc-daemon[1723]: time=2026-09-22T11:24:25.021Z level=INFO msg="Uploading 1 narinfos"6173lb # [ 169.483689] niks3-server[1155]: 2026/09/22 11:24:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6174lb # [ 169.490339] niks3-server[1155]: 2026/09/22 11:24:25 INFO Signed narinfos id=52 count=16175lb # [ 169.493655] niks3-server[1155]: 2026/09/22 11:24:25 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls6176lb # [ 169.501377] niks3-server[1155]: 2026/09/22 11:24:25 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6177lb # [ 169.505552] niks3-server[1155]: 2026/09/22 11:24:25 INFO Completed upload id=526178worker2 # [ 169.413963] nix-grpc-daemon[1723]: time=2026-09-22T11:24:25.045Z level=INFO msg="Upload complete. (306ms)"6179lb # [ 169.507948] niks3-server[1155]: 2026/09/22 11:24:25 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo6180worker2 # [ 169.425046] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52734 duration_s=7 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=16181worker2 # [ 169.441275] nix-daemon[863]: reaped child process 1746, status = succeeded6182client # [ 169.471857] systemd[1]: mid.service: Deactivated successfully.6183client # [ 169.476094] systemd[1]: mid.service: Consumed 193ms CPU time over 9.921s wall clock time, 41.2M memory peak, 8.1K incoming IP traffic, 9.2K outgoing IP traffic.6184client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds)6185client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }6186client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds)6187(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.79 seconds)6188subtest: interrupting the client stops the build on the worker6189client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr6190client # [ 170.320798] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.6191client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds)6192client # Running as unit: intr.service; invocation ID: e9c8ae132edd4fc09173483654e4c83b6193client # [ 170.557353] nix[1419]: don't know how to build these paths:6194client # [ 170.559167] nix[1419]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv6195worker2 # [ 170.554539] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:26Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:527346196worker1 # [ 170.589352] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:26Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=06197worker1 # [ 170.596856] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:26Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.3:50051 clients=16198worker1 # [ 170.646751] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499006199worker1 # [ 170.661517] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6200worker1 # [ 170.685583] nix-grpc-daemon[1643]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 37 ms (attempt 1/5)6201worker1 # [ 170.729439] nix-grpc-daemon[1643]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 182 ms (attempt 2/5)6202worker1 # [ 170.918956] nix-grpc-daemon[1643]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 350 ms (attempt 3/5)6203worker1 # [ 171.276691] nix-grpc-daemon[1643]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 564 ms (attempt 4/5)6204lb # [ 171.843567] envoy[913]: conn peer=[2001:db8:1::3]:38546 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=972 tx=385 ms=52966205lb # [ 171.848968] envoy[913]: conn peer=[2001:db8:1::1]:48836 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3215 tx=1755 ms=96326206worker1 # [ 171.849561] nix-grpc-daemon[1643]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6207worker1 # [ 171.856375] nix-grpc-daemon[1643]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6208worker1 # [ 171.875079] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:499006209client # [ 171.869234] nix[1419]: copying 1 paths to 'lb:50051'...6210worker1 # [ 171.890357] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:499006211client # [ 171.869484] nix[1419]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...6212worker1 # [ 171.905085] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6213worker1 # [ 171.936950] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:27Z level=info event=niks3_push_started pid=17216214worker1 # [ 172.148594] nix-grpc-daemon[1721]: time=2026-09-22T11:24:27.784Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca=""6215worker1 # [ 172.323154] nix-daemon[932]: accepted connection from pid 1734, user nix-grpc-daemon (trusted)6216worker1 # [ 172.339763] nix-daemon[932]: reaped child process 1737, status = succeeded6217worker1 # [ 172.511374] nix-daemon[932]: accepted connection from pid 1739, user nix-grpc-daemon (trusted)6218worker1 # [ 172.527994] nix-daemon[932]: reaped child process 1742, status = succeeded6219lb # [ 172.609657] niks3-server[1155]: 2026/09/22 11:24:28 INFO Received uploads request method=POST path=/api/pending_closures6220worker1 # [ 172.554068] nix-grpc-daemon[1721]: time=2026-09-22T11:24:28.189Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6221worker1 # [ 172.555557] nix-grpc-daemon[1721]: time=2026-09-22T11:24:28.189Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"6222lb # [ 172.645140] niks3-server[1155]: 2026/09/22 11:24:28 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst6223lb # [ 172.654485] niks3-server[1155]: 2026/09/22 11:24:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6224worker1 # [ 172.594210] nix-grpc-daemon[1721]: time=2026-09-22T11:24:28.229Z level=INFO msg="Uploading 1 narinfos"6225lb # [ 172.666716] niks3-server[1155]: 2026/09/22 11:24:28 INFO Signed narinfos id=53 count=16226lb # [ 172.674299] niks3-server[1155]: 2026/09/22 11:24:28 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls6227lb # [ 172.684559] niks3-server[1155]: 2026/09/22 11:24:28 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6228lb # [ 172.695078] niks3-server[1155]: 2026/09/22 11:24:28 INFO Completed upload id=536229worker1 # [ 172.628623] nix-grpc-daemon[1721]: time=2026-09-22T11:24:28.264Z level=INFO msg="Upload complete. (475ms)"6230lb # [ 172.697912] niks3-server[1155]: 2026/09/22 11:24:28 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo6231worker1 # [ 172.636130] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49900 duration_s=0 paths=1 nar_bytes_in=4246232worker1 # [ 172.650578] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499006233worker1 # [ 172.656887] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6234worker1 # [ 172.661400] nix-daemon[932]: reaped child process 1719, status = succeeded6235client # [ 172.648839] nix[1419]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...6236worker1 # [ 172.675038] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6237client: must succeed: systemctl kill -s INT intr6238client # [ 173.992634] systemd[1]: intr.service: Sent signal SIGINT to main process 1419 (nix) on client request.6239worker1 # [ 174.019931] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:29Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv6240client: (finished: must succeed: systemctl kill -s INT intr, in 0.05 seconds)6241client # [ 173.998150] nix[1419]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)6242client # [ 173.999707] nix[1419]: error: interrupted by the user6243client # [ 174.038800] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE6244client # [ 174.047448] systemd[1]: intr.service: Failed with result 'exit-code'.6245client # [ 174.049569] systemd[1]: intr.service: Consumed 157ms CPU time over 3.725s wall clock time, 41.2M memory peak, 6.4K incoming IP traffic, 8.3K outgoing IP traffic.6246worker1 # [ 174.106803] nix-daemon[932]: reaped child process 1744, status = succeeded6247worker1 # [ 174.112815] nix-daemon[1746]: unexpected Nix daemon error: error: interrupted by the user6248worker1 # [ 174.120943] nix-daemon[932]: reaped child process 1746, status = failed with exit code 16249(finished: subtest: interrupting the client stops the build on the worker, in 3.88 seconds)6250subtest: a deploy mid-build drains: the build finishes, the new generation takes over6251client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw6252client # [ 174.226933] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.6253client # Running as unit: sw.service; invocation ID: 36b65589c7f749358e985248eea85d546254client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.09 seconds)6255worker2 # [ 174.488251] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:527346256client # [ 174.495643] nix[1440]: don't know how to build these paths:6257client # [ 174.497414] nix[1440]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv6258worker1 # [ 174.527150] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:30Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=06259worker1 # [ 174.529917] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:30Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.4:50051 clients=16260worker2 # [ 174.549687] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:527346261worker2 # [ 174.566361] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:527346262client # [ 174.583165] nix[1440]: copying 1 paths to 'lb:50051'...6263worker2 # [ 174.581302] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:527346264client # [ 174.585770] nix[1440]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...6265worker2 # [ 174.596192] nix-daemon[863]: accepted connection from pid 1599, user nix-grpc-daemon (trusted)6266worker2 # [ 174.807085] nix-daemon[863]: accepted connection from pid 1816, user nix-grpc-daemon (trusted)6267worker2 # [ 174.825328] nix-daemon[863]: reaped child process 1819, status = succeeded6268worker2 # [ 174.998825] nix-daemon[863]: accepted connection from pid 1821, user nix-grpc-daemon (trusted)6269worker2 # [ 175.016117] nix-daemon[863]: reaped child process 1824, status = succeeded6270lb # [ 175.118977] niks3-server[1155]: 2026/09/22 11:24:30 INFO Received uploads request method=POST path=/api/pending_closures6271worker2 # [ 175.038967] nix-grpc-daemon[1723]: time=2026-09-22T11:24:30.669Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6272worker2 # [ 175.040570] nix-grpc-daemon[1723]: time=2026-09-22T11:24:30.669Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"6273lb # [ 175.139909] niks3-server[1155]: 2026/09/22 11:24:30 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst6274lb # [ 175.148089] niks3-server[1155]: 2026/09/22 11:24:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6275worker2 # [ 175.061190] nix-grpc-daemon[1723]: time=2026-09-22T11:24:30.692Z level=INFO msg="Uploading 1 narinfos"6276lb # [ 175.154925] niks3-server[1155]: 2026/09/22 11:24:30 INFO Signed narinfos id=54 count=16277lb # [ 175.158497] niks3-server[1155]: 2026/09/22 11:24:30 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls6278lb # [ 175.163614] niks3-server[1155]: 2026/09/22 11:24:30 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6279lb # [ 175.168930] niks3-server[1155]: 2026/09/22 11:24:30 INFO Completed upload id=546280worker2 # [ 175.078092] nix-grpc-daemon[1723]: time=2026-09-22T11:24:30.709Z level=INFO msg="Upload complete. (464ms)"6281lb # [ 175.170932] niks3-server[1155]: 2026/09/22 11:24:30 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo6282worker2 # [ 175.084118] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52734 duration_s=0 paths=1 nar_bytes_in=4166283worker2 # [ 175.094171] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:527346284worker2 # [ 175.098976] nix-daemon[863]: accepted connection from pid 1599, user nix-grpc-daemon (trusted)6285worker2 # [ 175.103082] nix-daemon[863]: reaped child process 1814, status = succeeded6286client # [ 175.112343] nix[1440]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...6287worker2 # [ 175.113280] nix-daemon[863]: accepted connection from pid 1599, user nix-grpc-daemon (trusted)6288worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&26289worker2 # Checking switch inhibitors... done6290worker2 # [ 177.763065] nixos[1860]: switching to system configuration /nix/store/v8y5lj3crkzjdn3j25r00rcfv3znf7fr-nixos-system-worker2-test6291worker2 # [ 177.765269] systemd[1]: Stopped target Local File Systems.6292worker2 # activating the configuration...6293worker2 # [ 177.768629] systemd[1]: Stopped target Remote File Systems.6294worker2 # setting up /etc...6295worker2 # [ 178.658918] systemd[1]: Reload requested from client PID 1860 ('.switch-to-conf') (unit backdoor.service)...6296worker2 # [ 178.661431] systemd[1]: Reloading...6297worker2 # [ 179.583556] systemd[1]: Reloading finished in 919 ms.6298worker2 # restarting sysinit-reactivation.target6299worker2 # [ 179.663629] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....6300worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service6301worker2 # [ 179.839081] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..6302worker2 # [ 179.843797] systemd[1]: Reached target Reactivate sysinit units.6303worker2 # [ 179.854633] systemd[1]: Reloading D-Bus System Message Bus...6304worker2 # [ 179.860491] dbus-broker-launch[499]: Caught SIGHUP, trigger reload.6305worker2 # [ 179.861423] systemd[1]: Reloading Nix worker-protocol over gRPC...6306worker2 # [ 179.872594] dbus-broker-launch[499]: Looking up NSS user entry for 'systemd-timesync'...6307worker2 # [ 179.874769] dbus-broker-launch[499]: NSS returned no entry for 'systemd-timesync'6308worker2 # [ 179.880257] dbus-broker-launch[499]: Invalid user-name in /nix/store/602n2r0g7ngz2pj9sxi9qamwpihwymx6-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"6309worker2 # [ 179.905439] systemd[1]: Reloaded Nix worker-protocol over gRPC.6310worker2 # [ 179.924358] systemd[1]: Reloaded D-Bus System Message Bus.6311worker2 # [ 179.931944] systemd[1]: Reached target Remote File Systems.6312worker2 # [ 179.935275] systemd[1]: Starting linger-users.service...6313worker2 # [ 179.946610] systemd[1]: Reached target Local File Systems.6314worker2 # [ 179.954399] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore6315worker2 # [ 179.960154] systemd[1]: Starting Create SUID/SGID Wrappers...6316worker2 # [ 179.968697] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.6317worker2 # [ 179.970008] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc676318worker2 # [ 179.977989] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore6319worker2 # [ 179.982005] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os6320worker2 # [ 179.988369] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os6321worker2 # [ 179.990045] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os6322worker2 # [ 179.992969] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki6323worker2 # [ 180.031257] systemd[1]: linger-users.service: Deactivated successfully.6324worker2 # [ 180.034765] systemd[1]: Finished linger-users.service.6325worker2 # [ 180.491002] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.6326worker2 # [ 180.496183] systemd[1]: Finished Create SUID/SGID Wrappers.6327worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service6328worker2 # [ 180.747458] nixos[1860]: finished switching to system configuration /nix/store/v8y5lj3crkzjdn3j25r00rcfv3znf7fr-nixos-system-worker2-test6329worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 3.90 seconds)6330worker2: must succeed: pgrep -f 'read -t [9]0 x'6331worker2 # [ 180.827900] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:36Z level=info event=draining6332worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds)6333client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&26334client # don't know how to build these paths:6335client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv6336worker1 # [ 181.142043] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:499006337worker1 # [ 181.149281] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:499006338worker1 # [ 181.179562] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:36Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=06339worker1 # [ 181.187413] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:36Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.3:50051 clients=16340worker1 # [ 181.231250] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499006341worker1 # [ 181.245966] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:499006342client # copying 1 paths to 'lb:50051'...6343worker1 # [ 181.256223] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:499006344client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...6345worker1 # [ 181.268428] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6346worker1 # [ 181.454256] nix-daemon[932]: accepted connection from pid 1797, user nix-grpc-daemon (trusted)6347worker1 # [ 181.474472] nix-daemon[932]: reaped child process 1800, status = succeeded6348worker1 # [ 181.655401] nix-daemon[932]: accepted connection from pid 1802, user nix-grpc-daemon (trusted)6349worker1 # [ 181.674498] nix-daemon[932]: reaped child process 1805, status = succeeded6350lb # [ 181.753824] niks3-server[1155]: 2026/09/22 11:24:37 INFO Received uploads request method=POST path=/api/pending_closures6351worker1 # [ 181.698891] nix-grpc-daemon[1721]: time=2026-09-22T11:24:37.333Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6352worker1 # [ 181.700522] nix-grpc-daemon[1721]: time=2026-09-22T11:24:37.334Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"6353lb # [ 181.784429] niks3-server[1155]: 2026/09/22 11:24:37 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst6354lb # [ 181.803092] niks3-server[1155]: 2026/09/22 11:24:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6355worker1 # [ 181.743556] nix-grpc-daemon[1721]: time=2026-09-22T11:24:37.379Z level=INFO msg="Uploading 1 narinfos"6356lb # [ 181.815500] niks3-server[1155]: 2026/09/22 11:24:37 INFO Signed narinfos id=55 count=16357lb # [ 181.822537] niks3-server[1155]: 2026/09/22 11:24:37 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls6358worker1 # [ 181.770596] nix-grpc-daemon[1721]: time=2026-09-22T11:24:37.406Z level=INFO msg="Upload complete. (492ms)"6359lb # [ 181.837700] niks3-server[1155]: 2026/09/22 11:24:37 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6360lb # [ 181.843577] niks3-server[1155]: 2026/09/22 11:24:37 INFO Completed upload id=556361lb # [ 181.847202] niks3-server[1155]: 2026/09/22 11:24:37 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo6362worker1 # [ 181.780928] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49900 duration_s=0 paths=1 nar_bytes_in=5286363lb # [ 181.852506] envoy[913]: conn peer=[2001:db8:1::1]:59616 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2987 tx=874 ms=34586364worker1 # [ 181.791585] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499006365worker1 # [ 181.798752] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6366worker1 # [ 181.803379] nix-daemon[932]: reaped child process 1795, status = succeeded6367client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...6368client # farm-a> node-a: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv6369worker1 # [ 181.814432] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6370client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds6371client # farm-a> LOG-farm-a-during-drain6372worker1 # [ 182.854435] nix-daemon[932]: reaped child process 1809, status = succeeded6373worker1 # [ 183.029509] nix-daemon[932]: accepted connection from pid 1825, user nix-grpc-daemon (trusted)6374worker1 # [ 183.047494] nix-daemon[932]: reaped child process 1828, status = succeeded6375lb # [ 183.130160] niks3-server[1155]: 2026/09/22 11:24:38 INFO Received uploads request method=POST path=/api/pending_closures6376worker1 # [ 183.075704] nix-grpc-daemon[1721]: time=2026-09-22T11:24:38.708Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6377worker1 # [ 183.077861] nix-grpc-daemon[1721]: time=2026-09-22T11:24:38.708Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"6378lb # [ 183.159066] niks3-server[1155]: 2026/09/22 11:24:38 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv6379lb # [ 183.178814] niks3-server[1155]: 2026/09/22 11:24:38 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst6380worker1 # [ 183.124152] nix-grpc-daemon[1721]: time=2026-09-22T11:24:38.759Z level=INFO msg="Uploading 1 narinfos"6381lb # [ 183.191214] niks3-server[1155]: 2026/09/22 11:24:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6382lb # [ 183.199738] niks3-server[1155]: 2026/09/22 11:24:38 INFO Signed narinfos id=56 count=16383lb # [ 183.206227] niks3-server[1155]: 2026/09/22 11:24:38 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls6384lb # [ 183.213976] niks3-server[1155]: 2026/09/22 11:24:38 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6385lb # [ 183.221611] niks3-server[1155]: 2026/09/22 11:24:38 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo6386worker1 # [ 183.160998] nix-grpc-daemon[1721]: time=2026-09-22T11:24:38.797Z level=INFO msg="Upload complete. (334ms)"6387lb # [ 183.227501] niks3-server[1155]: 2026/09/22 11:24:38 INFO Completed upload id=566388worker1 # [ 183.168654] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49900 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=3 outputs=16389worker1 # [ 183.175648] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:38Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=06390worker1 # [ 183.182179] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:38Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.3:50051 clients=16391worker1 # [ 183.184722] nix-daemon[932]: reaped child process 1807, status = succeeded6392worker1 # [ 183.221925] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499006393worker1 # [ 183.235862] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:499006394worker1 # [ 183.249394] nix-grpc-daemon[1721]: time=2026-09-22T11:24:38.885Z level=INFO msg="All 1 paths already cached"6395client # copying 1 paths to 'lb:50051'...6396worker1 # [ 183.258156] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:499006397client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...6398worker1 # [ 183.273017] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6399worker1 # [ 183.469563] nix-daemon[932]: accepted connection from pid 1834, user nix-grpc-daemon (trusted)6400worker1 # [ 183.489869] nix-daemon[932]: reaped child process 1837, status = succeeded6401worker1 # [ 183.672590] nix-daemon[932]: accepted connection from pid 1839, user nix-grpc-daemon (trusted)6402worker1 # [ 183.691706] nix-daemon[932]: reaped child process 1842, status = succeeded6403lb # [ 183.773494] niks3-server[1155]: 2026/09/22 11:24:39 INFO Received uploads request method=POST path=/api/pending_closures6404worker1 # [ 183.720219] nix-grpc-daemon[1721]: time=2026-09-22T11:24:39.355Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6405worker1 # [ 183.721901] nix-grpc-daemon[1721]: time=2026-09-22T11:24:39.355Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"6406lb # [ 183.815362] niks3-server[1155]: 2026/09/22 11:24:39 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst6407worker1 # [ 183.771580] nix-grpc-daemon[1721]: time=2026-09-22T11:24:39.407Z level=INFO msg="Uploading 1 narinfos"6408lb # [ 183.831939] niks3-server[1155]: 2026/09/22 11:24:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6409lb # [ 183.843973] niks3-server[1155]: 2026/09/22 11:24:39 INFO Signed narinfos id=57 count=16410lb # [ 183.850453] niks3-server[1155]: 2026/09/22 11:24:39 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls6411lb # [ 183.859724] niks3-server[1155]: 2026/09/22 11:24:39 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6412lb # [ 183.867047] niks3-server[1155]: 2026/09/22 11:24:39 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo6413lb # [ 183.872884] niks3-server[1155]: 2026/09/22 11:24:39 INFO Completed upload id=576414worker1 # [ 183.806609] nix-grpc-daemon[1721]: time=2026-09-22T11:24:39.442Z level=INFO msg="Upload complete. (518ms)"6415worker1 # [ 183.812322] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49900 duration_s=0 paths=1 nar_bytes_in=6406416worker1 # [ 183.823411] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499006417worker1 # [ 183.829515] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6418worker1 # [ 183.834230] nix-daemon[932]: reaped child process 1832, status = succeeded6419client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...6420worker1 # [ 183.846069] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6421client # farm-b> node-a: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv6422client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds6423client # farm-b> LOG-farm-b-during-drain6424worker1 # [ 184.467137] nix-daemon[932]: reaped child process 1846, status = succeeded6425worker1 # [ 184.640263] nix-daemon[932]: accepted connection from pid 1862, user nix-grpc-daemon (trusted)6426worker1 # [ 184.658301] nix-daemon[932]: reaped child process 1865, status = succeeded6427lb # [ 184.741942] niks3-server[1155]: 2026/09/22 11:24:40 INFO Received uploads request method=POST path=/api/pending_closures6428worker1 # [ 184.686544] nix-grpc-daemon[1721]: time=2026-09-22T11:24:40.321Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6429worker1 # [ 184.688313] nix-grpc-daemon[1721]: time=2026-09-22T11:24:40.321Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"6430lb # [ 184.774755] niks3-server[1155]: 2026/09/22 11:24:40 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst6431lb # [ 184.792871] niks3-server[1155]: 2026/09/22 11:24:40 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv6432lb # [ 184.804723] niks3-server[1155]: 2026/09/22 11:24:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6433worker1 # [ 184.746054] nix-grpc-daemon[1721]: time=2026-09-22T11:24:40.381Z level=INFO msg="Uploading 1 narinfos"6434lb # [ 184.816131] niks3-server[1155]: 2026/09/22 11:24:40 INFO Signed narinfos id=58 count=16435lb # [ 184.819377] niks3-server[1155]: 2026/09/22 11:24:40 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls6436lb # [ 184.835897] niks3-server[1155]: 2026/09/22 11:24:40 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6437lb # [ 184.842636] niks3-server[1155]: 2026/09/22 11:24:40 INFO Completed upload id=586438worker1 # [ 184.776267] nix-grpc-daemon[1721]: time=2026-09-22T11:24:40.412Z level=INFO msg="Upload complete. (322ms)"6439lb # [ 184.846265] niks3-server[1155]: 2026/09/22 11:24:40 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo6440worker1 # [ 184.792579] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49900 duration_s=0 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=4 outputs=16441worker1 # [ 184.812470] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:40Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=06442worker1 # [ 184.817630] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:40Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.3:50051 clients=16443worker1 # [ 184.822630] nix-daemon[932]: reaped child process 1844, status = succeeded6444worker1 # [ 184.854826] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499006445worker1 # [ 184.873605] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:499006446worker1 # [ 184.886247] nix-grpc-daemon[1721]: time=2026-09-22T11:24:40.522Z level=INFO msg="All 2 paths already cached"6447client # copying 1 paths to 'lb:50051'...6448worker1 # [ 184.895225] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:499006449client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...6450worker1 # [ 184.914259] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6451worker1 # [ 185.121631] nix-daemon[932]: accepted connection from pid 1871, user nix-grpc-daemon (trusted)6452worker1 # [ 185.140376] nix-daemon[932]: reaped child process 1874, status = succeeded6453worker1 # [ 185.317227] nix-daemon[932]: accepted connection from pid 1876, user nix-grpc-daemon (trusted)6454worker1 # [ 185.337663] nix-daemon[932]: reaped child process 1879, status = succeeded6455lb # [ 185.417672] niks3-server[1155]: 2026/09/22 11:24:41 INFO Received uploads request method=POST path=/api/pending_closures6456worker1 # [ 185.362951] nix-grpc-daemon[1721]: time=2026-09-22T11:24:40.998Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6457worker1 # [ 185.364670] nix-grpc-daemon[1721]: time=2026-09-22T11:24:40.998Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"6458lb # [ 185.456290] niks3-server[1155]: 2026/09/22 11:24:41 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst6459lb # [ 185.480711] niks3-server[1155]: 2026/09/22 11:24:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6460lb # [ 185.492289] niks3-server[1155]: 2026/09/22 11:24:41 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls6461lb # [ 185.501096] niks3-server[1155]: 2026/09/22 11:24:41 INFO Signed narinfos id=59 count=16462worker1 # [ 185.435270] nix-grpc-daemon[1721]: time=2026-09-22T11:24:41.070Z level=INFO msg="Uploading 1 narinfos"6463lb # [ 185.511766] niks3-server[1155]: 2026/09/22 11:24:41 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6464lb # [ 185.523275] niks3-server[1155]: 2026/09/22 11:24:41 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo6465lb # [ 185.536357] niks3-server[1155]: 2026/09/22 11:24:41 INFO Completed upload id=596466worker1 # [ 185.472616] nix-grpc-daemon[1721]: time=2026-09-22T11:24:41.108Z level=INFO msg="Upload complete. (542ms)"6467worker1 # [ 185.483550] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49900 duration_s=0 paths=1 nar_bytes_in=7686468worker1 # [ 185.505341] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499006469worker1 # [ 185.516997] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6470worker1 # [ 185.523336] nix-daemon[932]: reaped child process 1869, status = succeeded6471client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...6472worker1 # [ 185.534501] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6473client # farm-top> node-a: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv6474client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds6475client # farm-top> LOG-farm-top-during-drain6476worker1 # [ 186.377636] nix-daemon[932]: reaped child process 1883, status = succeeded6477worker1 # [ 186.567794] nix-daemon[932]: accepted connection from pid 1899, user nix-grpc-daemon (trusted)6478worker1 # [ 186.586297] nix-daemon[932]: reaped child process 1902, status = succeeded6479lb # [ 186.669725] niks3-server[1155]: 2026/09/22 11:24:42 INFO Received uploads request method=POST path=/api/pending_closures6480worker1 # [ 186.618835] nix-grpc-daemon[1721]: time=2026-09-22T11:24:42.251Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6481worker1 # [ 186.621055] nix-grpc-daemon[1721]: time=2026-09-22T11:24:42.252Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"6482lb # [ 186.717819] niks3-server[1155]: 2026/09/22 11:24:42 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv6483lb # [ 186.729007] niks3-server[1155]: 2026/09/22 11:24:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6484worker1 # [ 186.662992] nix-grpc-daemon[1721]: time=2026-09-22T11:24:42.298Z level=INFO msg="Uploading 1 narinfos"6485lb # [ 186.741315] niks3-server[1155]: 2026/09/22 11:24:42 INFO Signed narinfos id=60 count=16486lb # [ 186.749167] niks3-server[1155]: 2026/09/22 11:24:42 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst6487lb # [ 186.762079] niks3-server[1155]: 2026/09/22 11:24:42 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls6488lb # [ 186.766474] niks3-server[1155]: 2026/09/22 11:24:42 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6489worker1 # [ 186.699574] nix-grpc-daemon[1721]: time=2026-09-22T11:24:42.335Z level=INFO msg="Upload complete. (352ms)"6490lb # [ 186.770043] niks3-server[1155]: 2026/09/22 11:24:42 INFO Completed upload id=606491lb # [ 186.772670] niks3-server[1155]: 2026/09/22 11:24:42 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo6492worker1 # [ 186.716829] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49900 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=5 outputs=16493worker1 # [ 186.735556] nix-daemon[932]: reaped child process 1881, status = succeeded6494client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 5.92 seconds)6495client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath6496client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.25 seconds)6497worker2: must succeed: pkill -f 'read -t [9]0 x'6498worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds)6499client: waiting for success: ! systemctl is-active sw6500worker2 # [ 187.152802] nix-daemon[863]: reaped child process 1828, status = succeeded6501worker2 # [ 187.340122] nix-daemon[863]: accepted connection from pid 2000, user nix-grpc-daemon (trusted)6502worker2 # [ 187.359233] nix-daemon[863]: reaped child process 2003, status = succeeded6503lb # [ 187.464655] niks3-server[1155]: 2026/09/22 11:24:43 INFO Received uploads request method=POST path=/api/pending_closures6504worker2 # [ 187.385346] nix-grpc-daemon[1723]: time=2026-09-22T11:24:43.015Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6505worker2 # [ 187.386919] nix-grpc-daemon[1723]: time=2026-09-22T11:24:43.015Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"6506lb # [ 187.503609] niks3-server[1155]: 2026/09/22 11:24:43 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6507worker2 # [ 187.428136] nix-grpc-daemon[1723]: time=2026-09-22T11:24:43.058Z level=INFO msg="Uploading 1 narinfos"6508lb # [ 187.518205] niks3-server[1155]: 2026/09/22 11:24:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6509lb # [ 187.530588] niks3-server[1155]: 2026/09/22 11:24:43 INFO Signed narinfos id=61 count=16510lb # [ 187.537093] niks3-server[1155]: 2026/09/22 11:24:43 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv6511lb # [ 187.542966] niks3-server[1155]: 2026/09/22 11:24:43 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls6512lb # [ 187.551437] niks3-server[1155]: 2026/09/22 11:24:43 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6513lb # [ 187.557515] niks3-server[1155]: 2026/09/22 11:24:43 INFO Completed upload id=616514worker2 # [ 187.467023] nix-grpc-daemon[1723]: time=2026-09-22T11:24:43.098Z level=INFO msg="Upload complete. (334ms)"6515lb # [ 187.560462] niks3-server[1155]: 2026/09/22 11:24:43 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo6516worker2 # [ 187.481036] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52734 duration_s=12 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=2 outputs=16517worker2 # [ 187.496260] nix-daemon[863]: reaped child process 1826, status = succeeded6518client # [ 187.523941] systemd[1]: sw.service: Deactivated successfully.6519client # [ 187.529359] systemd[1]: sw.service: Consumed 190ms CPU time over 13.297s wall clock time, 39.2M memory peak, 7.1K incoming IP traffic, 8.4K outgoing IP traffic.6520worker2 # [ 187.832162] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:43Z level=info event=signal_exit6521client: (finished: waiting for success: ! systemctl is-active sw, in 1.14 seconds)6522client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6523client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds)6524worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6525worker2 # [ 188.356249] systemd[1]: Starting scheduler-token.service...6526worker2 # [ 188.449741] systemd[1]: scheduler-token.service: Deactivated successfully.6527worker2 # [ 188.453594] systemd[1]: Finished scheduler-token.service.6528worker2 # [ 188.454871] systemd[1]: scheduler-token.service: Consumed 36ms CPU time over 96ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.6529worker1 # [ 189.107314] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:44Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:498626530worker1 # [ 189.110702] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:44Z level=info event=worker_gone addr=192.168.1.4:500516531worker2 # [ 189.088803] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:44Z level=info event=scheduler_restarting6532worker2 # [ 189.111839] nix-grpc-daemon[1599]: ts=2026-09-22T11:24:44Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6533worker2 # [ 189.141895] nix-daemon[863]: reaped child process 1658, status = succeeded6534worker2 # [ 189.901560] nix-grpc-daemon[1599]: E0000 00:00:1790076285.532404 1644 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true6535worker2 # [ 189.901946] nix-grpc-daemon[1599]: E0000 00:00:1790076285.532669 1644 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true6536worker2 # [ 190.314682] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6537worker2 # [ 190.322753] systemd[1]: nix-grpc-daemon.service: Consumed 1.138s CPU time over 44.715s wall clock time, 34.2M memory peak, 26.7K incoming IP traffic, 45.4K outgoing IP traffic.6538worker2 # [ 190.336311] systemd[1]: Starting Nix worker-protocol over gRPC...6539worker2 # [ 190.537957] nix-grpc-daemon[2020]: ts=2026-09-22T11:24:46Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6540worker2 # [ 190.540773] nix-grpc-daemon[2020]: ts=2026-09-22T11:24:46Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6541worker2 # [ 190.545122] nix-grpc-daemon[2020]: ts=2026-09-22T11:24:46Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16542worker2 # [ 190.552198] nix-grpc-daemon[2020]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6543worker2 # [ 190.565651] nix-grpc-daemon[2020]: E0000 00:00:1790076286.182941 2020 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6544worker2 # [ 190.569226] nix-grpc-daemon[2020]: E0000 00:00:1790076286.188267 2020 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6545worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.32 seconds)6546lb: waiting until exactly no endpoints of aarch64-linux are unhealthy6547lb: must succeed: curl -sf localhost:9901/clusters6548worker2 # [ 190.596094] nix-grpc-daemon[2020]: ts=2026-09-22T11:24:46Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6549worker2 # [ 190.597836] systemd[1]: Started Nix worker-protocol over gRPC.6550worker2 # [ 190.598686] nix-grpc-daemon[2020]: E0000 00:00:1790076286.204480 2059 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6551worker2 # [ 190.611208] nix-grpc-daemon[2020]: E0000 00:00:1790076286.221501 2059 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6552worker2 # [ 190.614212] nix-grpc-daemon[2020]: E0000 00:00:1790076286.221660 2059 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6553worker2 # [ 190.616909] nix-grpc-daemon[2020]: E0000 00:00:1790076286.241309 2059 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6554worker2 # [ 190.630294] nix-grpc-daemon[2020]: ts=2026-09-22T11:24:46Z level=info event=scheduler_connected addr=lb:500516555worker1 # [ 190.659042] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:46Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:498626556worker1 # [ 190.665312] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:46Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=06557lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)6558lb: must succeed: curl -sf localhost:9901/clusters6559lb # [ 191.849702] envoy[913]: conn peer=[2001:db8:1::1]:55138 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9621 tx=4427 ms=55926560lb # [ 191.853840] envoy[913]: conn peer=[2001:db8:1::1]:57084 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2978 tx=1542 ms=130076561lb # [ 191.856690] envoy[913]: conn peer=[2001:db8:1::4]:53694 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=9196 tx=738 ms=432076562lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)6563lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.18 seconds)6564lb: must succeed: curl -sf localhost:9901/clusters6565lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)6566worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6567worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)6568(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 17.75 seconds)6569subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6570client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16571worker1 # [ 192.200646] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:499006572worker1 # [ 192.212711] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:499006573worker1 # [ 192.255595] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:47Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=06574worker1 # [ 192.262896] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:47Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=16575worker1 # [ 192.269300] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:47Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=06576worker1 # [ 192.275608] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:47Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=06577worker1 # [ 192.301543] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499006578worker1 # [ 192.318093] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:499006579worker1 # [ 192.333336] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:499006580worker1 # [ 192.348711] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6581worker1 # [ 192.560749] nix-daemon[932]: accepted connection from pid 1911, user nix-grpc-daemon (trusted)6582worker1 # [ 192.581803] nix-daemon[932]: reaped child process 1914, status = succeeded6583worker1 # [ 192.763739] nix-daemon[932]: accepted connection from pid 1916, user nix-grpc-daemon (trusted)6584worker1 # [ 192.782428] nix-daemon[932]: reaped child process 1919, status = succeeded6585lb # [ 192.866125] niks3-server[1155]: 2026/09/22 11:24:48 INFO Received uploads request method=POST path=/api/pending_closures6586worker1 # [ 192.808420] nix-grpc-daemon[1721]: time=2026-09-22T11:24:48.444Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6587worker1 # [ 192.809917] nix-grpc-daemon[1721]: time=2026-09-22T11:24:48.444Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"6588lb # [ 192.898486] niks3-server[1155]: 2026/09/22 11:24:48 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst6589lb # [ 192.917436] niks3-server[1155]: 2026/09/22 11:24:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6590worker1 # [ 192.858572] nix-grpc-daemon[1721]: time=2026-09-22T11:24:48.494Z level=INFO msg="Uploading 1 narinfos"6591lb # [ 192.930400] niks3-server[1155]: 2026/09/22 11:24:48 INFO Signed narinfos id=62 count=16592lb # [ 192.936983] niks3-server[1155]: 2026/09/22 11:24:48 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls6593worker1 # [ 192.883619] nix-grpc-daemon[1721]: time=2026-09-22T11:24:48.519Z level=INFO msg="Upload complete. (518ms)"6594lb # [ 192.950803] niks3-server[1155]: 2026/09/22 11:24:48 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6595lb # [ 192.954670] niks3-server[1155]: 2026/09/22 11:24:48 INFO Completed upload id=626596lb # [ 192.958506] niks3-server[1155]: 2026/09/22 11:24:48 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo6597worker1 # [ 192.897324] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49900 duration_s=0 paths=1 nar_bytes_in=5126598worker1 # [ 192.910805] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499006599worker1 # [ 192.917124] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6600worker1 # [ 192.922256] nix-daemon[932]: reaped child process 1909, status = succeeded6601worker1 # [ 192.936947] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6602worker1 # [ 193.758987] nix-daemon[932]: reaped child process 1923, status = succeeded6603worker1 # [ 193.923673] nix-daemon[932]: accepted connection from pid 1939, user nix-grpc-daemon (trusted)6604worker1 # [ 193.940997] nix-daemon[932]: reaped child process 1942, status = succeeded6605lb # [ 194.021633] niks3-server[1155]: 2026/09/22 11:24:49 INFO Received uploads request method=POST path=/api/pending_closures6606worker1 # [ 193.967730] nix-grpc-daemon[1721]: time=2026-09-22T11:24:49.601Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6607worker1 # [ 193.969374] nix-grpc-daemon[1721]: time=2026-09-22T11:24:49.601Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"6608lb # [ 194.055749] niks3-server[1155]: 2026/09/22 11:24:49 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv6609worker1 # [ 194.005780] nix-grpc-daemon[1721]: time=2026-09-22T11:24:49.641Z level=INFO msg="Uploading 1 narinfos"6610lb # [ 194.071928] niks3-server[1155]: 2026/09/22 11:24:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6611lb # [ 194.083119] niks3-server[1155]: 2026/09/22 11:24:49 INFO Signed narinfos id=63 count=16612lb # [ 194.089114] niks3-server[1155]: 2026/09/22 11:24:49 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6613lb # [ 194.102597] niks3-server[1155]: 2026/09/22 11:24:49 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6614lb # [ 194.107989] niks3-server[1155]: 2026/09/22 11:24:49 INFO Completed upload id=636615worker1 # [ 194.041697] nix-grpc-daemon[1721]: time=2026-09-22T11:24:49.677Z level=INFO msg="Upload complete. (294ms)"6616lb # [ 194.111204] niks3-server[1155]: 2026/09/22 11:24:49 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo6617lb # [ 194.117199] niks3-server[1155]: 2026/09/22 11:24:49 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls6618worker1 # [ 194.051806] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49900 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=6 outputs=16619worker1 # [ 194.068231] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:49Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=16620worker1 # [ 194.077312] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499006621worker1 # [ 194.082307] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:49Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=06622worker1 # [ 194.087393] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:499006623worker1 # [ 194.091495] nix-daemon[932]: reaped child process 1921, status = succeeded6624worker1 # [ 194.098068] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:499006625worker1 # [ 194.108838] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6626worker1 # [ 194.304190] nix-daemon[932]: accepted connection from pid 1948, user nix-grpc-daemon (trusted)6627worker1 # [ 194.322748] nix-daemon[932]: reaped child process 1951, status = succeeded6628worker1 # [ 194.501522] nix-daemon[932]: accepted connection from pid 1953, user nix-grpc-daemon (trusted)6629worker1 # [ 194.519264] nix-daemon[932]: reaped child process 1956, status = succeeded6630lb # [ 194.598658] niks3-server[1155]: 2026/09/22 11:24:50 INFO Received uploads request method=POST path=/api/pending_closures6631worker1 # [ 194.541634] nix-grpc-daemon[1721]: time=2026-09-22T11:24:50.177Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6632worker1 # [ 194.543111] nix-grpc-daemon[1721]: time=2026-09-22T11:24:50.177Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"6633lb # [ 194.627959] niks3-server[1155]: 2026/09/22 11:24:50 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst6634lb # [ 194.642471] niks3-server[1155]: 2026/09/22 11:24:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6635worker1 # [ 194.581606] nix-grpc-daemon[1721]: time=2026-09-22T11:24:50.217Z level=INFO msg="Uploading 1 narinfos"6636lb # [ 194.654520] niks3-server[1155]: 2026/09/22 11:24:50 INFO Signed narinfos id=64 count=16637lb # [ 194.659703] niks3-server[1155]: 2026/09/22 11:24:50 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls6638lb # [ 194.668630] niks3-server[1155]: 2026/09/22 11:24:50 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6639worker1 # [ 194.606889] nix-grpc-daemon[1721]: time=2026-09-22T11:24:50.243Z level=INFO msg="Upload complete. (486ms)"6640lb # [ 194.673741] niks3-server[1155]: 2026/09/22 11:24:50 INFO Completed upload id=646641lb # [ 194.676961] niks3-server[1155]: 2026/09/22 11:24:50 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo6642worker1 # [ 194.616266] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49900 duration_s=0 paths=1 nar_bytes_in=5126643worker1 # [ 194.628328] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499006644worker1 # [ 194.635782] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6645worker1 # [ 194.641373] nix-daemon[932]: reaped child process 1946, status = succeeded6646worker1 # [ 194.655429] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6647worker1 # [ 196.081578] nix-daemon[932]: reaped child process 1960, status = succeeded6648worker1 # [ 196.251571] nix-daemon[932]: accepted connection from pid 1976, user nix-grpc-daemon (trusted)6649worker1 # [ 196.271164] nix-daemon[932]: reaped child process 1979, status = succeeded6650lb # [ 196.350551] niks3-server[1155]: 2026/09/22 11:24:51 INFO Received uploads request method=POST path=/api/pending_closures6651worker1 # [ 196.294120] nix-grpc-daemon[1721]: time=2026-09-22T11:24:51.930Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6652worker1 # [ 196.298921] nix-grpc-daemon[1721]: time=2026-09-22T11:24:51.931Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"6653lb # [ 196.387592] niks3-server[1155]: 2026/09/22 11:24:52 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6654lb # [ 196.402787] niks3-server[1155]: 2026/09/22 11:24:52 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv6655lb # [ 196.413795] niks3-server[1155]: 2026/09/22 11:24:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6656worker1 # [ 196.352563] nix-grpc-daemon[1721]: time=2026-09-22T11:24:51.988Z level=INFO msg="Uploading 1 narinfos"6657lb # [ 196.423532] niks3-server[1155]: 2026/09/22 11:24:52 INFO Signed narinfos id=65 count=16658lb # [ 196.428886] niks3-server[1155]: 2026/09/22 11:24:52 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls6659lb # [ 196.436716] niks3-server[1155]: 2026/09/22 11:24:52 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6660lb # [ 196.445749] niks3-server[1155]: 2026/09/22 11:24:52 INFO Completed upload id=656661worker1 # [ 196.379409] nix-grpc-daemon[1721]: time=2026-09-22T11:24:52.015Z level=INFO msg="Upload complete. (313ms)"6662lb # [ 196.448990] niks3-server[1155]: 2026/09/22 11:24:52 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo6663worker1 # [ 196.397406] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49900 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=7 outputs=16664worker1 # [ 196.413188] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:52Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=16665worker1 # [ 196.425099] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499006666worker1 # [ 196.432287] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:52Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=06667worker1 # [ 196.437259] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:499006668worker1 # [ 196.441850] nix-daemon[932]: reaped child process 1958, status = succeeded6669worker1 # [ 196.445309] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:499006670worker1 # [ 196.459080] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6671worker1 # [ 196.640095] nix-daemon[932]: accepted connection from pid 1985, user nix-grpc-daemon (trusted)6672worker1 # [ 196.660228] nix-daemon[932]: reaped child process 1988, status = succeeded6673worker1 # [ 196.835504] nix-daemon[932]: accepted connection from pid 1990, user nix-grpc-daemon (trusted)6674worker1 # [ 196.855760] nix-daemon[932]: reaped child process 1993, status = succeeded6675lb # [ 196.931677] niks3-server[1155]: 2026/09/22 11:24:52 INFO Received uploads request method=POST path=/api/pending_closures6676worker1 # [ 196.874677] nix-grpc-daemon[1721]: time=2026-09-22T11:24:52.510Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6677worker1 # [ 196.876247] nix-grpc-daemon[1721]: time=2026-09-22T11:24:52.510Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"6678lb # [ 196.959470] niks3-server[1155]: 2026/09/22 11:24:52 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst6679lb # [ 196.972711] niks3-server[1155]: 2026/09/22 11:24:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6680worker1 # [ 196.912078] nix-grpc-daemon[1721]: time=2026-09-22T11:24:52.548Z level=INFO msg="Uploading 1 narinfos"6681lb # [ 196.982510] niks3-server[1155]: 2026/09/22 11:24:52 INFO Signed narinfos id=66 count=16682lb # [ 196.988808] niks3-server[1155]: 2026/09/22 11:24:52 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls6683lb # [ 196.996822] niks3-server[1155]: 2026/09/22 11:24:52 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6684lb # [ 197.002901] niks3-server[1155]: 2026/09/22 11:24:52 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo6685lb # [ 197.008279] niks3-server[1155]: 2026/09/22 11:24:52 INFO Completed upload id=666686worker1 # [ 196.941905] nix-grpc-daemon[1721]: time=2026-09-22T11:24:52.578Z level=INFO msg="Upload complete. (477ms)"6687worker1 # [ 196.950708] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49900 duration_s=0 paths=1 nar_bytes_in=5126688worker1 # [ 196.963433] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499006689worker1 # [ 196.970559] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6690worker1 # [ 196.975007] nix-daemon[932]: reaped child process 1983, status = succeeded6691worker1 # [ 196.985478] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6692worker1 # [ 198.214825] nix-daemon[932]: reaped child process 1997, status = succeeded6693worker1 # [ 198.373199] nix-daemon[932]: accepted connection from pid 2013, user nix-grpc-daemon (trusted)6694worker1 # [ 198.391227] nix-daemon[932]: reaped child process 2016, status = succeeded6695lb # [ 198.471524] niks3-server[1155]: 2026/09/22 11:24:54 INFO Received uploads request method=POST path=/api/pending_closures6696worker1 # [ 198.414984] nix-grpc-daemon[1721]: time=2026-09-22T11:24:54.049Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6697worker1 # [ 198.416589] nix-grpc-daemon[1721]: time=2026-09-22T11:24:54.049Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"6698lb # [ 198.502012] niks3-server[1155]: 2026/09/22 11:24:54 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6699worker1 # [ 198.444663] nix-grpc-daemon[1721]: time=2026-09-22T11:24:54.080Z level=INFO msg="Uploading 1 narinfos"6700lb # [ 198.510970] niks3-server[1155]: 2026/09/22 11:24:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6701lb # [ 198.518411] niks3-server[1155]: 2026/09/22 11:24:54 INFO Signed narinfos id=67 count=16702lb # [ 198.522651] niks3-server[1155]: 2026/09/22 11:24:54 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv6703lb # [ 198.527178] niks3-server[1155]: 2026/09/22 11:24:54 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls6704worker1 # [ 198.467019] nix-grpc-daemon[1721]: time=2026-09-22T11:24:54.103Z level=INFO msg="Upload complete. (270ms)"6705lb # [ 198.533981] niks3-server[1155]: 2026/09/22 11:24:54 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6706lb # [ 198.536833] niks3-server[1155]: 2026/09/22 11:24:54 INFO Completed upload id=676707lb # [ 198.539806] niks3-server[1155]: 2026/09/22 11:24:54 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo6708worker1 # [ 198.474406] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49900 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=8 outputs=16709worker1 # [ 198.488819] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:54Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=16710worker1 # [ 198.491940] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499006711worker1 # [ 198.500264] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:54Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=06712worker1 # [ 198.504208] nix-daemon[932]: reaped child process 1995, status = succeeded6713worker1 # [ 198.505661] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:499006714worker1 # [ 198.512079] nix-grpc-daemon[1721]: time=2026-09-22T11:24:54.148Z level=INFO msg="All 1 paths already cached"6715worker1 # [ 198.518929] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:499006716worker1 # [ 198.527277] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6717worker1 # [ 198.711735] nix-daemon[932]: accepted connection from pid 2022, user nix-grpc-daemon (trusted)6718worker1 # [ 198.731248] nix-daemon[932]: reaped child process 2025, status = succeeded6719worker1 # [ 198.908943] nix-daemon[932]: accepted connection from pid 2027, user nix-grpc-daemon (trusted)6720worker1 # [ 198.926415] nix-daemon[932]: reaped child process 2030, status = succeeded6721lb # [ 199.005316] niks3-server[1155]: 2026/09/22 11:24:54 INFO Received uploads request method=POST path=/api/pending_closures6722worker1 # [ 198.947647] nix-grpc-daemon[1721]: time=2026-09-22T11:24:54.583Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6723worker1 # [ 198.949288] nix-grpc-daemon[1721]: time=2026-09-22T11:24:54.583Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"6724lb # [ 199.031122] niks3-server[1155]: 2026/09/22 11:24:54 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst6725lb # [ 199.046687] niks3-server[1155]: 2026/09/22 11:24:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6726worker1 # [ 198.986594] nix-grpc-daemon[1721]: time=2026-09-22T11:24:54.622Z level=INFO msg="Uploading 1 narinfos"6727lb # [ 199.059419] niks3-server[1155]: 2026/09/22 11:24:54 INFO Signed narinfos id=68 count=16728lb # [ 199.065807] niks3-server[1155]: 2026/09/22 11:24:54 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls6729lb # [ 199.075301] niks3-server[1155]: 2026/09/22 11:24:54 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6730worker1 # [ 199.013952] nix-grpc-daemon[1721]: time=2026-09-22T11:24:54.650Z level=INFO msg="Upload complete. (477ms)"6731lb # [ 199.081139] niks3-server[1155]: 2026/09/22 11:24:54 INFO Completed upload id=686732worker1 # [ 199.018780] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49900 duration_s=0 paths=1 nar_bytes_in=6246733lb # [ 199.085571] niks3-server[1155]: 2026/09/22 11:24:54 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo6734worker1 # [ 199.026528] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499006735worker1 # [ 199.028433] nix-daemon[932]: reaped child process 2020, status = succeeded6736worker1 # [ 199.032283] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6737worker1 # [ 199.041149] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6738worker1 # [ 199.863162] nix-daemon[932]: reaped child process 2034, status = succeeded6739worker1 # [ 200.036699] nix-daemon[932]: accepted connection from pid 2050, user nix-grpc-daemon (trusted)6740worker1 # [ 200.058227] nix-daemon[932]: reaped child process 2053, status = succeeded6741lb # [ 200.134798] niks3-server[1155]: 2026/09/22 11:24:55 INFO Received uploads request method=POST path=/api/pending_closures6742worker1 # [ 200.080442] nix-grpc-daemon[1721]: time=2026-09-22T11:24:55.715Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6743worker1 # [ 200.081958] nix-grpc-daemon[1721]: time=2026-09-22T11:24:55.715Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"6744lb # [ 200.170160] niks3-server[1155]: 2026/09/22 11:24:55 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv6745lb # [ 200.179197] niks3-server[1155]: 2026/09/22 11:24:55 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst6746lb # [ 200.187932] niks3-server[1155]: 2026/09/22 11:24:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6747worker1 # [ 200.126066] nix-grpc-daemon[1721]: time=2026-09-22T11:24:55.761Z level=INFO msg="Uploading 1 narinfos"6748lb # [ 200.195510] niks3-server[1155]: 2026/09/22 11:24:55 INFO Signed narinfos id=69 count=16749lb # [ 200.200005] niks3-server[1155]: 2026/09/22 11:24:55 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls6750lb # [ 200.207639] niks3-server[1155]: 2026/09/22 11:24:55 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6751lb # [ 200.213315] niks3-server[1155]: 2026/09/22 11:24:55 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo6752lb # [ 200.217424] niks3-server[1155]: 2026/09/22 11:24:55 INFO Completed upload id=696753worker1 # [ 200.150787] nix-grpc-daemon[1721]: time=2026-09-22T11:24:55.786Z level=INFO msg="Upload complete. (298ms)"6754worker1 # [ 200.165734] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49900 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=9 outputs=16755worker1 # [ 200.180499] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:55Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=16756worker1 # [ 200.188270] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499006757worker1 # [ 200.194514] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:55Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=06758worker1 # [ 200.198554] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:499006759worker1 # [ 200.201512] nix-daemon[932]: reaped child process 2032, status = succeeded6760worker1 # [ 200.204721] nix-grpc-daemon[1721]: time=2026-09-22T11:24:55.839Z level=INFO msg="All 1 paths already cached"6761worker1 # [ 200.209413] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:499006762worker1 # [ 200.223591] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6763worker1 # [ 200.404166] nix-daemon[932]: accepted connection from pid 2059, user nix-grpc-daemon (trusted)6764worker1 # [ 200.422258] nix-daemon[932]: reaped child process 2062, status = succeeded6765worker1 # [ 200.603555] nix-daemon[932]: accepted connection from pid 2064, user nix-grpc-daemon (trusted)6766worker1 # [ 200.620505] nix-daemon[932]: reaped child process 2067, status = succeeded6767lb # [ 200.702313] niks3-server[1155]: 2026/09/22 11:24:56 INFO Received uploads request method=POST path=/api/pending_closures6768worker1 # [ 200.645694] nix-grpc-daemon[1721]: time=2026-09-22T11:24:56.281Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6769worker1 # [ 200.647347] nix-grpc-daemon[1721]: time=2026-09-22T11:24:56.281Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"6770lb # [ 200.733425] niks3-server[1155]: 2026/09/22 11:24:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/70/sign6771worker1 # [ 200.673866] nix-grpc-daemon[1721]: time=2026-09-22T11:24:56.309Z level=INFO msg="Uploading 1 narinfos"6772lb # [ 200.747227] niks3-server[1155]: 2026/09/22 11:24:56 INFO Signed narinfos id=70 count=16773lb # [ 200.755090] niks3-server[1155]: 2026/09/22 11:24:56 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst6774lb # [ 200.761754] niks3-server[1155]: 2026/09/22 11:24:56 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls6775lb # [ 200.769989] niks3-server[1155]: 2026/09/22 11:24:56 INFO Received complete upload request method=POST path=/api/pending_closures/70/complete6776worker1 # [ 200.708385] nix-grpc-daemon[1721]: time=2026-09-22T11:24:56.344Z level=INFO msg="Upload complete. (478ms)"6777lb # [ 200.774962] niks3-server[1155]: 2026/09/22 11:24:56 INFO Completed upload id=706778lb # [ 200.778092] niks3-server[1155]: 2026/09/22 11:24:56 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo6779worker1 # [ 200.716126] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49900 duration_s=0 paths=1 nar_bytes_in=6246780worker1 # [ 200.728425] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499006781worker1 # [ 200.734015] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6782worker1 # [ 200.738914] nix-daemon[932]: reaped child process 2057, status = succeeded6783worker1 # [ 200.751463] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6784worker1 # [ 202.201187] nix-daemon[932]: reaped child process 2071, status = succeeded6785worker1 # [ 202.362548] nix-daemon[932]: accepted connection from pid 2087, user nix-grpc-daemon (trusted)6786worker1 # [ 202.383083] nix-daemon[932]: reaped child process 2090, status = succeeded6787lb # [ 202.461321] niks3-server[1155]: 2026/09/22 11:24:58 INFO Received uploads request method=POST path=/api/pending_closures6788worker1 # [ 202.404994] nix-grpc-daemon[1721]: time=2026-09-22T11:24:58.039Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6789worker1 # [ 202.406614] nix-grpc-daemon[1721]: time=2026-09-22T11:24:58.039Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"6790lb # [ 202.488387] niks3-server[1155]: 2026/09/22 11:24:58 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst6791lb # [ 202.498198] niks3-server[1155]: 2026/09/22 11:24:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/71/sign6792worker1 # [ 202.434793] nix-grpc-daemon[1721]: time=2026-09-22T11:24:58.070Z level=INFO msg="Uploading 1 narinfos"6793lb # [ 202.503943] niks3-server[1155]: 2026/09/22 11:24:58 INFO Signed narinfos id=71 count=16794lb # [ 202.506168] niks3-server[1155]: 2026/09/22 11:24:58 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv6795lb # [ 202.514021] niks3-server[1155]: 2026/09/22 11:24:58 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls6796worker1 # [ 202.452412] nix-grpc-daemon[1721]: time=2026-09-22T11:24:58.088Z level=INFO msg="Upload complete. (289ms)"6797lb # [ 202.519819] niks3-server[1155]: 2026/09/22 11:24:58 INFO Received complete upload request method=POST path=/api/pending_closures/71/complete6798lb # [ 202.522343] niks3-server[1155]: 2026/09/22 11:24:58 INFO Completed upload id=716799lb # [ 202.524884] niks3-server[1155]: 2026/09/22 11:24:58 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo6800worker1 # [ 202.462955] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49900 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=10 outputs=16801worker1 # [ 202.476287] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:58Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=16802worker1 # [ 202.479061] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499006803worker1 # [ 202.484837] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:58Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=06804worker1 # [ 202.489011] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:499006805worker1 # [ 202.492877] nix-daemon[932]: reaped child process 2069, status = succeeded6806worker1 # [ 202.494914] nix-grpc-daemon[1721]: time=2026-09-22T11:24:58.131Z level=INFO msg="All 1 paths already cached"6807worker1 # [ 202.502060] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:499006808worker1 # [ 202.509766] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6809worker1 # [ 202.690245] nix-daemon[932]: accepted connection from pid 2096, user nix-grpc-daemon (trusted)6810worker1 # [ 202.711742] nix-daemon[932]: reaped child process 2099, status = succeeded6811worker1 # [ 202.886680] nix-daemon[932]: accepted connection from pid 2101, user nix-grpc-daemon (trusted)6812worker1 # [ 202.906132] nix-daemon[932]: reaped child process 2104, status = succeeded6813lb # [ 202.986280] niks3-server[1155]: 2026/09/22 11:24:58 INFO Received uploads request method=POST path=/api/pending_closures6814worker1 # [ 202.927869] nix-grpc-daemon[1721]: time=2026-09-22T11:24:58.563Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6815worker1 # [ 202.929660] nix-grpc-daemon[1721]: time=2026-09-22T11:24:58.563Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"6816lb # [ 203.010561] niks3-server[1155]: 2026/09/22 11:24:58 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst6817lb # [ 203.019382] niks3-server[1155]: 2026/09/22 11:24:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/72/sign6818worker1 # [ 202.956697] nix-grpc-daemon[1721]: time=2026-09-22T11:24:58.592Z level=INFO msg="Uploading 1 narinfos"6819lb # [ 203.026371] niks3-server[1155]: 2026/09/22 11:24:58 INFO Signed narinfos id=72 count=16820lb # [ 203.031136] niks3-server[1155]: 2026/09/22 11:24:58 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls6821lb # [ 203.038412] niks3-server[1155]: 2026/09/22 11:24:58 INFO Received complete upload request method=POST path=/api/pending_closures/72/complete6822lb # [ 203.042333] niks3-server[1155]: 2026/09/22 11:24:58 INFO Completed upload id=726823worker1 # [ 202.975451] nix-grpc-daemon[1721]: time=2026-09-22T11:24:58.611Z level=INFO msg="Upload complete. (456ms)"6824lb # [ 203.044346] niks3-server[1155]: 2026/09/22 11:24:58 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo6825worker1 # [ 202.984057] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49900 duration_s=0 paths=1 nar_bytes_in=6246826worker1 # [ 202.987267] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499006827worker1 # [ 202.998906] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6828worker1 # [ 203.002608] nix-daemon[932]: reaped child process 2094, status = succeeded6829worker1 # [ 203.011622] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6830worker1 # [ 204.060247] nix-daemon[932]: reaped child process 2108, status = succeeded6831worker1 # [ 204.255021] nix-daemon[932]: accepted connection from pid 2124, user nix-grpc-daemon (trusted)6832worker1 # [ 204.274024] nix-daemon[932]: reaped child process 2127, status = succeeded6833lb # [ 204.352517] niks3-server[1155]: 2026/09/22 11:24:59 INFO Received uploads request method=POST path=/api/pending_closures6834worker1 # [ 204.294734] nix-grpc-daemon[1721]: time=2026-09-22T11:24:59.928Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6835worker1 # [ 204.296453] nix-grpc-daemon[1721]: time=2026-09-22T11:24:59.928Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"6836lb # [ 204.374532] niks3-server[1155]: 2026/09/22 11:25:00 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv6837lb # [ 204.382007] niks3-server[1155]: 2026/09/22 11:25:00 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst6838lb # [ 204.390539] niks3-server[1155]: 2026/09/22 11:25:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/73/sign6839worker1 # [ 204.328036] nix-grpc-daemon[1721]: time=2026-09-22T11:24:59.963Z level=INFO msg="Uploading 1 narinfos"6840lb # [ 204.397024] niks3-server[1155]: 2026/09/22 11:25:00 INFO Signed narinfos id=73 count=16841lb # [ 204.401294] niks3-server[1155]: 2026/09/22 11:25:00 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls6842lb # [ 204.407221] niks3-server[1155]: 2026/09/22 11:25:00 INFO Received complete upload request method=POST path=/api/pending_closures/73/complete6843worker1 # [ 204.344069] nix-grpc-daemon[1721]: time=2026-09-22T11:24:59.980Z level=INFO msg="Upload complete. (318ms)"6844lb # [ 204.410953] niks3-server[1155]: 2026/09/22 11:25:00 INFO Completed upload id=736845lb # [ 204.413968] niks3-server[1155]: 2026/09/22 11:25:00 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo6846worker1 # [ 204.356910] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49900 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=11 outputs=16847worker1 # [ 204.371941] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:59Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=16848worker1 # [ 204.375355] nix-grpc-daemon[1643]: ts=2026-09-22T11:24:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499006849worker1 # [ 204.379575] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:00Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=06850worker1 # [ 204.384464] nix-daemon[932]: reaped child process 2106, status = succeeded6851worker1 # [ 204.387017] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:499006852worker1 # [ 204.396304] nix-grpc-daemon[1721]: time=2026-09-22T11:25:00.032Z level=INFO msg="All 2 paths already cached"6853worker1 # [ 204.403240] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:499006854worker1 # [ 204.412274] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6855worker1 # [ 204.595059] nix-daemon[932]: accepted connection from pid 2133, user nix-grpc-daemon (trusted)6856worker1 # [ 204.615551] nix-daemon[932]: reaped child process 2136, status = succeeded6857worker1 # [ 204.792054] nix-daemon[932]: accepted connection from pid 2138, user nix-grpc-daemon (trusted)6858worker1 # [ 204.809107] nix-daemon[932]: reaped child process 2141, status = succeeded6859lb # [ 204.889354] niks3-server[1155]: 2026/09/22 11:25:00 INFO Received uploads request method=POST path=/api/pending_closures6860worker1 # [ 204.832199] nix-grpc-daemon[1721]: time=2026-09-22T11:25:00.468Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6861worker1 # [ 204.834237] nix-grpc-daemon[1721]: time=2026-09-22T11:25:00.470Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"6862lb # [ 204.910167] niks3-server[1155]: 2026/09/22 11:25:00 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst6863lb # [ 204.915723] niks3-server[1155]: 2026/09/22 11:25:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/74/sign6864worker1 # [ 204.851772] nix-grpc-daemon[1721]: time=2026-09-22T11:25:00.487Z level=INFO msg="Uploading 1 narinfos"6865lb # [ 204.920515] niks3-server[1155]: 2026/09/22 11:25:00 INFO Signed narinfos id=74 count=16866lb # [ 204.923693] niks3-server[1155]: 2026/09/22 11:25:00 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls6867lb # [ 204.929522] niks3-server[1155]: 2026/09/22 11:25:00 INFO Received complete upload request method=POST path=/api/pending_closures/74/complete6868lb # [ 204.932707] niks3-server[1155]: 2026/09/22 11:25:00 INFO Completed upload id=746869worker1 # [ 204.866230] nix-grpc-daemon[1721]: time=2026-09-22T11:25:00.502Z level=INFO msg="Upload complete. (443ms)"6870lb # [ 204.934734] niks3-server[1155]: 2026/09/22 11:25:00 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo6871worker1 # [ 204.872102] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49900 duration_s=0 paths=1 nar_bytes_in=7526872worker1 # [ 204.881389] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499006873worker1 # [ 204.885526] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6874worker1 # [ 204.889158] nix-daemon[932]: reaped child process 2131, status = succeeded6875worker1 # [ 204.898918] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6876worker1 # [ 206.127476] nix-daemon[932]: reaped child process 2145, status = succeeded6877worker1 # [ 206.302652] nix-daemon[932]: accepted connection from pid 2161, user nix-grpc-daemon (trusted)6878worker1 # [ 206.321394] nix-daemon[932]: reaped child process 2164, status = succeeded6879lb # [ 206.397650] niks3-server[1155]: 2026/09/22 11:25:02 INFO Received uploads request method=POST path=/api/pending_closures6880worker1 # [ 206.337553] nix-grpc-daemon[1721]: time=2026-09-22T11:25:01.972Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6881worker1 # [ 206.339073] nix-grpc-daemon[1721]: time=2026-09-22T11:25:01.972Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"6882lb # [ 206.418352] niks3-server[1155]: 2026/09/22 11:25:02 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv6883lb # [ 206.423323] niks3-server[1155]: 2026/09/22 11:25:02 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst6884lb # [ 206.428982] niks3-server[1155]: 2026/09/22 11:25:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/75/sign6885worker1 # [ 206.365672] nix-grpc-daemon[1721]: time=2026-09-22T11:25:02.001Z level=INFO msg="Uploading 1 narinfos"6886lb # [ 206.432436] niks3-server[1155]: 2026/09/22 11:25:02 INFO Signed narinfos id=75 count=16887lb # [ 206.436285] niks3-server[1155]: 2026/09/22 11:25:02 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls6888lb # [ 206.443607] niks3-server[1155]: 2026/09/22 11:25:02 INFO Received complete upload request method=POST path=/api/pending_closures/75/complete6889worker1 # [ 206.381812] nix-grpc-daemon[1721]: time=2026-09-22T11:25:02.017Z level=INFO msg="Upload complete. (274ms)"6890lb # [ 206.449321] niks3-server[1155]: 2026/09/22 11:25:02 INFO Completed upload id=756891lb # [ 206.452611] niks3-server[1155]: 2026/09/22 11:25:02 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo6892worker1 # [ 206.388436] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49900 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=12 outputs=16893worker1 # [ 206.396444] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:02Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=16894worker1 # [ 206.398533] nix-daemon[932]: reaped child process 2143, status = succeeded6895worker1 # [ 206.436921] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499006896worker1 # [ 206.447169] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:499006897worker1 # [ 206.457564] nix-grpc-daemon[1721]: time=2026-09-22T11:25:02.093Z level=INFO msg="All 2 paths already cached"6898worker1 # [ 206.465729] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:499006899worker1 # [ 206.476099] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6900worker1 # [ 206.658917] nix-daemon[932]: accepted connection from pid 2168, user nix-grpc-daemon (trusted)6901worker1 # [ 206.678844] nix-daemon[932]: reaped child process 2171, status = succeeded6902worker1 # [ 206.857055] nix-daemon[932]: accepted connection from pid 2173, user nix-grpc-daemon (trusted)6903worker1 # [ 206.875259] nix-daemon[932]: reaped child process 2176, status = succeeded6904lb # [ 206.953088] niks3-server[1155]: 2026/09/22 11:25:02 INFO Received uploads request method=POST path=/api/pending_closures6905worker1 # [ 206.892628] nix-grpc-daemon[1721]: time=2026-09-22T11:25:02.528Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6906worker1 # [ 206.894157] nix-grpc-daemon[1721]: time=2026-09-22T11:25:02.528Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"6907lb # [ 206.976351] niks3-server[1155]: 2026/09/22 11:25:02 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst6908lb # [ 206.992110] niks3-server[1155]: 2026/09/22 11:25:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/76/sign6909worker1 # [ 206.933058] nix-grpc-daemon[1721]: time=2026-09-22T11:25:02.568Z level=INFO msg="Uploading 1 narinfos"6910lb # [ 207.004332] niks3-server[1155]: 2026/09/22 11:25:02 INFO Signed narinfos id=76 count=16911lb # [ 207.012155] niks3-server[1155]: 2026/09/22 11:25:02 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls6912worker1 # [ 206.955161] nix-grpc-daemon[1721]: time=2026-09-22T11:25:02.591Z level=INFO msg="Upload complete. (467ms)"6913lb # [ 207.022310] niks3-server[1155]: 2026/09/22 11:25:02 INFO Received complete upload request method=POST path=/api/pending_closures/76/complete6914worker1 # [ 206.960188] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49900 duration_s=0 paths=1 nar_bytes_in=7526915lb # [ 207.027591] niks3-server[1155]: 2026/09/22 11:25:02 INFO Completed upload id=766916lb # [ 207.030849] niks3-server[1155]: 2026/09/22 11:25:02 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo6917worker1 # [ 206.969183] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499006918worker1 # [ 206.973859] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6919worker1 # [ 206.977151] nix-daemon[932]: reaped child process 2166, status = succeeded6920worker1 # [ 206.986067] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6921worker1 # [ 208.007130] nix-daemon[932]: reaped child process 2180, status = succeeded6922worker1 # [ 208.174661] nix-daemon[932]: accepted connection from pid 2196, user nix-grpc-daemon (trusted)6923worker1 # [ 208.196793] nix-daemon[932]: reaped child process 2199, status = succeeded6924lb # [ 208.278371] niks3-server[1155]: 2026/09/22 11:25:03 INFO Received uploads request method=POST path=/api/pending_closures6925worker1 # [ 208.222223] nix-grpc-daemon[1721]: time=2026-09-22T11:25:03.857Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6926worker1 # [ 208.223760] nix-grpc-daemon[1721]: time=2026-09-22T11:25:03.857Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"6927lb # [ 208.327732] niks3-server[1155]: 2026/09/22 11:25:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/77/sign6928worker1 # [ 208.271312] nix-grpc-daemon[1721]: time=2026-09-22T11:25:03.907Z level=INFO msg="Uploading 1 narinfos"6929lb # [ 208.342993] niks3-server[1155]: 2026/09/22 11:25:03 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv6930lb # [ 208.353104] niks3-server[1155]: 2026/09/22 11:25:03 INFO Signed narinfos id=77 count=16931lb # [ 208.358462] niks3-server[1155]: 2026/09/22 11:25:03 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst6932worker1 # [ 208.302481] nix-grpc-daemon[1721]: time=2026-09-22T11:25:03.938Z level=INFO msg="Upload complete. (309ms)"6933lb # [ 208.369177] niks3-server[1155]: 2026/09/22 11:25:03 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls6934lb # [ 208.373536] niks3-server[1155]: 2026/09/22 11:25:04 INFO Received complete upload request method=POST path=/api/pending_closures/77/complete6935lb # [ 208.378872] niks3-server[1155]: 2026/09/22 11:25:04 INFO Completed upload id=776936lb # [ 208.381871] niks3-server[1155]: 2026/09/22 11:25:04 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo6937worker1 # [ 208.313727] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49900 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=13 outputs=16938worker1 # [ 208.328519] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:03Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=16939worker1 # [ 208.334597] nix-daemon[932]: reaped child process 2178, status = succeeded6940worker1 # [ 208.368816] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499006941worker1 # [ 208.393039] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:499006942worker1 # [ 208.409508] nix-grpc-daemon[1721]: time=2026-09-22T11:25:04.045Z level=INFO msg="All 2 paths already cached"6943worker1 # [ 208.421998] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:499006944worker1 # [ 208.435033] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6945worker1 # [ 208.633507] nix-daemon[932]: accepted connection from pid 2203, user nix-grpc-daemon (trusted)6946worker1 # [ 208.652778] nix-daemon[932]: reaped child process 2206, status = succeeded6947worker1 # [ 208.831582] nix-daemon[932]: accepted connection from pid 2208, user nix-grpc-daemon (trusted)6948worker1 # [ 208.852225] nix-daemon[932]: reaped child process 2211, status = succeeded6949lb # [ 208.926973] niks3-server[1155]: 2026/09/22 11:25:04 INFO Received uploads request method=POST path=/api/pending_closures6950worker1 # [ 208.870756] nix-grpc-daemon[1721]: time=2026-09-22T11:25:04.506Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6951worker1 # [ 208.872402] nix-grpc-daemon[1721]: time=2026-09-22T11:25:04.506Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"6952worker1 # [ 208.901552] nix-grpc-daemon[1721]: time=2026-09-22T11:25:04.537Z level=INFO msg="Uploading 1 narinfos"6953lb # [ 208.961098] niks3-server[1155]: 2026/09/22 11:25:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/78/sign6954lb # [ 208.973346] niks3-server[1155]: 2026/09/22 11:25:04 INFO Signed narinfos id=78 count=16955lb # [ 208.981441] niks3-server[1155]: 2026/09/22 11:25:04 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst6956lb # [ 208.990439] niks3-server[1155]: 2026/09/22 11:25:04 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls6957lb # [ 208.999806] niks3-server[1155]: 2026/09/22 11:25:04 INFO Received complete upload request method=POST path=/api/pending_closures/78/complete6958worker1 # [ 208.938080] nix-grpc-daemon[1721]: time=2026-09-22T11:25:04.574Z level=INFO msg="Upload complete. (487ms)"6959lb # [ 209.005261] niks3-server[1155]: 2026/09/22 11:25:04 INFO Completed upload id=786960lb # [ 209.008507] niks3-server[1155]: 2026/09/22 11:25:04 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo6961worker1 # [ 208.948383] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49900 duration_s=0 paths=1 nar_bytes_in=7526962worker1 # [ 208.960368] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:499006963worker1 # [ 208.968537] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6964worker1 # [ 208.974209] nix-daemon[932]: reaped child process 2201, status = succeeded6965worker1 # [ 208.988957] nix-daemon[932]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6966worker1 # [ 210.223794] nix-daemon[932]: reaped child process 2215, status = succeeded6967worker1 # [ 210.403909] nix-daemon[932]: accepted connection from pid 2231, user nix-grpc-daemon (trusted)6968worker1 # [ 210.425569] nix-daemon[932]: reaped child process 2234, status = succeeded6969lb # [ 210.505564] niks3-server[1155]: 2026/09/22 11:25:06 INFO Received uploads request method=POST path=/api/pending_closures6970worker1 # [ 210.450408] nix-grpc-daemon[1721]: time=2026-09-22T11:25:06.085Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6971worker1 # [ 210.451975] nix-grpc-daemon[1721]: time=2026-09-22T11:25:06.085Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"6972lb # [ 210.547304] niks3-server[1155]: 2026/09/22 11:25:06 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst6973lb # [ 210.559181] niks3-server[1155]: 2026/09/22 11:25:06 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv6974lb # [ 210.567624] niks3-server[1155]: 2026/09/22 11:25:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/79/sign6975lb # [ 210.573576] niks3-server[1155]: 2026/09/22 11:25:06 INFO Signed narinfos id=79 count=16976worker1 # [ 210.507169] nix-grpc-daemon[1721]: time=2026-09-22T11:25:06.142Z level=INFO msg="Uploading 1 narinfos"6977lb # [ 210.577221] niks3-server[1155]: 2026/09/22 11:25:06 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls6978lb # [ 210.587387] niks3-server[1155]: 2026/09/22 11:25:06 INFO Received complete upload request method=POST path=/api/pending_closures/79/complete6979lb # [ 210.594387] niks3-server[1155]: 2026/09/22 11:25:06 INFO Completed upload id=796980worker1 # [ 210.528089] nix-grpc-daemon[1721]: time=2026-09-22T11:25:06.164Z level=INFO msg="Upload complete. (327ms)"6981lb # [ 210.597151] niks3-server[1155]: 2026/09/22 11:25:06 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo6982worker1 # [ 210.541206] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49900 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=14 outputs=16983worker1 # [ 210.560470] nix-daemon[932]: reaped child process 2213, status = succeeded6984client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 18.69 seconds)6985worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6986worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)6987client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]'6988client # [ 210.746357] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features "[\"gpu\"]".6989client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.09 seconds)6990lb: must succeed: curl -sf localhost:9901/clusters6991lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)6992lb: must succeed: curl -sf localhost:9901/clusters6993lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6994worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6995worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)6996worker1 # [ 211.033782] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:499006997client # Running as unit: gpu.service; invocation ID: f99c90f65ee44385945e3a180777ea0b6998client # [ 211.017186] nix[1520]: don't know how to build these paths:6999client # [ 211.019070] nix[1520]: /nix/store/3i1nziwpdqq19lzpqy4rywzxnm8dlps6-farm-top.drv7000worker1 # [ 211.045248] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:499007001worker1 # [ 211.068141] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:06Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=07002client # [ 211.053845] nix[1520]: warning: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, waiting up to 30s for a worker7003lb # [ 211.851833] envoy[913]: conn peer=[2001:db8:1::1]:52600 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27144 tx=12555 ms=183567004lb: must succeed: curl -sf localhost:9901/clusters7005lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)7006lb: must succeed: curl -sf localhost:9901/clusters7007lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)7008worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics7009worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)7010client: waiting for success: systemctl show -p Result gpu | grep -q exit-code7011client # [ 241.055369] nix[1520]: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}7012client # [ 241.065182] nix[1520]: error: dependency '1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv' failed7013client # [ 241.114452] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE7014client # [ 241.122105] systemd[1]: gpu.service: Failed with result 'exit-code'.7015client # [ 241.125573] systemd[1]: gpu.service: Consumed 188ms CPU time over 30.373s wall clock time, 35.4M memory peak, 5.1K incoming IP traffic, 5K outgoing IP traffic.7016client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.27 seconds)7017client: must succeed: journalctl -u gpu -o cat7018client: (finished: must succeed: journalctl -u gpu -o cat, in 0.03 seconds)7019lb: must succeed: curl -sf localhost:9901/clusters7020lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)7021lb: must succeed: curl -sf localhost:9901/clusters7022lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)7023worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics7024lb # [ 241.846138] envoy[913]: conn peer=[2001:db8:1::1]:38972 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=499 ms=300707025worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)7026(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 49.86 seconds)7027subtest: low disk drains a worker and builds go to the other7028worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill7029worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.13 seconds)7030worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'7031worker1 # [ 243.163545] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:38Z level=info event=unhealthy reason=min_free7032worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.12 seconds)7033client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&27034worker1 # [ 244.313554] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:499007035client # don't know how to build these paths:7036client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv7037worker1 # [ 244.324911] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:499007038worker1 # [ 244.351764] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:39Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=07039worker1 # [ 244.357854] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:39Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=17040worker2 # [ 244.382405] nix-grpc-daemon[2020]: ts=2026-09-22T11:25:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359007041worker2 # [ 244.396429] nix-daemon[863]: accepted connection from pid 2020, user nix-grpc-daemon (trusted)7042worker2 # [ 244.424913] nix-grpc-daemon[2020]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 39 ms (attempt 1/5)7043worker2 # [ 244.471229] nix-grpc-daemon[2020]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 72 ms (attempt 2/5)7044worker2 # [ 244.550789] nix-grpc-daemon[2020]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 245 ms (attempt 3/5)7045worker2 # [ 244.803578] nix-grpc-daemon[2020]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 554 ms (attempt 4/5)7046worker2 # [ 245.365411] nix-grpc-daemon[2020]: disabling binary cache 'https://cache.nixos.org' for 60 seconds7047worker2 # [ 245.371270] nix-grpc-daemon[2020]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org7048worker2 # [ 245.394020] nix-grpc-daemon[2020]: ts=2026-09-22T11:25:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:359007049client # copying 1 paths to 'lb:50051'...7050client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...7051worker2 # [ 245.410049] nix-grpc-daemon[2020]: ts=2026-09-22T11:25:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:359007052worker2 # [ 245.423079] nix-daemon[863]: accepted connection from pid 2020, user nix-grpc-daemon (trusted)7053worker2 # [ 245.456131] nix-grpc-daemon[2020]: ts=2026-09-22T11:25:41Z level=info event=niks3_push_started pid=20807054worker2 # [ 245.669121] nix-grpc-daemon[2080]: time=2026-09-22T11:25:41.299Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca=""7055worker2 # [ 245.845438] nix-daemon[863]: accepted connection from pid 2093, user nix-grpc-daemon (trusted)7056worker2 # [ 245.863014] nix-daemon[863]: reaped child process 2096, status = succeeded7057worker2 # [ 246.036517] nix-daemon[863]: accepted connection from pid 2098, user nix-grpc-daemon (trusted)7058worker2 # [ 246.052847] nix-daemon[863]: reaped child process 2101, status = succeeded7059lb # [ 246.157430] niks3-server[1155]: 2026/09/22 11:25:41 INFO Received uploads request method=POST path=/api/pending_closures7060worker2 # [ 246.079504] nix-grpc-daemon[2080]: time=2026-09-22T11:25:41.709Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7061worker2 # [ 246.081355] nix-grpc-daemon[2080]: time=2026-09-22T11:25:41.709Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"7062lb # [ 246.203334] niks3-server[1155]: 2026/09/22 11:25:41 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst7063worker2 # [ 246.128128] nix-grpc-daemon[2080]: time=2026-09-22T11:25:41.758Z level=INFO msg="Uploading 1 narinfos"7064lb # [ 246.220307] niks3-server[1155]: 2026/09/22 11:25:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/80/sign7065lb # [ 246.229934] niks3-server[1155]: 2026/09/22 11:25:41 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls7066lb # [ 246.237591] niks3-server[1155]: 2026/09/22 11:25:41 INFO Signed narinfos id=80 count=17067worker2 # [ 246.157190] nix-grpc-daemon[2080]: time=2026-09-22T11:25:41.788Z level=INFO msg="Upload complete. (483ms)"7068lb # [ 246.247815] niks3-server[1155]: 2026/09/22 11:25:41 INFO Received complete upload request method=POST path=/api/pending_closures/80/complete7069lb # [ 246.254366] niks3-server[1155]: 2026/09/22 11:25:41 INFO Completed upload id=807070lb # [ 246.258814] niks3-server[1155]: 2026/09/22 11:25:41 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo7071worker2 # [ 246.168199] nix-grpc-daemon[2020]: ts=2026-09-22T11:25:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35900 duration_s=0 paths=1 nar_bytes_in=5127072worker2 # [ 246.180351] nix-grpc-daemon[2020]: ts=2026-09-22T11:25:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359007073worker2 # [ 246.188969] nix-daemon[863]: accepted connection from pid 2020, user nix-grpc-daemon (trusted)7074worker2 # [ 246.194256] nix-daemon[863]: reaped child process 2078, status = succeeded7075client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...7076worker2 # [ 246.205797] nix-daemon[863]: accepted connection from pid 2020, user nix-grpc-daemon (trusted)7077client # farm-a> worker2-next: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv7078client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds7079client # farm-a> LOG-farm-a-drain7080worker2 # [ 247.853666] nix-daemon[863]: reaped child process 2105, status = succeeded7081worker2 # [ 248.028666] nix-daemon[863]: accepted connection from pid 2121, user nix-grpc-daemon (trusted)7082worker2 # [ 248.048228] nix-daemon[863]: reaped child process 2124, status = succeeded7083lb # [ 248.150963] niks3-server[1155]: 2026/09/22 11:25:43 INFO Received uploads request method=POST path=/api/pending_closures7084worker2 # [ 248.072436] nix-grpc-daemon[2080]: time=2026-09-22T11:25:43.701Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7085worker2 # [ 248.074032] nix-grpc-daemon[2080]: time=2026-09-22T11:25:43.701Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"7086lb # [ 248.193435] niks3-server[1155]: 2026/09/22 11:25:43 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv7087lb # [ 248.204457] niks3-server[1155]: 2026/09/22 11:25:43 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst7088lb # [ 248.214794] niks3-server[1155]: 2026/09/22 11:25:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/81/sign7089lb # [ 248.221904] niks3-server[1155]: 2026/09/22 11:25:43 INFO Signed narinfos id=81 count=17090worker2 # [ 248.132130] nix-grpc-daemon[2080]: time=2026-09-22T11:25:43.761Z level=INFO msg="Uploading 1 narinfos"7091lb # [ 248.224942] niks3-server[1155]: 2026/09/22 11:25:43 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls7092lb # [ 248.240205] niks3-server[1155]: 2026/09/22 11:25:43 INFO Received complete upload request method=POST path=/api/pending_closures/81/complete7093lb # [ 248.247016] niks3-server[1155]: 2026/09/22 11:25:43 INFO Completed upload id=817094worker2 # [ 248.155864] nix-grpc-daemon[2080]: time=2026-09-22T11:25:43.787Z level=INFO msg="Upload complete. (336ms)"7095lb # [ 248.250302] niks3-server[1155]: 2026/09/22 11:25:43 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo7096worker2 # [ 248.169133] nix-grpc-daemon[2020]: ts=2026-09-22T11:25:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35900 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=15 outputs=17097worker1 # [ 248.198685] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:43Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=07098worker1 # [ 248.204872] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:43Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=17099worker2 # [ 248.189180] nix-daemon[863]: reaped child process 2103, status = succeeded7100worker2 # [ 248.221677] nix-grpc-daemon[2020]: ts=2026-09-22T11:25:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359007101worker2 # [ 248.238552] nix-grpc-daemon[2020]: ts=2026-09-22T11:25:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:359007102worker2 # [ 248.253007] nix-grpc-daemon[2080]: time=2026-09-22T11:25:43.884Z level=INFO msg="All 1 paths already cached"7103client # copying 1 paths to 'lb:50051'...7104client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...7105worker2 # [ 248.263954] nix-grpc-daemon[2020]: ts=2026-09-22T11:25:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:359007106worker2 # [ 248.277786] nix-daemon[863]: accepted connection from pid 2020, user nix-grpc-daemon (trusted)7107worker2 # [ 248.480297] nix-daemon[863]: accepted connection from pid 2128, user nix-grpc-daemon (trusted)7108worker2 # [ 248.498849] nix-daemon[863]: reaped child process 2131, status = succeeded7109worker2 # [ 248.676259] nix-daemon[863]: accepted connection from pid 2133, user nix-grpc-daemon (trusted)7110worker2 # [ 248.692574] nix-daemon[863]: reaped child process 2136, status = succeeded7111lb # [ 248.797970] niks3-server[1155]: 2026/09/22 11:25:44 INFO Received uploads request method=POST path=/api/pending_closures7112worker2 # [ 248.717872] nix-grpc-daemon[2080]: time=2026-09-22T11:25:44.348Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7113worker2 # [ 248.719366] nix-grpc-daemon[2080]: time=2026-09-22T11:25:44.348Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"7114lb # [ 248.825175] niks3-server[1155]: 2026/09/22 11:25:44 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst7115worker2 # [ 248.746653] nix-grpc-daemon[2080]: time=2026-09-22T11:25:44.377Z level=INFO msg="Uploading 1 narinfos"7116lb # [ 248.841095] niks3-server[1155]: 2026/09/22 11:25:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/82/sign7117lb # [ 248.851164] niks3-server[1155]: 2026/09/22 11:25:44 INFO Signed narinfos id=82 count=17118lb # [ 248.856584] niks3-server[1155]: 2026/09/22 11:25:44 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls7119lb # [ 248.864650] niks3-server[1155]: 2026/09/22 11:25:44 INFO Received complete upload request method=POST path=/api/pending_closures/82/complete7120lb # [ 248.869219] niks3-server[1155]: 2026/09/22 11:25:44 INFO Completed upload id=827121worker2 # [ 248.778424] nix-grpc-daemon[2080]: time=2026-09-22T11:25:44.409Z level=INFO msg="Upload complete. (483ms)"7122lb # [ 248.871971] niks3-server[1155]: 2026/09/22 11:25:44 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo7123worker2 # [ 248.788953] nix-grpc-daemon[2020]: ts=2026-09-22T11:25:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35900 duration_s=0 paths=1 nar_bytes_in=6327124worker2 # [ 248.797284] nix-grpc-daemon[2020]: ts=2026-09-22T11:25:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359007125worker2 # [ 248.803628] nix-daemon[863]: accepted connection from pid 2020, user nix-grpc-daemon (trusted)7126worker2 # [ 248.809153] nix-daemon[863]: reaped child process 2126, status = succeeded7127client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...7128worker2 # [ 248.821264] nix-daemon[863]: accepted connection from pid 2020, user nix-grpc-daemon (trusted)7129client # farm-b> worker2-next: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv7130client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds7131client # farm-b> LOG-farm-b-drain7132worker2 # [ 250.066709] nix-daemon[863]: reaped child process 2140, status = succeeded7133worker2 # [ 250.247871] nix-daemon[863]: accepted connection from pid 2156, user nix-grpc-daemon (trusted)7134worker2 # [ 250.266010] nix-daemon[863]: reaped child process 2159, status = succeeded7135lb # [ 250.369534] niks3-server[1155]: 2026/09/22 11:25:46 INFO Received uploads request method=POST path=/api/pending_closures7136worker2 # [ 250.288518] nix-grpc-daemon[2080]: time=2026-09-22T11:25:45.919Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7137worker2 # [ 250.290220] nix-grpc-daemon[2080]: time=2026-09-22T11:25:45.919Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"7138lb # [ 250.404175] niks3-server[1155]: 2026/09/22 11:25:46 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv7139lb # [ 250.418120] niks3-server[1155]: 2026/09/22 11:25:46 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst7140lb # [ 250.431589] niks3-server[1155]: 2026/09/22 11:25:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/83/sign7141worker2 # [ 250.345768] nix-grpc-daemon[2080]: time=2026-09-22T11:25:45.976Z level=INFO msg="Uploading 1 narinfos"7142lb # [ 250.441654] niks3-server[1155]: 2026/09/22 11:25:46 INFO Signed narinfos id=83 count=17143lb # [ 250.446924] niks3-server[1155]: 2026/09/22 11:25:46 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls7144lb # [ 250.454304] niks3-server[1155]: 2026/09/22 11:25:46 INFO Received complete upload request method=POST path=/api/pending_closures/83/complete7145lb # [ 250.461614] niks3-server[1155]: 2026/09/22 11:25:46 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo7146lb # [ 250.467700] niks3-server[1155]: 2026/09/22 11:25:46 INFO Completed upload id=837147worker2 # [ 250.377233] nix-grpc-daemon[2080]: time=2026-09-22T11:25:46.008Z level=INFO msg="Upload complete. (345ms)"7148worker2 # [ 250.389230] nix-grpc-daemon[2020]: ts=2026-09-22T11:25:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35900 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=16 outputs=17149worker1 # [ 250.418872] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:46Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=07150worker1 # [ 250.425159] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:46Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=17151worker2 # [ 250.411631] nix-grpc-daemon[2020]: ts=2026-09-22T11:25:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359007152worker2 # [ 250.418230] nix-daemon[863]: reaped child process 2138, status = succeeded7153worker2 # [ 250.427362] nix-grpc-daemon[2020]: ts=2026-09-22T11:25:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:359007154worker2 # [ 250.440747] nix-grpc-daemon[2080]: time=2026-09-22T11:25:46.071Z level=INFO msg="All 2 paths already cached"7155client # copying 1 paths to 'lb:50051'...7156client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...7157worker2 # [ 250.452071] nix-grpc-daemon[2020]: ts=2026-09-22T11:25:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:359007158worker2 # [ 250.465393] nix-daemon[863]: accepted connection from pid 2020, user nix-grpc-daemon (trusted)7159worker2 # [ 250.664821] nix-daemon[863]: accepted connection from pid 2163, user nix-grpc-daemon (trusted)7160worker2 # [ 250.684498] nix-daemon[863]: reaped child process 2166, status = succeeded7161worker2 # [ 250.858557] nix-daemon[863]: accepted connection from pid 2168, user nix-grpc-daemon (trusted)7162worker2 # [ 250.877218] nix-daemon[863]: reaped child process 2171, status = succeeded7163lb # [ 250.981345] niks3-server[1155]: 2026/09/22 11:25:46 INFO Received uploads request method=POST path=/api/pending_closures7164worker2 # [ 250.899414] nix-grpc-daemon[2080]: time=2026-09-22T11:25:46.530Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7165worker2 # [ 250.901081] nix-grpc-daemon[2080]: time=2026-09-22T11:25:46.530Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"7166lb # [ 251.008472] niks3-server[1155]: 2026/09/22 11:25:46 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst7167lb # [ 251.020459] niks3-server[1155]: 2026/09/22 11:25:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/84/sign7168worker2 # [ 250.937843] nix-grpc-daemon[2080]: time=2026-09-22T11:25:46.568Z level=INFO msg="Uploading 1 narinfos"7169lb # [ 251.028314] niks3-server[1155]: 2026/09/22 11:25:46 INFO Signed narinfos id=84 count=17170lb # [ 251.032794] niks3-server[1155]: 2026/09/22 11:25:46 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls7171lb # [ 251.046861] niks3-server[1155]: 2026/09/22 11:25:46 INFO Received complete upload request method=POST path=/api/pending_closures/84/complete7172worker2 # [ 250.962474] nix-grpc-daemon[2080]: time=2026-09-22T11:25:46.593Z level=INFO msg="Upload complete. (482ms)"7173lb # [ 251.056110] niks3-server[1155]: 2026/09/22 11:25:46 INFO Completed upload id=847174worker2 # [ 250.968246] nix-grpc-daemon[2020]: ts=2026-09-22T11:25:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35900 duration_s=0 paths=1 nar_bytes_in=7607175lb # [ 251.060548] niks3-server[1155]: 2026/09/22 11:25:46 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo7176worker2 # [ 250.983330] nix-grpc-daemon[2020]: ts=2026-09-22T11:25:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:359007177worker2 # [ 250.990295] nix-daemon[863]: accepted connection from pid 2020, user nix-grpc-daemon (trusted)7178worker2 # [ 250.995090] nix-daemon[863]: reaped child process 2161, status = succeeded7179client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...7180worker2 # [ 251.006468] nix-daemon[863]: accepted connection from pid 2020, user nix-grpc-daemon (trusted)7181client # farm-top> worker2-next: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv7182client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds7183client # farm-top> LOG-farm-top-drain7184worker2 # [ 252.040793] nix-daemon[863]: reaped child process 2175, status = succeeded7185worker2 # [ 252.212389] nix-daemon[863]: accepted connection from pid 2191, user nix-grpc-daemon (trusted)7186worker2 # [ 252.230833] nix-daemon[863]: reaped child process 2194, status = succeeded7187lb # [ 252.335526] niks3-server[1155]: 2026/09/22 11:25:47 INFO Received uploads request method=POST path=/api/pending_closures7188worker2 # [ 252.256434] nix-grpc-daemon[2080]: time=2026-09-22T11:25:47.886Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7189worker2 # [ 252.257960] nix-grpc-daemon[2080]: time=2026-09-22T11:25:47.886Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"7190lb # [ 252.371659] niks3-server[1155]: 2026/09/22 11:25:48 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst7191lb # [ 252.389830] niks3-server[1155]: 2026/09/22 11:25:48 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv7192lb # [ 252.399228] niks3-server[1155]: 2026/09/22 11:25:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/85/sign7193worker2 # [ 252.314369] nix-grpc-daemon[2080]: time=2026-09-22T11:25:47.945Z level=INFO msg="Uploading 1 narinfos"7194lb # [ 252.408403] niks3-server[1155]: 2026/09/22 11:25:48 INFO Signed narinfos id=85 count=17195lb # [ 252.410798] niks3-server[1155]: 2026/09/22 11:25:48 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls7196lb # [ 252.420678] niks3-server[1155]: 2026/09/22 11:25:48 INFO Received complete upload request method=POST path=/api/pending_closures/85/complete7197lb # [ 252.427811] niks3-server[1155]: 2026/09/22 11:25:48 INFO Completed upload id=857198worker2 # [ 252.337022] nix-grpc-daemon[2080]: time=2026-09-22T11:25:47.968Z level=INFO msg="Upload complete. (319ms)"7199lb # [ 252.430377] niks3-server[1155]: 2026/09/22 11:25:48 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo7200worker2 # [ 252.349178] nix-grpc-daemon[2020]: ts=2026-09-22T11:25:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35900 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=17 outputs=17201worker2 # [ 252.368211] nix-daemon[863]: reaped child process 2173, status = succeeded7202client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 8.39 seconds)7203client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath7204client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.25 seconds)7205worker1: must succeed: rm /nix/.rw-store/fill7206worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.17 seconds)7207worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'7208worker1 # [ 253.167543] nix-grpc-daemon[1643]: ts=2026-09-22T11:25:48Z level=info event=healthy reason=min_free7209worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.14 seconds)7210(finished: subtest: low disk drains a worker and builds go to the other, in 12.32 seconds)7211(finished: run the VM test script, in 254.97 seconds)7212test script finished in 255.30s7213cleanup7214kill QemuMachine (pid 49)7215client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)7216kill QemuMachine (pid 50)7217lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)7218kill QemuMachine (pid 51)7219worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)7220kill QemuMachine (pid 52)7221worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)7222(finished: cleanup, in 1.14 seconds)7223additionally exposed symbols:7224 client, lb, worker1, worker2,7225 vlan1,7226 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh