vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #488
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.01 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12client # Disk image does not exist, creating the virtualisation disk image...13lb # Disk image does not exist, creating the virtualisation disk image...14client: QEMU running (pid 49)15lb: QEMU running (pid 51)16lb # Formatting '/build/vm-state-lb/tmp.YdGJx1bs2o', fmt=raw size=107374182417lb # mke2fs 1.47.4 (6-Mar-2025)18lb # Discarding device blocks: 0/262144 done19lb # Creating filesystem with 262144 4k blocks and 65536 inodes20lb # Filesystem UUID: 32371818-190c-4a85-8b65-8a16c473a43c21lb # Superblock backups stored on blocks:22lb # 32768, 98304, 163840, 22937623lb # 24lb # Allocating group tables: 0/8 done25lb # Writing inode tables: 0/8 done26lb # Creating journal (8192 blocks): done27lb # Writing superblocks and filesystem accounting information: 0/8 done28lb # 29lb # Virtualisation disk image created.30worker2 # Disk image does not exist, creating the virtualisation disk image...31worker2: QEMU running (pid 52)32worker2 # Formatting '/build/vm-state-worker2/tmp.ytgiCePotg', fmt=raw size=107374182433client # Formatting '/build/vm-state-client/tmp.gYcIBsV7Te', fmt=raw size=107374182434worker2 # mke2fs 1.47.4 (6-Mar-2025)35worker1 # Disk image does not exist, creating the virtualisation disk image...36client # mke2fs 1.47.4 (6-Mar-2025)37worker2 # Discarding device blocks: 0/262144 done38worker1: QEMU running (pid 50)39worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes40worker1 # Formatting '/build/vm-state-worker1/tmp.q7zQpCjALH', fmt=raw size=107374182441worker2 # Filesystem UUID: 46601aa9-a2da-4d97-bf78-b2a378c498a542worker1 # mke2fs 1.47.4 (6-Mar-2025)43(finished: start all VMs, in 1.06 seconds)44client # Discarding device blocks: 0/262144 done45worker2 # Superblock backups stored on blocks:46worker1 # Discarding device blocks: 0/262144 done47client: waiting for unit network-addresses-eth1.service48client # Creating filesystem with 262144 4k blocks and 65536 inodes49worker2 # 32768, 98304, 163840, 22937650worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes51client: waiting for the VM to finish booting52client # Filesystem UUID: 0e25af29-1167-4ea2-9706-e005ba0f90e953worker2 # 54client # Superblock backups stored on blocks:55worker2 # Allocating group tables: 0/8 done56client # 32768, 98304, 163840, 22937657worker2 # Writing inode tables: 0/8 done58client # 59worker2 # Creating journal (8192 blocks): done60client # Allocating group tables: 0/8 done61worker2 # Writing superblocks and filesystem accounting information: 0/8 done62client # Writing inode tables: 0/8 done63worker2 # 64client # Creating journal (8192 blocks): done65worker2 # Virtualisation disk image created.66client # Writing superblocks and filesystem accounting information: 0/8 done67worker1 # Filesystem UUID: 8de9c3ca-d696-4c24-be69-648c18db6bb868client # 69worker1 # Superblock backups stored on blocks:70client # Virtualisation disk image created.71worker1 # 32768, 98304, 163840, 22937672worker1 # 73worker1 # Allocating group tables: 0/8 done74worker1 # Writing inode tables: 0/8 done75worker1 # Creating journal (8192 blocks): done76worker1 # Writing superblocks and filesystem accounting information: 0/8 done77worker1 # 78worker1 # Virtualisation disk image created.79worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]80worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202681worker2 # [ 0.000000] KASLR enabled82worker2 # [ 0.000000] random: crng init done83worker2 # [ 0.000000] Machine model: linux,dummy-virt84worker2 # [ 0.000000] efi: UEFI not found.85worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT86lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]87worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]88worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]89worker2 # [ 0.000000] Zone ranges:90lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202691lb # [ 0.000000] KASLR enabled92worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]93lb # [ 0.000000] random: crng init done94worker2 # [ 0.000000] DMA32 empty95lb # [ 0.000000] Machine model: linux,dummy-virt96worker2 # [ 0.000000] Normal empty97lb # [ 0.000000] efi: UEFI not found.98worker2 # [ 0.000000] Device empty99worker2 # [ 0.000000] Movable zone start for each node100lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT101worker2 # [ 0.000000] Early memory node ranges102lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]103worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]104lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]105worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]106lb # [ 0.000000] Zone ranges:107worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000108lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]109lb # [ 0.000000] DMA32 empty110worker2 # [ 0.000000] psci: probing for conduit method from DT.111lb # [ 0.000000] Normal empty112worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.113lb # [ 0.000000] Device empty114lb # [ 0.000000] Movable zone start for each node115worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs116lb # [ 0.000000] Early memory node ranges117worker2 # [ 0.000000] psci: Trusted OS migration not required118worker2 # [ 0.000000] psci: SMC Calling Convention v1.1119lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]120lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]121worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)122lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000123worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296124lb # [ 0.000000] psci: probing for conduit method from DT.125worker2 # [ 0.000000] Detected PIPT I-cache on CPU0126lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.127lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs128worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)129lb # [ 0.000000] psci: Trusted OS migration not required130worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface131lb # [ 0.000000] psci: SMC Calling Convention v1.1132worker2 # [ 0.000000] CPU features: detected: Spectre-v4133worker2 # [ 0.000000] CPU features: detected: Spectre-BHB134lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)135worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38136lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296137worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23138lb # [ 0.000000] Detected PIPT I-cache on CPU0139worker2 # [ 0.000000] alternatives: applying boot alternatives140lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)141lb # [ 0.000000] CPU features: detected: GICv3 CPU interface142worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/78c7ibbkdrnd8irpxz37agc6v4py6pgh-nixos-system-worker2-test/init regInfo=/nix/store/llaiz1z9ilncsbals7q734hl4qaxyws8-closure-info/registration console=ttyAMA0,115200n8 console=tty0143lb # [ 0.000000] CPU features: detected: Spectre-v4144lb # [ 0.000000] CPU features: detected: Spectre-BHB145lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38146worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/llaiz1z9ilncsbals7q734hl4qaxyws8-closure-info/registration", will be passed to user space.147lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23148worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes149lb # [ 0.000000] alternatives: applying boot alternatives150worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)151worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)152worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB153worker2 # [ 0.000000] software IO TLB: area num 1.154worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB155lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/a9n40kyqx09p2mx9kz6ck1ddzmmfmfqv-nixos-system-lb-test/init regInfo=/nix/store/kxfc7nc3yvm950aydaljrdz4dxr491hv-closure-info/registration console=ttyAMA0,115200n8 console=tty0156worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)157worker2 # [ 0.000000] Fallback order for Node 0: 0158lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/kxfc7nc3yvm950aydaljrdz4dxr491hv-closure-info/registration", will be passed to user space.159worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216160worker2 # [ 0.000000] Policy zone: DMA161lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes162worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off163lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)164worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1165lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)166worker2 # [ 0.000000] allocated 3145728 bytes of page_ext167worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages168lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB169worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups170lb # [ 0.000000] software IO TLB: area num 1.171worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.172lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB173worker2 # [ 0.000000] rcu: RCU event tracing is enabled.174worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]175lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)176worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.177lb # [ 0.000000] Fallback order for Node 0: 0178worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.179worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026180lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216181worker1 # [ 0.000000] KASLR enabled182worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.183lb # [ 0.000000] Policy zone: DMA184worker1 # [ 0.000000] random: crng init done185worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.186worker1 # [ 0.000000] Machine model: linux,dummy-virt187lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off188client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]189worker1 # [ 0.000000] efi: UEFI not found.190worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.191lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1192worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT193worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1194lb # [ 0.000000] allocated 3145728 bytes of page_ext195client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026196lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages197worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]198client # [ 0.000000] KASLR enabled199worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.200client # [ 0.000000] random: crng init done201lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups202worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]203worker1 # [ 0.000000] Zone ranges:204client # [ 0.000000] Machine model: linux,dummy-virt205lb # [ 0.000000] rcu: Hierarchical RCU implementation.206worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.207client # [ 0.000000] efi: UEFI not found.208lb # [ 0.000000] rcu: RCU event tracing is enabled.209worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]210worker1 # [ 0.000000] DMA32 empty211client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT212worker1 # [ 0.000000] Normal empty213worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.214lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.215worker1 # [ 0.000000] Device empty216lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.217worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0218worker1 # [ 0.000000] Movable zone start for each node219client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]220worker2 # [ 0.000000] GICv3: 256 SPIs implemented221worker1 # [ 0.000000] Early memory node ranges222lb # [ 0.000000] Rude variant of Tasks RCU enabled.223client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]224worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented225lb # [ 0.000000] Tracing variant of Tasks RCU enabled.226client # [ 0.000000] Zone ranges:227worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]228worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq229client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]230lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.231worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]232worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI233client # [ 0.000000] DMA32 empty234client # [ 0.000000] Normal empty235worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0236lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1237worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000238client # [ 0.000000] Device empty239client # [ 0.000000] Movable zone start for each node240worker1 # [ 0.000000] psci: probing for conduit method from DT.241worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000242client # [ 0.000000] Early memory node ranges243lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.244worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.245worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]246client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]247worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs248lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.249worker1 # [ 0.000000] psci: Trusted OS migration not required250worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)251client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]252worker1 # [ 0.000000] psci: SMC Calling Convention v1.1253lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.254client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000255worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)256lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0257worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)258client # [ 0.000000] psci: probing for conduit method from DT.259worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000260lb # [ 0.000000] GICv3: 256 SPIs implemented261client # [ 0.000000] psci: PSCIv1.3 detected in firmware.262worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296263lb # [ 0.000000] GICv3: 0 Extended SPIs implemented264client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs265worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000266worker1 # [ 0.000000] Detected PIPT I-cache on CPU0267lb # [ 0.000000] Root IRQ handler: gic_handle_irq268client # [ 0.000000] psci: Trusted OS migration not required269worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.270lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI271client # [ 0.000000] psci: SMC Calling Convention v1.1272worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)273lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0274worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface275worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns276client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)277lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000278worker1 # [ 0.000000] CPU features: detected: Spectre-v4279worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).280lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]281worker1 # [ 0.000000] CPU features: detected: Spectre-BHB282client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296283client # [ 0.000000] Detected PIPT I-cache on CPU0284worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38285lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)286worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns287client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)288worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23289lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)290worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns291client # [ 0.000000] CPU features: detected: GICv3 CPU interface292worker1 # [ 0.000000] alternatives: applying boot alternatives293lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000294worker2 # [ 0.000053] arm-pv: using stolen time PV295client # [ 0.000000] CPU features: detected: Spectre-v4296client # [ 0.000000] CPU features: detected: Spectre-BHB297lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000298worker2 # [ 0.001913] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)299client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38300worker2 # [ 0.002128] Console: colour dummy device 80x25301lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.302client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23303worker2 # [ 0.002136] printk: legacy console [tty0] enabled304client # [ 0.000000] alternatives: applying boot alternatives305lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns306worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/15akwfj87h9x1a1mm1madsr1gizhj855-nixos-system-worker1-test/init regInfo=/nix/store/akngzink193m6x1mxil9pnzd2g7wki6n-closure-info/registration console=ttyAMA0,115200n8 console=tty0307worker2 # [ 0.002351] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)308lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).309worker2 # [ 0.002358] pid_max: default: 32768 minimum: 301310worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/akngzink193m6x1mxil9pnzd2g7wki6n-closure-info/registration", will be passed to user space.311worker2 # [ 0.002435] LSM: initializing lsm=capability,landlock,yama,bpf,ima312lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns313worker2 # [ 0.002825] landlock: Up and running.314worker2 # [ 0.002828] Yama: becoming mindful.315worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes316lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns317worker2 # [ 0.004917] LSM support for eBPF active318client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/7k0a7n8x1zd6x0xsp0lh395b7bhivpl8-nixos-system-client-test/init regInfo=/nix/store/dk026v7ww80sprshdhxp62h8c8f019ym-closure-info/registration console=ttyAMA0,115200n8 console=tty0319lb # [ 0.000061] arm-pv: using stolen time PV320worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)321worker2 # [ 0.005236] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)322worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)323lb # [ 0.002072] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)324worker2 # [ 0.005277] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)325client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/dk026v7ww80sprshdhxp62h8c8f019ym-closure-info/registration", will be passed to user space.326lb # [ 0.002291] Console: colour dummy device 80x25327worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB328worker2 # [ 0.006504] cacheinfo: Unable to detect cache hierarchy for CPU 0329lb # [ 0.002300] printk: legacy console [tty0] enabled330worker1 # [ 0.000000] software IO TLB: area num 1.331client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes332worker2 # [ 0.007324] rcu: Hierarchical SRCU implementation.333worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB334worker2 # [ 0.007328] rcu: Max phase no-delay instances is 1000.335client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)336lb # [ 0.002519] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)337worker2 # [ 0.008603] fsl-mc MSI: its@8080000 domain created338worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)339lb # [ 0.002526] pid_max: default: 32768 minimum: 301340client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)341worker2 # [ 0.008702] EFI services will not be available.342worker1 # [ 0.000000] Fallback order for Node 0: 0343lb # [ 0.002618] LSM: initializing lsm=capability,landlock,yama,bpf,ima344worker2 # [ 0.008782] smp: Bringing up secondary CPUs ...345client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB346lb # [ 0.003029] landlock: Up and running.347worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216348worker2 # [ 0.008792] smp: Brought up 1 node, 1 CPU349client # [ 0.000000] software IO TLB: area num 1.350worker1 # [ 0.000000] Policy zone: DMA351lb # [ 0.003031] Yama: becoming mindful.352lb # [ 0.004931] LSM support for eBPF active353worker2 # [ 0.008795] SMP: Total of 1 processors activated.354client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB355worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off356worker2 # [ 0.008801] CPU: All CPU(s) started at EL1357lb # [ 0.005197] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)358client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)359worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1360worker2 # [ 0.008817] CPU features: detected: Branch Target Identification361client # [ 0.000000] Fallback order for Node 0: 0362worker1 # [ 0.000000] allocated 3145728 bytes of page_ext363lb # [ 0.005235] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)364worker2 # [ 0.008825] CPU features: detected: ARMv8.4 Translation Table Level365worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages366client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216367lb # [ 0.006498] cacheinfo: Unable to detect cache hierarchy for CPU 0368client # [ 0.000000] Policy zone: DMA369worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups370worker2 # [ 0.008828] CPU features: detected: Instruction cache invalidation not required for I/D coherence371lb # [ 0.007309] rcu: Hierarchical SRCU implementation.372worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.373client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off374lb # [ 0.007315] rcu: Max phase no-delay instances is 1000.375worker1 # [ 0.000000] rcu: RCU event tracing is enabled.376worker2 # [ 0.008832] CPU features: detected: Data cache clean to the PoU not required for I/D coherence377lb # [ 0.008634] fsl-mc MSI: its@8080000 domain created378client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1379worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.380lb # [ 0.008752] EFI services will not be available.381client # [ 0.000000] allocated 3145728 bytes of page_ext382worker2 # [ 0.008836] CPU features: detected: Common not Private translations383lb # [ 0.008870] smp: Bringing up secondary CPUs ...384worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.385worker2 # [ 0.008839] CPU features: detected: CRC32 instructions386client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages387lb # [ 0.008879] smp: Brought up 1 node, 1 CPU388worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.389client # [ 0.000000] ftrace: allocated 294 pages with 4 groups390worker2 # [ 0.008842] CPU features: detected: Data cache clean to Point of Deep Persistence391lb # [ 0.008882] SMP: Total of 1 processors activated.392worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.393client # [ 0.000000] rcu: Hierarchical RCU implementation.394lb # [ 0.008888] CPU: All CPU(s) started at EL1395worker2 # [ 0.008846] CPU features: detected: Data cache clean to Point of Persistence396client # [ 0.000000] rcu: RCU event tracing is enabled.397worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.398lb # [ 0.008906] CPU features: detected: Branch Target Identification399worker2 # [ 0.008849] CPU features: detected: Data independent timing control (DIT)400client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.401worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1402lb # [ 0.008912] CPU features: detected: ARMv8.4 Translation Table Level403worker2 # [ 0.008852] CPU features: detected: E0PD404client # [ 0.000000] Trampoline variant of Tasks RCU enabled.405worker2 # [ 0.008855] CPU features: detected: Enhanced Counter Virtualization406client # [ 0.000000] Rude variant of Tasks RCU enabled.407client # [ 0.000000] Tracing variant of Tasks RCU enabled.408lb # [ 0.008915] CPU features: detected: Instruction cache invalidation not required for I/D coherence409worker2 # [ 0.008858] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)410worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.411client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.412worker2 # [ 0.008861] CPU features: detected: Enhanced Virtualization Traps413lb # [ 0.008918] CPU features: detected: Data cache clean to the PoU not required for I/D coherence414worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.415worker2 # [ 0.008865] CPU features: detected: Fine Grained Traps416client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1417lb # [ 0.008922] CPU features: detected: Common not Private translations418lb # [ 0.008925] CPU features: detected: CRC32 instructions419worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.420worker2 # [ 0.008868] CPU features: detected: Generic authentication (architected QARMA5 algorithm)421client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.422worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0423lb # [ 0.008928] CPU features: detected: Data cache clean to Point of Deep Persistence424worker2 # [ 0.008874] CPU features: detected: RCpc load-acquire (LDAPR)425worker1 # [ 0.000000] GICv3: 256 SPIs implemented426client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.427worker2 # [ 0.008877] CPU features: detected: LSE atomic instructions428worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented429lb # [ 0.008932] CPU features: detected: Data cache clean to Point of Persistence430worker2 # [ 0.008880] CPU features: detected: Privileged Access Never431worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq432client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.433lb # [ 0.008936] CPU features: detected: Data independent timing control (DIT)434worker2 # [ 0.008883] CPU features: detected: PMUv3435worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI436lb # [ 0.008939] CPU features: detected: E0PD437client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0438worker2 # [ 0.008886] CPU features: detected: RAS Extension Support439worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0440client # [ 0.000000] GICv3: 256 SPIs implemented441lb # [ 0.008941] CPU features: detected: Enhanced Counter Virtualization442worker2 # [ 0.008888] CPU features: detected: RASv1p1 Extension Support443client # [ 0.000000] GICv3: 0 Extended SPIs implemented444worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000445lb # [ 0.008945] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)446worker2 # [ 0.008891] CPU features: detected: Random Number Generator447client # [ 0.000000] Root IRQ handler: gic_handle_irq448worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]449client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI450worker2 # [ 0.008894] CPU features: detected: Speculation barrier (SB)451lb # [ 0.008948] CPU features: detected: Enhanced Virtualization Traps452worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)453worker2 # [ 0.008897] CPU features: detected: Stage-2 Force Write-Back454lb # [ 0.008951] CPU features: detected: Fine Grained Traps455client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0456worker2 # [ 0.008900] CPU features: detected: TLB range maintenance instructions457lb # [ 0.008956] CPU features: detected: Generic authentication (architected QARMA5 algorithm)458client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000459worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)460client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]461lb # [ 0.008961] CPU features: detected: RCpc load-acquire (LDAPR)462worker2 # [ 0.008905] CPU features: detected: Speculative Store Bypassing Safe (SSBS)463worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000464client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)465worker2 # [ 0.008963] alternatives: applying system-wide alternatives466lb # [ 0.008965] CPU features: detected: LSE atomic instructions467worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000468lb # [ 0.008968] CPU features: detected: Privileged Access Never469worker2 # [ 0.012649] CPU features: detected: BBM Level 2 without TLB conflict abort470lb # [ 0.008971] CPU features: detected: PMUv3471client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)472worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.473lb # [ 0.008973] CPU features: detected: RAS Extension Support474client # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000475worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns476lb # [ 0.008976] CPU features: detected: RASv1p1 Extension Support477worker2 # [ 0.012902] Memory: 1406528K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)478client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000479lb # [ 0.008979] CPU features: detected: Random Number Generator480worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).481client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.482lb # [ 0.008982] CPU features: detected: Speculation barrier (SB)483worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns484lb # [ 0.008985] CPU features: detected: Stage-2 Force Write-Back485client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns486lb # [ 0.008988] CPU features: detected: TLB range maintenance instructions487worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns488client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).489worker1 # [ 0.000063] arm-pv: using stolen time PV490worker2 # [ 0.014009] devtmpfs: initialized491lb # [ 0.008993] CPU features: detected: Speculative Store Bypassing Safe (SSBS)492lb # [ 0.009066] alternatives: applying system-wide alternatives493client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns494worker2 # [ 0.016032] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)495worker1 # [ 0.001208] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)496lb # [ 0.013047] CPU features: detected: BBM Level 2 without TLB conflict abort497worker1 # [ 0.001402] Console: colour dummy device 80x25498client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns499worker2 # [ 0.016061] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).500worker1 # [ 0.001409] printk: legacy console [tty0] enabled501client # [ 0.000046] arm-pv: using stolen time PV502worker2 # [ 0.016259] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL503lb # [ 0.013273] Memory: 1406520K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)504worker2 # [ 0.016263] 0 pages in range for non-PLT usage505worker1 # [ 0.001631] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)506client # [ 0.001240] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)507lb # [ 0.015364] devtmpfs: initialized508worker2 # [ 0.016264] 508288 pages in range for PLT usage509client # [ 0.001400] Console: colour dummy device 80x25510worker1 # [ 0.001638] pid_max: default: 32768 minimum: 301511worker2 # [ 0.016398] pinctrl core: initialized pinctrl subsystem512lb # [ 0.017562] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)513client # [ 0.001409] printk: legacy console [tty0] enabled514worker1 # [ 0.001717] LSM: initializing lsm=capability,landlock,yama,bpf,ima515worker2 # [ 0.017274] DMI not present or invalid.516worker1 # [ 0.002076] landlock: Up and running.517lb # [ 0.017588] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).518worker2 # [ 0.023756] NET: Registered PF_NETLINK/PF_ROUTE protocol family519worker1 # [ 0.002083] Yama: becoming mindful.520client # [ 0.001616] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)521worker1 # [ 0.003595] LSM support for eBPF active522lb # [ 0.017865] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL523client # [ 0.001623] pid_max: default: 32768 minimum: 301524worker2 # [ 0.026271] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations525lb # [ 0.017871] 0 pages in range for non-PLT usage526worker1 # [ 0.003795] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)527client # [ 0.001707] LSM: initializing lsm=capability,landlock,yama,bpf,ima528lb # [ 0.017872] 508288 pages in range for PLT usage529worker2 # [ 0.026490] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations530client # [ 0.001962] landlock: Up and running.531worker1 # [ 0.003829] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)532lb # [ 0.018009] pinctrl core: initialized pinctrl subsystem533client # [ 0.001964] Yama: becoming mindful.534worker2 # [ 0.026715] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations535client # [ 0.003374] LSM support for eBPF active536lb # [ 0.018855] DMI not present or invalid.537worker1 # [ 0.005435] cacheinfo: Unable to detect cache hierarchy for CPU 0538worker2 # [ 0.026753] audit: initializing netlink subsys (disabled)539lb # [ 0.025199] NET: Registered PF_NETLINK/PF_ROUTE protocol family540worker1 # [ 0.006724] rcu: Hierarchical SRCU implementation.541client # [ 0.003646] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)542worker2 # [ 0.027477] thermal_sys: Registered thermal governor 'fair_share'543worker1 # [ 0.006731] rcu: Max phase no-delay instances is 1000.544lb # [ 0.027438] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations545client # [ 0.003687] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)546worker1 # [ 0.008151] fsl-mc MSI: its@8080000 domain created547worker2 # [ 0.027479] thermal_sys: Registered thermal governor 'bang_bang'548lb # [ 0.027636] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations549worker1 # [ 0.008257] EFI services will not be available.550client # [ 0.004979] cacheinfo: Unable to detect cache hierarchy for CPU 0551worker2 # [ 0.027483] thermal_sys: Registered thermal governor 'step_wise'552worker1 # [ 0.008347] smp: Bringing up secondary CPUs ...553client # [ 0.005790] rcu: Hierarchical SRCU implementation.554lb # [ 0.027856] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations555worker2 # [ 0.027489] thermal_sys: Registered thermal governor 'user_space'556worker1 # [ 0.008356] smp: Brought up 1 node, 1 CPU557client # [ 0.005795] rcu: Max phase no-delay instances is 1000.558lb # [ 0.027890] audit: initializing netlink subsys (disabled)559worker1 # [ 0.008359] SMP: Total of 1 processors activated.560worker2 # [ 0.027491] thermal_sys: Registered thermal governor 'power_allocator'561worker1 # [ 0.008365] CPU: All CPU(s) started at EL1562lb # [ 0.028578] thermal_sys: Registered thermal governor 'fair_share'563client # [ 0.007070] fsl-mc MSI: its@8080000 domain created564worker2 # [ 0.027518] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1565worker1 # [ 0.008383] CPU features: detected: Branch Target Identification566lb # [ 0.028581] thermal_sys: Registered thermal governor 'bang_bang'567worker2 # [ 0.027530] cpuidle: using governor ladder568client # [ 0.007175] EFI services will not be available.569worker1 # [ 0.008392] CPU features: detected: ARMv8.4 Translation Table Level570worker2 # [ 0.027535] cpuidle: using governor menu571client # [ 0.007264] smp: Bringing up secondary CPUs ...572lb # [ 0.028585] thermal_sys: Registered thermal governor 'step_wise'573client # [ 0.007273] smp: Brought up 1 node, 1 CPU574lb # [ 0.028590] thermal_sys: Registered thermal governor 'user_space'575worker2 # [ 0.027743] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.576worker1 # [ 0.008395] CPU features: detected: Instruction cache invalidation not required for I/D coherence577client # [ 0.007276] SMP: Total of 1 processors activated.578worker2 # [ 0.027760] ASID allocator initialised with 65536 entries579lb # [ 0.028593] thermal_sys: Registered thermal governor 'power_allocator'580client # [ 0.007282] CPU: All CPU(s) started at EL1581worker1 # [ 0.008399] CPU features: detected: Data cache clean to the PoU not required for I/D coherence582worker2 # [ 0.029326] Serial: AMBA PL011 UART driver583lb # [ 0.028618] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1584client # [ 0.007295] CPU features: detected: Branch Target Identification585worker1 # [ 0.008402] CPU features: detected: Common not Private translations586worker2 # [ 0.035077] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1587lb # [ 0.028629] cpuidle: using governor ladder588client # [ 0.007300] CPU features: detected: ARMv8.4 Translation Table Level589worker1 # [ 0.008405] CPU features: detected: CRC32 instructions590lb # [ 0.028635] cpuidle: using governor menu591worker2 # [ 0.035263] printk: console [ttyAMA0] enabled592client # [ 0.007303] CPU features: detected: Instruction cache invalidation not required for I/D coherence593lb # [ 0.028839] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.594worker1 # [ 0.008408] CPU features: detected: Data cache clean to Point of Deep Persistence595lb # [ 0.028857] ASID allocator initialised with 65536 entries596worker1 # [ 0.008412] CPU features: detected: Data cache clean to Point of Persistence597client # [ 0.007307] CPU features: detected: Data cache clean to the PoU not required for I/D coherence598lb # [ 0.030188] Serial: AMBA PL011 UART driver599worker1 # [ 0.008415] CPU features: detected: Data independent timing control (DIT)600client # [ 0.007311] CPU features: detected: Common not Private translations601worker1 # [ 0.008418] CPU features: detected: E0PD602client # [ 0.007314] CPU features: detected: CRC32 instructions603worker1 # [ 0.008421] CPU features: detected: Enhanced Counter Virtualization604client # [ 0.007316] CPU features: detected: Data cache clean to Point of Deep Persistence605worker1 # [ 0.008424] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)606lb # [ 0.036906] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1607client # [ 0.007320] CPU features: detected: Data cache clean to Point of Persistence608lb # [ 0.037103] printk: console [ttyAMA0] enabled609worker1 # [ 0.008427] CPU features: detected: Enhanced Virtualization Traps610client # [ 0.007324] CPU features: detected: Data independent timing control (DIT)611worker1 # [ 0.008430] CPU features: detected: Fine Grained Traps612client # [ 0.007327] CPU features: detected: E0PD613client # [ 0.007329] CPU features: detected: Enhanced Counter Virtualization614worker1 # [ 0.008433] CPU features: detected: Generic authentication (architected QARMA5 algorithm)615worker1 # [ 0.008438] CPU features: detected: RCpc load-acquire (LDAPR)616client # [ 0.007332] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)617worker1 # [ 0.008441] CPU features: detected: LSE atomic instructions618client # [ 0.007336] CPU features: detected: Enhanced Virtualization Traps619worker1 # [ 0.008444] CPU features: detected: Privileged Access Never620client # [ 0.007339] CPU features: detected: Fine Grained Traps621worker1 # [ 0.008447] CPU features: detected: PMUv3622worker2 # [ 0.166103] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages623client # [ 0.007343] CPU features: detected: Generic authentication (architected QARMA5 algorithm)624worker1 # [ 0.008449] CPU features: detected: RAS Extension Support625worker2 # [ 0.166127] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page626client # [ 0.007348] CPU features: detected: RCpc load-acquire (LDAPR)627worker1 # [ 0.008452] CPU features: detected: RASv1p1 Extension Support628worker1 # [ 0.008455] CPU features: detected: Random Number Generator629client # [ 0.007351] CPU features: detected: LSE atomic instructions630worker2 # [ 0.166132] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages631worker1 # [ 0.008457] CPU features: detected: Speculation barrier (SB)632client # [ 0.007354] CPU features: detected: Privileged Access Never633worker2 # [ 0.166137] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page634client # [ 0.007357] CPU features: detected: PMUv3635worker1 # [ 0.008460] CPU features: detected: Stage-2 Force Write-Back636worker2 # [ 0.166141] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages637client # [ 0.007359] CPU features: detected: RAS Extension Support638worker1 # [ 0.008463] CPU features: detected: TLB range maintenance instructions639worker2 # [ 0.166145] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page640client # [ 0.007362] CPU features: detected: RASv1p1 Extension Support641lb # [ 0.167806] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages642worker1 # [ 0.008470] CPU features: detected: Speculative Store Bypassing Safe (SSBS)643client # [ 0.007364] CPU features: detected: Random Number Generator644worker2 # [ 0.166149] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages645worker1 # [ 0.008527] alternatives: applying system-wide alternatives646lb # [ 0.167838] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page647client # [ 0.007367] CPU features: detected: Speculation barrier (SB)648worker2 # [ 0.166153] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page649worker1 # [ 0.012286] CPU features: detected: BBM Level 2 without TLB conflict abort650lb # [ 0.167844] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages651client # [ 0.007369] CPU features: detected: Stage-2 Force Write-Back652lb # [ 0.167849] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page653client # [ 0.007373] CPU features: detected: TLB range maintenance instructions654worker1 # [ 0.012646] Memory: 1406508K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)655lb # [ 0.167853] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages656client # [ 0.007377] CPU features: detected: Speculative Store Bypassing Safe (SSBS)657worker2 # [ 0.173937] fbcon: Taking over console658worker1 # [ 0.013228] devtmpfs: initialized659worker2 # [ 0.173957] ACPI: Interpreter disabled.660lb # [ 0.167858] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page661client # [ 0.007434] alternatives: applying system-wide alternatives662worker1 # [ 0.017958] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)663lb # [ 0.167862] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages664worker1 # [ 0.017987] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).665lb # [ 0.167867] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page666client # [ 0.011458] CPU features: detected: BBM Level 2 without TLB conflict abort667worker1 # [ 0.018198] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL668client # [ 0.011731] Memory: 1406576K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)669worker1 # [ 0.018209] 0 pages in range for non-PLT usage670client # [ 0.012368] devtmpfs: initialized671worker1 # [ 0.018210] 508288 pages in range for PLT usage672lb # [ 0.175731] fbcon: Taking over console673client # [ 0.014333] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)674worker1 # [ 0.018347] pinctrl core: initialized pinctrl subsystem675worker1 # [ 0.019218] DMI not present or invalid.676lb # [ 0.175753] ACPI: Interpreter disabled.677client # [ 0.014363] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).678worker1 # [ 0.023865] NET: Registered PF_NETLINK/PF_ROUTE protocol family679client # [ 0.014581] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL680worker1 # [ 0.027222] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations681client # [ 0.014592] 0 pages in range for non-PLT usage682client # [ 0.014593] 508288 pages in range for PLT usage683worker1 # [ 0.027427] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations684client # [ 0.014698] pinctrl core: initialized pinctrl subsystem685client # [ 0.015574] DMI not present or invalid.686worker1 # [ 0.027646] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations687worker2 # [ 0.182571] iommu: Default domain type: Translated688client # [ 0.020611] NET: Registered PF_NETLINK/PF_ROUTE protocol family689worker1 # [ 0.027682] audit: initializing netlink subsys (disabled)690worker2 # [ 0.182602] iommu: DMA domain TLB invalidation policy: strict mode691client # [ 0.025659] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations692worker2 # [ 0.183149] SCSI subsystem initialized693worker1 # [ 0.028403] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1694worker1 # [ 0.028440] thermal_sys: Registered thermal governor 'fair_share'695client # [ 0.025980] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations696worker2 # [ 0.185265] usbcore: registered new interface driver usbfs697worker1 # [ 0.028442] thermal_sys: Registered thermal governor 'bang_bang'698client # [ 0.026238] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations699worker2 # [ 0.185301] usbcore: registered new interface driver hub700worker1 # [ 0.028448] thermal_sys: Registered thermal governor 'step_wise'701client # [ 0.026278] audit: initializing netlink subsys (disabled)702worker2 # [ 0.185327] usbcore: registered new device driver usb703worker1 # [ 0.028451] thermal_sys: Registered thermal governor 'user_space'704client # [ 0.027101] thermal_sys: Registered thermal governor 'fair_share'705lb # [ 0.185086] iommu: Default domain type: Translated706worker2 # [ 0.185642] pps_core: LinuxPPS API ver. 1 registered707worker1 # [ 0.028454] thermal_sys: Registered thermal governor 'power_allocator'708client # [ 0.027104] thermal_sys: Registered thermal governor 'bang_bang'709lb # [ 0.185103] iommu: DMA domain TLB invalidation policy: strict mode710worker1 # [ 0.028480] cpuidle: using governor ladder711worker2 # [ 0.185648] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>712client # [ 0.027109] thermal_sys: Registered thermal governor 'step_wise'713worker1 # [ 0.028488] cpuidle: using governor menu714worker2 # [ 0.185659] PTP clock support registered715lb # [ 0.186998] SCSI subsystem initialized716client # [ 0.027114] thermal_sys: Registered thermal governor 'user_space'717worker2 # [ 0.185726] EDAC MC: Ver: 3.0.0718worker1 # [ 0.028727] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.719client # [ 0.027117] thermal_sys: Registered thermal governor 'power_allocator'720worker1 # [ 0.028750] ASID allocator initialised with 65536 entries721worker2 # [ 0.190556] scmi_core: SCMI protocol bus registered722lb # [ 0.187957] usbcore: registered new interface driver usbfs723worker1 # [ 0.030228] Serial: AMBA PL011 UART driver724client # [ 0.027157] audit: type=2000 audit(0.020:1): state=initialized audit_enabled=0 res=1725lb # [ 0.188002] usbcore: registered new interface driver hub726worker2 # [ 0.191608] FPGA manager framework727client # [ 0.027168] cpuidle: using governor ladder728worker1 # [ 0.037277] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1729lb # [ 0.188031] usbcore: registered new device driver usb730worker2 # [ 0.192607] vgaarb: loaded731client # [ 0.027174] cpuidle: using governor menu732worker1 # [ 0.037464] printk: console [ttyAMA0] enabled733lb # [ 0.190277] pps_core: LinuxPPS API ver. 1 registered734client # [ 0.027393] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.735worker2 # [ 0.193303] clocksource: Switched to clocksource arch_sys_counter736client # [ 0.027416] ASID allocator initialised with 65536 entries737lb # [ 0.190288] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>738client # [ 0.028761] Serial: AMBA PL011 UART driver739lb # [ 0.190299] PTP clock support registered740lb # [ 0.190357] EDAC MC: Ver: 3.0.0741client # [ 0.034571] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1742client # [ 0.034752] printk: console [ttyAMA0] enabled743lb # [ 0.193207] scmi_core: SCMI protocol bus registered744lb # [ 0.194274] FPGA manager framework745worker2 # [ 0.198127] VFS: Disk quotas dquot_6.6.0746worker2 # [ 0.198192] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)747lb # [ 0.197969] vgaarb: loaded748worker2 # [ 0.200010] netfs: FS-Cache loaded749worker2 # [ 0.200171] pnp: PnP ACPI: disabled750worker1 # [ 0.160747] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages751lb # [ 0.198702] clocksource: Switched to clocksource arch_sys_counter752lb # [ 0.199374] VFS: Disk quotas dquot_6.6.0753worker1 # [ 0.160774] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page754lb # [ 0.199412] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)755worker1 # [ 0.160780] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages756worker1 # [ 0.160784] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page757lb # [ 0.202027] netfs: FS-Cache loaded758client # [ 0.157593] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages759lb # [ 0.202166] pnp: PnP ACPI: disabled760worker2 # [ 0.204305] NET: Registered PF_INET protocol family761worker1 # [ 0.160789] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages762client # [ 0.157626] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page763worker2 # [ 0.204569] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)764client # [ 0.157631] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages765worker1 # [ 0.160793] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page766worker1 # [ 0.160797] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages767client # [ 0.157636] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page768worker1 # [ 0.160802] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page769client # [ 0.157640] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages770client # [ 0.157645] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page771client # [ 0.157649] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages772worker1 # [ 0.168643] fbcon: Taking over console773client # [ 0.157654] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page774worker1 # [ 0.168664] ACPI: Interpreter disabled.775client # [ 0.165397] fbcon: Taking over console776client # [ 0.165417] ACPI: Interpreter disabled.777lb # [ 0.209608] NET: Registered PF_INET protocol family778lb # [ 0.209900] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)779worker1 # [ 0.177234] iommu: Default domain type: Translated780worker1 # [ 0.177250] iommu: DMA domain TLB invalidation policy: strict mode781worker1 # [ 0.177678] SCSI subsystem initialized782client # [ 0.173898] iommu: Default domain type: Translated783client # [ 0.173913] iommu: DMA domain TLB invalidation policy: strict mode784client # [ 0.175759] SCSI subsystem initialized785worker1 # [ 0.179820] usbcore: registered new interface driver usbfs786client # [ 0.176541] usbcore: registered new interface driver usbfs787worker1 # [ 0.179857] usbcore: registered new interface driver hub788client # [ 0.176583] usbcore: registered new interface driver hub789worker1 # [ 0.179881] usbcore: registered new device driver usb790client # [ 0.176602] usbcore: registered new device driver usb791worker1 # [ 0.182721] pps_core: LinuxPPS API ver. 1 registered792client # [ 0.176927] pps_core: LinuxPPS API ver. 1 registered793worker1 # [ 0.182732] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>794client # [ 0.176934] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>795worker1 # [ 0.182744] PTP clock support registered796client # [ 0.176952] PTP clock support registered797worker1 # [ 0.182824] EDAC MC: Ver: 3.0.0798client # [ 0.177014] EDAC MC: Ver: 3.0.0799worker1 # [ 0.187765] scmi_core: SCMI protocol bus registered800client # [ 0.181902] scmi_core: SCMI protocol bus registered801worker1 # [ 0.188859] FPGA manager framework802worker1 # [ 0.190166] vgaarb: loaded803client # [ 0.182990] FPGA manager framework804client # [ 0.187040] vgaarb: loaded805worker1 # [ 0.192022] clocksource: Switched to clocksource arch_sys_counter806worker1 # [ 0.192686] VFS: Disk quotas dquot_6.6.0807worker1 # [ 0.192722] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)808client # [ 0.187786] clocksource: Switched to clocksource arch_sys_counter809client # [ 0.188492] VFS: Disk quotas dquot_6.6.0810worker1 # [ 0.195234] netfs: FS-Cache loaded811worker1 # [ 0.195373] pnp: PnP ACPI: disabled812client # [ 0.188527] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)813client # [ 0.190944] netfs: FS-Cache loaded814client # [ 0.191084] pnp: PnP ACPI: disabled815worker2 # [ 0.240716] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)816worker2 # [ 0.240786] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)817worker2 # [ 0.240826] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)818worker1 # [ 0.202057] NET: Registered PF_INET protocol family819worker2 # [ 0.240928] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)820worker1 # [ 0.202333] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)821worker2 # [ 0.241072] TCP: Hash tables configured (established 16384 bind 16384)822worker2 # [ 0.241200] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)823client # [ 0.198191] NET: Registered PF_INET protocol family824worker2 # [ 0.241245] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)825client # [ 0.198500] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)826worker2 # [ 0.241285] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)827worker2 # [ 0.249181] NET: Registered PF_UNIX/PF_LOCAL protocol family828worker2 # [ 0.249231] NET: Registered PF_XDP protocol family829worker2 # [ 0.249253] PCI: CLS 0 bytes, default 64830worker2 # [ 0.249428] Trying to unpack rootfs image as initramfs...831worker2 # [ 0.260118] kvm [1]: HYP mode not available832lb # [ 0.249356] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)833lb # [ 0.249434] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)834lb # [ 0.249472] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)835lb # [ 0.249571] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)836lb # [ 0.249718] TCP: Hash tables configured (established 16384 bind 16384)837lb # [ 0.249845] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)838lb # [ 0.249894] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)839lb # [ 0.249934] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)840lb # [ 0.250034] NET: Registered PF_UNIX/PF_LOCAL protocol family841lb # [ 0.250066] NET: Registered PF_XDP protocol family842lb # [ 0.250089] PCI: CLS 0 bytes, default 64843lb # [ 0.250404] Trying to unpack rootfs image as initramfs...844lb # [ 0.269196] kvm [1]: HYP mode not available845client # [ 0.232254] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)846client # [ 0.232324] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)847worker1 # [ 0.237687] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)848client # [ 0.232361] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)849worker1 # [ 0.237765] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)850client # [ 0.232465] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)851worker1 # [ 0.237805] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)852client # [ 0.232611] TCP: Hash tables configured (established 16384 bind 16384)853worker1 # [ 0.237938] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)854client # [ 0.232726] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)855worker1 # [ 0.238083] TCP: Hash tables configured (established 16384 bind 16384)856client # [ 0.232770] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)857worker1 # [ 0.238202] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)858client # [ 0.232810] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)859worker1 # [ 0.238246] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)860client # [ 0.232912] NET: Registered PF_UNIX/PF_LOCAL protocol family861worker1 # [ 0.238286] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)862client # [ 0.232958] NET: Registered PF_XDP protocol family863worker1 # [ 0.238426] NET: Registered PF_UNIX/PF_LOCAL protocol family864client # [ 0.232981] PCI: CLS 0 bytes, default 64865worker1 # [ 0.238452] NET: Registered PF_XDP protocol family866client # [ 0.233277] Trying to unpack rootfs image as initramfs...867worker1 # [ 0.238475] PCI: CLS 0 bytes, default 64868worker1 # [ 0.238787] Trying to unpack rootfs image as initramfs...869client # [ 0.250044] kvm [1]: HYP mode not available870worker1 # [ 0.257275] kvm [1]: HYP mode not available871worker2 # [ 0.466138] Initialise system trusted keyrings872worker2 # [ 0.473499] workingset: timestamp_bits=42 max_order=19 bucket_order=0873worker2 # [ 0.475132] squashfs: version 4.0 (2009/01/31) Phillip Lougher874worker2 # [ 0.475925] 9p: Installing v9fs 9p2000 file system support875lb # [ 0.480076] Initialise system trusted keyrings876lb # [ 0.480953] workingset: timestamp_bits=42 max_order=19 bucket_order=0877lb # [ 0.482353] squashfs: version 4.0 (2009/01/31) Phillip Lougher878lb # [ 0.483337] 9p: Installing v9fs 9p2000 file system support879worker2 # [ 0.497057] Key type asymmetric registered880worker2 # [ 0.497096] Asymmetric key parser 'x509' registered881worker2 # [ 0.497186] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)882worker1 # [ 0.459671] Initialise system trusted keyrings883worker1 # [ 0.460500] workingset: timestamp_bits=42 max_order=19 bucket_order=0884worker1 # [ 0.461940] squashfs: version 4.0 (2009/01/31) Phillip Lougher885worker1 # [ 0.462751] 9p: Installing v9fs 9p2000 file system support886client # [ 0.457529] Initialise system trusted keyrings887worker2 # [ 0.505402] io scheduler mq-deadline registered888client # [ 0.458460] workingset: timestamp_bits=42 max_order=19 bucket_order=0889worker2 # [ 0.505433] io scheduler kyber registered890lb # [ 0.503459] Key type asymmetric registered891lb # [ 0.503499] Asymmetric key parser 'x509' registered892client # [ 0.459962] squashfs: version 4.0 (2009/01/31) Phillip Lougher893lb # [ 0.503588] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)894client # [ 0.460857] 9p: Installing v9fs 9p2000 file system support895worker2 # [ 0.511068] pl061_gpio 9030000.pl061: PL061 GPIO chip registered896lb # [ 0.510789] io scheduler mq-deadline registered897lb # [ 0.510820] io scheduler kyber registered898worker2 # [ 0.517366] ledtrig-cpu: registered to indicate activity on CPUs899worker2 # [ 0.518237] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:900worker2 # [ 0.518266] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000901worker2 # [ 0.518280] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000902worker2 # [ 0.518288] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000903lb # [ 0.522935] pl061_gpio 9030000.pl061: PL061 GPIO chip registered904worker2 # [ 0.518325] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits905worker2 # [ 0.518359] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]906worker2 # [ 0.518463] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00907lb # [ 0.524598] ledtrig-cpu: registered to indicate activity on CPUs908worker2 # [ 0.518478] pci_bus 0000:00: root bus resource [bus 00-ff]909worker2 # [ 0.518485] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]910lb # [ 0.525106] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:911worker2 # [ 0.518490] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]912lb # [ 0.525129] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000913worker2 # [ 0.518496] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]914lb # [ 0.525143] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000915worker1 # [ 0.491841] Key type asymmetric registered916worker2 # [ 0.518589] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint917worker1 # [ 0.491879] Asymmetric key parser 'x509' registered918lb # [ 0.525151] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000919worker2 # [ 0.519091] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint920worker1 # [ 0.491979] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)921lb # [ 0.525179] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits922worker2 # [ 0.519286] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]923worker1 # [ 0.494196] io scheduler mq-deadline registered924worker2 # [ 0.519303] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]925worker1 # [ 0.494211] io scheduler kyber registered926lb # [ 0.525210] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]927client # [ 0.489207] Key type asymmetric registered928worker2 # [ 0.519333] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]929lb # [ 0.525306] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00930client # [ 0.489245] Asymmetric key parser 'x509' registered931worker2 # [ 0.519350] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]932lb # [ 0.525319] pci_bus 0000:00: root bus resource [bus 00-ff]933client # [ 0.489348] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)934worker2 # [ 0.519817] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint935lb # [ 0.525326] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]936client # [ 0.491506] io scheduler mq-deadline registered937worker2 # [ 0.520007] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]938client # [ 0.491520] io scheduler kyber registered939lb # [ 0.525332] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]940worker2 # [ 0.520024] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]941lb # [ 0.525337] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]942worker2 # [ 0.520055] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]943lb # [ 0.525416] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint944worker2 # [ 0.520514] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint945lb # [ 0.525890] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint946worker2 # [ 0.520699] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]947lb # [ 0.526083] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]948worker2 # [ 0.520716] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]949lb # [ 0.526100] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]950worker2 # [ 0.520757] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]951lb # [ 0.526131] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]952worker2 # [ 0.521300] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint953lb # [ 0.526149] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]954lb # [ 0.526621] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint955worker2 # [ 0.545802] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]956worker2 # [ 0.545824] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]957worker1 # [ 0.508600] pl061_gpio 9030000.pl061: PL061 GPIO chip registered958worker2 # [ 0.545859] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]959worker2 # [ 0.546374] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint960worker2 # [ 0.546561] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]961worker2 # [ 0.546577] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]962client # [ 0.505908] pl061_gpio 9030000.pl061: PL061 GPIO chip registered963worker2 # [ 0.546610] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]964client # [ 0.507364] ledtrig-cpu: registered to indicate activity on CPUs965worker2 # [ 0.547093] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint966worker1 # [ 0.510099] ledtrig-cpu: registered to indicate activity on CPUs967worker2 # [ 0.547280] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]968worker2 # [ 0.547297] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]969worker1 # [ 0.510564] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:970worker2 # [ 0.547327] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]971worker1 # [ 0.510583] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000972worker2 # [ 0.547844] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint973client # [ 0.508659] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:974worker1 # [ 0.510602] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000975worker2 # [ 0.548030] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]976client # [ 0.508710] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000977worker2 # [ 0.548053] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]978worker1 # [ 0.510611] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000979worker2 # [ 0.548091] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]980client # [ 0.508738] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000981worker1 # [ 0.510633] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits982lb # [ 0.550905] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]983worker2 # [ 0.548116] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]984client # [ 0.508763] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000985lb # [ 0.550947] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]986worker1 # [ 0.510665] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]987lb # [ 0.550978] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]988client # [ 0.508833] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits989worker2 # [ 0.548607] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint990worker1 # [ 0.510762] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00991worker1 # [ 0.510772] pci_bus 0000:00: root bus resource [bus 00-ff]992lb # [ 0.551545] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint993client # [ 0.508866] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]994lb # [ 0.551743] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]995worker1 # [ 0.510779] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]996worker2 # [ 0.548805] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]997client # [ 0.508977] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00998lb # [ 0.551764] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]999worker1 # [ 0.510785] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1000worker2 # [ 0.548836] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1001client # [ 0.508990] pci_bus 0000:00: root bus resource [bus 00-ff]1002lb # [ 0.551796] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1003worker1 # [ 0.510790] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1004client # [ 0.508996] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1005worker2 # [ 0.549292] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1006lb # [ 0.552294] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1007worker1 # [ 0.510933] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1008client # [ 0.509002] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1009lb # [ 0.552486] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1010client # [ 0.509007] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1011worker1 # [ 0.511419] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1012lb # [ 0.552503] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1013worker1 # [ 0.511619] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1014lb # [ 0.552537] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1015client # [ 0.509073] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1016worker1 # [ 0.511637] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1017lb # [ 0.553024] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1018client # [ 0.509543] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1019worker1 # [ 0.511668] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1020lb # [ 0.553212] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1021client # [ 0.509738] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1022worker1 # [ 0.511685] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1023lb # [ 0.553229] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1024client # [ 0.509756] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1025worker1 # [ 0.512159] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1026lb # [ 0.553259] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1027client # [ 0.509787] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1028worker1 # [ 0.512351] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1029client # [ 0.509805] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1030lb # [ 0.553732] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1031worker1 # [ 0.512368] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1032lb # [ 0.553922] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1033client # [ 0.510282] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1034worker1 # [ 0.512399] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1035lb # [ 0.553939] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1036client # [ 0.510476] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1037worker1 # [ 0.512870] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1038client # [ 0.510493] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1039lb # [ 0.553969] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1040worker1 # [ 0.513068] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1041client # [ 0.510525] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1042lb # [ 0.554482] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1043worker1 # [ 0.513085] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1044lb # [ 0.554675] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1045client # [ 0.510992] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1046worker2 # [ 0.573609] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1047worker1 # [ 0.513117] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1048lb # [ 0.554693] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1049client # [ 0.511183] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1050worker2 # [ 0.573664] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1051worker1 # [ 0.513590] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1052client # [ 0.511200] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1053lb # [ 0.554739] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1054worker1 # [ 0.513781] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1055worker2 # [ 0.574170] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1056lb # [ 0.554756] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1057client # [ 0.511232] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1058worker1 # [ 0.513798] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1059worker2 # [ 0.574364] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1060lb # [ 0.555232] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1061client # [ 0.511710] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1062worker1 # [ 0.513831] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1063lb # [ 0.555427] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1064worker2 # [ 0.574633] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1065worker1 # [ 0.514343] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1066lb # [ 0.555458] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1067worker2 # [ 0.574940] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1068worker1 # [ 0.514536] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1069worker2 # [ 0.574977] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1070lb # [ 0.555989] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1071worker1 # [ 0.514554] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1072worker2 # [ 0.575009] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1073lb # [ 0.556211] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1074worker1 # [ 0.514591] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1075lb # [ 0.556242] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1076worker2 # [ 0.575494] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1077worker2 # [ 0.575684] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1078lb # [ 0.556646] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1079worker2 # [ 0.575701] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1080lb # [ 0.556837] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1081worker2 # [ 0.575738] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1082lb # [ 0.557097] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1083worker2 # [ 0.576353] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1084lb # [ 0.557409] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1085worker2 # [ 0.576366] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1086lb # [ 0.557429] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1087lb # [ 0.557460] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1088worker2 # [ 0.576371] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1089lb # [ 0.557941] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1090worker2 # [ 0.576419] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1091lb # [ 0.558131] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1092worker2 # [ 0.576468] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1093lb # [ 0.558148] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1094worker1 # [ 0.547232] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1095worker2 # [ 0.576518] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1096lb # [ 0.558179] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1097worker1 # [ 0.547453] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1098worker2 # [ 0.576567] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1099worker1 # [ 0.547472] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1100worker1 # [ 0.547503] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1101worker2 # [ 0.576616] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1102client # [ 0.540020] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1103client # [ 0.540066] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1104worker1 # [ 0.547990] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1105worker2 # [ 0.576667] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1106worker1 # [ 0.548182] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1107client # [ 0.540102] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1108worker2 # [ 0.576718] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1109worker1 # [ 0.548198] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1110client # [ 0.540691] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1111worker2 # [ 0.576768] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1112worker1 # [ 0.548229] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1113client # [ 0.540887] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1114worker1 # [ 0.548246] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1115worker2 # [ 0.576818] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1116client # [ 0.540905] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1117worker1 # [ 0.548754] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1118worker2 # [ 0.576903] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1119client # [ 0.540937] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1120worker1 # [ 0.548951] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1121worker2 # [ 0.576958] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1122client # [ 0.541414] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1123worker1 # [ 0.548982] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1124client # [ 0.541602] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1125worker2 # [ 0.576987] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1126client # [ 0.541618] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1127worker2 # [ 0.577013] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1128worker1 # [ 0.549450] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1129client # [ 0.541648] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1130worker1 # [ 0.549657] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1131worker2 # [ 0.577043] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1132worker1 # [ 0.549689] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1133worker2 # [ 0.577086] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1134client # [ 0.542118] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1135client # [ 0.542308] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1136worker2 # [ 0.577114] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1137worker1 # [ 0.550128] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1138client # [ 0.542324] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1139worker2 # [ 0.577146] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1140worker1 # [ 0.550325] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1141client # [ 0.542356] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1142worker2 # [ 0.577178] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1143worker1 # [ 0.550587] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1144lb # [ 0.599019] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1145client # [ 0.542373] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1146worker2 # [ 0.577208] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1147worker1 # [ 0.550840] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1148lb # [ 0.599056] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1149client # [ 0.542890] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1150worker1 # [ 0.550858] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1151worker2 # [ 0.577235] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1152lb # [ 0.599062] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1153client # [ 0.543082] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1154worker1 # [ 0.550888] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1155worker2 # [ 0.577263] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1156client # [ 0.543113] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1157lb # [ 0.599120] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1158worker2 # [ 0.577291] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1159client # [ 0.543583] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1160lb # [ 0.599178] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1161client # [ 0.543783] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1162lb # [ 0.599229] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1163client # [ 0.543837] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1164lb # [ 0.599279] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1165client # [ 0.544275] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1166lb # [ 0.599330] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1167client # [ 0.544470] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1168lb # [ 0.599382] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1169client # [ 0.544726] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1170client # [ 0.545094] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1171lb # [ 0.599433] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1172client # [ 0.545114] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1173lb # [ 0.599484] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1174worker1 # [ 0.571485] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1175client # [ 0.545145] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1176worker2 # [ 0.613414] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1177worker1 # [ 0.571702] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1178lb # [ 0.599534] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1179client # [ 0.545626] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1180worker2 # [ 0.613475] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1181worker1 # [ 0.571719] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1182lb # [ 0.599671] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1183client # [ 0.545815] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1184worker2 # [ 0.613508] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1185worker1 # [ 0.571751] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1186client # [ 0.545831] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1187lb # [ 0.599723] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1188worker2 # [ 0.613543] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1189worker1 # [ 0.572392] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1190lb # [ 0.599747] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1191client # [ 0.545862] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1192worker2 # [ 0.613579] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1193worker1 # [ 0.572405] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1194client # [ 0.546504] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1195worker2 # [ 0.613616] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1196client # [ 0.546516] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1197worker1 # [ 0.572411] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1198lb # [ 0.599770] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1199worker2 # [ 0.613647] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1200worker2 # [ 0.613672] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1201worker1 # [ 0.572461] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1202lb # [ 0.599794] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1203client # [ 0.546522] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1204worker2 # [ 0.613697] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1205lb # [ 0.599821] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1206worker1 # [ 0.572512] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1207client # [ 0.546569] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1208worker2 # [ 0.613736] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1209lb # [ 0.599844] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1210worker1 # [ 0.572563] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1211worker2 # [ 0.613747] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1212client # [ 0.546619] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1213lb # [ 0.599867] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1214worker2 # [ 0.613751] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1215client # [ 0.546669] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1216worker1 # [ 0.572613] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1217lb # [ 0.599891] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1218worker2 # [ 0.615027] pci 0000:00:0a.0: enabling device (0000 -> 0002)1219client # [ 0.546718] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1220lb # [ 0.599913] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1221worker1 # [ 0.572663] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1222lb # [ 0.599937] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1223client # [ 0.546767] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1224worker1 # [ 0.572714] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1225lb # [ 0.599961] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1226client # [ 0.546817] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1227worker1 # [ 0.572764] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1228lb # [ 0.599985] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1229client # [ 0.546866] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1230worker1 # [ 0.572814] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1231lb # [ 0.600008] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1232client # [ 0.546916] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1233worker1 # [ 0.572864] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1234lb # [ 0.600031] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1235lb # [ 0.600054] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1236client # [ 0.546966] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1237worker1 # [ 0.573018] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1238lb # [ 0.600076] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1239worker1 # [ 0.573068] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1240client # [ 0.547065] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1241lb # [ 0.600099] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1242worker1 # [ 0.573092] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1243client # [ 0.547114] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1244lb # [ 0.600122] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1245worker1 # [ 0.573115] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1246client # [ 0.547138] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1247lb # [ 0.600145] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1248worker1 # [ 0.573139] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1249lb # [ 0.600168] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1250client # [ 0.547168] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1251worker1 # [ 0.573164] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1252lb # [ 0.600190] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1253client # [ 0.547192] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1254lb # [ 0.600242] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1255worker1 # [ 0.573188] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1256client # [ 0.547220] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1257lb # [ 0.600253] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1258worker1 # [ 0.573212] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1259client # [ 0.547244] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1260lb # [ 0.600258] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1261worker1 # [ 0.573236] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1262client # [ 0.547267] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1263lb # [ 0.601478] pci 0000:00:0a.0: enabling device (0000 -> 0002)1264worker1 # [ 0.573259] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1265client # [ 0.547290] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1266worker1 # [ 0.573282] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1267client # [ 0.547314] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1268worker1 # [ 0.573307] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1269client # [ 0.547340] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1270worker1 # [ 0.573331] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1271client # [ 0.547365] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1272worker1 # [ 0.573354] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1273client # [ 0.547390] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1274worker1 # [ 0.573376] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1275client # [ 0.547413] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1276worker1 # [ 0.573400] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1277client # [ 0.547436] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1278worker1 # [ 0.573423] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1279client # [ 0.547460] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1280worker1 # [ 0.573446] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1281client # [ 0.547483] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1282worker1 # [ 0.573469] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1283client # [ 0.547506] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1284worker1 # [ 0.573492] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1285client # [ 0.547529] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1286worker1 # [ 0.573515] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1287client # [ 0.547552] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1288worker1 # [ 0.573538] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1289client # [ 0.547577] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1290worker1 # [ 0.573569] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1291client # [ 0.547603] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1292worker1 # [ 0.573579] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1293client # [ 0.547633] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1294worker1 # [ 0.573584] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1295client # [ 0.547643] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1296worker1 # [ 0.574829] pci 0000:00:0a.0: enabling device (0000 -> 0002)1297client # [ 0.547648] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1298worker2 # [ 0.654773] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1299worker2 # [ 0.657279] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1300worker1 # [ 0.619128] pci 0000:00:0a.0: quirk_usb_early_handoff+0x0/0xa60 took 43263 usecs1301client # [ 0.613073] pci 0000:00:0a.0: enabling device (0000 -> 0002)1302lb # [ 0.658316] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1303worker2 # [ 0.668163] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1304worker2 # [ 0.671591] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1305lb # [ 0.668513] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1306worker1 # [ 0.641549] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1307worker2 # [ 0.683021] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1308lb # [ 0.680325] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1309lb # [ 0.682488] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1310client # [ 0.645090] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1311worker1 # [ 0.652990] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1312client # [ 0.647602] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1313lb # [ 0.693556] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1314worker2 # [ 0.694635] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1315worker2 # [ 0.696895] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1316client # [ 0.658697] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1317lb # [ 0.699985] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1318lb # [ 0.702307] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1319worker2 # [ 0.708964] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1320client # [ 0.661837] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1321worker1 # [ 0.663258] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1322worker1 # [ 0.667881] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1323worker1 # [ 0.670565] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1324worker2 # [ 0.713027] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1325lb # [ 0.712416] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1326lb # [ 0.714635] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1327worker2 # [ 0.718912] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1328client # [ 0.672148] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1329client # [ 0.674473] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1330worker1 # [ 0.681638] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1331client # [ 0.678529] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1332lb # [ 0.725723] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1333worker1 # [ 0.688935] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1334worker2 # [ 0.735275] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1335lb # [ 0.732501] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1336client # [ 0.694386] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1337worker1 # [ 0.699229] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1338worker1 # [ 0.701713] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1339worker2 # [ 0.749962] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1340worker1 # [ 0.703756] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1341worker1 # [ 0.706425] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1342worker2 # [ 0.753163] msm_serial: driver initialized1343lb # [ 0.752021] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1344worker2 # [ 0.753993] SuperH (H)SCI(F) driver initialized1345worker2 # [ 0.754061] STM32 USART driver initialized1346lb # [ 0.755447] msm_serial: driver initialized1347lb # [ 0.755616] SuperH (H)SCI(F) driver initialized1348lb # [ 0.755679] STM32 USART driver initialized1349client # [ 0.714080] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1350client # [ 0.717120] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1351worker1 # [ 0.728103] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1352worker1 # [ 0.731783] msm_serial: driver initialized1353worker1 # [ 0.731940] SuperH (H)SCI(F) driver initialized1354worker1 # [ 0.732001] STM32 USART driver initialized1355client # [ 0.736044] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1356worker2 # [ 0.794912] loop: module loaded1357worker2 # [ 0.795246] virtio_blk virtio5: 1/0/0 default/read/poll queues1358worker2 # [ 0.796169] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1359client # [ 0.749723] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1360client # [ 0.752468] msm_serial: driver initialized1361client # [ 0.752638] SuperH (H)SCI(F) driver initialized1362client # [ 0.752698] STM32 USART driver initialized1363worker2 # [ 0.802160] megasas: 07.734.00.00-rc11364worker2 # [ 0.802990] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1365lb # [ 0.804431] loop: module loaded1366lb # [ 0.804698] virtio_blk virtio5: 1/0/0 default/read/poll queues1367worker1 # [ 0.768336] loop: module loaded1368lb # [ 0.805950] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1369worker1 # [ 0.768583] virtio_blk virtio5: 1/0/0 default/read/poll queues1370worker1 # [ 0.769393] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1371worker2 # [ 0.814767] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001372worker2 # [ 0.814827] Intel/Sharp Extended Query Table at 0x00311373worker2 # [ 0.816985] Using buffer write method1374worker2 # [ 0.817113] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1375lb # [ 0.819684] megasas: 07.734.00.00-rc11376lb # [ 0.820703] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1377lb # [ 0.823215] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001378lb # [ 0.823303] Intel/Sharp Extended Query Table at 0x00311379worker2 # [ 0.830629] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001380worker2 # [ 0.830698] Intel/Sharp Extended Query Table at 0x00311381worker1 # [ 0.783730] megasas: 07.734.00.00-rc11382worker2 # [ 0.832862] Using buffer write method1383worker2 # [ 0.832911] Concatenating MTD devices:1384worker2 # [ 0.832915] (0): "0.flash"1385worker2 # [ 0.832919] (1): "0.flash"1386worker2 # [ 0.832923] into device "0.flash"1387worker1 # [ 0.784565] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1388worker1 # [ 0.786669] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001389worker1 # [ 0.786752] Intel/Sharp Extended Query Table at 0x00311390worker1 # [ 0.788538] Using buffer write method1391worker1 # [ 0.788626] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1392worker1 # [ 0.790331] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001393worker1 # [ 0.790362] Intel/Sharp Extended Query Table at 0x00311394lb # [ 0.834763] Using buffer write method1395lb # [ 0.834865] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1396client # [ 0.792784] loop: module loaded1397client # [ 0.793015] virtio_blk virtio5: 1/0/0 default/read/poll queues1398lb # [ 0.838045] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001399lb # [ 0.838099] Intel/Sharp Extended Query Table at 0x00311400client # [ 0.793857] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1401lb # [ 0.847857] Using buffer write method1402lb # [ 0.847919] Concatenating MTD devices:1403lb # [ 0.847923] (0): "0.flash"1404lb # [ 0.847928] (1): "0.flash"1405lb # [ 0.847931] into device "0.flash"1406client # [ 0.800601] megasas: 07.734.00.00-rc11407client # [ 0.801458] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1408client # [ 0.813157] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001409client # [ 0.813214] Intel/Sharp Extended Query Table at 0x00311410client # [ 0.824532] Using buffer write method1411worker1 # [ 0.827644] Using buffer write method1412client # [ 0.824657] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1413worker1 # [ 0.827691] Concatenating MTD devices:1414worker1 # [ 0.827695] (0): "0.flash"1415worker1 # [ 0.827700] (1): "0.flash"1416client # [ 0.827237] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001417worker1 # [ 0.827704] into device "0.flash"1418client # [ 0.827287] Intel/Sharp Extended Query Table at 0x00311419client # [ 0.832438] Using buffer write method1420client # [ 0.832478] Concatenating MTD devices:1421client # [ 0.832482] (0): "0.flash"1422client # [ 0.832486] (1): "0.flash"1423client # [ 0.832490] into device "0.flash"1424worker2 # [ 1.214036] Freeing initrd memory: 26148K1425client # [ 1.175993] Freeing initrd memory: 26160K1426worker2 # [ 1.226488] tun: Universal TUN/TAP device driver, 1.61427client # [ 1.186113] tun: Universal TUN/TAP device driver, 1.61428worker2 # [ 1.231871] thunder_xcv, ver 1.01429worker2 # [ 1.231952] thunder_bgx, ver 1.01430worker2 # [ 1.232027] nicpf, ver 1.01431worker2 # [ 1.236033] e1000: Intel(R) PRO/1000 Network Driver1432worker2 # [ 1.236076] e1000: Copyright (c) 1999-2006 Intel Corporation.1433worker1 # [ 1.195023] Freeing initrd memory: 26148K1434client # [ 1.190626] thunder_xcv, ver 1.01435worker2 # [ 1.236128] e1000e: Intel(R) PRO/1000 Network Driver1436client # [ 1.190685] thunder_bgx, ver 1.01437client # [ 1.190710] nicpf, ver 1.01438worker2 # [ 1.236140] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1439client # [ 1.191708] e1000: Intel(R) PRO/1000 Network Driver1440worker2 # [ 1.236179] igb: Intel(R) Gigabit Ethernet Network Driver1441client # [ 1.191722] e1000: Copyright (c) 1999-2006 Intel Corporation.1442worker2 # [ 1.236187] igb: Copyright (c) 2007-2014 Intel Corporation.1443client # [ 1.191749] e1000e: Intel(R) PRO/1000 Network Driver1444worker2 # [ 1.236213] igbvf: Intel(R) Gigabit Virtual Function Network Driver1445client # [ 1.191757] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1446worker2 # [ 1.236221] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1447worker2 # [ 1.236388] sky2: driver version 1.301448client # [ 1.195740] igb: Intel(R) Gigabit Ethernet Network Driver1449client # [ 1.195753] igb: Copyright (c) 2007-2014 Intel Corporation.1450worker1 # [ 1.202619] tun: Universal TUN/TAP device driver, 1.61451worker2 # [ 1.244339] usbcore: registered new interface driver usb-storage1452worker2 # [ 1.244456] usbcore: registered new interface driver usbserial_generic1453worker2 # [ 1.244472] usbserial: USB Serial support registered for generic1454worker2 # [ 1.245150] hv_vmbus: registering driver hyperv_keyboard1455client # [ 1.197346] igbvf: Intel(R) Gigabit Virtual Function Network Driver1456client # [ 1.197362] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1457client # [ 1.197545] sky2: driver version 1.301458worker2 # [ 1.249127] ehci-pci 0000:00:0a.0: EHCI Host Controller1459client # [ 1.199393] usbcore: registered new interface driver usb-storage1460worker2 # [ 1.249190] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11461client # [ 1.199523] usbcore: registered new interface driver usbserial_generic1462worker2 # [ 1.249476] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001463client # [ 1.199545] usbserial: USB Serial support registered for generic1464worker1 # [ 1.208846] thunder_xcv, ver 1.01465worker1 # [ 1.208926] thunder_bgx, ver 1.01466client # [ 1.200598] ehci-pci 0000:00:0a.0: EHCI Host Controller1467worker1 # [ 1.209012] nicpf, ver 1.01468worker1 # [ 1.210457] e1000: Intel(R) PRO/1000 Network Driver1469client # [ 1.200640] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11470worker2 # [ 1.253025] rtc-pl031 9010000.pl031: registered as rtc01471worker1 # [ 1.210473] e1000: Copyright (c) 1999-2006 Intel Corporation.1472client # [ 1.200875] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001473worker1 # [ 1.210506] e1000e: Intel(R) PRO/1000 Network Driver1474worker2 # [ 1.253067] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T10:44:58 UTC (1790073898)1475worker1 # [ 1.210514] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1476lb # [ 1.250520] Freeing initrd memory: 26140K1477worker1 # [ 1.210553] igb: Intel(R) Gigabit Ethernet Network Driver1478worker2 # [ 1.255287] i2c_dev: i2c /dev entries driver1479client # [ 1.208320] hv_vmbus: registering driver hyperv_keyboard1480worker1 # [ 1.210559] igb: Copyright (c) 2007-2014 Intel Corporation.1481worker1 # [ 1.210586] igbvf: Intel(R) Gigabit Virtual Function Network Driver1482worker1 # [ 1.210594] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1483worker1 # [ 1.210753] sky2: driver version 1.301484client # [ 1.210220] rtc-pl031 9010000.pl031: registered as rtc01485client # [ 1.210259] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T10:44:58 UTC (1790073898)1486client # [ 1.210612] i2c_dev: i2c /dev entries driver1487worker2 # [ 1.259247] sdhci: Secure Digital Host Controller Interface driver1488worker2 # [ 1.259265] sdhci: Copyright(c) Pierre Ossman1489client # [ 1.211845] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001490client # [ 1.212278] hub 1-0:1.0: USB hub found1491worker2 # [ 1.259548] Synopsys Designware Multimedia Card Interface Driver1492client # [ 1.212303] hub 1-0:1.0: 6 ports detected1493worker2 # [ 1.259967] sdhci-pltfm: SDHCI platform and OF driver helper1494worker2 # [ 1.264234] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001495lb # [ 1.262411] tun: Universal TUN/TAP device driver, 1.61496worker1 # [ 1.220066] usbcore: registered new interface driver usb-storage1497worker2 # [ 1.264690] hub 1-0:1.0: USB hub found1498worker1 # [ 1.220885] usbcore: registered new interface driver usbserial_generic1499worker2 # [ 1.264717] hub 1-0:1.0: 6 ports detected1500worker1 # [ 1.220907] usbserial: USB Serial support registered for generic1501worker1 # [ 1.221573] hv_vmbus: registering driver hyperv_keyboard1502worker1 # [ 1.223081] ehci-pci 0000:00:0a.0: EHCI Host Controller1503worker2 # [ 1.267653] hid: raw HID events driver (C) Jiri Kosina1504worker1 # [ 1.223117] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11505worker2 # [ 1.267997] usbcore: registered new interface driver usbhid1506worker1 # [ 1.223665] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001507worker2 # [ 1.268006] usbhid: USB HID core driver1508worker2 # [ 1.271317] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1509worker1 # [ 1.231454] rtc-pl031 9010000.pl031: registered as rtc01510worker2 # [ 1.273109] drop_monitor: Initializing network drop monitor service1511lb # [ 1.267223] thunder_xcv, ver 1.01512worker1 # [ 1.231497] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T10:44:58 UTC (1790073898)1513client # [ 1.224244] sdhci: Secure Digital Host Controller Interface driver1514lb # [ 1.267283] thunder_bgx, ver 1.01515lb # [ 1.267308] nicpf, ver 1.01516worker1 # [ 1.232006] i2c_dev: i2c /dev entries driver1517client # [ 1.224272] sdhci: Copyright(c) Pierre Ossman1518worker2 # [ 1.275571] NET: Registered PF_INET6 protocol family1519lb # [ 1.267949] e1000: Intel(R) PRO/1000 Network Driver1520client # [ 1.224682] Synopsys Designware Multimedia Card Interface Driver1521lb # [ 1.267957] e1000: Copyright (c) 1999-2006 Intel Corporation.1522client # [ 1.225444] sdhci-pltfm: SDHCI platform and OF driver helper1523worker2 # [ 1.276945] Segment Routing with IPv61524lb # [ 1.267994] e1000e: Intel(R) PRO/1000 Network Driver1525client # [ 1.227576] hid: raw HID events driver (C) Jiri Kosina1526worker2 # [ 1.276969] In-situ OAM (IOAM) with IPv61527lb # [ 1.268002] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1528worker2 # [ 1.277012] NET: Registered PF_PACKET protocol family1529worker1 # [ 1.235134] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001530lb # [ 1.268038] igb: Intel(R) Gigabit Ethernet Network Driver1531worker1 # [ 1.236754] hub 1-0:1.0: USB hub found1532client # [ 1.231235] usbcore: registered new interface driver usbhid1533worker1 # [ 1.236780] hub 1-0:1.0: 6 ports detected1534client # [ 1.231254] usbhid: USB HID core driver1535lb # [ 1.268046] igb: Copyright (c) 2007-2014 Intel Corporation.1536lb # [ 1.268072] igbvf: Intel(R) Gigabit Virtual Function Network Driver1537lb # [ 1.268081] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1538worker2 # [ 1.278807] 9pnet: Installing 9P2000 support1539lb # [ 1.268274] sky2: driver version 1.301540lb # [ 1.270695] usbcore: registered new interface driver usb-storage1541lb # [ 1.271693] ehci-pci 0000:00:0a.0: EHCI Host Controller1542client # [ 1.234604] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1543lb # [ 1.271775] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11544worker1 # [ 1.241450] sdhci: Secure Digital Host Controller Interface driver1545lb # [ 1.272022] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001546worker1 # [ 1.241466] sdhci: Copyright(c) Pierre Ossman1547client # [ 1.237813] drop_monitor: Initializing network drop monitor service1548worker1 # [ 1.241971] Synopsys Designware Multimedia Card Interface Driver1549worker2 # [ 1.282207] Key type dns_resolver registered1550client # [ 1.238027] NET: Registered PF_INET6 protocol family1551worker1 # [ 1.242397] sdhci-pltfm: SDHCI platform and OF driver helper1552lb # [ 1.282630] usbcore: registered new interface driver usbserial_generic1553lb # [ 1.282652] usbserial: USB Serial support registered for generic1554lb # [ 1.282808] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001555client # [ 1.241452] Segment Routing with IPv61556lb # [ 1.283239] hub 1-0:1.0: USB hub found1557client # [ 1.241487] In-situ OAM (IOAM) with IPv61558lb # [ 1.283265] hub 1-0:1.0: 6 ports detected1559client # [ 1.241560] NET: Registered PF_PACKET protocol family1560client # [ 1.243311] 9pnet: Installing 9P2000 support1561worker1 # [ 1.248901] hid: raw HID events driver (C) Jiri Kosina1562worker1 # [ 1.249231] usbcore: registered new interface driver usbhid1563lb # [ 1.288087] hv_vmbus: registering driver hyperv_keyboard1564worker1 # [ 1.249238] usbhid: USB HID core driver1565worker2 # [ 1.289866] registered taskstats version 11566worker2 # [ 1.290087] Loading compiled-in X.509 certificates1567client # [ 1.246477] Key type dns_resolver registered1568lb # [ 1.291183] rtc-pl031 9010000.pl031: registered as rtc01569lb # [ 1.291218] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T10:44:58 UTC (1790073898)1570worker1 # [ 1.252938] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1571lb # [ 1.291585] i2c_dev: i2c /dev entries driver1572worker1 # [ 1.254722] drop_monitor: Initializing network drop monitor service1573worker1 # [ 1.257002] NET: Registered PF_INET6 protocol family1574worker1 # [ 1.258362] Segment Routing with IPv61575worker1 # [ 1.258385] In-situ OAM (IOAM) with IPv61576worker1 # [ 1.258418] NET: Registered PF_PACKET protocol family1577client # [ 1.253976] registered taskstats version 11578client # [ 1.254205] Loading compiled-in X.509 certificates1579worker1 # [ 1.260367] 9pnet: Installing 9P2000 support1580worker2 # [ 1.303081] Demotion targets for Node 0: null1581worker1 # [ 1.262675] Key type dns_resolver registered1582worker2 # [ 1.303589] Key type .fscrypt registered1583worker2 # [ 1.303601] Key type fscrypt-provisioning registered1584lb # [ 1.298973] sdhci: Secure Digital Host Controller Interface driver1585worker2 # [ 1.303727] ima: No TPM chip found, activating TPM-bypass!1586lb # [ 1.298988] sdhci: Copyright(c) Pierre Ossman1587worker2 # [ 1.303752] ima: Allocated hash algorithm: sha11588lb # [ 1.299319] Synopsys Designware Multimedia Card Interface Driver1589worker2 # [ 1.303791] ima: No architecture policies found1590worker2 # [ 1.308360] input: gpio-keys as /devices/platform/gpio-keys/input/input01591worker1 # [ 1.270510] registered taskstats version 11592client # [ 1.264660] Demotion targets for Node 0: null1593worker1 # [ 1.270705] Loading compiled-in X.509 certificates1594client # [ 1.264830] Key type .fscrypt registered1595client # [ 1.264838] Key type fscrypt-provisioning registered1596lb # [ 1.308714] sdhci-pltfm: SDHCI platform and OF driver helper1597client # [ 1.264966] ima: No TPM chip found, activating TPM-bypass!1598client # [ 1.264996] ima: Allocated hash algorithm: sha11599client # [ 1.265029] ima: No architecture policies found1600lb # [ 1.311734] hid: raw HID events driver (C) Jiri Kosina1601client # [ 1.269538] input: gpio-keys as /devices/platform/gpio-keys/input/input01602lb # [ 1.312126] usbcore: registered new interface driver usbhid1603lb # [ 1.312136] usbhid: USB HID core driver1604lb # [ 1.315462] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1605worker1 # [ 1.280009] Demotion targets for Node 0: null1606lb # [ 1.317405] drop_monitor: Initializing network drop monitor service1607worker1 # [ 1.280166] Key type .fscrypt registered1608lb # [ 1.317652] NET: Registered PF_INET6 protocol family1609worker1 # [ 1.280173] Key type fscrypt-provisioning registered1610worker1 # [ 1.280289] ima: No TPM chip found, activating TPM-bypass!1611lb # [ 1.321210] Segment Routing with IPv61612worker1 # [ 1.280315] ima: Allocated hash algorithm: sha11613lb # [ 1.321237] In-situ OAM (IOAM) with IPv61614worker1 # [ 1.280345] ima: No architecture policies found1615lb # [ 1.321279] NET: Registered PF_PACKET protocol family1616worker1 # [ 1.285122] input: gpio-keys as /devices/platform/gpio-keys/input/input01617lb # [ 1.323057] 9pnet: Installing 9P2000 support1618lb # [ 1.325614] Key type dns_resolver registered1619worker2 # [ 1.339280] clk: Disabling unused clocks1620lb # [ 1.336777] registered taskstats version 11621worker2 # [ 1.339334] PM: genpd: Disabling unused power domains1622lb # [ 1.336992] Loading compiled-in X.509 certificates1623client # [ 1.293294] clk: Disabling unused clocks1624client # [ 1.293347] PM: genpd: Disabling unused power domains1625client # [ 1.298350] Freeing unused kernel memory: 4736K1626client # [ 1.299082] Run /init as init process1627worker2 # [ 1.347105] Freeing unused kernel memory: 4736K1628worker2 # [ 1.347537] Run /init as init process1629lb # [ 1.347380] Demotion targets for Node 0: null1630lb # [ 1.347560] Key type .fscrypt registered1631lb # [ 1.347567] Key type fscrypt-provisioning registered1632worker1 # [ 1.310887] clk: Disabling unused clocks1633lb # [ 1.347693] ima: No TPM chip found, activating TPM-bypass!1634lb # [ 1.347715] ima: Allocated hash algorithm: sha11635lb # [ 1.347748] ima: No architecture policies found1636worker1 # [ 1.311556] PM: genpd: Disabling unused power domains1637lb # [ 1.352169] input: gpio-keys as /devices/platform/gpio-keys/input/input01638worker1 # [ 1.316796] Freeing unused kernel memory: 4736K1639worker1 # [ 1.317544] Run /init as init process1640client # [ 1.318830] systemd[1]: Successfully made /usr/ read-only.1641worker2 # [ 1.368623] systemd[1]: Successfully made /usr/ read-only.1642worker1 # [ 1.343864] systemd[1]: Successfully made /usr/ read-only.1643lb # [ 1.382903] clk: Disabling unused clocks1644lb # [ 1.382940] PM: genpd: Disabling unused power domains1645lb # [ 1.388596] Freeing unused kernel memory: 4736K1646lb # [ 1.389010] Run /init as init process1647lb # [ 1.416812] systemd[1]: Successfully made /usr/ read-only.1648client # [ 1.459931] usb 1-1: new high-speed USB device number 2 using ehci-pci1649worker2 # [ 1.509411] usb 1-1: new high-speed USB device number 2 using ehci-pci1650worker1 # [ 1.483088] usb 1-1: new high-speed USB device number 2 using ehci-pci1651lb # [ 1.530772] usb 1-1: new high-speed USB device number 2 using ehci-pci1652client # [ 1.618280] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11653worker2 # [ 1.665976] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11654worker1 # [ 1.645735] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11655lb # [ 1.685420] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11656client # [ 1.654260] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1657client # [ 1.654339] systemd[1]: Detected virtualization qemu.1658client # [ 1.654452] systemd[1]: Detected architecture arm64.1659worker2 # [ 1.708296] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1660client # [ 1.654486] systemd[1]: Running in initrd.1661client # [ 1.655753] systemd[1]: Initializing machine ID from random generator.1662worker2 # [ 1.721190] systemd[1]: Detected virtualization qemu.1663client # [ 1.678041] systemd[1]: Hostname set to <client>.1664worker2 # [ 1.721360] systemd[1]: Detected architecture arm64.1665worker2 # [ 1.721389] systemd[1]: Running in initrd.1666worker2 # [ 1.723082] systemd[1]: Initializing machine ID from random generator.1667worker1 # [ 1.679558] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1668worker2 # [ 1.723546] systemd[1]: Hostname set to <worker2>.1669worker1 # [ 1.692439] systemd[1]: Detected virtualization qemu.1670worker1 # [ 1.694629] systemd[1]: Detected architecture arm64.1671worker1 # [ 1.696971] systemd[1]: Running in initrd.1672worker1 # [ 1.701766] systemd[1]: Initializing machine ID from random generator.1673worker1 # [ 1.706400] systemd[1]: Hostname set to <worker1>.1674client # [ 1.704489] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01675worker2 # [ 1.753875] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01676lb # [ 1.752344] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1677lb # [ 1.765344] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01678lb # [ 1.770692] systemd[1]: Detected virtualization qemu.1679lb # [ 1.772893] systemd[1]: Detected architecture arm64.1680worker1 # [ 1.731517] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01681lb # [ 1.774926] systemd[1]: Running in initrd.1682lb # [ 1.778213] systemd[1]: Initializing machine ID from random generator.1683lb # [ 1.787751] systemd[1]: Hostname set to <lb>.1684client # [ 1.843882] usb 1-2: new high-speed USB device number 3 using ehci-pci1685worker2 # [ 1.897417] usb 1-2: new high-speed USB device number 3 using ehci-pci1686worker1 # [ 1.863034] usb 1-2: new high-speed USB device number 3 using ehci-pci1687lb # [ 1.914858] usb 1-2: new high-speed USB device number 3 using ehci-pci1688client # [ 1.998904] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21689client # [ 2.001018] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01690client # [ 2.016702] systemd[1]: bpf-restrict-fs: LSM BPF program attached1691worker1 # [ 2.026097] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21692worker2 # [ 2.072505] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21693worker1 # [ 2.032388] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01694lb # [ 2.075341] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21695worker2 # [ 2.082331] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01696lb # [ 2.081304] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01697worker1 # [ 2.080715] systemd[1]: bpf-restrict-fs: LSM BPF program attached1698worker2 # [ 2.148423] systemd[1]: bpf-restrict-fs: LSM BPF program attached1699client # [ 2.113308] systemd[1]: Queued start job for default target Initrd Default Target.1700lb # [ 2.158598] systemd[1]: bpf-restrict-fs: LSM BPF program attached1701client # [ 2.122809] systemd[1]: Created slice Slice /system/modprobe.1702client # [ 2.123967] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1703client # [ 2.125011] systemd[1]: Expecting device /dev/disk/by-label/nixos...1704client # [ 2.125897] systemd[1]: Reached target Path Units.1705client # [ 2.126537] systemd[1]: Reached target Slice Units.1706client # [ 2.127183] systemd[1]: Reached target Swaps.1707client # [ 2.127778] systemd[1]: Reached target Timer Units.1708client # [ 2.128693] systemd[1]: Listening on D-Bus System Message Bus Socket.1709client # [ 2.129778] systemd[1]: Listening on Journal Socket (/dev/log).1710client # [ 2.130697] systemd[1]: Listening on Journal Sockets.1711client # [ 2.131490] systemd[1]: Listening on udev Control Socket.1712client # [ 2.132390] systemd[1]: Listening on udev Kernel Socket.1713client # [ 2.133094] systemd[1]: Reached target Socket Units.1714client # [ 2.135335] systemd[1]: Starting Create List of Static Device Nodes...1715client # [ 2.144403] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1716client # [ 2.145383] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1717client # [ 2.156115] systemd[1]: Mounting Kernel Configuration File System...1718worker1 # [ 2.180793] systemd[1]: Queued start job for default target Initrd Default Target.1719client # [ 2.176124] systemd[1]: Starting Journal Service...1720worker1 # [ 2.189200] systemd[1]: Created slice Slice /system/modprobe.1721worker1 # [ 2.190312] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1722worker1 # [ 2.191551] systemd[1]: Expecting device /dev/disk/by-label/nixos...1723worker1 # [ 2.191599] systemd[1]: Reached target Path Units.1724worker1 # [ 2.191619] systemd[1]: Reached target Slice Units.1725worker1 # [ 2.191637] systemd[1]: Reached target Swaps.1726worker1 # [ 2.191656] systemd[1]: Reached target Timer Units.1727worker1 # [ 2.191860] systemd[1]: Listening on D-Bus System Message Bus Socket.1728worker1 # [ 2.191998] systemd[1]: Listening on Journal Socket (/dev/log).1729worker1 # [ 2.192121] systemd[1]: Listening on Journal Sockets.1730worker1 # [ 2.192235] systemd[1]: Listening on udev Control Socket.1731worker1 # [ 2.192339] systemd[1]: Listening on udev Kernel Socket.1732worker1 # [ 2.192358] systemd[1]: Reached target Socket Units.1733worker1 # [ 2.201446] systemd[1]: Starting Create List of Static Device Nodes...1734worker1 # [ 2.211224] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1735worker1 # [ 2.211359] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1736client # [ 2.211763] systemd[1]: Starting Load Kernel Modules...1737client # [ 2.212048] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1738client # [ 2.215754] systemd[1]: Starting Coldplug All udev Devices...1739worker1 # [ 2.224526] systemd[1]: Mounting Kernel Configuration File System...1740lb # [ 2.263791] systemd[1]: Queued start job for default target Initrd Default Target.1741lb # [ 2.273128] systemd[1]: Created slice Slice /system/modprobe.1742lb # [ 2.274204] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1743lb # [ 2.275363] systemd[1]: Expecting device /dev/disk/by-label/nixos...1744lb # [ 2.276348] systemd[1]: Reached target Path Units.1745lb # [ 2.277064] systemd[1]: Reached target Slice Units.1746lb # [ 2.277792] systemd[1]: Reached target Swaps.1747lb # [ 2.278413] systemd[1]: Reached target Timer Units.1748lb # [ 2.279458] systemd[1]: Listening on D-Bus System Message Bus Socket.1749lb # [ 2.280530] systemd[1]: Listening on Journal Socket (/dev/log).1750lb # [ 2.281467] systemd[1]: Listening on Journal Sockets.1751lb # [ 2.282282] systemd[1]: Listening on udev Control Socket.1752client # [ 2.236217] systemd[1]: Finished Create List of Static Device Nodes.1753client # [ 2.237601] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1754lb # [ 2.283224] systemd[1]: Listening on udev Kernel Socket.1755lb # [ 2.283974] systemd[1]: Reached target Socket Units.1756lb # [ 2.286448] systemd[1]: Starting Create List of Static Device Nodes...1757client # [ 2.249235] systemd-journald[73]: Collecting audit messages is disabled.1758worker2 # [ 2.300578] systemd[1]: Queued start job for default target Initrd Default Target.1759lb # [ 2.298578] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1760worker1 # [ 2.259301] systemd[1]: Starting Journal Service...1761lb # [ 2.299823] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1762worker2 # [ 2.314717] systemd[1]: Created slice Slice /system/modprobe.1763worker2 # [ 2.316121] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1764worker2 # [ 2.317717] systemd[1]: Expecting device /dev/disk/by-label/nixos...1765worker2 # [ 2.318817] systemd[1]: Reached target Path Units.1766worker1 # [ 2.278202] systemd[1]: Starting Load Kernel Modules...1767worker2 # [ 2.319668] systemd[1]: Reached target Slice Units.1768worker2 # [ 2.320510] systemd[1]: Reached target Swaps.1769worker1 # [ 2.279397] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1770worker2 # [ 2.321288] systemd[1]: Reached target Timer Units.1771lb # [ 2.312559] systemd[1]: Mounting Kernel Configuration File System...1772client # [ 2.272309] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1773worker2 # [ 2.322476] systemd[1]: Listening on D-Bus System Message Bus Socket.1774worker2 # [ 2.323840] systemd[1]: Listening on Journal Socket (/dev/log).1775worker2 # [ 2.325029] systemd[1]: Listening on Journal Sockets.1776worker2 # [ 2.326213] systemd[1]: Listening on udev Control Socket.1777worker2 # [ 2.326342] systemd[1]: Listening on udev Kernel Socket.1778worker2 # [ 2.326365] systemd[1]: Reached target Socket Units.1779worker2 # [ 2.331248] systemd[1]: Starting Create List of Static Device Nodes...1780client # [ 2.284440] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1781client # [ 2.285851] systemd[1]: Mounted Kernel Configuration File System.1782worker2 # [ 2.338694] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1783lb # [ 2.336934] systemd[1]: Starting Journal Service...1784worker1 # [ 2.295195] systemd[1]: Starting Coldplug All udev Devices...1785worker2 # [ 2.339881] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1786worker2 # [ 2.351707] systemd[1]: Mounting Kernel Configuration File System...1787lb # [ 2.349479] systemd[1]: Starting Load Kernel Modules...1788lb # [ 2.350393] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1789worker1 # [ 2.315222] systemd[1]: Finished Create List of Static Device Nodes.1790client # [ 2.329452] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1791worker1 # [ 2.339451] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1792worker1 # [ 2.343586] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1793worker1 # [ 2.344198] systemd[1]: Mounted Kernel Configuration File System.1794worker2 # [ 2.391485] systemd[1]: Starting Journal Service...1795lb # [ 2.391837] systemd[1]: Starting Coldplug All udev Devices...1796lb # [ 2.396873] systemd[1]: Finished Create List of Static Device Nodes.1797worker2 # [ 2.401643] systemd[1]: Starting Load Kernel Modules...1798lb # [ 2.399981] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1799worker2 # [ 2.402632] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1800client # [ 2.351305] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1801worker1 # [ 2.363424] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1802lb # [ 2.402700] systemd-journald[73]: Collecting audit messages is disabled.1803worker1 # [ 2.367243] systemd-journald[73]: Collecting audit messages is disabled.1804worker2 # [ 2.418902] systemd[1]: Starting Coldplug All udev Devices...1805client # [ 2.367162] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01806client # [ 2.367426] [drm] features: -virgl +edid -resource_blob -host_visible1807client # [ 2.367438] [drm] features: -context_init1808worker1 # [ 2.383821] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1809lb # [ 2.427092] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1810worker2 # [ 2.428772] systemd[1]: Finished Create List of Static Device Nodes.1811client # [ 2.392460] [drm] number of scanouts: 11812client # [ 2.392500] [drm] number of cap sets: 01813client # [ 2.395433] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1814client # [ 2.395466] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01815worker1 # [ 2.403225] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1816worker2 # [ 2.444459] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1817lb # [ 2.443351] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1818worker2 # [ 2.455642] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1819client # [ 2.424132] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1820worker2 # [ 2.474258] systemd[1]: Mounted Kernel Configuration File System.1821worker1 # [ 2.432673] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01822worker1 # [ 2.432943] [drm] features: -virgl +edid -resource_blob -host_visible1823worker1 # [ 2.432958] [drm] features: -context_init1824worker1 # [ 2.433793] [drm] number of scanouts: 11825worker1 # [ 2.433816] [drm] number of cap sets: 01826worker2 # [ 2.486124] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1827worker1 # [ 2.451847] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1828client # [ 2.436374] systemd[1]: Starting Create Static Device Nodes in /dev...1829worker1 # [ 2.459419] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1830worker1 # [ 2.459452] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01831lb # [ 2.507441] systemd[1]: Mounted Kernel Configuration File System.1832client # [ 2.461475] Console: switching to colour frame buffer device 160x501833client # [ 2.462257] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1834lb # [ 2.524045] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1835lb # [ 2.539025] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1836worker2 # [ 2.548285] systemd-journald[73]: Collecting audit messages is disabled.1837worker1 # [ 2.499666] Console: switching to colour frame buffer device 160x501838worker1 # [ 2.506552] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1839worker1 # [ 2.519763] systemd[1]: Starting Create Static Device Nodes in /dev...1840lb # [ 2.571648] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1841client # [ 2.510372] systemd-modules-load[75]: Inserted module 'dm_mod'1842lb # [ 2.575341] systemd[1]: Starting Create Static Device Nodes in /dev...1843worker1 # [ 2.537614] systemd[1]: Finished Load Kernel Modules.1844client # [ 2.532181] systemd[1]: Finished Load Kernel Modules.1845client # [ 2.535155] systemd[1]: Started Journal Service.1846lb # [ 2.587125] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01847worker2 # [ 2.590192] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1848lb # [ 2.587405] [drm] features: -virgl +edid -resource_blob -host_visible1849worker2 # [ 2.592487] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1850lb # [ 2.587419] [drm] features: -context_init1851lb # [ 2.588416] [drm] number of scanouts: 11852lb # [ 2.588441] [drm] number of cap sets: 01853lb # [ 2.592227] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1854lb # [ 2.592250] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01855worker1 # [ 2.555615] systemd[1]: Starting Apply Kernel Variables...1856client # [ 2.520523] systemd-modules-load[75]: Module 'virtio_balloon' is built in1857client # [ 2.536967] systemd-modules-load[75]: Module 'virtio_console' is built in1858client # [ 2.538291] systemd-modules-load[75]: Inserted module 'virtio_gpu'1859client # [ 2.539382] systemd-modules-load[75]: Module 'virtio_rng' is built in1860worker2 # [ 2.606385] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1861client # [ 2.548696] systemd[1]: Finished Create Static Device Nodes in /dev.1862client # [ 2.549865] systemd[1]: Reached target Preparation for Local File Systems.1863client # [ 2.550928] systemd[1]: Reached target Local File Systems.1864client # [ 2.551873] systemd[1]: Starting Apply Kernel Variables...1865worker2 # [ 2.619223] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01866worker2 # [ 2.619607] [drm] features: -virgl +edid -resource_blob -host_visible1867worker2 # [ 2.619623] [drm] features: -context_init1868worker2 # [ 2.620476] [drm] number of scanouts: 11869worker2 # [ 2.620498] [drm] number of cap sets: 01870worker2 # [ 2.624780] systemd[1]: Starting Create Static Device Nodes in /dev...1871client # [ 2.560420] systemd[1]: Starting Create System Files and Directories...1872client # [ 2.570366] systemd[1]: Starting Rule-based Manager for Device Events and Files...1873lb # [ 2.635184] Console: switching to colour frame buffer device 160x501874worker1 # [ 2.602356] systemd[1]: Started Journal Service.1875worker1 # [ 2.596696] systemd-modules-load[74]: Inserted module 'dm_mod'1876worker2 # [ 2.650884] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1877worker2 # [ 2.650925] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01878worker1 # [ 2.605707] systemd-modules-load[74]: Module 'virtio_balloon' is built in1879lb # [ 2.660524] systemd[1]: Started Journal Service.1880worker1 # [ 2.607654] systemd-modules-load[74]: Module 'virtio_console' is built in1881lb # [ 2.643365] systemd-modules-load[74]: Inserted module 'dm_mod'1882lb # [ 2.663871] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1883lb # [ 2.649169] systemd-modules-load[74]: Module 'virtio_balloon' is built in1884lb # [ 2.651102] systemd-modules-load[74]: Module 'virtio_console' is built in1885worker1 # [ 2.620766] systemd-modules-load[74]: Inserted module 'virtio_gpu'1886worker1 # [ 2.622021] systemd-modules-load[74]: Module 'virtio_rng' is built in1887worker1 # [ 2.623160] systemd[1]: Finished Create Static Device Nodes in /dev.1888lb # [ 2.661728] systemd-modules-load[74]: Inserted module 'virtio_gpu'1889worker1 # [ 2.632658] systemd[1]: Reached target Preparation for Local File Systems.1890worker1 # [ 2.633952] systemd[1]: Reached target Local File Systems.1891lb # [ 2.668606] systemd-modules-load[74]: Module 'virtio_rng' is built in1892worker1 # [ 2.634916] systemd[1]: Starting Create System Files and Directories...1893lb # [ 2.672912] systemd[1]: Finished Load Kernel Modules.1894worker1 # [ 2.641622] systemd[1]: Starting Rule-based Manager for Device Events and Files...1895lb # [ 2.677346] systemd[1]: Finished Create Static Device Nodes in /dev.1896worker1 # [ 2.643661] systemd[1]: Finished Apply Kernel Variables.1897lb # [ 2.682515] systemd[1]: Reached target Preparation for Local File Systems.1898worker2 # [ 2.706161] systemd[1]: Finished Create Static Device Nodes in /dev.1899worker2 # [ 2.706423] systemd[1]: Reached target Preparation for Local File Systems.1900worker2 # [ 2.706453] systemd[1]: Reached target Local File Systems.1901lb # [ 2.692579] systemd[1]: Reached target Local File Systems.1902client # [ 2.649772] systemd[1]: Finished Apply Kernel Variables.1903worker2 # [ 2.711045] systemd[1]: Starting Rule-based Manager for Device Events and Files...1904lb # [ 2.697759] systemd[1]: Starting Apply Kernel Variables...1905lb # [ 2.699329] systemd[1]: Starting Create System Files and Directories...1906client # [ 2.672589] systemd[1]: Finished Create System Files and Directories.1907worker2 # [ 2.733945] Console: switching to colour frame buffer device 160x501908lb # [ 2.725450] systemd[1]: Starting Rule-based Manager for Device Events and Files...1909client # [ 2.695678] systemd-udevd[81]: Using default interface naming scheme 'v261'.1910worker2 # [ 2.762244] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1911worker1 # [ 2.713489] systemd[1]: Finished Create System Files and Directories.1912worker2 # [ 2.774203] systemd[1]: Finished Load Kernel Modules.1913worker2 # [ 2.777133] systemd[1]: Starting Apply Kernel Variables...1914worker1 # [ 2.746153] systemd-udevd[82]: Using default interface naming scheme 'v261'.1915client # [ 2.743348] systemd[1]: Started Rule-based Manager for Device Events and Files.1916lb # [ 2.789874] systemd[1]: Finished Apply Kernel Variables.1917lb # [ 2.800906] systemd[1]: Finished Create System Files and Directories.1918worker1 # [ 2.780260] systemd[1]: Started Rule-based Manager for Device Events and Files.1919lb # [ 2.833852] systemd-udevd[83]: Using default interface naming scheme 'v261'.1920worker2 # [ 2.836480] systemd-modules-load[74]: Inserted module 'dm_mod'1921worker2 # [ 2.859100] systemd[1]: Started Journal Service.1922worker2 # [ 2.841834] systemd-modules-load[74]: Module 'virtio_balloon' is built in1923worker2 # [ 2.843008] systemd-modules-load[74]: Module 'virtio_console' is built in1924worker2 # [ 2.856459] systemd-modules-load[74]: Inserted module 'virtio_gpu'1925worker2 # [ 2.857858] systemd-modules-load[74]: Module 'virtio_rng' is built in1926worker2 # [ 2.858930] systemd[1]: Starting Create System Files and Directories...1927lb # [ 2.866503] systemd[1]: Started Rule-based Manager for Device Events and Files.1928worker2 # [ 2.869513] systemd-udevd[79]: Using default interface naming scheme 'v261'.1929worker2 # [ 2.878267] systemd[1]: Finished Apply Kernel Variables.1930client # [ 2.840370] systemd[1]: Starting Virtual Console Setup...1931worker1 # [ 2.880906] systemd[1]: Starting Virtual Console Setup...1932worker2 # [ 2.937926] systemd[1]: Finished Create System Files and Directories.1933worker2 # [ 2.944576] systemd[1]: Started Rule-based Manager for Device Events and Files.1934client # [ 2.908774] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1935lb # [ 2.960234] systemd[1]: Starting Virtual Console Setup...1936client # [ 2.916804] systemd[1]: Finished Virtual Console Setup.1937worker1 # [ 2.948713] systemd-vconsole-setup[104]: Configuration of first virtual console was skipped, ignoring remaining ones.1938worker1 # [ 2.956794] systemd[1]: Finished Virtual Console Setup.1939lb # [ 3.021697] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1940worker2 # [ 3.024887] systemd[1]: Starting Virtual Console Setup...1941lb # [ 3.028750] systemd[1]: Finished Virtual Console Setup.1942worker2 # [ 3.107571] systemd-vconsole-setup[104]: Configuration of first virtual console was skipped, ignoring remaining ones.1943worker2 # [ 3.109533] systemd[1]: Finished Virtual Console Setup.1944client # [ 3.621847] systemd[1]: Finished Coldplug All udev Devices.1945client # [ 3.622862] systemd[1]: Reached target System Initialization.1946client # [ 3.623689] systemd[1]: Reached target Basic System.1947worker1 # [ 3.686646] systemd[1]: Finished Coldplug All udev Devices.1948worker1 # [ 3.689946] systemd[1]: Reached target System Initialization.1949worker1 # [ 3.692397] systemd[1]: Reached target Basic System.1950lb # [ 3.800986] systemd[1]: Finished Coldplug All udev Devices.1951lb # [ 3.803300] systemd[1]: Reached target System Initialization.1952lb # [ 3.805654] systemd[1]: Reached target Basic System.1953worker2 # [ 3.882577] systemd[1]: Finished Coldplug All udev Devices.1954worker2 # [ 3.884526] systemd[1]: Reached target System Initialization.1955worker2 # [ 3.885956] systemd[1]: Reached target Basic System.1956worker1 # [ 4.092854] (udev-worker)[98]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1957worker1 # [ 4.104303] (udev-worker)[102]: Network interface NamePolicy= disabled on kernel command line.1958worker1 # [ 4.107226] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line.1959worker2 # [ 4.360777] (udev-worker)[99]: Network interface NamePolicy= disabled on kernel command line.1960worker2 # [ 4.469194] (udev-worker)[94]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1961worker2 # [ 4.491066] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line.1962lb # [ 4.713539] systemd[1]: Found device /dev/disk/by-label/nixos.1963lb # [ 4.715521] systemd[1]: Reached target Initrd Root Device.1964lb # [ 4.716598] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1965worker2 # [ 4.949168] systemd[1]: Found device /dev/disk/by-label/nixos.1966worker2 # [ 4.951982] systemd[1]: Reached target Initrd Root Device.1967worker2 # [ 4.957584] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1968lb # [ 4.978302] (udev-worker)[92]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1969lb # [ 4.988690] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line.1970lb # [ 5.002436] (udev-worker)[106]: Network interface NamePolicy= disabled on kernel command line.1971lb # [ 5.050713] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks1972worker2 # [ 5.070577] systemd-fsck[113]: nixos: clean, 12/65536 files, 13019/262144 blocks1973lb # [ 5.075253] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1974worker2 # [ 5.088329] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1975worker2 # [ 5.096610] systemd[1]: Mounting /sysroot...1976lb # [ 5.100912] systemd[1]: Mounting /sysroot...1977worker2 # [ 5.315068] EXT4-fs (vda): mounted filesystem 46601aa9-a2da-4d97-bf78-b2a378c498a5 r/w with ordered data mode. Quota mode: none.1978worker2 # [ 5.315045] systemd[1]: Mounted /sysroot.1979worker2 # [ 5.318945] systemd[1]: Reached target Initrd Root File System.1980worker2 # [ 5.324950] systemd[1]: Starting Mountpoints Configured in the Real Root...1981lb # [ 5.342026] EXT4-fs (vda): mounted filesystem 32371818-190c-4a85-8b65-8a16c473a43c r/w with ordered data mode. Quota mode: none.1982lb # [ 5.361681] systemd[1]: Mounted /sysroot.1983lb # [ 5.374570] systemd[1]: Reached target Initrd Root File System.1984lb # [ 5.382520] systemd[1]: Mounting /sysroot/nix/.ro-store...1985lb # [ 5.404470] systemd[1]: Mounting /sysroot/nix/.rw-store...1986lb # [ 5.417907] systemd[1]: Mounting /sysroot/run...1987worker2 # [ 5.428492] systemd-sysroot-fstab-check[121]: /sysroot should be mounted in the initrd, will request daemon-reload.1988worker2 # [ 5.432208] systemd[1]: Reload requested from client PID 121 ('systemd-sysroot') (unit initrd-parse-etc.service)...1989worker2 # [ 5.435532] systemd[1]: Reloading...1990lb # [ 5.462043] systemd[1]: Mounting /sysroot/tmp/shared...1991lb # [ 5.534147] systemd[1]: Mounting /sysroot/tmp/xchg...1992worker1 # [ 5.664493] systemd[1]: Found device /dev/disk/by-label/nixos.1993client # [ 5.673968] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line.1994worker1 # [ 5.729272] systemd[1]: Reached target Initrd Root Device.1995worker1 # [ 5.730422] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1996lb # [ 5.772304] systemd[1]: Starting Mountpoints Configured in the Real Root...1997lb # [ 5.849861] systemd[1]: Mounted /sysroot/nix/.rw-store.1998lb # [ 5.852768] systemd[1]: Mounted /sysroot/nix/.ro-store.1999lb # [ 5.860608] systemd[1]: Mounted /sysroot/run.2000lb # [ 5.904834] systemd-sysroot-fstab-check[125]: /sysroot should be mounted in the initrd, will request daemon-reload.
loading 1,852 hidden lines…
3853lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)3854worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open'3855worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.07 seconds)3856worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics3857worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)3858lb: must succeed: curl -sf localhost:9901/clusters3859lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)3860lb: must succeed: curl -sf localhost:9901/clusters3861lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)3862worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics3863worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.11 seconds)3864worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics3865worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)3866worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics3867worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)3868worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics3869worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)3870(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 25.75 seconds)3871subtest: balancer auth: client cert, bearer token, nothing, unknown CN3872worker2 # [ 81.408909] nix-grpc-daemon[867]: ts=2026-09-22T10:46:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:403763873worker2 # [ 81.423152] systemd[1]: Started Nix Daemon.3874worker2 # [ 81.977156] nix-daemon[947]: accepted connection from pid 867, user nix-grpc-daemon (trusted)3875worker2 # [ 82.021318] nix-grpc-daemon[867]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 39 ms (attempt 1/5)3876worker2 # [ 82.064351] nix-grpc-daemon[867]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 185 ms (attempt 2/5)3877worker2 # [ 82.254476] nix-grpc-daemon[867]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 48 ms (attempt 3/5)3878worker2 # [ 82.306860] nix-grpc-daemon[867]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 272 ms (attempt 4/5)3879worker2 # [ 82.595503] nix-grpc-daemon[867]: disabling binary cache 'https://cache.nixos.org' for 60 seconds3880worker2 # [ 82.599221] nix-grpc-daemon[867]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3881worker1 # [ 82.653888] nix-grpc-daemon[860]: ts=2026-09-22T10:46:19Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:349103882worker1 # [ 82.665696] systemd[1]: Started Nix Daemon.3883worker1 # [ 83.304543] nix-daemon[921]: accepted connection from pid 860, user nix-grpc-daemon (trusted)3884worker1 # [ 83.337088] nix-grpc-daemon[860]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 4 ms (attempt 1/5)3885worker1 # [ 83.344938] nix-grpc-daemon[860]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 154 ms (attempt 2/5)3886worker1 # [ 83.503276] nix-grpc-daemon[860]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 128 ms (attempt 3/5)3887worker1 # [ 83.642547] nix-grpc-daemon[860]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 671 ms (attempt 4/5)3888worker1 # [ 84.330370] nix-grpc-daemon[860]: disabling binary cache 'https://cache.nixos.org' for 60 seconds3889worker1 # [ 84.337615] nix-grpc-daemon[860]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3890worker1 # [ 84.360139] nix-grpc-daemon[860]: ts=2026-09-22T10:46:21Z level=debug event=path_info_miss path=7k0a7n8x1zd6x0xsp0lh395b7bhivpl8-nixos-system-client-test error="error: path '/nix/store/7k0a7n8x1zd6x0xsp0lh395b7bhivpl8-nixos-system-client-test' is required, but there is no substituter that can build it"3891worker2 # [ 84.418013] nix-grpc-daemon[867]: ts=2026-09-22T10:46:21Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:403763892worker2 # [ 84.430191] nix-grpc-daemon[867]: ts=2026-09-22T10:46:21Z level=debug event=path_info_miss path=7k0a7n8x1zd6x0xsp0lh395b7bhivpl8-nixos-system-client-test error="error: path '/nix/store/7k0a7n8x1zd6x0xsp0lh395b7bhivpl8-nixos-system-client-test' is required, but there is no substituter that can build it"3893client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt3894client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.07 seconds)3895client: must succeed: install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key3896client: (finished: must succeed: install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.06 seconds)3897worker1 # [ 84.846764] nix-grpc-daemon[860]: ts=2026-09-22T10:46:22Z level=info event=oidc_jwks provider=mock keys=13898worker1 # [ 84.853834] nix-grpc-daemon[860]: ts=2026-09-22T10:46:22Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:349103899worker2 # [ 84.914155] nix-grpc-daemon[867]: ts=2026-09-22T10:46:22Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:403763900worker2 # [ 84.927602] nix-grpc-daemon[867]: ts=2026-09-22T10:46:22Z level=debug event=path_info_miss path=7k0a7n8x1zd6x0xsp0lh395b7bhivpl8-nixos-system-client-test error="error: path '/nix/store/7k0a7n8x1zd6x0xsp0lh395b7bhivpl8-nixos-system-client-test' is required, but there is no substituter that can build it"3901worker2 # [ 84.945998] nix-grpc-daemon[867]: ts=2026-09-22T10:46:22Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:403763902worker2 # [ 84.955823] nix-grpc-daemon[867]: ts=2026-09-22T10:46:22Z level=debug event=path_info_miss path=7k0a7n8x1zd6x0xsp0lh395b7bhivpl8-nixos-system-client-test error="error: path '/nix/store/7k0a7n8x1zd6x0xsp0lh395b7bhivpl8-nixos-system-client-test' is required, but there is no substituter that can build it"3903client: must succeed: rm -r /var/lib/nix-grpc-store3904client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.05 seconds)3905worker2 # [ 85.376007] nix-grpc-daemon[867]: ts=2026-09-22T10:46:22Z level=info event=denied method=QueryMissing cn=- role=none3906worker2 # [ 85.769981] nix-grpc-daemon[867]: ts=2026-09-22T10:46:23Z level=info event=denied method=QueryMissing cn=stranger role=none3907(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 4.82 seconds)3908subtest: DAG build is scheduled across workers and lands in the cache3909client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&23910worker2 # [ 86.116822] nix-grpc-daemon[867]: ts=2026-09-22T10:46:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:403763911client # don't know how to build these paths:3912client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3913worker2 # [ 86.133115] nix-grpc-daemon[867]: ts=2026-09-22T10:46:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:403763914worker2 # [ 86.185953] nix-grpc-daemon[867]: ts=2026-09-22T10:46:23Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=03915worker2 # [ 86.193024] nix-grpc-daemon[867]: ts=2026-09-22T10:46:23Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.3:50051 clients=13916worker1 # [ 86.214097] nix-grpc-daemon[860]: ts=2026-09-22T10:46:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:349103917worker1 # [ 86.240517] nix-grpc-daemon[860]: ts=2026-09-22T10:46:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:349103918client # copying 1 paths to 'lb:50051'...3919worker1 # [ 86.260993] nix-grpc-daemon[860]: ts=2026-09-22T10:46:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:349103920client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...3921worker1 # [ 86.291926] nix-daemon[921]: accepted connection from pid 860, user nix-grpc-daemon (trusted)3922worker1 # [ 86.342850] nix-grpc-daemon[860]: ts=2026-09-22T10:46:23Z level=info event=niks3_push_started pid=9333923worker1 # [ 86.754313] nix-grpc-daemon[933]: time=2026-09-22T10:46:24.035Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca=""3924worker1 # [ 87.057953] nix-daemon[921]: accepted connection from pid 946, user nix-grpc-daemon (trusted)3925worker1 # [ 87.088282] nix-daemon[921]: reaped child process 949, status = succeeded3926worker1 # [ 87.359296] nix-daemon[921]: accepted connection from pid 951, user nix-grpc-daemon (trusted)3927lb # [ 87.438837] niks3-server[1010]: 2026/09/22 10:46:24 INFO Received uploads request method=POST path=/api/pending_closures3928worker1 # [ 87.408533] nix-daemon[921]: reaped child process 954, status = succeeded3929worker1 # [ 87.449901] nix-grpc-daemon[933]: time=2026-09-22T10:46:24.733Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3930worker1 # [ 87.469091] nix-grpc-daemon[933]: time=2026-09-22T10:46:24.737Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"3931lb # [ 87.609825] niks3-server[1010]: 2026/09/22 10:46:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign3932lb # [ 87.628462] niks3-server[1010]: 2026/09/22 10:46:24 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst3933lb # [ 87.666794] niks3-server[1010]: 2026/09/22 10:46:24 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls3934lb # [ 87.683619] niks3-server[1010]: 2026/09/22 10:46:24 INFO Signed narinfos id=1 count=13935worker1 # [ 87.661180] nix-grpc-daemon[933]: time=2026-09-22T10:46:24.942Z level=INFO msg="Uploading 1 narinfos"3936lb # [ 87.715531] niks3-server[1010]: 2026/09/22 10:46:24 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete3937lb # [ 87.731266] niks3-server[1010]: 2026/09/22 10:46:24 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo3938lb # [ 87.752695] niks3-server[1010]: 2026/09/22 10:46:24 INFO Completed upload id=13939worker1 # [ 87.734922] nix-grpc-daemon[933]: time=2026-09-22T10:46:25.018Z level=INFO msg="Upload complete. (933ms)"3940worker1 # [ 87.765369] nix-grpc-daemon[860]: ts=2026-09-22T10:46:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34910 duration_s=1 paths=1 nar_bytes_in=5043941worker1 # [ 87.781933] nix-grpc-daemon[860]: ts=2026-09-22T10:46:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:349103942worker1 # [ 87.801135] nix-daemon[921]: accepted connection from pid 860, user nix-grpc-daemon (trusted)3943worker1 # [ 87.804719] nix-daemon[921]: reaped child process 931, status = succeeded3944client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...3945client # farm-a> node-a: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3946worker1 # [ 87.823380] nix-daemon[921]: accepted connection from pid 860, user nix-grpc-daemon (trusted)3947client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds3948lb # [ 88.910407] envoy[961]: conn peer=[2001:db8:1::1]:50856 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=30753949lb # [ 88.917302] envoy[961]: conn peer=[2001:db8:1::1]:50872 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=388 ms=1163950lb # [ 88.922818] envoy[961]: conn peer=[2001:db8:1::1]:50888 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=223951lb # [ 88.929011] envoy[961]: conn peer=[2001:db8:1::1]:50892 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=182 ms=263952client # farm-a> LOG-farm-a-t13953worker1 # [ 89.102084] nix-daemon[921]: reaped child process 958, status = succeeded3954worker1 # [ 89.293242] nix-daemon[921]: accepted connection from pid 974, user nix-grpc-daemon (trusted)3955worker1 # [ 89.317912] nix-daemon[921]: reaped child process 977, status = succeeded3956lb # [ 89.366563] niks3-server[1010]: 2026/09/22 10:46:26 INFO Received uploads request method=POST path=/api/pending_closures3957worker1 # [ 89.349713] nix-grpc-daemon[933]: time=2026-09-22T10:46:26.631Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3958worker1 # [ 89.351947] nix-grpc-daemon[933]: time=2026-09-22T10:46:26.631Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"3959lb # [ 89.444297] niks3-server[1010]: 2026/09/22 10:46:26 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3960lb # [ 89.453961] niks3-server[1010]: 2026/09/22 10:46:26 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst3961lb # [ 89.462596] niks3-server[1010]: 2026/09/22 10:46:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign3962lb # [ 89.468713] niks3-server[1010]: 2026/09/22 10:46:26 INFO Signed narinfos id=2 count=13963worker1 # [ 89.435167] nix-grpc-daemon[933]: time=2026-09-22T10:46:26.716Z level=INFO msg="Uploading 1 narinfos"3964lb # [ 89.471503] niks3-server[1010]: 2026/09/22 10:46:26 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls3965lb # [ 89.482682] niks3-server[1010]: 2026/09/22 10:46:26 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete3966lb # [ 89.491308] niks3-server[1010]: 2026/09/22 10:46:26 INFO Completed upload id=23967worker1 # [ 89.457116] nix-grpc-daemon[933]: time=2026-09-22T10:46:26.740Z level=INFO msg="Upload complete. (414ms)"3968lb # [ 89.496317] niks3-server[1010]: 2026/09/22 10:46:26 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo3969worker1 # [ 89.469486] nix-grpc-daemon[860]: ts=2026-09-22T10:46:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34910 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=13970worker2 # [ 89.522782] nix-grpc-daemon[867]: ts=2026-09-22T10:46:26Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=03971worker2 # [ 89.529795] nix-grpc-daemon[867]: ts=2026-09-22T10:46:26Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.3:50051 clients=13972worker1 # [ 89.501921] nix-daemon[921]: reaped child process 956, status = succeeded3973worker1 # [ 89.542850] nix-grpc-daemon[860]: ts=2026-09-22T10:46:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:349103974worker1 # [ 89.566091] nix-grpc-daemon[860]: ts=2026-09-22T10:46:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:349103975worker1 # [ 89.591420] nix-grpc-daemon[933]: time=2026-09-22T10:46:26.874Z level=INFO msg="All 1 paths already cached"3976client # copying 1 paths to 'lb:50051'...3977worker1 # [ 89.606313] nix-grpc-daemon[860]: ts=2026-09-22T10:46:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:349103978client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...3979worker1 # [ 89.635864] nix-daemon[921]: accepted connection from pid 860, user nix-grpc-daemon (trusted)3980worker1 # [ 89.884955] nix-daemon[921]: accepted connection from pid 981, user nix-grpc-daemon (trusted)3981worker1 # [ 89.915749] nix-daemon[921]: reaped child process 984, status = succeeded3982worker1 # [ 90.076149] nix-daemon[921]: accepted connection from pid 986, user nix-grpc-daemon (trusted)3983worker1 # [ 90.112234] nix-daemon[921]: reaped child process 989, status = succeeded3984lb # [ 90.154368] niks3-server[1010]: 2026/09/22 10:46:27 INFO Received uploads request method=POST path=/api/pending_closures3985worker1 # [ 90.139166] nix-grpc-daemon[933]: time=2026-09-22T10:46:27.421Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3986worker1 # [ 90.140951] nix-grpc-daemon[933]: time=2026-09-22T10:46:27.421Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"3987lb # [ 90.206031] niks3-server[1010]: 2026/09/22 10:46:27 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst3988worker1 # [ 90.184794] nix-grpc-daemon[933]: time=2026-09-22T10:46:27.467Z level=INFO msg="Uploading 1 narinfos"3989lb # [ 90.221875] niks3-server[1010]: 2026/09/22 10:46:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign3990lb # [ 90.231423] niks3-server[1010]: 2026/09/22 10:46:27 INFO Signed narinfos id=3 count=13991lb # [ 90.236822] niks3-server[1010]: 2026/09/22 10:46:27 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls3992lb # [ 90.246772] niks3-server[1010]: 2026/09/22 10:46:27 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete3993lb # [ 90.254743] niks3-server[1010]: 2026/09/22 10:46:27 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo3994lb # [ 90.259748] niks3-server[1010]: 2026/09/22 10:46:27 INFO Completed upload id=33995worker1 # [ 90.225846] nix-grpc-daemon[933]: time=2026-09-22T10:46:27.509Z level=INFO msg="Upload complete. (562ms)"3996worker1 # [ 90.238376] nix-grpc-daemon[860]: ts=2026-09-22T10:46:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34910 duration_s=0 paths=1 nar_bytes_in=6243997worker1 # [ 90.253019] nix-grpc-daemon[860]: ts=2026-09-22T10:46:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:349103998worker1 # [ 90.267338] nix-daemon[921]: accepted connection from pid 860, user nix-grpc-daemon (trusted)3999worker1 # [ 90.275543] nix-daemon[921]: reaped child process 979, status = succeeded4000client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...4001client # farm-b> node-a: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv4002worker1 # [ 90.291186] nix-daemon[921]: accepted connection from pid 860, user nix-grpc-daemon (trusted)4003client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds4004client # farm-b> LOG-farm-b-t14005worker1 # [ 91.525053] nix-daemon[921]: reaped child process 993, status = succeeded4006worker1 # [ 91.700665] nix-daemon[921]: accepted connection from pid 1009, user nix-grpc-daemon (trusted)4007worker1 # [ 91.729699] nix-daemon[921]: reaped child process 1012, status = succeeded4008lb # [ 91.777667] niks3-server[1010]: 2026/09/22 10:46:29 INFO Received uploads request method=POST path=/api/pending_closures4009worker1 # [ 91.756558] nix-grpc-daemon[933]: time=2026-09-22T10:46:29.038Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4010worker1 # [ 91.758313] nix-grpc-daemon[933]: time=2026-09-22T10:46:29.038Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"4011lb # [ 91.819647] niks3-server[1010]: 2026/09/22 10:46:29 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst4012lb # [ 91.836809] niks3-server[1010]: 2026/09/22 10:46:29 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv4013lb # [ 91.845661] niks3-server[1010]: 2026/09/22 10:46:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4014lb # [ 91.854032] niks3-server[1010]: 2026/09/22 10:46:29 INFO Signed narinfos id=4 count=14015worker1 # [ 91.820238] nix-grpc-daemon[933]: time=2026-09-22T10:46:29.102Z level=INFO msg="Uploading 1 narinfos"4016lb # [ 91.862679] niks3-server[1010]: 2026/09/22 10:46:29 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls4017lb # [ 91.873893] niks3-server[1010]: 2026/09/22 10:46:29 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4018lb # [ 91.878891] niks3-server[1010]: 2026/09/22 10:46:29 INFO Completed upload id=44019worker1 # [ 91.844384] nix-grpc-daemon[933]: time=2026-09-22T10:46:29.127Z level=INFO msg="Upload complete. (335ms)"4020lb # [ 91.881232] niks3-server[1010]: 2026/09/22 10:46:29 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo4021worker1 # [ 91.858363] nix-grpc-daemon[860]: ts=2026-09-22T10:46:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34910 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=14022worker2 # [ 91.897417] nix-grpc-daemon[867]: ts=2026-09-22T10:46:29Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=04023worker2 # [ 91.903700] nix-grpc-daemon[867]: ts=2026-09-22T10:46:29Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.3:50051 clients=14024worker1 # [ 91.876500] nix-daemon[921]: reaped child process 991, status = succeeded4025worker1 # [ 91.907282] nix-grpc-daemon[860]: ts=2026-09-22T10:46:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:349104026worker1 # [ 91.929038] nix-grpc-daemon[860]: ts=2026-09-22T10:46:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:349104027worker1 # [ 91.950775] nix-grpc-daemon[933]: time=2026-09-22T10:46:29.233Z level=INFO msg="All 2 paths already cached"4028client # copying 1 paths to 'lb:50051'...4029worker1 # [ 91.966027] nix-grpc-daemon[860]: ts=2026-09-22T10:46:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:349104030client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...4031worker1 # [ 91.994881] nix-daemon[921]: accepted connection from pid 860, user nix-grpc-daemon (trusted)4032worker1 # [ 92.233261] nix-daemon[921]: accepted connection from pid 1016, user nix-grpc-daemon (trusted)4033worker1 # [ 92.263734] nix-daemon[921]: reaped child process 1019, status = succeeded4034worker1 # [ 92.464877] nix-daemon[921]: accepted connection from pid 1021, user nix-grpc-daemon (trusted)4035worker1 # [ 92.487908] nix-daemon[921]: reaped child process 1024, status = succeeded4036lb # [ 92.533047] niks3-server[1010]: 2026/09/22 10:46:29 INFO Received uploads request method=POST path=/api/pending_closures4037worker1 # [ 92.512111] nix-grpc-daemon[933]: time=2026-09-22T10:46:29.794Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4038worker1 # [ 92.513774] nix-grpc-daemon[933]: time=2026-09-22T10:46:29.794Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"4039lb # [ 92.572837] niks3-server[1010]: 2026/09/22 10:46:29 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst4040lb # [ 92.588634] niks3-server[1010]: 2026/09/22 10:46:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4041worker1 # [ 92.561178] nix-grpc-daemon[933]: time=2026-09-22T10:46:29.844Z level=INFO msg="Uploading 1 narinfos"4042lb # [ 92.602573] niks3-server[1010]: 2026/09/22 10:46:29 INFO Signed narinfos id=5 count=14043lb # [ 92.609332] niks3-server[1010]: 2026/09/22 10:46:29 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls4044lb # [ 92.619383] niks3-server[1010]: 2026/09/22 10:46:29 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4045lb # [ 92.628357] niks3-server[1010]: 2026/09/22 10:46:29 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo4046lb # [ 92.635952] niks3-server[1010]: 2026/09/22 10:46:29 INFO Completed upload id=54047worker1 # [ 92.601912] nix-grpc-daemon[933]: time=2026-09-22T10:46:29.885Z level=INFO msg="Upload complete. (583ms)"4048worker1 # [ 92.613174] nix-grpc-daemon[860]: ts=2026-09-22T10:46:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34910 duration_s=0 paths=1 nar_bytes_in=7524049worker1 # [ 92.632450] nix-grpc-daemon[860]: ts=2026-09-22T10:46:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:349104050worker1 # [ 92.645402] nix-daemon[921]: accepted connection from pid 860, user nix-grpc-daemon (trusted)4051worker1 # [ 92.656502] nix-daemon[921]: reaped child process 1014, status = succeeded4052client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...4053client # farm-top> node-a: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4054worker1 # [ 92.668338] nix-daemon[921]: accepted connection from pid 860, user nix-grpc-daemon (trusted)4055client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds4056client # farm-top> LOG-farm-top-t14057worker1 # [ 93.713612] nix-daemon[921]: reaped child process 1028, status = succeeded4058worker1 # [ 93.891215] nix-daemon[921]: accepted connection from pid 1044, user nix-grpc-daemon (trusted)4059worker1 # [ 93.915167] nix-daemon[921]: reaped child process 1047, status = succeeded4060lb # [ 93.962023] niks3-server[1010]: 2026/09/22 10:46:31 INFO Received uploads request method=POST path=/api/pending_closures4061worker1 # [ 93.940805] nix-grpc-daemon[933]: time=2026-09-22T10:46:31.222Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4062worker1 # [ 93.945399] nix-grpc-daemon[933]: time=2026-09-22T10:46:31.222Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"4063lb # [ 94.015226] niks3-server[1010]: 2026/09/22 10:46:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4064worker1 # [ 93.996571] nix-grpc-daemon[933]: time=2026-09-22T10:46:31.279Z level=INFO msg="Uploading 1 narinfos"4065lb # [ 94.030914] niks3-server[1010]: 2026/09/22 10:46:31 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst4066lb # [ 94.043077] niks3-server[1010]: 2026/09/22 10:46:31 INFO Signed narinfos id=6 count=14067lb # [ 94.048633] niks3-server[1010]: 2026/09/22 10:46:31 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4068lb # [ 94.060461] niks3-server[1010]: 2026/09/22 10:46:31 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls4069lb # [ 94.063583] niks3-server[1010]: 2026/09/22 10:46:31 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4070lb # [ 94.070443] niks3-server[1010]: 2026/09/22 10:46:31 INFO Completed upload id=64071lb # [ 94.074407] niks3-server[1010]: 2026/09/22 10:46:31 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo4072worker1 # [ 94.036523] nix-grpc-daemon[933]: time=2026-09-22T10:46:31.319Z level=INFO msg="Upload complete. (353ms)"4073worker1 # [ 94.049604] nix-grpc-daemon[860]: ts=2026-09-22T10:46:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34910 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=14074worker1 # [ 94.069547] nix-daemon[921]: reaped child process 1026, status = succeeded4075client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 8.33 seconds)4076client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4077client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.25 seconds)4078client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4079client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.03 seconds)4080client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4081client # copying 3 paths...4082client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...4083client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...4084client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...4085client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.31 seconds)4086(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 9.03 seconds)4087subtest: repeat is answered Cached by the scheduler without building4088worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4089worker1 # finding garbage collector roots...4090worker1 # deleting specified paths...4091worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4092worker1 # deleting unused links...4093worker1 # note: hard linking is currently saving 0.0 KiB4094worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.30 seconds)4095worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4096worker2 # finding garbage collector roots...4097worker2 # deleting specified paths...4098worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4099worker2 # deleting unused links...4100worker2 # note: hard linking is currently saving 0.0 KiB4101worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.32 seconds)4102client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&24103client # don't know how to build these paths:4104client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4105worker2 # [ 95.743191] nix-grpc-daemon[867]: ts=2026-09-22T10:46:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:403764106worker1 # [ 95.713196] nix-grpc-daemon[860]: ts=2026-09-22T10:46:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:349104107worker1 # [ 95.728363] nix-grpc-daemon[933]: time=2026-09-22T10:46:33.010Z level=INFO msg="All 2 paths already cached"4108worker2 # [ 95.784941] nix-grpc-daemon[867]: ts=2026-09-22T10:46:33Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=14109client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.36 seconds)4110client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4111client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.22 seconds)4112lb: must succeed: curl -sf localhost:9901/clusters4113lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)4114lb: must succeed: curl -sf localhost:9901/clusters4115lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4116worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4117worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds)4118(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.60 seconds)4119subtest: inputs already in the cache are not sent to the scheduler4120lb: must succeed: curl -sf localhost:9901/clusters4121lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4122lb: must succeed: curl -sf localhost:9901/clusters4123lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4124worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4125worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds)4126client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&24127client # don't know how to build these paths:4128client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4129worker2 # [ 96.911725] nix-grpc-daemon[867]: ts=2026-09-22T10:46:34Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:403764130worker1 # [ 96.882959] nix-grpc-daemon[860]: ts=2026-09-22T10:46:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:349104131worker1 # [ 96.896472] nix-grpc-daemon[933]: time=2026-09-22T10:46:34.178Z level=INFO msg="All 2 paths already cached"4132worker2 # [ 96.949229] nix-grpc-daemon[867]: ts=2026-09-22T10:46:34Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=04133worker2 # [ 96.956142] nix-grpc-daemon[867]: ts=2026-09-22T10:46:34Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.3:50051 clients=14134worker1 # [ 96.962511] nix-grpc-daemon[860]: ts=2026-09-22T10:46:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:349104135worker1 # [ 96.979570] nix-grpc-daemon[860]: ts=2026-09-22T10:46:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:349104136worker1 # [ 96.995586] nix-grpc-daemon[933]: time=2026-09-22T10:46:34.278Z level=INFO msg="All 2 paths already cached"4137client # copying 1 paths to 'lb:50051'...4138client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'...4139worker1 # [ 97.008147] nix-grpc-daemon[860]: ts=2026-09-22T10:46:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:349104140worker1 # [ 97.024471] nix-daemon[921]: accepted connection from pid 860, user nix-grpc-daemon (trusted)4141worker1 # [ 97.245258] nix-daemon[921]: accepted connection from pid 1064, user nix-grpc-daemon (trusted)4142worker1 # [ 97.269824] nix-daemon[921]: reaped child process 1067, status = succeeded4143worker1 # [ 97.459917] nix-daemon[921]: accepted connection from pid 1069, user nix-grpc-daemon (trusted)4144worker1 # [ 97.481398] nix-daemon[921]: reaped child process 1072, status = succeeded4145lb # [ 97.527713] niks3-server[1010]: 2026/09/22 10:46:34 INFO Received uploads request method=POST path=/api/pending_closures4146worker1 # [ 97.504942] nix-grpc-daemon[933]: time=2026-09-22T10:46:34.787Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4147worker1 # [ 97.506552] nix-grpc-daemon[933]: time=2026-09-22T10:46:34.787Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)"4148lb # [ 97.562119] niks3-server[1010]: 2026/09/22 10:46:34 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst4149worker1 # [ 97.543699] nix-grpc-daemon[933]: time=2026-09-22T10:46:34.826Z level=INFO msg="Uploading 1 narinfos"4150lb # [ 97.579264] niks3-server[1010]: 2026/09/22 10:46:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4151lb # [ 97.591825] niks3-server[1010]: 2026/09/22 10:46:34 INFO Signed narinfos id=7 count=14152lb # [ 97.595057] niks3-server[1010]: 2026/09/22 10:46:34 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls4153lb # [ 97.604506] niks3-server[1010]: 2026/09/22 10:46:34 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4154lb # [ 97.612224] niks3-server[1010]: 2026/09/22 10:46:34 INFO Completed upload id=74155worker1 # [ 97.578305] nix-grpc-daemon[933]: time=2026-09-22T10:46:34.861Z level=INFO msg="Upload complete. (533ms)"4156lb # [ 97.615005] niks3-server[1010]: 2026/09/22 10:46:34 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo4157worker1 # [ 97.588943] nix-grpc-daemon[860]: ts=2026-09-22T10:46:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34910 duration_s=0 paths=1 nar_bytes_in=7524158worker1 # [ 97.596407] nix-grpc-daemon[860]: ts=2026-09-22T10:46:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:349104159worker1 # [ 97.611899] nix-daemon[921]: accepted connection from pid 860, user nix-grpc-daemon (trusted)4160worker1 # [ 97.614369] nix-daemon[921]: reaped child process 1062, status = succeeded4161client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051...4162worker1 # [ 97.628603] nix-daemon[921]: accepted connection from pid 860, user nix-grpc-daemon (trusted)4163client # farm-top> node-a: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4164client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds4165client # farm-top> LOG-farm-top-t1b4166worker1 # [ 98.483780] nix-daemon[921]: reaped child process 1076, status = succeeded4167worker1 # [ 98.663987] nix-daemon[921]: accepted connection from pid 1092, user nix-grpc-daemon (trusted)4168worker1 # [ 98.687350] nix-daemon[921]: reaped child process 1095, status = succeeded4169lb # [ 98.738239] niks3-server[1010]: 2026/09/22 10:46:35 INFO Received uploads request method=POST path=/api/pending_closures4170worker1 # [ 98.713100] nix-grpc-daemon[933]: time=2026-09-22T10:46:35.996Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4171worker1 # [ 98.715777] nix-grpc-daemon[933]: time=2026-09-22T10:46:35.998Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)"4172lb # [ 98.781873] niks3-server[1010]: 2026/09/22 10:46:36 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst4173lb # [ 98.794937] niks3-server[1010]: 2026/09/22 10:46:36 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4174worker1 # [ 98.769971] nix-grpc-daemon[933]: time=2026-09-22T10:46:36.052Z level=INFO msg="Uploading 1 narinfos"4175lb # [ 98.804805] niks3-server[1010]: 2026/09/22 10:46:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4176lb # [ 98.813721] niks3-server[1010]: 2026/09/22 10:46:36 INFO Signed narinfos id=8 count=14177lb # [ 98.819292] niks3-server[1010]: 2026/09/22 10:46:36 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls4178lb # [ 98.829053] niks3-server[1010]: 2026/09/22 10:46:36 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4179lb # [ 98.840399] niks3-server[1010]: 2026/09/22 10:46:36 INFO Completed upload id=84180lb # [ 98.843566] niks3-server[1010]: 2026/09/22 10:46:36 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo4181worker1 # [ 98.806445] nix-grpc-daemon[933]: time=2026-09-22T10:46:36.089Z level=INFO msg="Upload complete. (364ms)"4182worker1 # [ 98.821819] nix-grpc-daemon[860]: ts=2026-09-22T10:46:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34910 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=14183worker1 # [ 98.841131] nix-daemon[921]: reaped child process 1074, status = succeeded4184client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.25 seconds)4185client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath4186lb # [ 98.909362] envoy[961]: conn peer=[2001:db8:1::1]:50904 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9549 tx=4070 ms=80004187lb # [ 98.911626] envoy[961]: conn peer=[2001:db8:1::1]:57980 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=654188lb # [ 98.914351] envoy[961]: conn peer=[2001:db8:1::1]:57982 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4172 tx=1806 ms=19564189client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.25 seconds)4190lb: must succeed: curl -sf localhost:9901/clusters4191lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4192lb: must succeed: curl -sf localhost:9901/clusters4193lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4194worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4195worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds)4196(finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.89 seconds)4197subtest: two clients wanting the same drv build it once4198client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4199client # [ 99.372890] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4200client # Running as unit: dedup1.service; invocation ID: 3e11f11fe0894dd3b264dd41ee33c4924201client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.10 seconds)4202client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4203worker2 # [ 99.704733] nix-grpc-daemon[867]: ts=2026-09-22T10:46:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:403764204client # [ 99.667551] nix[898]: don't know how to build these paths:4205client # [ 99.668797] nix[898]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4206worker2 # [ 99.727454] nix-grpc-daemon[867]: ts=2026-09-22T10:46:36Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04207worker2 # [ 99.736130] nix-grpc-daemon[867]: ts=2026-09-22T10:46:36Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=14208worker2 # [ 99.774093] nix-grpc-daemon[867]: ts=2026-09-22T10:46:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:403764209worker2 # [ 99.796761] nix-grpc-daemon[867]: ts=2026-09-22T10:46:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:403764210client # [ 99.768238] nix[898]: copying 1 paths to 'lb:50051'...4211worker2 # [ 99.814608] nix-grpc-daemon[867]: ts=2026-09-22T10:46:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:403764212client # [ 99.770884] nix[898]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4213worker2 # [ 99.835984] nix-daemon[947]: accepted connection from pid 867, user nix-grpc-daemon (trusted)4214worker2 # [ 99.868694] nix-grpc-daemon[867]: ts=2026-09-22T10:46:37Z level=info event=niks3_push_started pid=9974215worker2 # [ 100.155950] nix-grpc-daemon[997]: time=2026-09-22T10:46:37.422Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca=""4216worker2 # [ 100.368290] nix-daemon[947]: accepted connection from pid 1010, user nix-grpc-daemon (trusted)4217worker2 # [ 100.392895] nix-daemon[947]: reaped child process 1013, status = succeeded4218client # [ 100.501966] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4219worker2 # [ 100.576396] nix-daemon[947]: accepted connection from pid 1015, user nix-grpc-daemon (trusted)4220client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.14 seconds)4221worker2 # [ 100.597477] nix-daemon[947]: reaped child process 1018, status = succeeded4222lb # [ 100.608838] niks3-server[1010]: 2026/09/22 10:46:37 INFO Received uploads request method=POST path=/api/pending_closures4223worker2 # [ 100.619232] nix-grpc-daemon[997]: time=2026-09-22T10:46:37.887Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4224worker2 # [ 100.622561] nix-grpc-daemon[997]: time=2026-09-22T10:46:37.889Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4225lb # [ 100.639325] niks3-server[1010]: 2026/09/22 10:46:37 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4226lb # [ 100.645978] niks3-server[1010]: 2026/09/22 10:46:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4227worker2 # [ 100.650181] nix-grpc-daemon[997]: time=2026-09-22T10:46:37.917Z level=INFO msg="Uploading 1 narinfos"4228lb # [ 100.651051] niks3-server[1010]: 2026/09/22 10:46:37 INFO Signed narinfos id=9 count=14229lb # [ 100.656245] niks3-server[1010]: 2026/09/22 10:46:37 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4230lb # [ 100.665506] niks3-server[1010]: 2026/09/22 10:46:37 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4231lb # [ 100.670186] niks3-server[1010]: 2026/09/22 10:46:37 INFO Completed upload id=94232lb # [ 100.672482] niks3-server[1010]: 2026/09/22 10:46:37 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4233worker2 # [ 100.670342] nix-grpc-daemon[997]: time=2026-09-22T10:46:37.938Z level=INFO msg="Upload complete. (506ms)"4234worker2 # [ 100.676491] nix-grpc-daemon[867]: ts=2026-09-22T10:46:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40376 duration_s=0 paths=1 nar_bytes_in=4324235worker2 # [ 100.688820] nix-grpc-daemon[867]: ts=2026-09-22T10:46:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:403764236worker2 # [ 100.696349] nix-daemon[947]: accepted connection from pid 867, user nix-grpc-daemon (trusted)4237worker2 # [ 100.699483] nix-daemon[947]: reaped child process 995, status = succeeded4238client # Running as unit: dedup2.service; invocation ID: 8d144596af204c179c8bd89d303c9bee4239client # [ 100.665474] nix[898]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4240worker2 # [ 100.717926] nix-daemon[947]: accepted connection from pid 867, user nix-grpc-daemon (trusted)4241worker1 # [ 100.967797] nix-grpc-daemon[860]: ts=2026-09-22T10:46:38Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:349104242client # [ 100.965593] nix[914]: don't know how to build these paths:4243client # [ 100.967431] nix[914]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4244worker2 # [ 101.026628] nix-grpc-daemon[867]: ts=2026-09-22T10:46:38Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04245client # [ 100.989806] nix[914]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4246worker2 # [ 101.034851] nix-grpc-daemon[867]: ts=2026-09-22T10:46:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:403764247client: must succeed: sleep 24248client: (finished: must succeed: sleep 2, in 2.08 seconds)4249client: waiting for success: ! systemctl is-active dedup1 dedup24250worker2 # [ 104.380810] nix-daemon[947]: reaped child process 1026, status = succeeded4251worker2 # [ 104.571447] nix-daemon[947]: accepted connection from pid 1054, user nix-grpc-daemon (trusted)4252worker2 # [ 104.592913] nix-daemon[947]: reaped child process 1057, status = succeeded4253lb # [ 104.606072] niks3-server[1010]: 2026/09/22 10:46:41 INFO Received uploads request method=POST path=/api/pending_closures4254worker2 # [ 104.619452] nix-grpc-daemon[997]: time=2026-09-22T10:46:41.885Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4255worker2 # [ 104.621846] nix-grpc-daemon[997]: time=2026-09-22T10:46:41.885Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4256lb # [ 104.657815] niks3-server[1010]: 2026/09/22 10:46:41 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4257lb # [ 104.669085] niks3-server[1010]: 2026/09/22 10:46:41 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4258lb # [ 104.679854] niks3-server[1010]: 2026/09/22 10:46:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4259lb # [ 104.686963] niks3-server[1010]: 2026/09/22 10:46:41 INFO Signed narinfos id=10 count=14260worker2 # [ 104.688133] nix-grpc-daemon[997]: time=2026-09-22T10:46:41.955Z level=INFO msg="Uploading 1 narinfos"4261lb # [ 104.690347] niks3-server[1010]: 2026/09/22 10:46:41 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4262lb # [ 104.701950] niks3-server[1010]: 2026/09/22 10:46:41 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4263worker2 # [ 104.711414] nix-grpc-daemon[997]: time=2026-09-22T10:46:41.979Z level=INFO msg="Upload complete. (376ms)"4264lb # [ 104.711613] niks3-server[1010]: 2026/09/22 10:46:41 INFO Completed upload id=104265lb # [ 104.714890] niks3-server[1010]: 2026/09/22 10:46:41 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4266worker2 # [ 104.726345] nix-grpc-daemon[867]: ts=2026-09-22T10:46:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40376 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14267worker2 # [ 104.740832] nix-grpc-daemon[867]: ts=2026-09-22T10:46:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40376 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14268worker2 # [ 104.748831] nix-daemon[947]: reaped child process 1022, status = succeeded4269client # [ 104.730563] systemd[1]: dedup2.service: Deactivated successfully.4270client # [ 104.738254] systemd[1]: dedup2.service: Consumed 261ms CPU time over 4.235s wall clock time, 33.2M memory peak, 5.9K incoming IP traffic, 5.6K outgoing IP traffic.4271client # [ 104.789500] systemd[1]: dedup1.service: Deactivated successfully.4272client # [ 104.794089] systemd[1]: dedup1.service: Consumed 200ms CPU time over 5.420s wall clock time, 39.3M memory peak, 7.3K incoming IP traffic, 8.4K outgoing IP traffic.4273client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.16 seconds)4274client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4275client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds)4276worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4277worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds)4278worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4279worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds)4280worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4281worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)4282worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4283worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds)4284(finished: subtest: two clients wanting the same drv build it once, in 6.39 seconds)4285subtest: --timeout and --max-silent-time reach the builder4286worker1 # [ 105.994396] nix-grpc-daemon[860]: ts=2026-09-22T10:46:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:349104287worker2 # [ 106.049095] nix-grpc-daemon[867]: ts=2026-09-22T10:46:43Z level=debug event=want client=6 drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv cached=04288worker2 # [ 106.049476] nix-grpc-daemon[867]: ts=2026-09-22T10:46:43Z level=debug event=assigned drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv worker=192.168.1.3:50051 clients=14289worker1 # [ 106.059832] nix-grpc-daemon[860]: ts=2026-09-22T10:46:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:349104290worker1 # [ 106.077531] nix-grpc-daemon[860]: ts=2026-09-22T10:46:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:349104291worker1 # [ 106.094888] nix-grpc-daemon[860]: ts=2026-09-22T10:46:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:349104292worker1 # [ 106.111628] nix-daemon[921]: accepted connection from pid 860, user nix-grpc-daemon (trusted)4293worker1 # [ 106.327287] nix-daemon[921]: accepted connection from pid 1120, user nix-grpc-daemon (trusted)4294worker1 # [ 106.351433] nix-daemon[921]: reaped child process 1123, status = succeeded4295worker1 # [ 106.526773] nix-daemon[921]: accepted connection from pid 1125, user nix-grpc-daemon (trusted)4296worker1 # [ 106.547616] nix-daemon[921]: reaped child process 1128, status = succeeded4297lb # [ 106.598861] niks3-server[1010]: 2026/09/22 10:46:43 INFO Received uploads request method=POST path=/api/pending_closures4298worker1 # [ 106.576496] nix-grpc-daemon[933]: time=2026-09-22T10:46:43.859Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4299worker1 # [ 106.579107] nix-grpc-daemon[933]: time=2026-09-22T10:46:43.859Z level=INFO msg="Uploading sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv (424B)"4300lb # [ 106.642687] niks3-server[1010]: 2026/09/22 10:46:43 INFO Registered completed upload object_key=nar/1m12xmj6yzmb9y2j8ly0yvh5fyzy1nqk7ajhqwr4wn3b5h0bsch5.nar.zst4301worker1 # [ 106.621824] nix-grpc-daemon[933]: time=2026-09-22T10:46:43.904Z level=INFO msg="Uploading 1 narinfos"4302lb # [ 106.662113] niks3-server[1010]: 2026/09/22 10:46:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4303lb # [ 106.674118] niks3-server[1010]: 2026/09/22 10:46:43 INFO Signed narinfos id=11 count=14304lb # [ 106.680506] niks3-server[1010]: 2026/09/22 10:46:43 INFO Registered completed upload object_key=sfkglm39i7dsf4k91pn9ij8xz5mkgirx.ls4305worker1 # [ 106.657782] nix-grpc-daemon[933]: time=2026-09-22T10:46:43.940Z level=INFO msg="Upload complete. (527ms)"4306lb # [ 106.691983] niks3-server[1010]: 2026/09/22 10:46:43 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4307lb # [ 106.696211] niks3-server[1010]: 2026/09/22 10:46:43 INFO Completed upload id=114308lb # [ 106.699844] niks3-server[1010]: 2026/09/22 10:46:43 INFO Registered completed upload object_key=sfkglm39i7dsf4k91pn9ij8xz5mkgirx.narinfo4309worker1 # [ 106.665723] nix-grpc-daemon[860]: ts=2026-09-22T10:46:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34910 duration_s=0 paths=1 nar_bytes_in=4244310worker1 # [ 106.684523] nix-grpc-daemon[860]: ts=2026-09-22T10:46:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:349104311worker1 # [ 106.693340] nix-daemon[921]: accepted connection from pid 860, user nix-grpc-daemon (trusted)4312worker1 # [ 106.699470] nix-daemon[921]: reaped child process 1118, status = succeeded4313worker1 # [ 106.717108] nix-daemon[921]: accepted connection from pid 860, user nix-grpc-daemon (trusted)4314lb # [ 108.913468] envoy[961]: conn peer=[2001:db8:1::1]:58824 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1430 tx=1085 ms=37414315lb # [ 108.918883] envoy[961]: conn peer=[2001:db8:1::1]:57998 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3022 tx=1471 ms=51014316worker1 # [ 112.737696] nix-grpc-daemon[860]: ts=2026-09-22T10:46:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34910 duration_s=6 drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv assign_id=6 outputs=04317worker1 # [ 112.758275] nix-daemon[921]: reaped child process 1130, status = succeeded4318worker1 # [ 112.759490] nix-daemon[921]: reaped child process 1132, status = succeeded4319worker1 # [ 113.066195] nix-grpc-daemon[860]: ts=2026-09-22T10:46:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:349104320worker2 # [ 113.121771] nix-grpc-daemon[867]: ts=2026-09-22T10:46:50Z level=debug event=want client=7 drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv cached=04321worker2 # [ 113.130065] nix-grpc-daemon[867]: ts=2026-09-22T10:46:50Z level=debug event=assigned drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv worker=192.168.1.4:50051 clients=14322worker2 # [ 113.137723] nix-grpc-daemon[867]: ts=2026-09-22T10:46:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:403764323worker2 # [ 113.152927] nix-grpc-daemon[867]: ts=2026-09-22T10:46:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:403764324worker2 # [ 113.167253] nix-grpc-daemon[867]: ts=2026-09-22T10:46:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:403764325worker2 # [ 113.185129] nix-daemon[947]: accepted connection from pid 867, user nix-grpc-daemon (trusted)4326worker2 # [ 113.401308] nix-daemon[947]: accepted connection from pid 1074, user nix-grpc-daemon (trusted)4327worker2 # [ 113.422742] nix-daemon[947]: reaped child process 1077, status = succeeded4328worker2 # [ 113.604429] nix-daemon[947]: accepted connection from pid 1079, user nix-grpc-daemon (trusted)4329worker2 # [ 113.624477] nix-daemon[947]: reaped child process 1082, status = succeeded4330lb # [ 113.642261] niks3-server[1010]: 2026/09/22 10:46:50 INFO Received uploads request method=POST path=/api/pending_closures4331worker2 # [ 113.655116] nix-grpc-daemon[997]: time=2026-09-22T10:46:50.922Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4332worker2 # [ 113.656823] nix-grpc-daemon[997]: time=2026-09-22T10:46:50.922Z level=INFO msg="Uploading pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv (424B)"4333lb # [ 113.678749] niks3-server[1010]: 2026/09/22 10:46:50 INFO Registered completed upload object_key=nar/14f5yrnllfav3svmw4v4svw15r4zlf5yv1p972jy14mmq6gdw943.nar.zst4334lb # [ 113.692612] niks3-server[1010]: 2026/09/22 10:46:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4335worker2 # [ 113.698978] nix-grpc-daemon[997]: time=2026-09-22T10:46:50.966Z level=INFO msg="Uploading 1 narinfos"4336lb # [ 113.700359] niks3-server[1010]: 2026/09/22 10:46:50 INFO Signed narinfos id=12 count=14337lb # [ 113.708873] niks3-server[1010]: 2026/09/22 10:46:50 INFO Registered completed upload object_key=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s.ls4338lb # [ 113.719557] niks3-server[1010]: 2026/09/22 10:46:50 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4339worker2 # [ 113.726038] nix-grpc-daemon[997]: time=2026-09-22T10:46:50.994Z level=INFO msg="Upload complete. (523ms)"4340lb # [ 113.728464] niks3-server[1010]: 2026/09/22 10:46:50 INFO Completed upload id=124341lb # [ 113.731565] niks3-server[1010]: 2026/09/22 10:46:50 INFO Registered completed upload object_key=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s.narinfo4342worker2 # [ 113.736409] nix-grpc-daemon[867]: ts=2026-09-22T10:46:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40376 duration_s=0 paths=1 nar_bytes_in=4244343worker2 # [ 113.747561] nix-grpc-daemon[867]: ts=2026-09-22T10:46:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:403764344worker2 # [ 113.760942] nix-daemon[947]: accepted connection from pid 867, user nix-grpc-daemon (trusted)4345worker2 # [ 113.766349] nix-daemon[947]: reaped child process 1072, status = succeeded4346worker2 # [ 113.782603] nix-daemon[947]: accepted connection from pid 867, user nix-grpc-daemon (trusted)4347lb # [ 118.914080] envoy[961]: conn peer=[2001:db8:1::1]:58830 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2975 tx=953 ms=67694348worker2 # [ 120.021009] nix-grpc-daemon[867]: ts=2026-09-22T10:46:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40376 duration_s=6 drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv assign_id=7 outputs=04349worker2 # [ 120.128551] nix-daemon[947]: reaped child process 1084, status = succeeded4350worker2 # [ 120.133587] nix-daemon[947]: reaped child process 1086, status = succeeded4351(finished: subtest: --timeout and --max-silent-time reach the builder, in 14.77 seconds)4352subtest: the first client leaving does not fail the second4353client: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag share4354client # [ 120.567788] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag share.4355client # Running as unit: share1.service; invocation ID: 074cb3f9a7304d94b1e4f426e0f2a9034356client: (finished: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag share, in 0.15 seconds)4357client: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag share4358worker1 # [ 120.931166] nix-grpc-daemon[860]: ts=2026-09-22T10:46:58Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:349104359client # [ 120.928968] nix[988]: don't know how to build these paths:4360client # [ 120.931492] nix[988]: /nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv4361worker2 # [ 120.991453] nix-grpc-daemon[867]: ts=2026-09-22T10:46:58Z level=debug event=want client=8 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv cached=04362worker1 # [ 120.967271] nix-grpc-daemon[860]: ts=2026-09-22T10:46:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:349104363worker1 # [ 120.988845] nix-grpc-daemon[860]: ts=2026-09-22T10:46:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:349104364client # [ 120.992657] nix[988]: copying 1 paths to 'lb:50051'...4365client # [ 120.995539] nix[988]: copying path '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' to 'lb:50051'...4366worker1 # [ 121.005076] nix-grpc-daemon[860]: ts=2026-09-22T10:46:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:349104367worker1 # [ 121.019683] nix-daemon[921]: accepted connection from pid 860, user nix-grpc-daemon (trusted)4368worker1 # [ 121.245543] nix-daemon[921]: accepted connection from pid 1155, user nix-grpc-daemon (trusted)4369worker1 # [ 121.269679] nix-daemon[921]: reaped child process 1158, status = succeeded4370worker1 # [ 121.431030] nix-daemon[921]: accepted connection from pid 1160, user nix-grpc-daemon (trusted)4371worker1 # [ 121.449451] nix-daemon[921]: reaped child process 1163, status = succeeded4372lb # [ 121.499279] niks3-server[1010]: 2026/09/22 10:46:58 INFO Received uploads request method=POST path=/api/pending_closures4373worker1 # [ 121.476747] nix-grpc-daemon[933]: time=2026-09-22T10:46:58.759Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4374worker1 # [ 121.478297] nix-grpc-daemon[933]: time=2026-09-22T10:46:58.759Z level=INFO msg="Uploading rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv (432B)"4375lb # [ 121.537732] niks3-server[1010]: 2026/09/22 10:46:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4376worker1 # [ 121.512209] nix-grpc-daemon[933]: time=2026-09-22T10:46:58.795Z level=INFO msg="Uploading 1 narinfos"4377lb # [ 121.553294] niks3-server[1010]: 2026/09/22 10:46:58 INFO Signed narinfos id=13 count=14378lb # [ 121.560170] niks3-server[1010]: 2026/09/22 10:46:58 INFO Registered completed upload object_key=rxafkggp1xca5h7p0r6gwpq3qqp2kn63.ls4379lb # [ 121.571932] niks3-server[1010]: 2026/09/22 10:46:58 INFO Registered completed upload object_key=nar/0chdjpc9an2ckdblh08lnyrmzvw3h8qs76cn5ydwjwvgwkrm731l.nar.zst4380worker1 # [ 121.541979] nix-grpc-daemon[933]: time=2026-09-22T10:46:58.825Z level=INFO msg="Upload complete. (496ms)"4381lb # [ 121.576705] niks3-server[1010]: 2026/09/22 10:46:58 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4382lb # [ 121.581002] niks3-server[1010]: 2026/09/22 10:46:58 INFO Completed upload id=134383worker1 # [ 121.546529] nix-grpc-daemon[860]: ts=2026-09-22T10:46:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34910 duration_s=0 paths=1 nar_bytes_in=4324384lb # [ 121.583689] niks3-server[1010]: 2026/09/22 10:46:58 INFO Registered completed upload object_key=rxafkggp1xca5h7p0r6gwpq3qqp2kn63.narinfo4385worker1 # [ 121.558172] nix-grpc-daemon[860]: ts=2026-09-22T10:46:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:349104386worker1 # [ 121.562577] nix-daemon[921]: accepted connection from pid 860, user nix-grpc-daemon (trusted)4387worker1 # [ 121.566582] nix-daemon[921]: reaped child process 1153, status = succeeded4388client # [ 121.563751] nix[988]: building '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' on lb:50051...4389worker1 # [ 121.577162] nix-daemon[921]: accepted connection from pid 860, user nix-grpc-daemon (trusted)4390worker2 # [ 120.998028] nix-grpc-daemon[867]: ts=2026-09-22T10:46:58Z level=debug event=assigned drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv worker=192.168.1.3:50051 clients=14391client # [ 121.729143] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag share.4392client # Running as unit: share2.service; invocation ID: 72ce58ce3b864bd5b01f224e06aafda14393client: (finished: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag share, in 1.16 seconds)4394worker2 # [ 122.251830] nix-grpc-daemon[867]: ts=2026-09-22T10:46:59Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:403764395client # [ 122.212834] nix[1004]: don't know how to build these paths:4396client # [ 122.214309] nix[1004]: /nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv4397worker2 # [ 122.294468] nix-grpc-daemon[867]: ts=2026-09-22T10:46:59Z level=debug event=want client=9 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv cached=04398worker1 # [ 122.285100] nix-grpc-daemon[860]: ts=2026-09-22T10:46:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:349104399client # [ 122.278789] nix[1004]: building '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' on lb:50051...4400client: must succeed: sleep 2; systemctl kill -s INT share14401client # [ 125.300626] systemd[1]: share1.service: Sent signal SIGINT to main process 988 (nix) on client request.4402client # [ 125.309728] nix[988]: shutting downrxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)4403client: (finished: must succeed: sleep 2; systemctl kill -s INT share1, in 2.12 seconds)4404client: waiting for success: ! systemctl is-active share14405client # [ 125.327917] nix[988]: error: interrupted by the user4406client # [ 125.381769] systemd[1]: share1.service: Main process exited, code=exited, status=1/FAILURE4407client # [ 125.387900] systemd[1]: share1.service: Failed with result 'exit-code'.4408client # [ 125.391875] systemd[1]: share1.service: Consumed 236ms CPU time over 4.818s wall clock time, 41.2M memory peak, 6.2K incoming IP traffic, 8.2K outgoing IP traffic.4409client: (finished: waiting for success: ! systemctl is-active share1, in 0.11 seconds)4410worker1 # [ 125.808454] nix-daemon[921]: reaped child process 1167, status = succeeded4411client: waiting for success: ! systemctl is-active share24412worker1 # [ 126.001739] nix-daemon[921]: accepted connection from pid 1201, user nix-grpc-daemon (trusted)4413worker1 # [ 126.033868] nix-daemon[921]: reaped child process 1204, status = succeeded4414lb # [ 126.081967] niks3-server[1010]: 2026/09/22 10:47:03 INFO Received uploads request method=POST path=/api/pending_closures4415worker1 # [ 126.064257] nix-grpc-daemon[933]: time=2026-09-22T10:47:03.344Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4416worker1 # [ 126.065886] nix-grpc-daemon[933]: time=2026-09-22T10:47:03.344Z level=INFO msg="Uploading fjww0fd4rwk1s35jav3cyal62l24n356-slow-share (120B)"4417worker1 # [ 126.117313] nix-grpc-daemon[933]: time=2026-09-22T10:47:03.399Z level=INFO msg="Uploading 1 narinfos"4418lb # [ 126.144263] niks3-server[1010]: 2026/09/22 10:47:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4419lb # [ 126.158246] niks3-server[1010]: 2026/09/22 10:47:03 INFO Signed narinfos id=14 count=14420lb # [ 126.163289] niks3-server[1010]: 2026/09/22 10:47:03 INFO Registered completed upload object_key=log/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv4421lb # [ 126.171384] niks3-server[1010]: 2026/09/22 10:47:03 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst4422lb # [ 126.179407] niks3-server[1010]: 2026/09/22 10:47:03 INFO Registered completed upload object_key=fjww0fd4rwk1s35jav3cyal62l24n356.ls4423lb # [ 126.183980] niks3-server[1010]: 2026/09/22 10:47:03 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4424lb # [ 126.188925] niks3-server[1010]: 2026/09/22 10:47:03 INFO Completed upload id=144425worker1 # [ 126.154376] nix-grpc-daemon[933]: time=2026-09-22T10:47:03.437Z level=INFO msg="Upload complete. (364ms)"4426lb # [ 126.192235] niks3-server[1010]: 2026/09/22 10:47:03 INFO Registered completed upload object_key=fjww0fd4rwk1s35jav3cyal62l24n356.narinfo4427worker1 # [ 126.160729] nix-grpc-daemon[860]: ts=2026-09-22T10:47:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34910 duration_s=4 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv assign_id=8 outputs=14428worker1 # [ 126.172594] nix-grpc-daemon[860]: ts=2026-09-22T10:47:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34910 duration_s=3 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv assign_id=8 outputs=14429worker1 # [ 126.175602] nix-daemon[921]: reaped child process 1165, status = succeeded4430client # [ 126.185750] systemd[1]: share2.service: Deactivated successfully.4431client # [ 126.188954] systemd[1]: share2.service: Consumed 345ms CPU time over 4.459s wall clock time, 33.2M memory peak, 5.8K incoming IP traffic, 5.6K outgoing IP traffic.4432client: (finished: waiting for success: ! systemctl is-active share2, in 1.14 seconds)4433client: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }4434client: (finished: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }, in 0.06 seconds)4435(finished: subtest: the first client leaving does not fail the second, in 6.58 seconds)4436subtest: build hook: nix-daemon with builders = grpc://lb4437client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log4438client # [ 127.262691] systemd[1]: Started Nix Daemon.4439client # [ 127.504287] nix-daemon[1051]: accepted connection from pid 1048, user root (trusted)4440worker2 # [ 127.829528] nix-grpc-daemon[867]: ts=2026-09-22T10:47:05Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:403764441worker1 # [ 127.804665] nix-grpc-daemon[860]: ts=2026-09-22T10:47:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:349104442worker2 # [ 127.865152] nix-grpc-daemon[867]: ts=2026-09-22T10:47:05Z level=debug event=want client=10 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04443worker2 # [ 127.870814] nix-grpc-daemon[867]: ts=2026-09-22T10:47:05Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.4:50051 clients=14444worker2 # [ 127.915976] nix-grpc-daemon[867]: ts=2026-09-22T10:47:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:403764445worker2 # [ 127.939443] nix-grpc-daemon[867]: ts=2026-09-22T10:47:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:403764446worker2 # [ 127.961004] nix-grpc-daemon[867]: ts=2026-09-22T10:47:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:403764447worker2 # [ 127.971371] nix-daemon[947]: accepted connection from pid 867, user nix-grpc-daemon (trusted)4448worker2 # [ 128.216697] nix-daemon[947]: accepted connection from pid 1131, user nix-grpc-daemon (trusted)4449worker2 # [ 128.245697] nix-daemon[947]: reaped child process 1134, status = succeeded4450worker2 # [ 128.488046] nix-daemon[947]: accepted connection from pid 1136, user nix-grpc-daemon (trusted)4451worker2 # [ 128.510265] nix-daemon[947]: reaped child process 1139, status = succeeded4452lb # [ 128.529044] niks3-server[1010]: 2026/09/22 10:47:05 INFO Received uploads request method=POST path=/api/pending_closures4453worker2 # [ 128.544098] nix-grpc-daemon[997]: time=2026-09-22T10:47:05.811Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4454worker2 # [ 128.545792] nix-grpc-daemon[997]: time=2026-09-22T10:47:05.811Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4455lb # [ 128.558791] niks3-server[1010]: 2026/09/22 10:47:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4456lb # [ 128.562280] niks3-server[1010]: 2026/09/22 10:47:05 INFO Signed narinfos id=15 count=14457worker2 # [ 128.564171] nix-grpc-daemon[997]: time=2026-09-22T10:47:05.831Z level=INFO msg="Uploading 1 narinfos"4458lb # [ 128.564747] niks3-server[1010]: 2026/09/22 10:47:05 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4459lb # [ 128.573895] niks3-server[1010]: 2026/09/22 10:47:05 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4460lb # [ 128.580145] niks3-server[1010]: 2026/09/22 10:47:05 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4461lb # [ 128.587621] niks3-server[1010]: 2026/09/22 10:47:05 INFO Completed upload id=154462worker2 # [ 128.588170] nix-grpc-daemon[997]: time=2026-09-22T10:47:05.856Z level=INFO msg="Upload complete. (601ms)"4463lb # [ 128.591307] niks3-server[1010]: 2026/09/22 10:47:05 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4464worker2 # [ 128.596271] nix-grpc-daemon[867]: ts=2026-09-22T10:47:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40376 duration_s=0 paths=1 nar_bytes_in=5124465worker2 # [ 128.599468] nix-grpc-daemon[867]: ts=2026-09-22T10:47:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:403764466worker2 # [ 128.613767] nix-daemon[947]: accepted connection from pid 867, user nix-grpc-daemon (trusted)4467worker2 # [ 128.618451] nix-daemon[947]: reaped child process 1129, status = succeeded4468worker2 # [ 128.631315] nix-daemon[947]: accepted connection from pid 867, user nix-grpc-daemon (trusted)4469lb # [ 128.913376] envoy[961]: conn peer=[2001:db8:1::1]:39340 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2989 tx=954 ms=69724470lb # [ 128.915114] envoy[961]: conn peer=[2001:db8:1::1]:54438 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3003 tx=789 ms=44154471lb # [ 128.917222] envoy[961]: conn peer=[2001:db8:1::1]:54440 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1443 tx=1087 ms=39904472worker2 # [ 129.888195] nix-daemon[947]: reaped child process 1143, status = succeeded4473worker2 # [ 130.080911] nix-daemon[947]: accepted connection from pid 1159, user nix-grpc-daemon (trusted)4474worker2 # [ 130.105605] nix-daemon[947]: reaped child process 1162, status = succeeded4475lb # [ 130.119784] niks3-server[1010]: 2026/09/22 10:47:07 INFO Received uploads request method=POST path=/api/pending_closures4476worker2 # [ 130.132660] nix-grpc-daemon[997]: time=2026-09-22T10:47:07.398Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4477worker2 # [ 130.135687] nix-grpc-daemon[997]: time=2026-09-22T10:47:07.398Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4478lb # [ 130.159302] niks3-server[1010]: 2026/09/22 10:47:07 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4479lb # [ 130.176571] niks3-server[1010]: 2026/09/22 10:47:07 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4480lb # [ 130.186780] niks3-server[1010]: 2026/09/22 10:47:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4481worker2 # [ 130.193913] nix-grpc-daemon[997]: time=2026-09-22T10:47:07.460Z level=INFO msg="Uploading 1 narinfos"4482lb # [ 130.193650] niks3-server[1010]: 2026/09/22 10:47:07 INFO Signed narinfos id=16 count=14483lb # [ 130.201292] niks3-server[1010]: 2026/09/22 10:47:07 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4484lb # [ 130.212511] niks3-server[1010]: 2026/09/22 10:47:07 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4485lb # [ 130.221373] niks3-server[1010]: 2026/09/22 10:47:07 INFO Completed upload id=164486worker2 # [ 130.221200] nix-grpc-daemon[997]: time=2026-09-22T10:47:07.489Z level=INFO msg="Upload complete. (373ms)"4487lb # [ 130.224719] niks3-server[1010]: 2026/09/22 10:47:07 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4488worker1 # [ 130.206453] nix-grpc-daemon[860]: ts=2026-09-22T10:47:07Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:349104489worker2 # [ 130.237536] nix-grpc-daemon[867]: ts=2026-09-22T10:47:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40376 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=9 outputs=14490worker2 # [ 130.262394] nix-daemon[947]: reaped child process 1141, status = succeeded4491worker1 # [ 130.233967] nix-grpc-daemon[860]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4492worker2 # [ 130.320173] nix-grpc-daemon[867]: ts=2026-09-22T10:47:07Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:403764493worker2 # [ 130.331255] nix-grpc-daemon[867]: ts=2026-09-22T10:47:07Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40376 duration_s=0 paths=1 nar_bytes_out=1284494worker2 # [ 130.650548] nix-grpc-daemon[867]: ts=2026-09-22T10:47:07Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:403764495worker1 # [ 130.625022] nix-grpc-daemon[860]: ts=2026-09-22T10:47:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:349104496worker1 # [ 130.641825] nix-grpc-daemon[933]: time=2026-09-22T10:47:07.924Z level=INFO msg="All 1 paths already cached"4497worker2 # [ 130.699571] nix-grpc-daemon[867]: ts=2026-09-22T10:47:07Z level=debug event=want client=11 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04498worker2 # [ 130.710189] nix-grpc-daemon[867]: ts=2026-09-22T10:47:07Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.4:50051 clients=14499worker2 # [ 130.723052] nix-grpc-daemon[867]: ts=2026-09-22T10:47:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:403764500worker2 # [ 130.740190] nix-grpc-daemon[867]: ts=2026-09-22T10:47:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:403764501worker2 # [ 130.909156] nix-grpc-daemon[997]: time=2026-09-22T10:47:08.177Z level=INFO msg="All 1 paths already cached"4502worker2 # [ 130.941112] nix-grpc-daemon[867]: ts=2026-09-22T10:47:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:403764503worker2 # [ 130.958941] nix-daemon[947]: accepted connection from pid 867, user nix-grpc-daemon (trusted)4504worker2 # [ 131.198883] nix-daemon[947]: accepted connection from pid 1168, user nix-grpc-daemon (trusted)4505worker2 # [ 131.240632] nix-daemon[947]: reaped child process 1171, status = succeeded4506worker2 # [ 131.474844] nix-daemon[947]: accepted connection from pid 1173, user nix-grpc-daemon (trusted)4507worker2 # [ 131.511629] nix-daemon[947]: reaped child process 1176, status = succeeded4508lb # [ 131.521783] niks3-server[1010]: 2026/09/22 10:47:08 INFO Received uploads request method=POST path=/api/pending_closures4509worker2 # [ 131.538363] nix-grpc-daemon[997]: time=2026-09-22T10:47:08.806Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4510worker2 # [ 131.541678] nix-grpc-daemon[997]: time=2026-09-22T10:47:08.809Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4511lb # [ 131.568848] niks3-server[1010]: 2026/09/22 10:47:08 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4512worker2 # [ 131.584630] nix-grpc-daemon[997]: time=2026-09-22T10:47:08.852Z level=INFO msg="Uploading 1 narinfos"4513lb # [ 131.585568] niks3-server[1010]: 2026/09/22 10:47:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4514lb # [ 131.595155] niks3-server[1010]: 2026/09/22 10:47:08 INFO Signed narinfos id=17 count=14515lb # [ 131.602038] niks3-server[1010]: 2026/09/22 10:47:08 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4516lb # [ 131.608655] niks3-server[1010]: 2026/09/22 10:47:08 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4517lb # [ 131.617123] niks3-server[1010]: 2026/09/22 10:47:08 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4518lb # [ 131.620631] niks3-server[1010]: 2026/09/22 10:47:08 INFO Completed upload id=174519worker2 # [ 131.621128] nix-grpc-daemon[997]: time=2026-09-22T10:47:08.889Z level=INFO msg="Upload complete. (644ms)"4520worker2 # [ 131.628709] nix-grpc-daemon[867]: ts=2026-09-22T10:47:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40376 duration_s=0 paths=1 nar_bytes_in=6244521worker2 # [ 131.636595] nix-grpc-daemon[867]: ts=2026-09-22T10:47:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:403764522worker2 # [ 131.651185] nix-daemon[947]: accepted connection from pid 867, user nix-grpc-daemon (trusted)4523worker2 # [ 131.653723] nix-daemon[947]: reaped child process 1166, status = succeeded4524worker2 # [ 131.668002] nix-daemon[947]: accepted connection from pid 867, user nix-grpc-daemon (trusted)4525worker2 # [ 133.114079] nix-daemon[947]: reaped child process 1180, status = succeeded4526worker2 # [ 133.318150] nix-daemon[947]: accepted connection from pid 1196, user nix-grpc-daemon (trusted)4527worker2 # [ 133.359394] nix-daemon[947]: reaped child process 1199, status = succeeded4528lb # [ 133.369563] niks3-server[1010]: 2026/09/22 10:47:10 INFO Received uploads request method=POST path=/api/pending_closures4529worker2 # [ 133.383957] nix-grpc-daemon[997]: time=2026-09-22T10:47:10.649Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4530worker2 # [ 133.385745] nix-grpc-daemon[997]: time=2026-09-22T10:47:10.649Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4531lb # [ 133.399241] niks3-server[1010]: 2026/09/22 10:47:10 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4532lb # [ 133.410806] niks3-server[1010]: 2026/09/22 10:47:10 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4533worker2 # [ 133.415519] nix-grpc-daemon[997]: time=2026-09-22T10:47:10.683Z level=INFO msg="Uploading 1 narinfos"4534lb # [ 133.416636] niks3-server[1010]: 2026/09/22 10:47:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4535lb # [ 133.418579] niks3-server[1010]: 2026/09/22 10:47:10 INFO Signed narinfos id=18 count=14536lb # [ 133.425461] niks3-server[1010]: 2026/09/22 10:47:10 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4537lb # [ 133.432131] niks3-server[1010]: 2026/09/22 10:47:10 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4538lb # [ 133.438957] niks3-server[1010]: 2026/09/22 10:47:10 INFO Completed upload id=184539worker2 # [ 133.439577] nix-grpc-daemon[997]: time=2026-09-22T10:47:10.707Z level=INFO msg="Upload complete. (354ms)"4540lb # [ 133.441014] niks3-server[1010]: 2026/09/22 10:47:10 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4541worker2 # [ 133.448998] nix-grpc-daemon[867]: ts=2026-09-22T10:47:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40376 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=10 outputs=14542worker1 # [ 133.423381] nix-grpc-daemon[860]: ts=2026-09-22T10:47:10Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:349104543worker2 # [ 133.468480] nix-daemon[947]: reaped child process 1178, status = succeeded4544worker1 # [ 133.441057] nix-grpc-daemon[860]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4545worker2 # [ 133.525562] nix-grpc-daemon[867]: ts=2026-09-22T10:47:10Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:403764546worker2 # [ 133.529651] nix-grpc-daemon[867]: ts=2026-09-22T10:47:10Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40376 duration_s=0 paths=1 nar_bytes_out=1764547worker2 # [ 133.969913] nix-grpc-daemon[867]: ts=2026-09-22T10:47:11Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:403764548worker1 # [ 133.940593] nix-grpc-daemon[860]: ts=2026-09-22T10:47:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:349104549worker1 # [ 133.950904] nix-grpc-daemon[933]: time=2026-09-22T10:47:11.233Z level=INFO msg="All 2 paths already cached"4550worker2 # [ 134.010369] nix-grpc-daemon[867]: ts=2026-09-22T10:47:11Z level=debug event=want client=12 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04551worker2 # [ 134.019176] nix-grpc-daemon[867]: ts=2026-09-22T10:47:11Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.4:50051 clients=14552worker2 # [ 134.030205] nix-grpc-daemon[867]: ts=2026-09-22T10:47:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:403764553worker2 # [ 134.045473] nix-grpc-daemon[867]: ts=2026-09-22T10:47:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:403764554worker2 # [ 134.193051] nix-grpc-daemon[997]: time=2026-09-22T10:47:11.460Z level=INFO msg="All 2 paths already cached"4555worker2 # [ 134.208238] nix-grpc-daemon[867]: ts=2026-09-22T10:47:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:403764556worker2 # [ 134.225635] nix-daemon[947]: accepted connection from pid 867, user nix-grpc-daemon (trusted)4557worker2 # [ 134.483212] nix-daemon[947]: accepted connection from pid 1205, user nix-grpc-daemon (trusted)4558worker2 # [ 134.521790] nix-daemon[947]: reaped child process 1208, status = succeeded4559worker2 # [ 134.715247] nix-daemon[947]: accepted connection from pid 1210, user nix-grpc-daemon (trusted)4560lb # [ 134.741235] niks3-server[1010]: 2026/09/22 10:47:11 INFO Received uploads request method=POST path=/api/pending_closures4561worker2 # [ 134.743918] nix-daemon[947]: reaped child process 1213, status = succeeded4562worker2 # [ 134.758449] nix-grpc-daemon[997]: time=2026-09-22T10:47:12.025Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4563worker2 # [ 134.759888] nix-grpc-daemon[997]: time=2026-09-22T10:47:12.025Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4564lb # [ 134.783968] niks3-server[1010]: 2026/09/22 10:47:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4565lb # [ 134.791237] niks3-server[1010]: 2026/09/22 10:47:12 INFO Signed narinfos id=19 count=14566worker2 # [ 134.793291] nix-grpc-daemon[997]: time=2026-09-22T10:47:12.061Z level=INFO msg="Uploading 1 narinfos"4567lb # [ 134.794955] niks3-server[1010]: 2026/09/22 10:47:12 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4568lb # [ 134.802190] niks3-server[1010]: 2026/09/22 10:47:12 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4569lb # [ 134.822919] niks3-server[1010]: 2026/09/22 10:47:12 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4570lb # [ 134.867928] niks3-server[1010]: 2026/09/22 10:47:12 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4571worker2 # [ 134.874006] nix-grpc-daemon[997]: time=2026-09-22T10:47:12.142Z level=INFO msg="Upload complete. (627ms)"4572lb # [ 134.875567] niks3-server[1010]: 2026/09/22 10:47:12 INFO Completed upload id=194573worker2 # [ 134.880763] nix-grpc-daemon[867]: ts=2026-09-22T10:47:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40376 duration_s=0 paths=1 nar_bytes_in=7524574worker2 # [ 134.889874] nix-grpc-daemon[867]: ts=2026-09-22T10:47:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:403764575worker2 # [ 134.900657] nix-daemon[947]: accepted connection from pid 867, user nix-grpc-daemon (trusted)4576worker2 # [ 134.904695] nix-daemon[947]: reaped child process 1203, status = succeeded4577worker2 # [ 134.917072] nix-daemon[947]: accepted connection from pid 867, user nix-grpc-daemon (trusted)4578worker2 # [ 136.161624] nix-daemon[947]: reaped child process 1217, status = succeeded4579worker2 # [ 136.349835] nix-daemon[947]: accepted connection from pid 1233, user nix-grpc-daemon (trusted)4580worker2 # [ 136.373666] nix-daemon[947]: reaped child process 1236, status = succeeded4581lb # [ 136.391459] niks3-server[1010]: 2026/09/22 10:47:13 INFO Received uploads request method=POST path=/api/pending_closures4582worker2 # [ 136.404547] nix-grpc-daemon[997]: time=2026-09-22T10:47:13.670Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4583worker2 # [ 136.406139] nix-grpc-daemon[997]: time=2026-09-22T10:47:13.670Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4584lb # [ 136.443034] niks3-server[1010]: 2026/09/22 10:47:13 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4585worker2 # [ 136.455374] nix-grpc-daemon[997]: time=2026-09-22T10:47:13.723Z level=INFO msg="Uploading 1 narinfos"4586lb # [ 136.454569] niks3-server[1010]: 2026/09/22 10:47:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4587lb # [ 136.462870] niks3-server[1010]: 2026/09/22 10:47:13 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4588lb # [ 136.469908] niks3-server[1010]: 2026/09/22 10:47:13 INFO Signed narinfos id=20 count=14589lb # [ 136.472962] niks3-server[1010]: 2026/09/22 10:47:13 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4590worker2 # [ 136.482460] nix-grpc-daemon[997]: time=2026-09-22T10:47:13.750Z level=INFO msg="Upload complete. (348ms)"4591lb # [ 136.482687] niks3-server[1010]: 2026/09/22 10:47:13 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4592lb # [ 136.486875] niks3-server[1010]: 2026/09/22 10:47:13 INFO Completed upload id=204593lb # [ 136.490387] niks3-server[1010]: 2026/09/22 10:47:13 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4594worker2 # [ 136.496807] nix-grpc-daemon[867]: ts=2026-09-22T10:47:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40376 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=11 outputs=14595worker2 # [ 136.513733] nix-grpc-daemon[867]: ts=2026-09-22T10:47:13Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:403764596worker2 # [ 136.519563] nix-daemon[947]: reaped child process 1215, status = succeeded4597worker2 # [ 136.539343] nix-grpc-daemon[867]: ts=2026-09-22T10:47:13Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:403764598worker2 # [ 136.543961] nix-grpc-daemon[867]: ts=2026-09-22T10:47:13Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40376 duration_s=0 paths=1 nar_bytes_out=2324599client # [ 136.641294] nix-daemon[1051]: reaped child process 1053, status = succeeded4600client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 9.62 seconds)4601client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4602client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.05 seconds)4603client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4604client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.06 seconds)4605client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4606client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.04 seconds)4607(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 9.76 seconds)4608subtest: an input only one worker has still reaches the builder4609client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4610client # this derivation will be built:4611client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4612client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4613client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.53 seconds)4614client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4615client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.24 seconds)4616worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4617worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.31 seconds)4618worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4619worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.05 seconds)4620client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24621client # [ 138.108448] nix-daemon[1051]: accepted connection from pid 1134, user root (trusted)4622client # this derivation will be built:4623client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4624client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'...4625worker2 # [ 138.469066] nix-grpc-daemon[867]: ts=2026-09-22T10:47:15Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:403764626worker2 # [ 138.480674] nix-grpc-daemon[867]: ts=2026-09-22T10:47:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:403764627client # copying 1 paths...4628client # copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' to 'grpc://lb:50051'...4629worker1 # [ 138.464785] nix-grpc-daemon[860]: ts=2026-09-22T10:47:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:349104630worker1 # [ 138.482625] nix-daemon[921]: accepted connection from pid 860, user nix-grpc-daemon (trusted)4631worker1 # [ 138.714063] nix-daemon[921]: accepted connection from pid 1215, user nix-grpc-daemon (trusted)4632worker1 # [ 138.737429] nix-daemon[921]: reaped child process 1218, status = succeeded4633lb # [ 138.787576] niks3-server[1010]: 2026/09/22 10:47:16 INFO Received uploads request method=POST path=/api/pending_closures4634worker1 # [ 138.765443] nix-grpc-daemon[933]: time=2026-09-22T10:47:16.048Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4635worker1 # [ 138.767054] nix-grpc-daemon[933]: time=2026-09-22T10:47:16.048Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4636lb # [ 138.822672] niks3-server[1010]: 2026/09/22 10:47:16 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4637lb # [ 138.839849] niks3-server[1010]: 2026/09/22 10:47:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4638worker1 # [ 138.811509] nix-grpc-daemon[933]: time=2026-09-22T10:47:16.094Z level=INFO msg="Uploading 1 narinfos"4639lb # [ 138.852366] niks3-server[1010]: 2026/09/22 10:47:16 INFO Signed narinfos id=21 count=14640lb # [ 138.857377] niks3-server[1010]: 2026/09/22 10:47:16 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4641lb # [ 138.867222] niks3-server[1010]: 2026/09/22 10:47:16 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4642lb # [ 138.875280] niks3-server[1010]: 2026/09/22 10:47:16 INFO Completed upload id=214643worker1 # [ 138.841276] nix-grpc-daemon[933]: time=2026-09-22T10:47:16.124Z level=INFO msg="Upload complete. (343ms)"4644lb # [ 138.878143] niks3-server[1010]: 2026/09/22 10:47:16 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4645worker1 # [ 138.852540] nix-grpc-daemon[860]: ts=2026-09-22T10:47:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34910 duration_s=0 paths=1 nar_bytes_in=1204646worker1 # [ 138.867814] nix-daemon[921]: reaped child process 1213, status = succeeded4647worker2 # [ 138.905441] nix-grpc-daemon[867]: ts=2026-09-22T10:47:16Z level=debug event=want client=13 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04648worker2 # [ 138.910052] nix-grpc-daemon[867]: ts=2026-09-22T10:47:16Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=14649lb # [ 138.913827] envoy[961]: conn peer=[2001:db8:1::1]:54458 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=334 ms=334650lb # [ 138.919299] envoy[961]: conn peer=[2001:db8:1::1]:54442 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3444 tx=1873 ms=25224651lb # [ 138.925239] envoy[961]: conn peer=[2001:db8:1::1]:54462 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3903 tx=2088 ms=29454652lb # [ 138.930527] envoy[961]: conn peer=[2001:db8:1::1]:56884 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=375 ms=734653lb # [ 138.934632] envoy[961]: conn peer=[2001:db8:1::1]:56910 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=406 ms=634654lb # [ 138.939989] envoy[961]: conn peer=[2001:db8:1::1]:56896 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4356 tx=2206 ms=26354655worker1 # [ 138.920414] nix-grpc-daemon[860]: ts=2026-09-22T10:47:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:349104656worker1 # [ 138.943344] nix-grpc-daemon[860]: ts=2026-09-22T10:47:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:349104657client # copying 2 paths to 'lb:50051'...4658client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4659worker1 # [ 138.969079] nix-grpc-daemon[860]: ts=2026-09-22T10:47:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:349104660client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4661worker1 # [ 138.987180] nix-daemon[921]: accepted connection from pid 860, user nix-grpc-daemon (trusted)4662worker1 # [ 139.237562] nix-daemon[921]: accepted connection from pid 1222, user nix-grpc-daemon (trusted)4663worker1 # [ 139.263181] nix-daemon[921]: reaped child process 1225, status = succeeded4664worker1 # [ 139.469128] nix-daemon[921]: accepted connection from pid 1227, user nix-grpc-daemon (trusted)4665worker1 # [ 139.493554] nix-daemon[921]: reaped child process 1230, status = succeeded4666lb # [ 139.537467] niks3-server[1010]: 2026/09/22 10:47:16 INFO Received uploads request method=POST path=/api/pending_closures4667lb # [ 139.548481] niks3-server[1010]: 2026/09/22 10:47:16 INFO Received uploads request method=POST path=/api/pending_closures4668worker1 # [ 139.524993] nix-grpc-daemon[933]: time=2026-09-22T10:47:16.807Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4669worker1 # [ 139.527023] nix-grpc-daemon[933]: time=2026-09-22T10:47:16.807Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4670worker1 # [ 139.528927] nix-grpc-daemon[933]: time=2026-09-22T10:47:16.807Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4671lb # [ 139.601360] niks3-server[1010]: 2026/09/22 10:47:16 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4672lb # [ 139.611355] niks3-server[1010]: 2026/09/22 10:47:16 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4673lb # [ 139.621202] niks3-server[1010]: 2026/09/22 10:47:16 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4674lb # [ 139.631966] niks3-server[1010]: 2026/09/22 10:47:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4675lb # [ 139.636335] niks3-server[1010]: 2026/09/22 10:47:16 INFO Signed narinfos id=23 count=24676lb # [ 139.639300] niks3-server[1010]: 2026/09/22 10:47:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4677worker1 # [ 139.606209] nix-grpc-daemon[933]: time=2026-09-22T10:47:16.888Z level=INFO msg="Uploading 3 narinfos"4678lb # [ 139.642061] niks3-server[1010]: 2026/09/22 10:47:16 INFO Signed narinfos id=22 count=14679lb # [ 139.645823] niks3-server[1010]: 2026/09/22 10:47:16 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4680lb # [ 139.666033] niks3-server[1010]: 2026/09/22 10:47:16 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4681lb # [ 139.794692] niks3-server[1010]: 2026/09/22 10:47:17 INFO Completed upload id=224682lb # [ 139.802024] niks3-server[1010]: 2026/09/22 10:47:17 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4683lb # [ 139.808325] niks3-server[1010]: 2026/09/22 10:47:17 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4684worker1 # [ 139.779502] nix-grpc-daemon[933]: time=2026-09-22T10:47:17.058Z level=INFO msg="Upload complete. (754ms)"4685lb # [ 139.817994] niks3-server[1010]: 2026/09/22 10:47:17 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4686lb # [ 139.825291] niks3-server[1010]: 2026/09/22 10:47:17 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4687lb # [ 139.830853] niks3-server[1010]: 2026/09/22 10:47:17 INFO Completed upload id=234688worker1 # [ 139.794365] nix-grpc-daemon[860]: ts=2026-09-22T10:47:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34910 duration_s=0 paths=2 nar_bytes_in=9844689worker1 # [ 139.817391] nix-grpc-daemon[860]: ts=2026-09-22T10:47:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:349104690worker1 # [ 139.827618] nix-daemon[921]: accepted connection from pid 860, user nix-grpc-daemon (trusted)4691worker1 # [ 139.839993] nix-daemon[921]: reaped child process 1220, status = succeeded4692client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4693client # uses-input-w1onlya> node-a: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4694worker1 # [ 139.864183] nix-daemon[921]: accepted connection from pid 860, user nix-grpc-daemon (trusted)4695client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds4696worker1 # [ 140.696245] nix-daemon[921]: reaped child process 1234, status = succeeded4697worker1 # [ 140.872528] nix-daemon[921]: accepted connection from pid 1250, user nix-grpc-daemon (trusted)4698worker1 # [ 140.894974] nix-daemon[921]: reaped child process 1253, status = succeeded4699lb # [ 140.945749] niks3-server[1010]: 2026/09/22 10:47:18 INFO Received uploads request method=POST path=/api/pending_closures4700worker1 # [ 140.924561] nix-grpc-daemon[933]: time=2026-09-22T10:47:18.207Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4701lb # [ 140.987997] niks3-server[1010]: 2026/09/22 10:47:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4702worker1 # [ 140.963891] nix-grpc-daemon[933]: time=2026-09-22T10:47:18.246Z level=INFO msg="Uploading 1 narinfos"4703lb # [ 140.999539] niks3-server[1010]: 2026/09/22 10:47:18 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4704lb # [ 141.011438] niks3-server[1010]: 2026/09/22 10:47:18 INFO Signed narinfos id=24 count=14705lb # [ 141.023120] niks3-server[1010]: 2026/09/22 10:47:18 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4706worker1 # [ 140.996674] nix-grpc-daemon[933]: time=2026-09-22T10:47:18.279Z level=INFO msg="Upload complete. (317ms)"4707lb # [ 141.031468] niks3-server[1010]: 2026/09/22 10:47:18 INFO Completed upload id=244708lb # [ 141.036717] niks3-server[1010]: 2026/09/22 10:47:18 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4709worker1 # [ 141.004637] nix-grpc-daemon[860]: ts=2026-09-22T10:47:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34910 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=12 outputs=14710lb # [ 141.042570] niks3-server[1010]: 2026/09/22 10:47:18 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4711client # copying 1 paths...4712worker1 # [ 141.013832] nix-daemon[921]: reaped child process 1232, status = succeeded4713worker2 # [ 141.049578] nix-grpc-daemon[867]: ts=2026-09-22T10:47:18Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:403764714worker2 # [ 141.068283] nix-grpc-daemon[867]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'...4715client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4716worker1 # [ 141.092149] nix-grpc-daemon[860]: ts=2026-09-22T10:47:18Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:349104717worker1 # [ 141.100168] nix-grpc-daemon[860]: ts=2026-09-22T10:47:18Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34910 duration_s=0 paths=1 nar_bytes_out=1204718client # [ 141.186335] nix-daemon[1051]: reaped child process 1137, status = succeeded4719client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.28 seconds)4720client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24721client # [ 141.430847] nix-daemon[1051]: accepted connection from pid 1156, user root (trusted)4722client # this derivation will be built:4723client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4724worker1 # [ 141.689949] nix-grpc-daemon[860]: ts=2026-09-22T10:47:18Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:349104725client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'...4726worker1 # [ 141.698336] nix-grpc-daemon[860]: ts=2026-09-22T10:47:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:349104727worker1 # [ 141.705949] nix-grpc-daemon[933]: time=2026-09-22T10:47:18.989Z level=INFO msg="All 1 paths already cached"4728worker2 # [ 141.761868] nix-grpc-daemon[867]: ts=2026-09-22T10:47:19Z level=debug event=want client=14 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04729worker2 # [ 141.769561] nix-grpc-daemon[867]: ts=2026-09-22T10:47:19Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=14730worker2 # [ 141.773324] nix-grpc-daemon[867]: ts=2026-09-22T10:47:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:403764731worker2 # [ 141.798322] nix-grpc-daemon[867]: ts=2026-09-22T10:47:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:403764732client # copying 1 paths to 'lb:50051'...4733client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4734worker2 # [ 141.827405] nix-grpc-daemon[867]: ts=2026-09-22T10:47:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:403764735worker2 # [ 141.853498] nix-daemon[947]: accepted connection from pid 867, user nix-grpc-daemon (trusted)4736worker2 # [ 141.876525] nix-grpc-daemon[867]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 72 ms (attempt 1/5)4737worker2 # [ 141.954429] nix-grpc-daemon[867]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 170 ms (attempt 2/5)4738worker2 # [ 142.128855] nix-grpc-daemon[867]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 71 ms (attempt 3/5)4739worker2 # [ 142.199146] nix-grpc-daemon[867]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 22 ms (attempt 4/5)4740worker2 # [ 142.231914] nix-grpc-daemon[867]: disabling binary cache 'https://cache.nixos.org' for 60 seconds4741worker2 # [ 142.238316] nix-grpc-daemon[867]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4742worker2 # [ 142.250306] nix-grpc-daemon[867]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4743worker2 # [ 142.501328] nix-daemon[947]: accepted connection from pid 1253, user nix-grpc-daemon (trusted)4744worker2 # [ 142.524786] nix-daemon[947]: reaped child process 1256, status = succeeded4745worker2 # [ 142.714392] nix-daemon[947]: accepted connection from pid 1258, user nix-grpc-daemon (trusted)4746worker2 # [ 142.748318] nix-daemon[947]: reaped child process 1261, status = succeeded4747lb # [ 142.755785] niks3-server[1010]: 2026/09/22 10:47:19 INFO Received uploads request method=POST path=/api/pending_closures4748worker2 # [ 142.770065] nix-grpc-daemon[997]: time=2026-09-22T10:47:20.037Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4749worker2 # [ 142.771681] nix-grpc-daemon[997]: time=2026-09-22T10:47:20.037Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4750lb # [ 142.796365] niks3-server[1010]: 2026/09/22 10:47:20 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4751lb # [ 142.818149] niks3-server[1010]: 2026/09/22 10:47:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4752worker2 # [ 142.824942] nix-grpc-daemon[997]: time=2026-09-22T10:47:20.092Z level=INFO msg="Uploading 1 narinfos"4753lb # [ 142.831396] niks3-server[1010]: 2026/09/22 10:47:20 INFO Signed narinfos id=25 count=14754lb # [ 142.837956] niks3-server[1010]: 2026/09/22 10:47:20 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4755lb # [ 142.849655] niks3-server[1010]: 2026/09/22 10:47:20 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4756lb # [ 142.857103] niks3-server[1010]: 2026/09/22 10:47:20 INFO Completed upload id=254757worker2 # [ 142.857739] nix-grpc-daemon[997]: time=2026-09-22T10:47:20.125Z level=INFO msg="Upload complete. (578ms)"4758lb # [ 142.859948] niks3-server[1010]: 2026/09/22 10:47:20 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4759worker2 # [ 142.869250] nix-grpc-daemon[867]: ts=2026-09-22T10:47:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40376 duration_s=1 paths=1 nar_bytes_in=5684760worker2 # [ 142.883872] nix-grpc-daemon[867]: ts=2026-09-22T10:47:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:403764761worker2 # [ 142.902248] nix-daemon[947]: accepted connection from pid 867, user nix-grpc-daemon (trusted)4762worker2 # [ 142.906740] nix-daemon[947]: reaped child process 1246, status = succeeded4763worker2 # [ 142.931665] nix-grpc-daemon[867]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...4764client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4765client # uses-input-w1onlyb> worker2: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4766worker2 # [ 142.961007] nix-daemon[947]: accepted connection from pid 867, user nix-grpc-daemon (trusted)4767client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds4768worker2 # [ 144.229145] nix-daemon[947]: reaped child process 1266, status = succeeded4769worker2 # [ 144.416740] nix-daemon[947]: accepted connection from pid 1282, user nix-grpc-daemon (trusted)4770worker2 # [ 144.439164] nix-daemon[947]: reaped child process 1285, status = succeeded4771lb # [ 144.451323] niks3-server[1010]: 2026/09/22 10:47:21 INFO Received uploads request method=POST path=/api/pending_closures4772worker2 # [ 144.480706] nix-grpc-daemon[997]: time=2026-09-22T10:47:21.745Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4773lb # [ 144.502687] niks3-server[1010]: 2026/09/22 10:47:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4774worker2 # [ 144.512450] nix-grpc-daemon[997]: time=2026-09-22T10:47:21.780Z level=INFO msg="Uploading 1 narinfos"4775lb # [ 144.514934] niks3-server[1010]: 2026/09/22 10:47:21 INFO Signed narinfos id=26 count=14776lb # [ 144.523206] niks3-server[1010]: 2026/09/22 10:47:21 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4777lb # [ 144.530083] niks3-server[1010]: 2026/09/22 10:47:21 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4778lb # [ 144.538113] niks3-server[1010]: 2026/09/22 10:47:21 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4779lb # [ 144.546567] niks3-server[1010]: 2026/09/22 10:47:21 INFO Completed upload id=264780lb # [ 144.548002] niks3-server[1010]: 2026/09/22 10:47:21 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4781client # copying 1 paths...4782worker2 # [ 144.546707] nix-grpc-daemon[997]: time=2026-09-22T10:47:21.814Z level=INFO msg="Upload complete. (360ms)"4783worker2 # [ 144.561393] nix-grpc-daemon[867]: ts=2026-09-22T10:47:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40376 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=13 outputs=14784worker1 # [ 144.529534] nix-grpc-daemon[860]: ts=2026-09-22T10:47:21Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:349104785worker2 # [ 144.575440] nix-daemon[947]: reaped child process 1263, status = succeeded4786worker1 # [ 144.544604] nix-grpc-daemon[860]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'...4787client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4788worker1 # [ 144.603609] nix-grpc-daemon[860]: ts=2026-09-22T10:47:21Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:349104789worker1 # [ 144.606355] nix-grpc-daemon[860]: ts=2026-09-22T10:47:21Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34910 duration_s=0 paths=1 nar_bytes_out=1204790client # [ 144.740578] nix-daemon[1051]: reaped child process 1159, status = succeeded4791client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.55 seconds)4792client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24793client # [ 144.962001] nix-daemon[1051]: accepted connection from pid 1178, user root (trusted)4794client # this derivation will be built:4795client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4796client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'...4797worker1 # [ 145.256817] nix-grpc-daemon[860]: ts=2026-09-22T10:47:22Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:349104798worker1 # [ 145.267958] nix-grpc-daemon[860]: ts=2026-09-22T10:47:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:349104799worker1 # [ 145.278838] nix-grpc-daemon[933]: time=2026-09-22T10:47:22.559Z level=INFO msg="All 1 paths already cached"4800worker2 # [ 145.332521] nix-grpc-daemon[867]: ts=2026-09-22T10:47:22Z level=debug event=want client=15 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04801worker2 # [ 145.340130] nix-grpc-daemon[867]: ts=2026-09-22T10:47:22Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=14802worker1 # [ 145.368349] nix-grpc-daemon[860]: ts=2026-09-22T10:47:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:349104803worker1 # [ 145.384683] nix-grpc-daemon[860]: ts=2026-09-22T10:47:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:349104804worker1 # [ 145.400641] nix-grpc-daemon[933]: time=2026-09-22T10:47:22.683Z level=INFO msg="All 1 paths already cached"4805client # copying 1 paths to 'lb:50051'...4806worker1 # [ 145.409614] nix-grpc-daemon[860]: ts=2026-09-22T10:47:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:349104807client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4808worker1 # [ 145.431008] nix-daemon[921]: accepted connection from pid 860, user nix-grpc-daemon (trusted)4809worker1 # [ 145.614963] nix-daemon[921]: accepted connection from pid 1258, user nix-grpc-daemon (trusted)4810worker1 # [ 145.641856] nix-daemon[921]: reaped child process 1261, status = succeeded4811worker1 # [ 145.832859] nix-daemon[921]: accepted connection from pid 1263, user nix-grpc-daemon (trusted)4812worker1 # [ 145.857834] nix-daemon[921]: reaped child process 1266, status = succeeded4813lb # [ 145.906551] niks3-server[1010]: 2026/09/22 10:47:23 INFO Received uploads request method=POST path=/api/pending_closures4814worker1 # [ 145.888064] nix-grpc-daemon[933]: time=2026-09-22T10:47:23.170Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4815worker1 # [ 145.889718] nix-grpc-daemon[933]: time=2026-09-22T10:47:23.170Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4816lb # [ 145.945825] niks3-server[1010]: 2026/09/22 10:47:23 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4817worker1 # [ 145.928604] nix-grpc-daemon[933]: time=2026-09-22T10:47:23.211Z level=INFO msg="Uploading 1 narinfos"4818lb # [ 145.966922] niks3-server[1010]: 2026/09/22 10:47:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign4819lb # [ 145.976275] niks3-server[1010]: 2026/09/22 10:47:23 INFO Signed narinfos id=27 count=14820lb # [ 145.980679] niks3-server[1010]: 2026/09/22 10:47:23 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4821lb # [ 145.982222] niks3-server[1010]: 2026/09/22 10:47:23 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete4822worker1 # [ 145.946551] nix-grpc-daemon[933]: time=2026-09-22T10:47:23.229Z level=INFO msg="Upload complete. (503ms)"4823lb # [ 145.986811] niks3-server[1010]: 2026/09/22 10:47:23 INFO Completed upload id=274824worker1 # [ 145.952751] nix-grpc-daemon[860]: ts=2026-09-22T10:47:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34910 duration_s=0 paths=1 nar_bytes_in=5684825lb # [ 145.990011] niks3-server[1010]: 2026/09/22 10:47:23 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4826worker1 # [ 145.963924] nix-grpc-daemon[860]: ts=2026-09-22T10:47:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:349104827worker1 # [ 145.972864] nix-daemon[921]: accepted connection from pid 860, user nix-grpc-daemon (trusted)4828worker1 # [ 145.976933] nix-daemon[921]: reaped child process 1256, status = succeeded4829client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4830client # uses-input-w1onlyc> node-a: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4831worker1 # [ 145.992260] nix-daemon[921]: accepted connection from pid 860, user nix-grpc-daemon (trusted)4832client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds4833worker1 # [ 147.247251] nix-daemon[921]: reaped child process 1270, status = succeeded4834worker1 # [ 147.454320] nix-daemon[921]: accepted connection from pid 1286, user nix-grpc-daemon (trusted)4835worker1 # [ 147.479843] nix-daemon[921]: reaped child process 1289, status = succeeded4836lb # [ 147.529569] niks3-server[1010]: 2026/09/22 10:47:24 INFO Received uploads request method=POST path=/api/pending_closures4837worker1 # [ 147.504968] nix-grpc-daemon[933]: time=2026-09-22T10:47:24.787Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4838lb # [ 147.562839] niks3-server[1010]: 2026/09/22 10:47:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign4839worker1 # [ 147.540481] nix-grpc-daemon[933]: time=2026-09-22T10:47:24.823Z level=INFO msg="Uploading 1 narinfos"4840lb # [ 147.579056] niks3-server[1010]: 2026/09/22 10:47:24 INFO Signed narinfos id=28 count=14841lb # [ 147.586491] niks3-server[1010]: 2026/09/22 10:47:24 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4842lb # [ 147.595304] niks3-server[1010]: 2026/09/22 10:47:24 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4843lb # [ 147.603880] niks3-server[1010]: 2026/09/22 10:47:24 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete4844lb # [ 147.608967] niks3-server[1010]: 2026/09/22 10:47:24 INFO Completed upload id=284845worker1 # [ 147.574239] nix-grpc-daemon[933]: time=2026-09-22T10:47:24.857Z level=INFO msg="Upload complete. (367ms)"4846lb # [ 147.611795] niks3-server[1010]: 2026/09/22 10:47:24 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4847worker1 # [ 147.583301] nix-grpc-daemon[860]: ts=2026-09-22T10:47:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34910 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=14 outputs=14848client # copying 1 paths...4849worker2 # [ 147.627049] nix-grpc-daemon[867]: ts=2026-09-22T10:47:24Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:403764850worker1 # [ 147.598898] nix-daemon[921]: reaped child process 1268, status = succeeded4851worker2 # [ 147.642144] nix-grpc-daemon[867]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'...4852client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4853worker1 # [ 147.656721] nix-grpc-daemon[860]: ts=2026-09-22T10:47:24Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:349104854worker1 # [ 147.663736] nix-grpc-daemon[860]: ts=2026-09-22T10:47:24Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34910 duration_s=0 paths=1 nar_bytes_out=1204855client # [ 147.773385] nix-daemon[1051]: reaped child process 1181, status = succeeded4856client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 3.04 seconds)4857(finished: subtest: an input only one worker has still reaches the builder, in 11.00 seconds)4858subtest: upload whose reference the worker lacks is completed from the cache4859client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4860client # this derivation will be built:4861client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4862client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4863client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.56 seconds)4864client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4865client # this derivation will be built:4866client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4867client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4868client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.52 seconds)4869lb # [ 148.913925] envoy[961]: conn peer=[2001:db8:1::1]:56926 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4232 tx=1963 ms=26894870client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4871lb # [ 148.919118] envoy[961]: conn peer=[2001:db8:1::1]:41698 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=344872lb # [ 148.924188] envoy[961]: conn peer=[2001:db8:1::1]:41700 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3740 tx=2015 ms=29784873lb # [ 148.930145] envoy[961]: conn peer=[2001:db8:1::1]:41706 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=674874lb # [ 148.935018] envoy[961]: conn peer=[2001:db8:1::1]:41722 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3784 tx=2005 ms=24274875lb # [ 148.939976] envoy[961]: conn peer=[2001:db8:1::1]:41730 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=304876client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.23 seconds)4877worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4878worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.24 seconds)4879worker2 # [ 149.479209] systemd[1]: Stopping Nix worker-protocol over gRPC...4880worker2 # [ 149.791009] nix-grpc-daemon[867]: ts=2026-09-22T10:47:27Z level=info event=signal_exit4881lb # [ 149.809247] niks3-server[1010]: 2026/09/22 10:47:27 INFO lead: released remote=192.168.1.4:488704882worker1 # [ 150.776999] nix-grpc-daemon[860]: ts=2026-09-22T10:47:28Z level=info event=scheduler_restarting addr=lb:500514883worker2 # [ 150.815653] nix-grpc-daemon[867]: ts=2026-09-22T10:47:28Z level=info event=scheduler_restarting4884worker2 # [ 150.821433] nix-grpc-daemon[867]: ts=2026-09-22T10:47:28Z level=info event=scheduler_restarting addr=lb:500514885worker2 # [ 150.829708] nix-grpc-daemon[867]: ts=2026-09-22T10:47:28Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:500824886worker2 # [ 150.835230] nix-grpc-daemon[867]: ts=2026-09-22T10:47:28Z level=info event=worker_gone addr=192.168.1.4:500514887worker2 # [ 150.839837] nix-grpc-daemon[867]: ts=2026-09-22T10:47:28Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:500824888worker2 # [ 150.845249] nix-grpc-daemon[867]: ts=2026-09-22T10:47:28Z level=info event=worker_gone addr=192.168.1.3:500514889worker2 # [ 150.884653] nix-daemon[947]: reaped child process 949, status = succeeded4890worker1 # [ 150.978745] nix-grpc-daemon[860]: ts=2026-09-22T10:47:28Z level=info event=scheduler_connected addr=lb:500514891worker1 # [ 150.985217] nix-grpc-daemon[860]: ts=2026-09-22T10:47:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4892worker2 # [ 151.051994] nix-grpc-daemon[867]: ts=2026-09-22T10:47:28Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4893worker2 # [ 151.183475] nix-grpc-daemon[867]: E0000 00:00:1790074048.451101 912 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true4894worker2 # [ 151.191953] nix-grpc-daemon[867]: E0000 00:00:1790074048.451457 912 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4895worker1 # [ 151.186577] nix-grpc-daemon[860]: ts=2026-09-22T10:47:28Z level=info event=scheduler_connected addr=lb:500514896worker1 # [ 151.193120] nix-grpc-daemon[860]: ts=2026-09-22T10:47:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4897worker1 # [ 151.394364] nix-grpc-daemon[860]: ts=2026-09-22T10:47:28Z level=info event=scheduler_connected addr=lb:500514898worker1 # [ 151.400946] nix-grpc-daemon[860]: ts=2026-09-22T10:47:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4899worker1 # [ 151.602079] nix-grpc-daemon[860]: ts=2026-09-22T10:47:28Z level=info event=scheduler_connected addr=lb:500514900worker1 # [ 151.606383] nix-grpc-daemon[860]: ts=2026-09-22T10:47:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4901worker1 # [ 151.807954] nix-grpc-daemon[860]: ts=2026-09-22T10:47:29Z level=info event=scheduler_connected addr=lb:500514902worker1 # [ 151.811363] nix-grpc-daemon[860]: ts=2026-09-22T10:47:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4903worker2 # [ 151.878103] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4904worker2 # [ 151.883416] systemd[1]: Stopped Nix worker-protocol over gRPC.4905worker2 # [ 151.893300] systemd[1]: nix-grpc-daemon.service: Consumed 8.417s CPU time over 1min 39.092s wall clock time, 59.2M memory peak, 72.9K incoming IP traffic, 173.2K outgoing IP traffic.4906worker2 # [ 151.906429] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4907worker2 # [ 151.915003] systemd[1]: Closed Nix worker-protocol over gRPC.4908worker2 # [ 151.918291] systemd[1]: nix-grpc-daemon.socket: Consumed 875us CPU time over 2min 14.952s wall clock time, 256K memory peak, 102.1K incoming IP traffic, 80.7K outgoing IP traffic.4909lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4910lb: must succeed: curl -sf localhost:9901/clusters4911lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4912lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.08 seconds)4913client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24914worker1 # [ 152.012732] nix-grpc-daemon[860]: ts=2026-09-22T10:47:29Z level=info event=scheduler_connected addr=lb:500514915worker1 # [ 152.018449] nix-grpc-daemon[860]: ts=2026-09-22T10:47:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4916worker1 # [ 152.219277] nix-grpc-daemon[860]: ts=2026-09-22T10:47:29Z level=info event=scheduler_connected addr=lb:500514917worker1 # [ 152.227226] nix-grpc-daemon[860]: ts=2026-09-22T10:47:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4918worker1 # [ 152.285261] nix-grpc-daemon[860]: ts=2026-09-22T10:47:29Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:349104919client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4920worker1 # [ 152.295823] nix-grpc-daemon[860]: ts=2026-09-22T10:47:29Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:349104921client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.37 seconds)4922worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4923worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)4924worker1 # [ 152.428614] nix-grpc-daemon[860]: ts=2026-09-22T10:47:29Z level=info event=scheduler_connected addr=lb:500514925worker1 # [ 152.436156] nix-grpc-daemon[860]: ts=2026-09-22T10:47:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4926worker2 # [ 152.508148] systemd[1]: Listening on Nix worker-protocol over gRPC.4927worker1 # [ 152.591030] systemd[1]: Stopping Nix worker-protocol over gRPC...4928worker1 # [ 152.637204] nix-grpc-daemon[860]: ts=2026-09-22T10:47:29Z level=info event=scheduler_connected addr=lb:500514929worker1 # [ 152.641288] nix-grpc-daemon[860]: ts=2026-09-22T10:47:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4930worker2 # [ 152.816814] systemd[1]: Starting scheduler-token.service...4931worker1 # [ 152.845100] nix-grpc-daemon[860]: ts=2026-09-22T10:47:30Z level=info event=scheduler_connected addr=lb:500514932worker1 # [ 152.851831] nix-grpc-daemon[860]: ts=2026-09-22T10:47:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4933worker1 # [ 152.909612] nix-grpc-daemon[860]: ts=2026-09-22T10:47:30Z level=info event=signal_exit4934worker2 # [ 152.949525] systemd[1]: scheduler-token.service: Deactivated successfully.4935worker2 # [ 152.954558] systemd[1]: Finished scheduler-token.service.4936worker2 # [ 152.960412] systemd[1]: scheduler-token.service: Consumed 72ms CPU time over 137ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.4937worker2 # [ 152.990176] systemd[1]: Starting Nix worker-protocol over gRPC...4938worker1 # [ 153.054487] nix-grpc-daemon[860]: ts=2026-09-22T10:47:30Z level=info event=scheduler_connected addr=lb:500514939worker1 # [ 153.070485] nix-grpc-daemon[860]: ts=2026-09-22T10:47:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4940worker1 # [ 153.274835] nix-grpc-daemon[860]: ts=2026-09-22T10:47:30Z level=info event=scheduler_connected addr=lb:500514941worker1 # [ 153.281079] nix-grpc-daemon[860]: ts=2026-09-22T10:47:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4942worker2 # [ 153.485937] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:30Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4943worker2 # [ 153.489531] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:30Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4944worker2 # [ 153.494593] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:30Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14945worker2 # [ 153.504118] nix-grpc-daemon[1312]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4946worker2 # [ 153.506359] nix-grpc-daemon[1312]: E0000 00:00:1790074050.769610 1312 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.4947worker1 # [ 153.483041] nix-grpc-daemon[860]: ts=2026-09-22T10:47:30Z level=info event=scheduler_connected addr=lb:500514948worker2 # [ 153.522068] nix-grpc-daemon[1312]: E0000 00:00:1790074050.772019 1312 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.4949worker1 # [ 153.490983] nix-grpc-daemon[860]: ts=2026-09-22T10:47:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4950lb # [ 153.531126] niks3-server[1010]: 2026/09/22 10:47:30 INFO lead: acquired remote=192.168.1.4:599144951worker2 # [ 153.529902] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:30Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4952worker2 # [ 153.535807] systemd[1]: Started Nix worker-protocol over gRPC.4953worker2 # [ 153.537212] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:30Z level=info event=scheduler_take_over4954worker2 # [ 153.544121] nix-grpc-daemon[1312]: E0000 00:00:1790074050.808354 1351 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.4955worker2 # [ 153.568345] nix-grpc-daemon[1312]: E0000 00:00:1790074050.826646 1351 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.4956worker2 # [ 153.579438] nix-grpc-daemon[1312]: E0000 00:00:1790074050.826909 1351 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.4957worker2 # [ 153.582872] nix-grpc-daemon[1312]: E0000 00:00:1790074050.846212 1351 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.4958worker2 # [ 153.599756] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:30Z level=info event=scheduler_connected addr=lb:500514959worker2 # [ 153.603039] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4960worker1 # [ 153.691735] nix-grpc-daemon[860]: ts=2026-09-22T10:47:30Z level=info event=scheduler_connected addr=lb:500514961worker1 # [ 153.694749] nix-grpc-daemon[860]: ts=2026-09-22T10:47:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4962worker2 # [ 153.804175] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:31Z level=info event=scheduler_connected addr=lb:500514963worker2 # [ 153.807243] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4964worker1 # [ 153.895945] nix-grpc-daemon[860]: ts=2026-09-22T10:47:31Z level=info event=scheduler_connected addr=lb:500514965worker1 # [ 153.899094] nix-grpc-daemon[860]: ts=2026-09-22T10:47:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4966worker2 # [ 154.008761] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:31Z level=info event=scheduler_connected addr=lb:500514967worker2 # [ 154.012377] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4968worker1 # [ 154.099727] nix-grpc-daemon[860]: ts=2026-09-22T10:47:31Z level=info event=scheduler_connected addr=lb:500514969worker1 # [ 154.102747] nix-grpc-daemon[860]: ts=2026-09-22T10:47:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4970worker2 # [ 154.213287] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:31Z level=info event=scheduler_connected addr=lb:500514971worker2 # [ 154.216391] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4972worker1 # [ 154.303822] nix-grpc-daemon[860]: ts=2026-09-22T10:47:31Z level=info event=scheduler_connected addr=lb:500514973worker1 # [ 154.309531] nix-grpc-daemon[860]: ts=2026-09-22T10:47:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4974worker1 # [ 154.375580] nix-grpc-daemon[860]: ts=2026-09-22T10:47:31Z level=info event=scheduler_restarting4975worker2 # [ 154.417342] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:31Z level=info event=scheduler_connected addr=lb:500514976worker2 # [ 154.419833] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4977worker1 # [ 154.420657] nix-daemon[921]: reaped child process 923, status = succeeded4978worker1 # [ 154.527455] nix-grpc-daemon[860]: ts=2026-09-22T10:47:31Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4979worker2 # [ 154.621921] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:31Z level=info event=scheduler_connected addr=lb:500514980worker2 # [ 154.682214] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:31Z level=info event=oidc_jwks provider=mock keys=14981worker2 # [ 154.683604] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:31Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:420004982worker2 # [ 154.685641] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:31Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04983worker1 # [ 155.167525] nix-grpc-daemon[860]: E0000 00:00:1790074052.448564 906 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true4984worker1 # [ 155.177303] nix-grpc-daemon[860]: E0000 00:00:1790074052.449524 906 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4985worker1 # [ 155.699908] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4986worker1 # [ 155.703055] systemd[1]: Stopped Nix worker-protocol over gRPC.4987worker1 # [ 155.703960] systemd[1]: nix-grpc-daemon.service: Consumed 8.502s CPU time over 1min 43.077s wall clock time, 59.5M memory peak, 92.5K incoming IP traffic, 161K outgoing IP traffic.4988worker1 # [ 155.715858] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4989worker1 # [ 155.718959] systemd[1]: Closed Nix worker-protocol over gRPC.4990worker1 # [ 155.721859] systemd[1]: nix-grpc-daemon.socket: Consumed 817us CPU time over 2min 18.214s wall clock time, 256K memory peak, 93.2K incoming IP traffic, 75.8K outgoing IP traffic.4991lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4992lb: must succeed: curl -sf localhost:9901/clusters4993lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4994lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.06 seconds)4995client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24996worker2 # [ 156.109259] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:420064997worker2 # [ 156.120253] nix-daemon[947]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)4998worker2 # [ 156.139899] nix-grpc-daemon[1312]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 13 ms (attempt 1/5)4999worker2 # [ 156.155652] nix-grpc-daemon[1312]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 5 ms (attempt 2/5)5000worker2 # [ 156.161017] nix-grpc-daemon[1312]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 283 ms (attempt 3/5)5001worker2 # [ 156.444616] nix-grpc-daemon[1312]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 649 ms (attempt 4/5)5002worker2 # [ 157.108131] nix-grpc-daemon[1312]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5003worker2 # [ 157.108462] nix-grpc-daemon[1312]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5004client # copying 2 paths...5005client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...5006client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...5007worker2 # [ 157.144350] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:420065008worker2 # [ 157.154869] nix-daemon[947]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5009worker2 # [ 157.186401] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:34Z level=info event=niks3_push_started pid=13725010worker2 # [ 157.469886] nix-grpc-daemon[1372]: time=2026-09-22T10:47:34.735Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca=""5011worker2 # [ 158.249835] nix-daemon[947]: accepted connection from pid 1385, user nix-grpc-daemon (trusted)5012worker2 # [ 158.306265] nix-daemon[947]: reaped child process 1388, status = succeeded5013lb # [ 158.387003] niks3-server[1010]: 2026/09/22 10:47:35 INFO Received uploads request method=POST path=/api/pending_closures5014lb # [ 158.470406] niks3-server[1010]: 2026/09/22 10:47:35 INFO Received uploads request method=POST path=/api/pending_closures5015lb # [ 159.001088] envoy[961]: conn peer=[2001:db8:1::4]:35954 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=31922 tx=2141 ms=976385016worker2 # [ 158.982811] nix-grpc-daemon[1372]: time=2026-09-22T10:47:36.191Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5017worker2 # [ 159.130074] nix-grpc-daemon[1372]: time=2026-09-22T10:47:36.213Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"5018lb # [ 159.360151] envoy[961]: conn peer=[2001:db8:1::1]:37446 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=285019lb # [ 159.473323] envoy[961]: conn peer=[2001:db8:1::3]:59170 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=9199 tx=2831 ms=1012275020worker2 # [ 159.288675] nix-grpc-daemon[1372]: time=2026-09-22T10:47:36.472Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"5021lb # [ 159.961327] niks3-server[1010]: 2026/09/22 10:47:37 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst5022lb # [ 159.971732] niks3-server[1010]: 2026/09/22 10:47:37 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5023lb # [ 159.980305] niks3-server[1010]: 2026/09/22 10:47:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5024worker2 # [ 159.982406] nix-grpc-daemon[1372]: time=2026-09-22T10:47:37.248Z level=INFO msg="Uploading 3 narinfos"5025lb # [ 159.986157] niks3-server[1010]: 2026/09/22 10:47:37 INFO Signed narinfos id=30 count=25026lb # [ 159.992263] niks3-server[1010]: 2026/09/22 10:47:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5027lb # [ 159.997147] niks3-server[1010]: 2026/09/22 10:47:37 INFO Signed narinfos id=29 count=15028lb # [ 159.998363] niks3-server[1010]: 2026/09/22 10:47:37 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls5029lb # [ 160.020883] niks3-server[1010]: 2026/09/22 10:47:37 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo5030lb # [ 160.033357] niks3-server[1010]: 2026/09/22 10:47:37 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5031lb # [ 160.037787] niks3-server[1010]: 2026/09/22 10:47:37 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls5032lb # [ 160.042970] niks3-server[1010]: 2026/09/22 10:47:37 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo5033lb # [ 160.046031] niks3-server[1010]: 2026/09/22 10:47:37 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo5034lb # [ 160.049360] niks3-server[1010]: 2026/09/22 10:47:37 INFO Completed upload id=305035lb # [ 160.051834] niks3-server[1010]: 2026/09/22 10:47:37 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5036lb # [ 160.054263] niks3-server[1010]: 2026/09/22 10:47:37 INFO Completed upload id=295037worker2 # [ 160.054602] nix-grpc-daemon[1372]: time=2026-09-22T10:47:37.322Z level=INFO msg="Upload complete. (2.585s)"5038worker2 # [ 160.065299] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42006 duration_s=2 paths=2 nar_bytes_in=3125039worker2 # [ 160.069414] nix-daemon[947]: reaped child process 1370, status = succeeded5040client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 4.25 seconds)5041worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache5042worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.02 seconds)5043worker1 # [ 160.148814] systemd[1]: Listening on Nix worker-protocol over gRPC.5044worker1 # [ 160.154064] systemd[1]: Starting Nix worker-protocol over gRPC...5045worker1 # [ 160.353912] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:37Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5046worker1 # [ 160.356982] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:37Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5047worker1 # [ 160.361828] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:37Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15048worker1 # [ 160.376127] nix-grpc-daemon[1312]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5049worker1 # [ 160.377778] nix-grpc-daemon[1312]: E0000 00:00:1790074057.656476 1312 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5050worker1 # [ 160.398715] nix-grpc-daemon[1312]: E0000 00:00:1790074057.659059 1312 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5051worker1 # [ 160.405442] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:37Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5052lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5053lb: must succeed: curl -sf localhost:9901/clusters5054worker1 # [ 160.446031] systemd[1]: Started Nix worker-protocol over gRPC.5055worker1 # [ 160.447913] nix-grpc-daemon[1312]: E0000 00:00:1790074057.689636 1354 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5056worker1 # [ 160.451671] nix-grpc-daemon[1312]: E0000 00:00:1790074057.708728 1354 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5057worker1 # [ 160.458817] nix-grpc-daemon[1312]: E0000 00:00:1790074057.709125 1354 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5058worker1 # [ 160.464998] nix-grpc-daemon[1312]: E0000 00:00:1790074057.728038 1354 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5059worker1 # [ 160.468768] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:37Z level=info event=scheduler_connected addr=lb:500515060worker2 # [ 160.500674] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:37Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:420005061worker2 # [ 160.507572] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:37Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05062lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.22 seconds)5063lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.22 seconds)5064(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 12.86 seconds)5065subtest: a niks3 restart does not cost the leader its role5066lb: must succeed: curl -sf localhost:9901/clusters5067lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5068lb: must succeed: curl -sf localhost:9901/clusters5069lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5070lb # [ 160.837715] systemd[1]: Stopping niks3 server...5071lb # [ 160.838042] niks3-server[1010]: 2026/09/22 10:47:38 INFO Shutdown signal received, draining in-flight requests timeout=10s5072lb # [ 160.843936] niks3-server[1010]: 2026/09/22 10:47:38 INFO lead: released remote=192.168.1.4:599145073worker1 # [ 160.808413] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:38Z level=info event=scheduler_lock_lost status=2005074worker2 # [ 160.843252] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:38Z level=info event=scheduler_lock_lost status=2005075lb # [ 165.144350] systemd[1]: niks3.service: Deactivated successfully.5076lb # [ 165.146888] systemd[1]: Stopped niks3 server.5077lb # [ 165.150780] systemd[1]: niks3.service: Consumed 2.410s CPU time over 1min 52.023s wall clock time, 22.6M memory peak, 77.5K incoming IP traffic, 112.8K outgoing IP traffic.5078lb # [ 165.173309] systemd[1]: Starting niks3 server...5079lb # [ 165.260649] niks3-server[1133]: 2026/09/22 10:47:42 goose: no migrations to run. current version: 202609200000005080lb # [ 165.268959] niks3-server[1133]: 2026/09/22 10:47:42 OK 1_commit_pending_closure.sql (9.02ms)5081lb # [ 165.273416] niks3-server[1133]: 2026/09/22 10:47:42 OK 2_object_stats_trigger.sql (2.5ms)5082lb # [ 165.274857] niks3-server[1133]: 2026/09/22 10:47:42 goose: up to current file version: 25083lb # [ 165.276885] niks3-server[1133]: 2026/09/22 10:47:42 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key5084lb # [ 165.292918] niks3-server[1133]: 2026/09/22 10:47:42 INFO Read proxy enabled — serving cache objects from S35085lb # [ 165.294433] niks3-server[1133]: 2026/09/22 10:47:42 INFO Using socket-activated listener address=0.0.0.0:57515086lb # [ 165.302797] niks3-server[1133]: 2026/09/22 10:47:42 INFO systemd watchdog enabled interval=15s5087lb # [ 165.305693] niks3-server[1133]: 2026/09/22 10:47:42 INFO Starting HTTP server address=0.0.0.0:57515088lb # [ 165.307178] niks3-server[1133]: 2026/09/22 10:47:42 INFO lead: acquired remote=192.168.1.4:342845089lb # [ 165.308574] systemd[1]: Started niks3 server.5090lb: waiting for unit niks3.service5091lb: (finished: waiting for unit niks3.service, in 0.05 seconds)5092lb: must succeed: curl -sf localhost:9901/clusters5093lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5094worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5095worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5096lb: must succeed: curl -sf localhost:9901/clusters5097lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5098lb: must succeed: curl -sf localhost:9901/clusters5099lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5100worker2: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield5101worker2: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.07 seconds)5102client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag after-niks3-restart >&25103worker1 # [ 165.945075] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:520085104worker1 # [ 165.965813] nix-daemon[921]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5105client # don't know how to build these paths:5106client # /nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv5107worker2 # [ 166.032560] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:420065108worker2 # [ 166.094563] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:43Z level=debug event=want client=1 drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv cached=05109worker2 # [ 166.105140] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:43Z level=debug event=assigned drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv worker=192.168.1.4:50051 clients=15110worker2 # [ 166.143754] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:420065111worker2 # [ 166.169109] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:420065112client # copying 1 paths to 'lb:50051'...5113client # copying path '/nix/store/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv' to 'lb:50051'...5114worker2 # [ 166.192260] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:420065115worker2 # [ 166.213407] nix-daemon[947]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5116worker2 # [ 166.444717] nix-daemon[947]: accepted connection from pid 1407, user nix-grpc-daemon (trusted)5117worker2 # [ 166.469392] nix-daemon[947]: reaped child process 1410, status = succeeded5118worker2 # [ 166.653930] nix-daemon[947]: accepted connection from pid 1412, user nix-grpc-daemon (trusted)5119worker2 # [ 166.686446] nix-daemon[947]: reaped child process 1415, status = succeeded5120lb # [ 166.701017] niks3-server[1133]: 2026/09/22 10:47:43 INFO Received uploads request method=POST path=/api/pending_closures5121worker2 # [ 166.729879] nix-grpc-daemon[1372]: time=2026-09-22T10:47:43.997Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5122worker2 # [ 166.732445] nix-grpc-daemon[1372]: time=2026-09-22T10:47:43.997Z level=INFO msg="Uploading mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv (544B)"5123lb # [ 166.758020] niks3-server[1133]: 2026/09/22 10:47:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5124lb # [ 166.775507] niks3-server[1133]: 2026/09/22 10:47:44 INFO Registered completed upload object_key=nar/0hn539w6achi7azzyhpihsi61g85x9f535dxv438yq5y50ksrp1d.nar.zst5125lb # [ 166.793890] niks3-server[1133]: 2026/09/22 10:47:44 INFO Signed narinfos id=31 count=15126worker2 # [ 166.798278] nix-grpc-daemon[1372]: time=2026-09-22T10:47:44.066Z level=INFO msg="Uploading 1 narinfos"5127lb # [ 166.808314] niks3-server[1133]: 2026/09/22 10:47:44 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5128lb # [ 166.815701] niks3-server[1133]: 2026/09/22 10:47:44 INFO Registered completed upload object_key=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z.ls5129lb # [ 166.824315] niks3-server[1133]: 2026/09/22 10:47:44 INFO Registered completed upload object_key=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z.narinfo5130lb # [ 166.834249] niks3-server[1133]: 2026/09/22 10:47:44 INFO Completed upload id=315131worker2 # [ 166.835047] nix-grpc-daemon[1372]: time=2026-09-22T10:47:44.103Z level=INFO msg="Upload complete. (601ms)"5132worker2 # [ 166.840384] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42006 duration_s=0 paths=1 nar_bytes_in=5445133worker2 # [ 166.845256] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:420065134worker2 # [ 166.858484] nix-daemon[947]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5135worker2 # [ 166.863330] nix-daemon[947]: reaped child process 1405, status = succeeded5136client # building '/nix/store/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv' on lb:50051...5137client # farm-a> worker2: building mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv5138worker2 # [ 166.878965] nix-daemon[947]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5139client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds5140client # farm-a> LOG-farm-a-after-niks3-restart5141worker2 # [ 167.737838] nix-daemon[947]: reaped child process 1419, status = succeeded5142worker2 # [ 167.995238] nix-daemon[947]: accepted connection from pid 1435, user nix-grpc-daemon (trusted)5143worker2 # [ 168.021344] nix-daemon[947]: reaped child process 1438, status = succeeded5144lb # [ 168.034519] niks3-server[1133]: 2026/09/22 10:47:45 INFO Received uploads request method=POST path=/api/pending_closures5145worker2 # [ 168.055559] nix-grpc-daemon[1372]: time=2026-09-22T10:47:45.320Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5146worker2 # [ 168.059219] nix-grpc-daemon[1372]: time=2026-09-22T10:47:45.320Z level=INFO msg="Uploading j3iswx3ynilvcycpyw0z667966c9kpzx-farm-a (144B)"5147lb # [ 168.082483] niks3-server[1133]: 2026/09/22 10:47:45 INFO Registered completed upload object_key=log/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv5148lb # [ 168.088779] niks3-server[1133]: 2026/09/22 10:47:45 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst5149lb # [ 168.094741] niks3-server[1133]: 2026/09/22 10:47:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5150worker2 # [ 168.097228] nix-grpc-daemon[1372]: time=2026-09-22T10:47:45.364Z level=INFO msg="Uploading 1 narinfos"5151lb # [ 168.100573] niks3-server[1133]: 2026/09/22 10:47:45 INFO Signed narinfos id=32 count=15152lb # [ 168.104615] niks3-server[1133]: 2026/09/22 10:47:45 INFO Registered completed upload object_key=j3iswx3ynilvcycpyw0z667966c9kpzx.ls5153lb # [ 168.110257] niks3-server[1133]: 2026/09/22 10:47:45 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5154lb # [ 168.121230] niks3-server[1133]: 2026/09/22 10:47:45 INFO Completed upload id=325155worker2 # [ 168.121825] nix-grpc-daemon[1372]: time=2026-09-22T10:47:45.389Z level=INFO msg="Upload complete. (423ms)"5156lb # [ 168.126406] niks3-server[1133]: 2026/09/22 10:47:45 INFO Registered completed upload object_key=j3iswx3ynilvcycpyw0z667966c9kpzx.narinfo5157worker2 # [ 168.132272] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42006 duration_s=1 drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv assign_id=1 outputs=15158worker2 # [ 168.139523] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:45Z level=debug event=want client=1 drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv cached=05159worker2 # [ 168.144322] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:45Z level=debug event=assigned drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv worker=192.168.1.4:50051 clients=15160worker2 # [ 168.160343] nix-daemon[947]: reaped child process 1417, status = succeeded5161worker2 # [ 168.184391] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:420065162worker2 # [ 168.195364] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:420065163worker2 # [ 168.211099] nix-grpc-daemon[1372]: time=2026-09-22T10:47:45.479Z level=INFO msg="All 1 paths already cached"5164client # copying 1 paths to 'lb:50051'...5165client # copying path '/nix/store/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv' to 'lb:50051'...5166worker2 # [ 168.220824] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:420065167worker2 # [ 168.227929] nix-daemon[947]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5168worker2 # [ 168.415496] nix-daemon[947]: accepted connection from pid 1444, user nix-grpc-daemon (trusted)5169worker2 # [ 168.461074] nix-daemon[947]: reaped child process 1447, status = succeeded5170worker2 # [ 168.669337] nix-daemon[947]: accepted connection from pid 1449, user nix-grpc-daemon (trusted)5171worker2 # [ 168.694057] nix-daemon[947]: reaped child process 1452, status = succeeded5172lb # [ 168.741046] niks3-server[1133]: 2026/09/22 10:47:45 INFO Received uploads request method=POST path=/api/pending_closures5173worker2 # [ 168.761431] nix-grpc-daemon[1372]: time=2026-09-22T10:47:46.029Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5174worker2 # [ 168.763766] nix-grpc-daemon[1372]: time=2026-09-22T10:47:46.029Z level=INFO msg="Uploading 5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv (656B)"5175lb # [ 168.775953] niks3-server[1133]: 2026/09/22 10:47:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5176worker2 # [ 168.783294] nix-grpc-daemon[1372]: time=2026-09-22T10:47:46.051Z level=INFO msg="Uploading 1 narinfos"5177lb # [ 168.785000] niks3-server[1133]: 2026/09/22 10:47:46 INFO Signed narinfos id=33 count=15178lb # [ 168.790815] niks3-server[1133]: 2026/09/22 10:47:46 INFO Registered completed upload object_key=nar/1xpcisa10g5by3yknnrs1xwhxhf4s243h7gwzjii0799pwbhfjfa.nar.zst5179lb # [ 168.800239] niks3-server[1133]: 2026/09/22 10:47:46 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5180lb # [ 168.806276] niks3-server[1133]: 2026/09/22 10:47:46 INFO Registered completed upload object_key=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.ls5181lb # [ 168.811505] niks3-server[1133]: 2026/09/22 10:47:46 INFO Completed upload id=335182worker2 # [ 168.812896] nix-grpc-daemon[1372]: time=2026-09-22T10:47:46.081Z level=INFO msg="Upload complete. (575ms)"5183lb # [ 168.820367] niks3-server[1133]: 2026/09/22 10:47:46 INFO Registered completed upload object_key=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.narinfo5184worker2 # [ 168.820402] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42006 duration_s=0 paths=1 nar_bytes_in=6565185worker2 # [ 168.828592] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:420065186worker2 # [ 168.842069] nix-daemon[947]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5187worker2 # [ 168.846185] nix-daemon[947]: reaped child process 1442, status = succeeded5188client # building '/nix/store/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv' on lb:50051...5189client # farm-b> worker2: building 5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv5190worker2 # [ 168.856181] nix-daemon[947]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5191lb # [ 168.948882] envoy[961]: conn peer=[2001:db8:1::1]:37460 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1007 tx=305 ms=39715192client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds5193client # farm-b> LOG-farm-b-after-niks3-restart5194worker2 # [ 170.300939] nix-daemon[947]: reaped child process 1456, status = succeeded5195worker2 # [ 170.685676] nix-daemon[947]: accepted connection from pid 1472, user nix-grpc-daemon (trusted)5196worker2 # [ 170.720734] nix-daemon[947]: reaped child process 1475, status = succeeded5197lb # [ 170.972743] niks3-server[1133]: 2026/09/22 10:47:48 INFO Received uploads request method=POST path=/api/pending_closures5198worker2 # [ 170.992705] nix-grpc-daemon[1372]: time=2026-09-22T10:47:48.259Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5199worker2 # [ 170.994816] nix-grpc-daemon[1372]: time=2026-09-22T10:47:48.259Z level=INFO msg="Uploading myar0ljvsqm9h7fxyh6qrqkg0175r3xn-farm-b (192B)"5200lb # [ 171.037544] niks3-server[1133]: 2026/09/22 10:47:48 INFO Registered completed upload object_key=log/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv5201lb # [ 171.050513] niks3-server[1133]: 2026/09/22 10:47:48 INFO Registered completed upload object_key=nar/0zvv5rxmyk9afay83j52m7ipyhrqivhg6h6a0ksjd658pxzwi78w.nar.zst5202worker2 # [ 171.052316] nix-grpc-daemon[1372]: time=2026-09-22T10:47:48.320Z level=INFO msg="Uploading 1 narinfos"5203lb # [ 171.055503] niks3-server[1133]: 2026/09/22 10:47:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5204lb # [ 171.070049] niks3-server[1133]: 2026/09/22 10:47:48 INFO Signed narinfos id=34 count=15205lb # [ 171.071807] niks3-server[1133]: 2026/09/22 10:47:48 INFO Registered completed upload object_key=myar0ljvsqm9h7fxyh6qrqkg0175r3xn.ls5206lb # [ 171.080311] niks3-server[1133]: 2026/09/22 10:47:48 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5207lb # [ 171.089471] niks3-server[1133]: 2026/09/22 10:47:48 INFO Completed upload id=345208worker2 # [ 171.090647] nix-grpc-daemon[1372]: time=2026-09-22T10:47:48.358Z level=INFO msg="Upload complete. (818ms)"5209lb # [ 171.094399] niks3-server[1133]: 2026/09/22 10:47:48 INFO Registered completed upload object_key=myar0ljvsqm9h7fxyh6qrqkg0175r3xn.narinfo5210worker2 # [ 171.100636] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42006 duration_s=2 drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv assign_id=2 outputs=15211worker2 # [ 171.109820] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:48Z level=debug event=want client=1 drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv cached=05212worker2 # [ 171.112541] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:48Z level=debug event=assigned drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv worker=192.168.1.4:50051 clients=15213worker2 # [ 171.125034] nix-daemon[947]: reaped child process 1454, status = succeeded5214worker2 # [ 171.158577] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:420065215worker2 # [ 171.176729] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:420065216worker2 # [ 171.202825] nix-grpc-daemon[1372]: time=2026-09-22T10:47:48.470Z level=INFO msg="All 2 paths already cached"5217client # copying 1 paths to 'lb:50051'...5218client # copying path '/nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv' to 'lb:50051'...5219worker2 # [ 171.211989] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:420065220worker2 # [ 171.228500] nix-daemon[947]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5221worker2 # [ 171.853391] nix-daemon[947]: accepted connection from pid 1481, user nix-grpc-daemon (trusted)5222worker2 # [ 171.891608] nix-daemon[947]: reaped child process 1484, status = succeeded5223worker2 # [ 172.421870] nix-daemon[947]: accepted connection from pid 1486, user nix-grpc-daemon (trusted)5224worker2 # [ 172.459130] nix-daemon[947]: reaped child process 1489, status = succeeded5225lb # [ 172.488343] niks3-server[1133]: 2026/09/22 10:47:49 INFO Received uploads request method=POST path=/api/pending_closures5226worker2 # [ 172.506311] nix-grpc-daemon[1372]: time=2026-09-22T10:47:49.773Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5227worker2 # [ 172.509644] nix-grpc-daemon[1372]: time=2026-09-22T10:47:49.777Z level=INFO msg="Uploading 6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv (784B)"5228lb # [ 172.526929] niks3-server[1133]: 2026/09/22 10:47:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5229lb # [ 172.534237] niks3-server[1133]: 2026/09/22 10:47:49 INFO Signed narinfos id=35 count=15230worker2 # [ 172.540484] nix-grpc-daemon[1372]: time=2026-09-22T10:47:49.808Z level=INFO msg="Uploading 1 narinfos"5231lb # [ 172.541434] niks3-server[1133]: 2026/09/22 10:47:49 INFO Registered completed upload object_key=6j7gr603xfslr5lxcbh72430f5q1r4b0.ls5232lb # [ 172.547890] niks3-server[1133]: 2026/09/22 10:47:49 INFO Registered completed upload object_key=nar/1fnvw3c0v6n1j60nd5iagl3bggzcvixsw103w98mwhnpmnmgb248.nar.zst5233lb # [ 172.561038] niks3-server[1133]: 2026/09/22 10:47:49 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5234lb # [ 172.574048] niks3-server[1133]: 2026/09/22 10:47:49 INFO Completed upload id=355235worker2 # [ 172.575186] nix-grpc-daemon[1372]: time=2026-09-22T10:47:49.843Z level=INFO msg="Upload complete. (1.332s)"5236worker2 # [ 172.580826] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42006 duration_s=1 paths=1 nar_bytes_in=7845237lb # [ 172.581626] niks3-server[1133]: 2026/09/22 10:47:49 INFO Registered completed upload object_key=6j7gr603xfslr5lxcbh72430f5q1r4b0.narinfo5238worker2 # [ 172.588837] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:420065239worker2 # [ 172.605056] nix-daemon[947]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5240worker2 # [ 172.607845] nix-daemon[947]: reaped child process 1479, status = succeeded5241client # building '/nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv' on lb:50051...5242client # farm-top> worker2: building 6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv5243worker2 # [ 172.621109] nix-daemon[947]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5244client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds5245client # farm-top> LOG-farm-top-after-niks3-restart5246worker2 # [ 175.077190] nix-daemon[947]: reaped child process 1493, status = succeeded5247worker2 # [ 175.709091] nix-daemon[947]: accepted connection from pid 1509, user nix-grpc-daemon (trusted)5248worker2 # [ 175.753920] nix-daemon[947]: reaped child process 1512, status = succeeded5249lb # [ 175.797631] niks3-server[1133]: 2026/09/22 10:47:53 INFO Received uploads request method=POST path=/api/pending_closures5250worker2 # [ 175.812976] nix-grpc-daemon[1372]: time=2026-09-22T10:47:53.080Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5251worker2 # [ 175.817065] nix-grpc-daemon[1372]: time=2026-09-22T10:47:53.082Z level=INFO msg="Uploading z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc-farm-top (248B)"5252lb # [ 175.843246] niks3-server[1133]: 2026/09/22 10:47:53 INFO Registered completed upload object_key=log/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv5253lb # [ 175.863779] niks3-server[1133]: 2026/09/22 10:47:53 INFO Registered completed upload object_key=nar/0cypkbh15calmx90jgh2waxpq661jalf4c99dgb7j606z61xh0ld.nar.zst5254worker2 # [ 175.871484] nix-grpc-daemon[1372]: time=2026-09-22T10:47:53.138Z level=INFO msg="Uploading 1 narinfos"5255lb # [ 175.874106] niks3-server[1133]: 2026/09/22 10:47:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5256lb # [ 175.881136] niks3-server[1133]: 2026/09/22 10:47:53 INFO Signed narinfos id=36 count=15257lb # [ 175.887547] niks3-server[1133]: 2026/09/22 10:47:53 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5258lb # [ 175.894551] niks3-server[1133]: 2026/09/22 10:47:53 INFO Registered completed upload object_key=z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.ls5259lb # [ 175.901164] niks3-server[1133]: 2026/09/22 10:47:53 INFO Completed upload id=365260worker2 # [ 175.903399] nix-grpc-daemon[1372]: time=2026-09-22T10:47:53.171Z level=INFO msg="Upload complete. (855ms)"5261lb # [ 175.906369] niks3-server[1133]: 2026/09/22 10:47:53 INFO Registered completed upload object_key=z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.narinfo5262worker2 # [ 175.908753] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42006 duration_s=3 drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv assign_id=3 outputs=15263worker2 # [ 175.933081] nix-daemon[947]: reaped child process 1491, status = succeeded5264client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag after-niks3-restart >&2, in 10.28 seconds)5265client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag after-niks3-restart outPath5266client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag after-niks3-restart outPath, in 0.36 seconds)5267(finished: subtest: a niks3 restart does not cost the leader its role, in 15.63 seconds)5268subtest: scheduler down: the other node takes the lock and keeps it5269lb: must succeed: curl -sf localhost:9901/clusters5270lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5271lb: must succeed: curl -sf localhost:9901/clusters5272lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5273lb: must succeed: curl -sf localhost:9901/clusters5274lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5275lb: must succeed: curl -sf localhost:9901/clusters5276lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5277worker2 # [ 176.623637] systemd[1]: Stopping Nix worker-protocol over gRPC...5278worker2 # [ 177.546750] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:54Z level=info event=signal_exit5279lb # [ 178.082902] niks3-server[1133]: 2026/09/22 10:47:55 INFO lead: released remote=192.168.1.4:342845280lb # [ 178.949264] envoy[961]: conn peer=[2001:db8:1::1]:42784 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9882 tx=4183 ms=99715281worker2 # [ 179.075238] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:56Z level=info event=scheduler_restarting5282worker1 # [ 179.044559] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:56Z level=info event=scheduler_restarting addr=lb:500515283worker2 # [ 179.083986] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:56Z level=info event=scheduler_restarting addr=lb:500515284worker2 # [ 179.093322] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:56Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:420005285worker2 # [ 179.098084] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:56Z level=info event=worker_gone addr=192.168.1.3:500515286worker2 # [ 179.100887] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:56Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:420005287worker2 # [ 179.103712] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:56Z level=info event=worker_gone addr=192.168.1.4:500515288worker2 # [ 179.144802] nix-daemon[947]: reaped child process 1364, status = succeeded5289worker2 # [ 179.192928] nix-grpc-daemon[1312]: E0000 00:00:1790074076.460916 1357 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5290worker2 # [ 179.238928] nix-grpc-daemon[1312]: E0000 00:00:1790074076.506934 1357 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5291worker1 # [ 179.244948] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:56Z level=info event=scheduler_connected addr=lb:500515292worker1 # [ 179.248004] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5293worker2 # [ 179.307395] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:56Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5294worker1 # [ 179.448979] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:56Z level=info event=scheduler_connected addr=lb:500515295worker1 # [ 179.454865] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5296worker2 # [ 179.541956] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5297worker2 # [ 179.548391] systemd[1]: Stopped Nix worker-protocol over gRPC.5298worker2 # [ 179.550000] systemd[1]: nix-grpc-daemon.service: Consumed 2.980s CPU time over 26.551s wall clock time, 36.1M memory peak, 49.8K incoming IP traffic, 81.8K outgoing IP traffic.5299worker2 # [ 179.557926] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5300worker2 # [ 179.561197] systemd[1]: Closed Nix worker-protocol over gRPC.5301worker2 # [ 179.562135] systemd[1]: nix-grpc-daemon.socket: Consumed 1ms CPU time over 27.068s wall clock time, 256K memory peak, 44.5K incoming IP traffic, 33.9K outgoing IP traffic.5302worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5303worker1 # [ 179.655848] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:56Z level=info event=scheduler_connected addr=lb:500515304worker1 # [ 179.658702] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5305worker1 # [ 179.862316] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:57Z level=info event=scheduler_connected addr=lb:500515306worker1 # [ 179.867300] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5307worker1 # [ 180.069123] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:57Z level=info event=scheduler_connected addr=lb:500515308worker1 # [ 180.071560] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5309worker1 # [ 180.266199] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:57Z level=info event=scheduler_take_over5310lb # [ 180.300820] niks3-server[1133]: 2026/09/22 10:47:57 INFO lead: acquired remote=192.168.1.3:559745311worker1 # [ 180.272264] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:57Z level=info event=scheduler_connected addr=lb:500515312worker1 # [ 180.275391] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5313worker1 # [ 180.476505] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:57Z level=info event=scheduler_connected addr=lb:500515314worker1 # [ 180.484848] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:57Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:376925315worker1 # [ 180.486777] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:57Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05316worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 1.13 seconds)5317worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5318worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)5319client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&25320worker1 # [ 181.014195] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:58Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:520085321client # don't know how to build these paths:5322client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5323worker1 # [ 181.026924] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:520085324worker1 # [ 181.045159] nix-grpc-daemon[1312]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 82 ms (attempt 1/5)5325worker1 # [ 181.134508] nix-grpc-daemon[1312]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 111 ms (attempt 2/5)5326worker1 # [ 181.248899] nix-grpc-daemon[1312]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 139 ms (attempt 3/5)5327worker1 # [ 181.393286] nix-grpc-daemon[1312]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 171 ms (attempt 4/5)5328worker1 # [ 181.572900] nix-grpc-daemon[1312]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5329worker1 # [ 181.574392] nix-grpc-daemon[1312]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5330worker1 # [ 181.609857] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:58Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=05331worker1 # [ 181.614519] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:58Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=15332worker1 # [ 181.660942] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520085333worker1 # [ 181.679981] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:520085334client # copying 1 paths to 'lb:50051'...5335client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...5336worker1 # [ 181.702161] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:520085337worker1 # [ 181.719968] nix-daemon[921]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5338worker1 # [ 181.744402] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:59Z level=info event=niks3_push_started pid=13915339worker1 # [ 181.964608] nix-grpc-daemon[1391]: time=2026-09-22T10:47:59.246Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca=""5340worker1 # [ 182.157813] nix-daemon[921]: accepted connection from pid 1404, user nix-grpc-daemon (trusted)5341worker1 # [ 182.182915] nix-daemon[921]: reaped child process 1407, status = succeeded5342worker1 # [ 182.383184] nix-daemon[921]: accepted connection from pid 1409, user nix-grpc-daemon (trusted)5343worker1 # [ 182.405978] nix-daemon[921]: reaped child process 1412, status = succeeded5344lb # [ 182.457368] niks3-server[1133]: 2026/09/22 10:47:59 INFO Received uploads request method=POST path=/api/pending_closures5345worker1 # [ 182.442380] nix-grpc-daemon[1391]: time=2026-09-22T10:47:59.723Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5346worker1 # [ 182.444754] nix-grpc-daemon[1391]: time=2026-09-22T10:47:59.723Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"5347lb # [ 182.508477] niks3-server[1133]: 2026/09/22 10:47:59 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst5348worker1 # [ 182.502506] nix-grpc-daemon[1391]: time=2026-09-22T10:47:59.784Z level=INFO msg="Uploading 1 narinfos"5349lb # [ 182.529986] niks3-server[1133]: 2026/09/22 10:47:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5350lb # [ 182.540880] niks3-server[1133]: 2026/09/22 10:47:59 INFO Signed narinfos id=37 count=15351lb # [ 182.553477] niks3-server[1133]: 2026/09/22 10:47:59 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls5352lb # [ 182.563387] niks3-server[1133]: 2026/09/22 10:47:59 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5353lb # [ 182.572384] niks3-server[1133]: 2026/09/22 10:47:59 INFO Completed upload id=375354worker1 # [ 182.536821] nix-grpc-daemon[1391]: time=2026-09-22T10:47:59.819Z level=INFO msg="Upload complete. (568ms)"5355lb # [ 182.575390] niks3-server[1133]: 2026/09/22 10:47:59 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo5356worker1 # [ 182.549462] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52008 duration_s=0 paths=1 nar_bytes_in=5205357worker1 # [ 182.561113] nix-grpc-daemon[1312]: ts=2026-09-22T10:47:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520085358worker1 # [ 182.572850] nix-daemon[921]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5359worker1 # [ 182.578307] nix-daemon[921]: reaped child process 1389, status = succeeded5360worker1 # [ 182.591615] nix-daemon[921]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5361client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...5362client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5363client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds5364client # farm-a> LOG-farm-a-on-standby5365worker1 # [ 183.625825] nix-daemon[921]: reaped child process 1416, status = succeeded5366worker1 # [ 183.799035] nix-daemon[921]: accepted connection from pid 1432, user nix-grpc-daemon (trusted)5367worker1 # [ 183.825231] nix-daemon[921]: reaped child process 1435, status = succeeded5368lb # [ 183.874390] niks3-server[1133]: 2026/09/22 10:48:01 INFO Received uploads request method=POST path=/api/pending_closures5369worker1 # [ 183.851075] nix-grpc-daemon[1391]: time=2026-09-22T10:48:01.133Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5370worker1 # [ 183.859436] nix-grpc-daemon[1391]: time=2026-09-22T10:48:01.136Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"5371lb # [ 183.919966] niks3-server[1133]: 2026/09/22 10:48:01 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5372lb # [ 183.934548] niks3-server[1133]: 2026/09/22 10:48:01 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5373lb # [ 183.951013] niks3-server[1133]: 2026/09/22 10:48:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5374worker1 # [ 183.924263] nix-grpc-daemon[1391]: time=2026-09-22T10:48:01.206Z level=INFO msg="Uploading 1 narinfos"5375lb # [ 183.962293] niks3-server[1133]: 2026/09/22 10:48:01 INFO Signed narinfos id=38 count=15376lb # [ 183.968274] niks3-server[1133]: 2026/09/22 10:48:01 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls5377lb # [ 183.978967] niks3-server[1133]: 2026/09/22 10:48:01 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5378worker1 # [ 183.951120] nix-grpc-daemon[1391]: time=2026-09-22T10:48:01.234Z level=INFO msg="Upload complete. (342ms)"5379lb # [ 183.987845] niks3-server[1133]: 2026/09/22 10:48:01 INFO Completed upload id=385380lb # [ 183.990267] niks3-server[1133]: 2026/09/22 10:48:01 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo5381worker1 # [ 183.974655] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52008 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=15382worker1 # [ 183.995422] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:01Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=05383worker1 # [ 183.999248] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:01Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=15384worker1 # [ 184.003564] nix-daemon[921]: reaped child process 1414, status = succeeded5385worker1 # [ 184.035206] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520085386worker1 # [ 184.051387] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:520085387worker1 # [ 184.064190] nix-grpc-daemon[1391]: time=2026-09-22T10:48:01.347Z level=INFO msg="All 1 paths already cached"5388client # copying 1 paths to 'lb:50051'...5389client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...5390worker1 # [ 184.074070] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:520085391worker1 # [ 184.087264] nix-daemon[921]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5392worker1 # [ 184.299129] nix-daemon[921]: accepted connection from pid 1441, user nix-grpc-daemon (trusted)5393worker1 # [ 184.325935] nix-daemon[921]: reaped child process 1444, status = succeeded5394worker1 # [ 184.520098] nix-daemon[921]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)5395worker1 # [ 184.541514] nix-daemon[921]: reaped child process 1449, status = succeeded5396lb # [ 184.591036] niks3-server[1133]: 2026/09/22 10:48:01 INFO Received uploads request method=POST path=/api/pending_closures5397worker1 # [ 184.568994] nix-grpc-daemon[1391]: time=2026-09-22T10:48:01.851Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5398worker1 # [ 184.570687] nix-grpc-daemon[1391]: time=2026-09-22T10:48:01.851Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"5399lb # [ 184.626707] niks3-server[1133]: 2026/09/22 10:48:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5400worker1 # [ 184.603976] nix-grpc-daemon[1391]: time=2026-09-22T10:48:01.886Z level=INFO msg="Uploading 1 narinfos"5401lb # [ 184.647261] niks3-server[1133]: 2026/09/22 10:48:01 INFO Signed narinfos id=39 count=15402lb # [ 184.654877] niks3-server[1133]: 2026/09/22 10:48:01 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst5403lb # [ 184.677032] niks3-server[1133]: 2026/09/22 10:48:01 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5404worker1 # [ 184.656400] nix-grpc-daemon[1391]: time=2026-09-22T10:48:01.939Z level=INFO msg="Upload complete. (554ms)"5405lb # [ 184.690374] niks3-server[1133]: 2026/09/22 10:48:01 INFO Completed upload id=395406lb # [ 184.694997] niks3-server[1133]: 2026/09/22 10:48:01 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo5407lb # [ 184.703120] niks3-server[1133]: 2026/09/22 10:48:01 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls5408worker1 # [ 184.667561] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52008 duration_s=0 paths=1 nar_bytes_in=6405409worker1 # [ 184.680494] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520085410worker1 # [ 184.693966] nix-daemon[921]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5411worker1 # [ 184.700742] nix-daemon[921]: reaped child process 1439, status = succeeded5412client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...5413client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5414worker1 # [ 184.719656] nix-daemon[921]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5415client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds5416client # farm-b> LOG-farm-b-on-standby5417worker1 # [ 186.154850] nix-daemon[921]: reaped child process 1453, status = succeeded5418worker1 # [ 186.348186] nix-daemon[921]: accepted connection from pid 1469, user nix-grpc-daemon (trusted)5419worker1 # [ 186.369901] nix-daemon[921]: reaped child process 1472, status = succeeded5420lb # [ 186.422632] niks3-server[1133]: 2026/09/22 10:48:03 INFO Received uploads request method=POST path=/api/pending_closures5421worker1 # [ 186.405612] nix-grpc-daemon[1391]: time=2026-09-22T10:48:03.687Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5422worker1 # [ 186.407253] nix-grpc-daemon[1391]: time=2026-09-22T10:48:03.687Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"5423lb # [ 186.471649] niks3-server[1133]: 2026/09/22 10:48:03 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst5424worker1 # [ 186.462229] nix-grpc-daemon[1391]: time=2026-09-22T10:48:03.745Z level=INFO msg="Uploading 1 narinfos"5425lb # [ 186.495712] niks3-server[1133]: 2026/09/22 10:48:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5426lb # [ 186.508727] niks3-server[1133]: 2026/09/22 10:48:03 INFO Signed narinfos id=40 count=15427lb # [ 186.514770] niks3-server[1133]: 2026/09/22 10:48:03 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5428lb # [ 186.524372] niks3-server[1133]: 2026/09/22 10:48:03 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls5429lb # [ 186.533451] niks3-server[1133]: 2026/09/22 10:48:03 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5430lb # [ 186.538588] niks3-server[1133]: 2026/09/22 10:48:03 INFO Completed upload id=405431worker1 # [ 186.504132] nix-grpc-daemon[1391]: time=2026-09-22T10:48:03.787Z level=INFO msg="Upload complete. (371ms)"5432lb # [ 186.541244] niks3-server[1133]: 2026/09/22 10:48:03 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo5433worker1 # [ 186.524583] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52008 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=15434worker1 # [ 186.540300] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:03Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=05435worker1 # [ 186.543984] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:03Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=15436worker1 # [ 186.549250] nix-daemon[921]: reaped child process 1451, status = succeeded5437worker1 # [ 186.567065] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520085438worker1 # [ 186.581249] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:520085439worker1 # [ 186.594195] nix-grpc-daemon[1391]: time=2026-09-22T10:48:03.877Z level=INFO msg="All 2 paths already cached"5440client # copying 1 paths to 'lb:50051'...5441worker1 # [ 186.604544] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:520085442client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...5443worker1 # [ 186.614450] nix-daemon[921]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5444worker1 # [ 186.805500] nix-daemon[921]: accepted connection from pid 1478, user nix-grpc-daemon (trusted)5445worker1 # [ 186.832161] nix-daemon[921]: reaped child process 1481, status = succeeded5446worker1 # [ 187.024597] nix-daemon[921]: accepted connection from pid 1483, user nix-grpc-daemon (trusted)5447worker1 # [ 187.050579] nix-daemon[921]: reaped child process 1486, status = succeeded5448lb # [ 187.097621] niks3-server[1133]: 2026/09/22 10:48:04 INFO Received uploads request method=POST path=/api/pending_closures5449worker1 # [ 187.075404] nix-grpc-daemon[1391]: time=2026-09-22T10:48:04.358Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5450worker1 # [ 187.077820] nix-grpc-daemon[1391]: time=2026-09-22T10:48:04.360Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"5451worker1 # [ 187.112592] nix-grpc-daemon[1391]: time=2026-09-22T10:48:04.395Z level=INFO msg="Uploading 1 narinfos"5452lb # [ 187.138143] niks3-server[1133]: 2026/09/22 10:48:04 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst5453lb # [ 187.151014] niks3-server[1133]: 2026/09/22 10:48:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5454lb # [ 187.163320] niks3-server[1133]: 2026/09/22 10:48:04 INFO Signed narinfos id=41 count=15455lb # [ 187.168467] niks3-server[1133]: 2026/09/22 10:48:04 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls5456lb # [ 187.178228] niks3-server[1133]: 2026/09/22 10:48:04 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5457worker1 # [ 187.148366] nix-grpc-daemon[1391]: time=2026-09-22T10:48:04.431Z level=INFO msg="Upload complete. (525ms)"5458lb # [ 187.183517] niks3-server[1133]: 2026/09/22 10:48:04 INFO Completed upload id=415459lb # [ 187.186627] niks3-server[1133]: 2026/09/22 10:48:04 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo5460worker1 # [ 187.156206] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52008 duration_s=0 paths=1 nar_bytes_in=7685461worker1 # [ 187.168462] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520085462worker1 # [ 187.183503] nix-daemon[921]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5463worker1 # [ 187.189622] nix-daemon[921]: reaped child process 1476, status = succeeded5464client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...5465client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5466worker1 # [ 187.206093] nix-daemon[921]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5467client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds5468client # farm-top> LOG-farm-top-on-standby5469worker1 # [ 188.632833] nix-daemon[921]: reaped child process 1490, status = succeeded5470worker1 # [ 188.808787] nix-daemon[921]: accepted connection from pid 1506, user nix-grpc-daemon (trusted)5471worker1 # [ 188.830162] nix-daemon[921]: reaped child process 1509, status = succeeded5472lb # [ 188.881060] niks3-server[1133]: 2026/09/22 10:48:06 INFO Received uploads request method=POST path=/api/pending_closures5473worker1 # [ 188.859498] nix-grpc-daemon[1391]: time=2026-09-22T10:48:06.140Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5474worker1 # [ 188.861292] nix-grpc-daemon[1391]: time=2026-09-22T10:48:06.140Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"5475lb # [ 188.919923] niks3-server[1133]: 2026/09/22 10:48:06 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5476lb # [ 188.935448] niks3-server[1133]: 2026/09/22 10:48:06 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst5477worker1 # [ 188.916962] nix-grpc-daemon[1391]: time=2026-09-22T10:48:06.199Z level=INFO msg="Uploading 1 narinfos"5478lb # [ 188.952970] niks3-server[1133]: 2026/09/22 10:48:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5479lb # [ 188.965665] niks3-server[1133]: 2026/09/22 10:48:06 INFO Signed narinfos id=42 count=15480lb # [ 188.971460] envoy[961]: conn peer=[2001:db8:1::4]:39732 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=5496 tx=648 ms=257055481worker1 # [ 188.946757] nix-grpc-daemon[1391]: time=2026-09-22T10:48:06.230Z level=INFO msg="Upload complete. (329ms)"5482lb # [ 188.981128] niks3-server[1133]: 2026/09/22 10:48:06 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls5483worker1 # [ 188.953034] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52008 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=15484lb # [ 188.986694] niks3-server[1133]: 2026/09/22 10:48:06 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5485lb # [ 188.990993] niks3-server[1133]: 2026/09/22 10:48:06 INFO Completed upload id=425486lb # [ 188.992877] niks3-server[1133]: 2026/09/22 10:48:06 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo5487worker1 # [ 188.964614] nix-daemon[921]: reaped child process 1488, status = succeeded5488client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 8.30 seconds)5489client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath5490client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.28 seconds)5491worker2 # [ 189.433095] systemd[1]: Listening on Nix worker-protocol over gRPC.5492worker2 # [ 189.443878] systemd[1]: Starting scheduler-token.service...5493worker2 # [ 189.557268] systemd[1]: scheduler-token.service: Deactivated successfully.5494worker2 # [ 189.563364] systemd[1]: Finished scheduler-token.service.5495worker2 # [ 189.565417] systemd[1]: scheduler-token.service: Consumed 42ms CPU time over 114ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5496worker2 # [ 189.570016] systemd[1]: Starting Nix worker-protocol over gRPC...5497worker2 # [ 189.761143] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:07Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5498worker2 # [ 189.766015] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:07Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5499worker2 # [ 189.768089] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:07Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15500worker2 # [ 189.775297] nix-grpc-daemon[1533]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5501worker2 # [ 189.791653] nix-grpc-daemon[1533]: E0000 00:00:1790074087.042768 1533 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5502worker2 # [ 189.802331] nix-grpc-daemon[1533]: E0000 00:00:1790074087.046957 1533 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5503lb: must succeed: curl -sf localhost:9901/clusters5504worker2 # [ 189.806822] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:07Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5505worker2 # [ 189.808806] systemd[1]: Started Nix worker-protocol over gRPC.5506worker2 # [ 189.812181] nix-grpc-daemon[1533]: E0000 00:00:1790074087.078592 1572 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5507worker2 # [ 189.840149] nix-grpc-daemon[1533]: E0000 00:00:1790074087.097353 1572 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5508worker2 # [ 189.842675] nix-grpc-daemon[1533]: E0000 00:00:1790074087.097630 1572 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5509worker2 # [ 189.851011] nix-grpc-daemon[1533]: E0000 00:00:1790074087.117897 1572 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5510worker2 # [ 189.865697] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:07Z level=info event=scheduler_connected addr=lb:500515511worker1 # [ 189.841978] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:07Z level=info event=oidc_jwks provider=mock keys=15512worker1 # [ 189.842493] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:07Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:376925513worker1 # [ 189.852437] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:07Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05514lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)5515worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5516worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5517lb: must succeed: curl -sf localhost:9901/clusters5518lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5519lb: must succeed: curl -sf localhost:9901/clusters5520lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5521worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5522worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5523(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 13.90 seconds)5524subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5525client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs5526client # [ 190.253465] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.5527client # Running as unit: rs.service; invocation ID: bcb79a721d324c4786407517f09e26bd5528client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.10 seconds)5529worker2 # [ 190.587525] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:581825530worker2 # [ 190.597038] nix-daemon[947]: accepted connection from pid 1533, user nix-grpc-daemon (trusted)5531client # [ 190.571351] nix[1304]: don't know how to build these paths:5532client # [ 190.572795] nix[1304]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5533worker1 # [ 190.593304] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:07Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=05534worker1 # [ 190.600446] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:07Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=15535worker1 # [ 190.648218] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520085536worker1 # [ 190.665574] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:520085537client # [ 190.666616] nix[1304]: copying 1 paths to 'lb:50051'...5538client # [ 190.667862] nix[1304]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...5539worker1 # [ 190.678110] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:520085540worker1 # [ 190.694373] nix-daemon[921]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5541worker1 # [ 190.913114] nix-daemon[921]: accepted connection from pid 1522, user nix-grpc-daemon (trusted)5542worker1 # [ 190.938486] nix-daemon[921]: reaped child process 1525, status = succeeded5543worker1 # [ 191.116697] nix-daemon[921]: accepted connection from pid 1527, user nix-grpc-daemon (trusted)5544worker1 # [ 191.139291] nix-daemon[921]: reaped child process 1530, status = succeeded5545lb # [ 191.194464] niks3-server[1133]: 2026/09/22 10:48:08 INFO Received uploads request method=POST path=/api/pending_closures5546worker1 # [ 191.171762] nix-grpc-daemon[1391]: time=2026-09-22T10:48:08.454Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5547worker1 # [ 191.173541] nix-grpc-daemon[1391]: time=2026-09-22T10:48:08.454Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"5548lb # [ 191.228545] niks3-server[1133]: 2026/09/22 10:48:08 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst5549lb # [ 191.241478] niks3-server[1133]: 2026/09/22 10:48:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5550worker1 # [ 191.213749] nix-grpc-daemon[1391]: time=2026-09-22T10:48:08.496Z level=INFO msg="Uploading 1 narinfos"5551lb # [ 191.252226] niks3-server[1133]: 2026/09/22 10:48:08 INFO Signed narinfos id=43 count=15552lb # [ 191.254886] niks3-server[1133]: 2026/09/22 10:48:08 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls5553lb # [ 191.265243] niks3-server[1133]: 2026/09/22 10:48:08 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5554lb # [ 191.276214] niks3-server[1133]: 2026/09/22 10:48:08 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5555lb # [ 191.281465] niks3-server[1133]: 2026/09/22 10:48:08 INFO Completed upload id=435556worker1 # [ 191.247373] nix-grpc-daemon[1391]: time=2026-09-22T10:48:08.530Z level=INFO msg="Upload complete. (535ms)"5557worker1 # [ 191.257486] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52008 duration_s=0 paths=1 nar_bytes_in=4165558worker1 # [ 191.275692] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520085559worker1 # [ 191.282860] nix-daemon[921]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5560worker1 # [ 191.288921] nix-daemon[921]: reaped child process 1520, status = succeeded5561client # [ 191.290357] nix[1304]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5562worker1 # [ 191.304284] nix-daemon[921]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5563lb: must succeed: curl -sf localhost:9901/clusters5564lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5565lb: must succeed: curl -sf localhost:9901/clusters5566lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5567lb: must succeed: curl -sf localhost:9901/clusters5568lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5569lb: must succeed: curl -sf localhost:9901/clusters5570lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5571worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5572worker2 # [ 193.232725] systemd-journald[281]: Received client request to rotate journal, rotating.5573worker2 # [ 193.250690] systemd-journald[281]: Vacuuming done, freed 0B of archived journals from /var/log/journal/877443b90b5641cfba3c4c17d61524ec.5574worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.09 seconds)5575worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5576worker1 # [ 193.273440] systemd[1]: Stopping Nix worker-protocol over gRPC...5577worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.05 seconds)5578client: must succeed: sleep 5.05579worker1 # [ 193.413628] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:10Z level=info event=draining5580client: (finished: must succeed: sleep 5.0, in 5.06 seconds)5581worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5582worker1 # [ 198.765487] nix-daemon[921]: reaped child process 1534, status = succeeded5583lb # [ 198.952661] envoy[961]: conn peer=[2001:db8:1::1]:51200 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9679 tx=4162 ms=79735584worker1 # [ 198.957822] nix-daemon[921]: accepted connection from pid 1575, user nix-grpc-daemon (trusted)5585worker1 # [ 198.979584] nix-daemon[921]: reaped child process 1578, status = succeeded5586lb # [ 199.027041] niks3-server[1133]: 2026/09/22 10:48:16 INFO Received uploads request method=POST path=/api/pending_closures5587worker1 # [ 199.008234] nix-grpc-daemon[1391]: time=2026-09-22T10:48:16.288Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5588worker1 # [ 199.009876] nix-grpc-daemon[1391]: time=2026-09-22T10:48:16.288Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5589lb # [ 199.073725] niks3-server[1133]: 2026/09/22 10:48:16 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5590lb # [ 199.090283] niks3-server[1133]: 2026/09/22 10:48:16 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5591lb # [ 199.100500] niks3-server[1133]: 2026/09/22 10:48:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5592worker1 # [ 199.071099] nix-grpc-daemon[1391]: time=2026-09-22T10:48:16.353Z level=INFO msg="Uploading 1 narinfos"5593lb # [ 199.108731] niks3-server[1133]: 2026/09/22 10:48:16 INFO Signed narinfos id=44 count=15594lb # [ 199.111273] niks3-server[1133]: 2026/09/22 10:48:16 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5595lb # [ 199.123364] niks3-server[1133]: 2026/09/22 10:48:16 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5596lb # [ 199.131150] niks3-server[1133]: 2026/09/22 10:48:16 INFO Completed upload id=445597worker1 # [ 199.095347] nix-grpc-daemon[1391]: time=2026-09-22T10:48:16.378Z level=INFO msg="Upload complete. (371ms)"5598lb # [ 199.134114] niks3-server[1133]: 2026/09/22 10:48:16 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5599worker1 # [ 199.112635] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52008 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15600worker1 # [ 199.125725] nix-daemon[921]: reaped child process 1532, status = succeeded5601client # [ 199.145631] systemd[1]: rs.service: Deactivated successfully.5602client # [ 199.150140] systemd[1]: rs.service: Consumed 205ms CPU time over 8.895s wall clock time, 41.2M memory peak, 7.2K incoming IP traffic, 8.4K outgoing IP traffic.5603worker1 # [ 199.414393] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:16Z level=info event=signal_exit5604lb # [ 200.121020] niks3-server[1133]: 2026/09/22 10:48:17 INFO lead: released remote=192.168.1.3:559745605worker2 # [ 201.116872] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:18Z level=info event=scheduler_restarting addr=lb:500515606worker1 # [ 201.086425] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:18Z level=info event=scheduler_restarting5607worker1 # [ 201.091463] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:18Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:376925608worker1 # [ 201.097510] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:18Z level=info event=worker_gone addr=192.168.1.4:500515609worker1 # [ 201.102271] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:18Z level=info event=scheduler_restarting addr=lb:500515610worker1 # [ 201.107378] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:18Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:376925611worker1 # [ 201.112392] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:18Z level=info event=worker_gone addr=192.168.1.3:500515612worker1 # [ 201.138028] nix-daemon[921]: reaped child process 1366, status = succeeded5613worker2 # [ 201.317156] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:18Z level=info event=scheduler_connected addr=lb:500515614worker2 # [ 201.322990] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5615worker1 # [ 201.308005] nix-grpc-daemon[1312]: ts=2026-09-22T10:48:18Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5616worker2 # [ 201.524378] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:18Z level=info event=scheduler_connected addr=lb:500515617worker2 # [ 201.529951] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5618worker1 # [ 201.515062] nix-grpc-daemon[1312]: E0000 00:00:1790074098.798130 1357 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true5619worker1 # [ 201.540426] nix-grpc-daemon[1312]: E0000 00:00:1790074098.823538 1357 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5620worker2 # [ 201.731422] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:18Z level=info event=scheduler_connected addr=lb:500515621worker2 # [ 201.737615] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5622worker2 # [ 201.939115] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:19Z level=info event=scheduler_connected addr=lb:500515623worker2 # [ 201.946854] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5624worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 3.31 seconds)5625client: waiting for success: ! systemctl is-active rs5626worker1 # [ 202.007309] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5627worker1 # [ 202.015135] systemd[1]: Stopped Nix worker-protocol over gRPC.5628worker1 # [ 202.019570] systemd[1]: nix-grpc-daemon.service: Consumed 2.066s CPU time over 41.850s wall clock time, 37.1M memory peak, 46.5K incoming IP traffic, 85.3K outgoing IP traffic.5629worker1 # [ 202.035404] systemd[1]: Starting Nix worker-protocol over gRPC...5630client: (finished: waiting for success: ! systemctl is-active rs, in 0.08 seconds)5631client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5632client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.06 seconds)5633client: must fail: journalctl -u rs | grep -q 'reconnecting'5634worker2 # [ 202.148500] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:19Z level=info event=scheduler_connected addr=lb:500515635worker2 # [ 202.153345] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5636client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.04 seconds)5637lb: must succeed: curl -sf localhost:9901/clusters5638lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5639worker1 # [ 202.237563] nix-grpc-daemon[1585]: ts=2026-09-22T10:48:19Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5640worker1 # [ 202.240276] nix-grpc-daemon[1585]: ts=2026-09-22T10:48:19Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5641worker1 # [ 202.244584] nix-grpc-daemon[1585]: ts=2026-09-22T10:48:19Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15642worker1 # [ 202.251383] nix-grpc-daemon[1585]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5643worker1 # [ 202.259835] nix-grpc-daemon[1585]: E0000 00:00:1790074099.534078 1585 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5644worker1 # [ 202.264228] nix-grpc-daemon[1585]: E0000 00:00:1790074099.537987 1585 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5645worker1 # [ 202.267142] nix-grpc-daemon[1585]: ts=2026-09-22T10:48:19Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5646lb # [ 202.300714] niks3-server[1133]: 2026/09/22 10:48:19 INFO lead: acquired remote=192.168.1.3:413985647worker1 # [ 202.269845] systemd[1]: Started Nix worker-protocol over gRPC.5648worker1 # [ 202.270756] nix-grpc-daemon[1585]: ts=2026-09-22T10:48:19Z level=info event=scheduler_take_over5649worker1 # [ 202.276089] nix-grpc-daemon[1585]: E0000 00:00:1790074099.556054 1627 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5650worker1 # [ 202.304099] nix-grpc-daemon[1585]: E0000 00:00:1790074099.574518 1627 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5651worker1 # [ 202.310385] nix-grpc-daemon[1585]: E0000 00:00:1790074099.574771 1627 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5652worker1 # [ 202.313594] nix-grpc-daemon[1585]: E0000 00:00:1790074099.592334 1627 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5653worker2 # [ 202.355071] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:19Z level=info event=scheduler_connected addr=lb:500515654worker1 # [ 202.324318] nix-grpc-daemon[1585]: ts=2026-09-22T10:48:19Z level=info event=scheduler_connected addr=lb:500515655worker1 # [ 202.326478] nix-grpc-daemon[1585]: ts=2026-09-22T10:48:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5656worker2 # [ 202.361233] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5657worker1 # [ 202.527704] nix-grpc-daemon[1585]: ts=2026-09-22T10:48:19Z level=info event=scheduler_connected addr=lb:500515658worker2 # [ 202.562500] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:19Z level=info event=scheduler_connected addr=lb:500515659worker1 # [ 202.533456] nix-grpc-daemon[1585]: ts=2026-09-22T10:48:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5660worker2 # [ 202.568245] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5661worker1 # [ 202.734551] nix-grpc-daemon[1585]: ts=2026-09-22T10:48:20Z level=info event=scheduler_connected addr=lb:500515662worker2 # [ 202.769823] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:20Z level=info event=scheduler_connected addr=lb:500515663worker1 # [ 202.740942] nix-grpc-daemon[1585]: ts=2026-09-22T10:48:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5664worker2 # [ 202.775702] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5665worker2 # [ 202.976535] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:20Z level=info event=scheduler_connected addr=lb:500515666worker1 # [ 202.942125] nix-grpc-daemon[1585]: ts=2026-09-22T10:48:20Z level=info event=scheduler_connected addr=lb:500515667worker2 # [ 202.980295] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5668worker1 # [ 202.947883] nix-grpc-daemon[1585]: ts=2026-09-22T10:48:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5669worker2 # [ 203.183496] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:20Z level=info event=scheduler_connected addr=lb:500515670worker1 # [ 203.149384] nix-grpc-daemon[1585]: ts=2026-09-22T10:48:20Z level=info event=scheduler_connected addr=lb:500515671worker1 # [ 203.161444] nix-grpc-daemon[1585]: ts=2026-09-22T10:48:20Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:348865672worker1 # [ 203.168317] nix-grpc-daemon[1585]: ts=2026-09-22T10:48:20Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05673worker1 # [ 203.179031] nix-grpc-daemon[1585]: ts=2026-09-22T10:48:20Z level=info event=oidc_jwks provider=mock keys=15674worker1 # [ 203.183101] nix-grpc-daemon[1585]: ts=2026-09-22T10:48:20Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:348865675worker1 # [ 203.187765] nix-grpc-daemon[1585]: ts=2026-09-22T10:48:20Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05676lb: must succeed: curl -sf localhost:9901/clusters5677lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5678worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5679worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds)5680(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.20 seconds)5681subtest: scheduler restart mid-build: build finishes, no double build5682client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5683client # [ 203.455032] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5684client # Running as unit: mid.service; invocation ID: d61e0b4503414186a25b99e7d4f4d3085685client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.10 seconds)5686worker1 # [ 203.754326] nix-grpc-daemon[1585]: ts=2026-09-22T10:48:21Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:348885687worker1 # [ 203.771114] nix-daemon[921]: accepted connection from pid 1585, user nix-grpc-daemon (trusted)5688client # [ 203.779458] nix[1340]: don't know how to build these paths:5689client # [ 203.781484] nix[1340]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5690worker1 # [ 203.805759] nix-grpc-daemon[1585]: ts=2026-09-22T10:48:21Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05691worker1 # [ 203.813421] nix-grpc-daemon[1585]: ts=2026-09-22T10:48:21Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=15692worker1 # [ 203.855980] nix-grpc-daemon[1585]: ts=2026-09-22T10:48:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348885693worker1 # [ 203.877566] nix-grpc-daemon[1585]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 83 ms (attempt 1/5)5694worker1 # [ 203.968794] nix-grpc-daemon[1585]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 122 ms (attempt 2/5)5695worker1 # [ 204.091516] nix-grpc-daemon[1585]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 220 ms (attempt 3/5)5696worker1 # [ 204.320262] nix-grpc-daemon[1585]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 553 ms (attempt 4/5)5697worker1 # [ 204.898751] nix-grpc-daemon[1585]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5698worker1 # [ 204.905385] nix-grpc-daemon[1585]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5699worker1 # [ 205.844247] nix-grpc-daemon[1585]: ts=2026-09-22T10:48:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:348885700client # [ 206.025017] nix[1340]: copying 1 paths to 'lb:50051'...5701client # [ 206.025240] nix[1340]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5702worker1 # [ 206.039773] nix-grpc-daemon[1585]: ts=2026-09-22T10:48:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:348885703worker1 # [ 206.065661] nix-daemon[921]: accepted connection from pid 1585, user nix-grpc-daemon (trusted)5704worker1 # [ 206.136545] nix-grpc-daemon[1585]: ts=2026-09-22T10:48:23Z level=info event=niks3_push_started pid=16625705worker1 # [ 206.339155] nix-grpc-daemon[1662]: time=2026-09-22T10:48:23.621Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca=""5706worker1 # [ 206.533471] nix-daemon[921]: accepted connection from pid 1675, user nix-grpc-daemon (trusted)5707worker1 # [ 206.555300] nix-daemon[921]: reaped child process 1678, status = succeeded5708worker1 # [ 206.742870] nix-daemon[921]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)5709worker1 # [ 206.762571] nix-daemon[921]: reaped child process 1683, status = succeeded5710lb # [ 206.814455] niks3-server[1133]: 2026/09/22 10:48:24 INFO Received uploads request method=POST path=/api/pending_closures5711worker1 # [ 206.790613] nix-grpc-daemon[1662]: time=2026-09-22T10:48:24.072Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5712worker1 # [ 206.792504] nix-grpc-daemon[1662]: time=2026-09-22T10:48:24.072Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5713lb # [ 206.857229] niks3-server[1133]: 2026/09/22 10:48:24 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5714lb # [ 206.871901] niks3-server[1133]: 2026/09/22 10:48:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5715worker1 # [ 206.843852] nix-grpc-daemon[1662]: time=2026-09-22T10:48:24.126Z level=INFO msg="Uploading 1 narinfos"5716lb # [ 206.883938] niks3-server[1133]: 2026/09/22 10:48:24 INFO Signed narinfos id=45 count=15717lb # [ 206.891531] niks3-server[1133]: 2026/09/22 10:48:24 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5718lb # [ 206.905616] niks3-server[1133]: 2026/09/22 10:48:24 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5719worker1 # [ 206.877607] nix-grpc-daemon[1662]: time=2026-09-22T10:48:24.160Z level=INFO msg="Upload complete. (534ms)"5720lb # [ 206.912920] niks3-server[1133]: 2026/09/22 10:48:24 INFO Completed upload id=455721lb # [ 206.917928] niks3-server[1133]: 2026/09/22 10:48:24 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo5722worker1 # [ 206.888432] nix-grpc-daemon[1585]: ts=2026-09-22T10:48:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34888 duration_s=0 paths=1 nar_bytes_in=4245723worker1 # [ 206.904563] nix-grpc-daemon[1585]: ts=2026-09-22T10:48:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:348885724worker1 # [ 206.912321] nix-daemon[921]: accepted connection from pid 1585, user nix-grpc-daemon (trusted)5725worker1 # [ 206.920315] nix-daemon[921]: reaped child process 1660, status = succeeded5726client # [ 206.918828] nix[1340]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5727worker1 # [ 206.933649] nix-daemon[921]: accepted connection from pid 1585, user nix-grpc-daemon (trusted)5728lb: must succeed: curl -sf localhost:9901/clusters5729lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5730lb: must succeed: curl -sf localhost:9901/clusters5731lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5732worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5733worker1 # [ 208.824766] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1585 (nix-grpc-daemon) on client request.5734worker1 # [ 208.826564] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5735lb # [ 208.873627] niks3-server[1133]: 2026/09/22 10:48:26 INFO lead: released remote=192.168.1.3:413985736client # [ 208.836787] nix[1340]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5737worker2 # [ 208.881980] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:26Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5738worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.09 seconds)5739client: must succeed: sleep 5.05740client # [ 208.844356] nix[1340]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5741worker1 # [ 208.872189] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5742worker1 # [ 208.873933] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5743worker1 # [ 208.875212] systemd[1]: nix-grpc-daemon.service: Consumed 741ms CPU time over 6.833s wall clock time, 34.3M memory peak, 14.4K incoming IP traffic, 18.7K outgoing IP traffic.5744worker1 # [ 208.890728] nix-daemon[921]: reaped child process 1685, status = succeeded5745worker1 # [ 208.891970] nix-daemon[921]: reaped child process 1644, status = succeeded5746worker1 # [ 208.900606] nix-daemon[1687]: unexpected Nix daemon error: error: interrupted by the user5747worker1 # [ 208.909493] nix-daemon[921]: reaped child process 1687, status = failed with exit code 15748lb # [ 208.956235] envoy[961]: conn peer=[2001:db8:1::1]:51210 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2979 tx=1428 ms=85715749lb # [ 208.957941] envoy[961]: conn peer=[2001:db8:1::3]:50696 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2265 tx=831 ms=408365750lb # [ 208.959527] envoy[961]: conn peer=[2001:db8:1::3]:42314 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1015 tx=411 ms=65305751worker2 # [ 209.082588] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:26Z level=info event=scheduler_connected addr=lb:500515752worker1 # [ 209.208851] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5753worker1 # [ 209.218018] systemd[1]: Starting Nix worker-protocol over gRPC...5754worker1 # [ 209.444468] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:26Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5755worker1 # [ 209.447325] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:26Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5756worker1 # [ 209.451635] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:26Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15757worker1 # [ 209.460145] nix-grpc-daemon[1724]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5758worker1 # [ 209.461746] nix-grpc-daemon[1724]: E0000 00:00:1790074106.741857 1724 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5759worker1 # [ 209.477070] nix-grpc-daemon[1724]: E0000 00:00:1790074106.748657 1724 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5760worker1 # [ 209.479711] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:26Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5761worker1 # [ 209.483521] systemd[1]: Started Nix worker-protocol over gRPC.5762worker1 # [ 209.485406] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:26Z level=info event=scheduler_take_over5763lb # [ 209.517392] niks3-server[1133]: 2026/09/22 10:48:26 INFO lead: acquired remote=192.168.1.3:414505764worker1 # [ 209.490506] nix-grpc-daemon[1724]: E0000 00:00:1790074106.771849 1766 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5765worker2 # [ 209.548178] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:581825766worker1 # [ 209.520246] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:26Z level=info event=oidc_jwks provider=mock keys=15767worker1 # [ 209.521716] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:26Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:349185768worker1 # [ 209.523394] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:26Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05769worker1 # [ 209.535466] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:26Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05770worker1 # [ 209.537958] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:26Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=15771worker2 # [ 209.568175] nix-grpc-daemon[1533]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 34 ms (attempt 1/5)5772worker1 # [ 209.540066] nix-grpc-daemon[1724]: E0000 00:00:1790074106.797680 1766 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5773worker1 # [ 209.542335] nix-grpc-daemon[1724]: E0000 00:00:1790074106.797887 1766 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5774worker1 # [ 209.547670] nix-grpc-daemon[1724]: E0000 00:00:1790074106.817812 1766 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5775worker1 # [ 209.553123] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:26Z level=info event=scheduler_connected addr=lb:500515776worker1 # [ 209.554632] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:26Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:349185777worker1 # [ 209.556195] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:26Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05778worker2 # [ 209.610378] nix-grpc-daemon[1533]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 45 ms (attempt 2/5)5779worker2 # [ 209.655564] nix-grpc-daemon[1533]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 246 ms (attempt 3/5)5780worker2 # [ 209.906016] nix-grpc-daemon[1533]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 408 ms (attempt 4/5)5781worker2 # [ 210.322777] nix-grpc-daemon[1533]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5782worker2 # [ 210.328878] nix-grpc-daemon[1533]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5783worker2 # [ 210.345222] nix-grpc-daemon[1533]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' from 'http://lb:5751'...5784worker2 # [ 210.371722] nix-daemon[947]: accepted connection from pid 1533, user nix-grpc-daemon (trusted)5785worker2 # [ 210.381782] nix-daemon[947]: accepted connection from pid 1533, user nix-grpc-daemon (trusted)5786client # [ 210.337400] nix[1340]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5787client: (finished: must succeed: sleep 5.0, in 5.08 seconds)5788client: waiting for success: ! systemctl is-active mid5789worker2 # [ 214.419174] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:31Z level=info event=niks3_push_started pid=16995790worker2 # [ 214.468598] nix-daemon[947]: reaped child process 1674, status = succeeded5791worker2 # [ 214.661960] nix-grpc-daemon[1699]: time=2026-09-22T10:48:31.929Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca=""5792worker2 # [ 214.898724] nix-daemon[947]: accepted connection from pid 1712, user nix-grpc-daemon (trusted)5793worker2 # [ 214.921526] nix-daemon[947]: reaped child process 1715, status = succeeded5794lb # [ 214.939811] niks3-server[1133]: 2026/09/22 10:48:32 INFO Received uploads request method=POST path=/api/pending_closures5795worker2 # [ 214.955014] nix-grpc-daemon[1699]: time=2026-09-22T10:48:32.220Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5796worker2 # [ 214.958230] nix-grpc-daemon[1699]: time=2026-09-22T10:48:32.220Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5797lb # [ 215.001615] niks3-server[1133]: 2026/09/22 10:48:32 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5798worker2 # [ 215.012230] nix-grpc-daemon[1699]: time=2026-09-22T10:48:32.279Z level=INFO msg="Uploading 1 narinfos"5799lb # [ 215.010756] niks3-server[1133]: 2026/09/22 10:48:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5800lb # [ 215.018134] niks3-server[1133]: 2026/09/22 10:48:32 INFO Signed narinfos id=46 count=15801lb # [ 215.022042] niks3-server[1133]: 2026/09/22 10:48:32 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5802lb # [ 215.028983] niks3-server[1133]: 2026/09/22 10:48:32 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls5803lb # [ 215.036358] niks3-server[1133]: 2026/09/22 10:48:32 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5804lb # [ 215.043275] niks3-server[1133]: 2026/09/22 10:48:32 INFO Completed upload id=465805worker2 # [ 215.044103] nix-grpc-daemon[1699]: time=2026-09-22T10:48:32.312Z level=INFO msg="Upload complete. (378ms)"5806worker2 # [ 215.052058] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58182 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15807worker2 # [ 215.063605] nix-daemon[947]: reaped child process 1672, status = succeeded5808client # [ 215.049743] systemd[1]: mid.service: Deactivated successfully.5809client # [ 215.052746] systemd[1]: mid.service: Consumed 335ms CPU time over 11.597s wall clock time, 41.2M memory peak, 9.2K incoming IP traffic, 10.7K outgoing IP traffic.5810client: (finished: waiting for success: ! systemctl is-active mid, in 1.20 seconds)5811client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5812client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds)5813(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 12.16 seconds)5814subtest: interrupting the client stops the build on the worker5815client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5816client # [ 215.574605] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5817client # Running as unit: intr.service; invocation ID: 4f0889ac341a49fb8240153b97afe4285818client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.05 seconds)5819worker2 # [ 215.877744] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:581825820client # [ 215.842150] nix[1376]: don't know how to build these paths:5821client # [ 215.843225] nix[1376]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5822worker1 # [ 215.865483] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:33Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05823worker1 # [ 215.865824] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:33Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.3:50051 clients=15824worker1 # [ 215.919806] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375365825worker1 # [ 215.938055] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)5826worker1 # [ 215.969412] nix-grpc-daemon[1724]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 1/5)5827worker1 # [ 216.011299] nix-grpc-daemon[1724]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 102 ms (attempt 2/5)5828worker1 # [ 216.121615] nix-grpc-daemon[1724]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 307 ms (attempt 3/5)5829worker1 # [ 216.436764] nix-grpc-daemon[1724]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 295 ms (attempt 4/5)5830worker1 # [ 216.740377] nix-grpc-daemon[1724]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5831worker1 # [ 216.746151] nix-grpc-daemon[1724]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5832worker1 # [ 216.768195] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:375365833client # [ 216.776536] nix[1376]: copying 1 paths to 'lb:50051'...5834worker1 # [ 216.787838] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:375365835client # [ 216.780828] nix[1376]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5836worker1 # [ 216.808752] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)5837worker1 # [ 216.849531] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:34Z level=info event=niks3_push_started pid=18045838worker1 # [ 217.071442] nix-grpc-daemon[1804]: time=2026-09-22T10:48:34.353Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca=""5839worker1 # [ 217.253586] nix-daemon[921]: accepted connection from pid 1817, user nix-grpc-daemon (trusted)5840worker1 # [ 217.276123] nix-daemon[921]: reaped child process 1820, status = succeeded5841worker1 # [ 217.455721] nix-daemon[921]: accepted connection from pid 1822, user nix-grpc-daemon (trusted)5842worker1 # [ 217.475890] nix-daemon[921]: reaped child process 1825, status = succeeded5843lb # [ 217.526841] niks3-server[1133]: 2026/09/22 10:48:34 INFO Received uploads request method=POST path=/api/pending_closures5844worker1 # [ 217.505857] nix-grpc-daemon[1804]: time=2026-09-22T10:48:34.789Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5845worker1 # [ 217.509551] nix-grpc-daemon[1804]: time=2026-09-22T10:48:34.791Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5846lb # [ 217.566806] niks3-server[1133]: 2026/09/22 10:48:34 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5847worker1 # [ 217.538374] nix-grpc-daemon[1804]: time=2026-09-22T10:48:34.821Z level=INFO msg="Uploading 1 narinfos"5848lb # [ 217.574522] niks3-server[1133]: 2026/09/22 10:48:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5849lb # [ 217.579429] niks3-server[1133]: 2026/09/22 10:48:34 INFO Signed narinfos id=47 count=15850lb # [ 217.582647] niks3-server[1133]: 2026/09/22 10:48:34 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5851lb # [ 217.589496] niks3-server[1133]: 2026/09/22 10:48:34 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5852lb # [ 217.593872] niks3-server[1133]: 2026/09/22 10:48:34 INFO Completed upload id=475853worker1 # [ 217.559696] nix-grpc-daemon[1804]: time=2026-09-22T10:48:34.842Z level=INFO msg="Upload complete. (484ms)"5854lb # [ 217.595731] niks3-server[1133]: 2026/09/22 10:48:34 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5855worker1 # [ 217.568236] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37536 duration_s=0 paths=1 nar_bytes_in=4245856worker1 # [ 217.571438] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375365857worker1 # [ 217.585811] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)5858worker1 # [ 217.590264] nix-daemon[921]: reaped child process 1801, status = succeeded5859worker1 # [ 217.601907] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)5860client # [ 217.591700] nix[1376]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5861lb # [ 218.952405] envoy[961]: conn peer=[2001:db8:1::1]:50802 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3927 tx=1877 ms=112875862client: must succeed: systemctl kill -s INT intr5863client # [ 219.363092] systemd[1]: intr.service: Sent signal SIGINT to main process 1376 (nix) on client request.5864worker1 # [ 219.383573] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:36Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5865client # [ 219.372487] nix[1376]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5866client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds)5867client # [ 219.383497] nix[1376]: error: interrupted by the user5868client # [ 219.412663] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5869client # [ 219.414463] systemd[1]: intr.service: Failed with result 'exit-code'.5870client # [ 219.417369] systemd[1]: intr.service: Consumed 185ms CPU time over 3.837s wall clock time, 41.2M memory peak, 6.3K incoming IP traffic, 8.2K outgoing IP traffic.5871worker1 # [ 219.441799] nix-daemon[1829]: unexpected Nix daemon error: error: interrupted by the user5872worker1 # [ 219.446300] nix-daemon[921]: reaped child process 1827, status = succeeded5873worker1 # [ 219.454796] nix-daemon[921]: reaped child process 1829, status = failed with exit code 15874(finished: subtest: interrupting the client stops the build on the worker, in 4.01 seconds)5875subtest: a deploy mid-build drains: the build finishes, the new generation takes over5876client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5877client # [ 219.610048] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5878client # Running as unit: sw.service; invocation ID: 20645317a9d94cfaaa908dc92456cddc5879client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.09 seconds)5880worker1 # [ 219.894868] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:375365881client # [ 219.893689] nix[1397]: don't know how to build these paths:5882client # [ 219.894776] nix[1397]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5883worker1 # [ 219.915043] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:37Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05884worker1 # [ 219.921464] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:37Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.4:50051 clients=15885worker2 # [ 219.997795] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:581825886worker2 # [ 220.010323] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:581825887client # [ 219.972448] nix[1397]: copying 1 paths to 'lb:50051'...5888worker2 # [ 220.019691] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:581825889client # [ 219.975396] nix[1397]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5890worker2 # [ 220.027160] nix-daemon[947]: accepted connection from pid 1533, user nix-grpc-daemon (trusted)5891worker2 # [ 220.207644] nix-daemon[947]: accepted connection from pid 1748, user nix-grpc-daemon (trusted)5892worker2 # [ 220.226818] nix-daemon[947]: reaped child process 1751, status = succeeded5893worker2 # [ 220.405948] nix-daemon[947]: accepted connection from pid 1753, user nix-grpc-daemon (trusted)5894worker2 # [ 220.427585] nix-daemon[947]: reaped child process 1756, status = succeeded5895lb # [ 220.440827] niks3-server[1133]: 2026/09/22 10:48:37 INFO Received uploads request method=POST path=/api/pending_closures5896worker2 # [ 220.452438] nix-grpc-daemon[1699]: time=2026-09-22T10:48:37.719Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5897worker2 # [ 220.454078] nix-grpc-daemon[1699]: time=2026-09-22T10:48:37.719Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5898lb # [ 220.476425] niks3-server[1133]: 2026/09/22 10:48:37 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5899worker2 # [ 220.487403] nix-grpc-daemon[1699]: time=2026-09-22T10:48:37.755Z level=INFO msg="Uploading 1 narinfos"5900lb # [ 220.490529] niks3-server[1133]: 2026/09/22 10:48:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5901lb # [ 220.503494] niks3-server[1133]: 2026/09/22 10:48:37 INFO Signed narinfos id=48 count=15902lb # [ 220.509683] niks3-server[1133]: 2026/09/22 10:48:37 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5903lb # [ 220.518460] niks3-server[1133]: 2026/09/22 10:48:37 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5904worker2 # [ 220.523698] nix-grpc-daemon[1699]: time=2026-09-22T10:48:37.791Z level=INFO msg="Upload complete. (488ms)"5905lb # [ 220.524393] niks3-server[1133]: 2026/09/22 10:48:37 INFO Completed upload id=485906lb # [ 220.528710] niks3-server[1133]: 2026/09/22 10:48:37 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5907worker2 # [ 220.532294] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58182 duration_s=0 paths=1 nar_bytes_in=4165908worker2 # [ 220.547162] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:581825909worker2 # [ 220.554044] nix-daemon[947]: accepted connection from pid 1533, user nix-grpc-daemon (trusted)5910worker2 # [ 220.558947] nix-daemon[947]: reaped child process 1746, status = succeeded5911client # [ 220.524547] nix[1397]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5912worker2 # [ 220.571212] nix-daemon[947]: accepted connection from pid 1533, user nix-grpc-daemon (trusted)5913worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&25914worker2 # Checking switch inhibitors... done5915worker2 # [ 223.184624] nixos[1792]: switching to system configuration /nix/store/53zsn476qs62sf3s60b4si9wblfzz0vj-nixos-system-worker2-test5916worker2 # activating the configuration...5917worker2 # [ 223.188132] systemd[1]: Stopped target Remote File Systems.5918worker2 # [ 223.189000] systemd[1]: Stopped target Local File Systems.5919worker2 # setting up /etc...5920worker2 # [ 223.970155] systemd[1]: Reload requested from client PID 1792 ('.switch-to-conf') (unit backdoor.service)...5921worker2 # [ 223.982147] systemd[1]: Reloading...5922worker2 # [ 224.837349] systemd[1]: Reloading finished in 863 ms.5923worker2 # restarting sysinit-reactivation.target5924worker2 # [ 224.920239] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....5925worker2 # [ 225.082252] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..5926worker2 # [ 225.083468] systemd[1]: Reached target Reactivate sysinit units.5927worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service5928worker2 # [ 225.091374] systemd[1]: Reloading D-Bus System Message Bus...5929worker2 # [ 225.092977] dbus-broker-launch[589]: Caught SIGHUP, trigger reload.5930worker2 # [ 225.097137] systemd[1]: Reloading Nix worker-protocol over gRPC...5931worker2 # [ 225.129766] dbus-broker-launch[589]: Looking up NSS user entry for 'systemd-timesync'...5932worker2 # [ 225.139115] dbus-broker-launch[589]: NSS returned no entry for 'systemd-timesync'5933worker2 # [ 225.141974] dbus-broker-launch[589]: Invalid user-name in /nix/store/602n2r0g7ngz2pj9sxi9qamwpihwymx6-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"5934worker2 # [ 225.155000] systemd[1]: Reloaded Nix worker-protocol over gRPC.5935worker2 # [ 225.181586] systemd[1]: Reloaded D-Bus System Message Bus.5936worker2 # [ 225.187740] systemd[1]: Reached target Local File Systems.5937worker2 # [ 225.192306] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore5938worker2 # [ 225.196163] systemd[1]: Starting Create SUID/SGID Wrappers...5939worker2 # [ 225.197014] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.5940worker2 # [ 225.198188] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc675941worker2 # [ 225.217155] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore5942worker2 # [ 225.218773] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5943worker2 # [ 225.220001] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5944worker2 # [ 225.228607] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os5945worker2 # [ 225.232163] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki5946worker2 # [ 225.236075] systemd[1]: Reached target Remote File Systems.5947worker2 # [ 225.714730] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.5948worker2 # [ 225.722318] systemd[1]: Finished Create SUID/SGID Wrappers.5949worker2 # [ 225.725164] systemd[1]: Starting linger-users.service...5950worker2 # [ 225.786884] systemd[1]: linger-users.service: Deactivated successfully.5951worker2 # [ 225.792095] systemd[1]: Finished linger-users.service.5952worker2 # [ 225.910730] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:43Z level=info event=draining5953worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service5954worker2 # [ 226.044824] nixos[1792]: finished switching to system configuration /nix/store/53zsn476qs62sf3s60b4si9wblfzz0vj-nixos-system-worker2-test5955worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 3.72 seconds)5956worker2: must succeed: pgrep -f 'read -t [9]0 x'5957worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.07 seconds)5958client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&25959worker1 # [ 226.373422] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:375365960client # don't know how to build these paths:5961client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5962worker1 # [ 226.385005] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:375365963worker1 # [ 226.413987] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:43Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05964worker1 # [ 226.421125] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:43Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.3:50051 clients=15965worker1 # [ 226.468594] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375365966worker1 # [ 226.489007] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:375365967client # copying 1 paths to 'lb:50051'...5968client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5969worker1 # [ 226.506376] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:375365970worker1 # [ 226.523940] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)5971worker1 # [ 226.752444] nix-daemon[921]: accepted connection from pid 1880, user nix-grpc-daemon (trusted)5972worker1 # [ 226.775480] nix-daemon[921]: reaped child process 1883, status = succeeded5973worker1 # [ 226.943622] nix-daemon[921]: accepted connection from pid 1885, user nix-grpc-daemon (trusted)5974worker1 # [ 226.963854] nix-daemon[921]: reaped child process 1888, status = succeeded5975lb # [ 227.017716] niks3-server[1133]: 2026/09/22 10:48:44 INFO Received uploads request method=POST path=/api/pending_closures5976worker1 # [ 226.995237] nix-grpc-daemon[1804]: time=2026-09-22T10:48:44.277Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5977worker1 # [ 226.996944] nix-grpc-daemon[1804]: time=2026-09-22T10:48:44.277Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5978worker1 # [ 227.029379] nix-grpc-daemon[1804]: time=2026-09-22T10:48:44.312Z level=INFO msg="Uploading 1 narinfos"5979lb # [ 227.055944] niks3-server[1133]: 2026/09/22 10:48:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5980lb # [ 227.073966] niks3-server[1133]: 2026/09/22 10:48:44 INFO Signed narinfos id=49 count=15981lb # [ 227.081787] niks3-server[1133]: 2026/09/22 10:48:44 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5982lb # [ 227.098058] niks3-server[1133]: 2026/09/22 10:48:44 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5983lb # [ 227.107547] niks3-server[1133]: 2026/09/22 10:48:44 INFO Completed upload id=495984worker1 # [ 227.069773] nix-grpc-daemon[1804]: time=2026-09-22T10:48:44.352Z level=INFO msg="Upload complete. (525ms)"5985worker1 # [ 227.080551] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37536 duration_s=0 paths=1 nar_bytes_in=5285986lb # [ 227.116831] niks3-server[1133]: 2026/09/22 10:48:44 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5987worker1 # [ 227.095054] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375365988lb # [ 227.130373] niks3-server[1133]: 2026/09/22 10:48:44 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5989worker1 # [ 227.101915] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)5990worker1 # [ 227.107122] nix-daemon[921]: reaped child process 1878, status = succeeded5991client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5992worker1 # [ 227.119504] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)5993client # farm-a> node-a: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5994client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds5995client # farm-a> LOG-farm-a-during-drain5996worker1 # [ 228.147778] nix-daemon[921]: reaped child process 1892, status = succeeded5997worker1 # [ 228.309127] nix-daemon[921]: accepted connection from pid 1908, user nix-grpc-daemon (trusted)5998worker1 # [ 228.329593] nix-daemon[921]: reaped child process 1911, status = succeeded5999lb # [ 228.375786] niks3-server[1133]: 2026/09/22 10:48:45 INFO Received uploads request method=POST path=/api/pending_closures6000worker1 # [ 228.356495] nix-grpc-daemon[1804]: time=2026-09-22T10:48:45.638Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6001worker1 # [ 228.358070] nix-grpc-daemon[1804]: time=2026-09-22T10:48:45.638Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"6002lb # [ 228.443157] niks3-server[1133]: 2026/09/22 10:48:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6003worker1 # [ 228.418141] nix-grpc-daemon[1804]: time=2026-09-22T10:48:45.700Z level=INFO msg="Uploading 1 narinfos"6004lb # [ 228.454079] niks3-server[1133]: 2026/09/22 10:48:45 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst6005lb # [ 228.463413] niks3-server[1133]: 2026/09/22 10:48:45 INFO Signed narinfos id=50 count=16006worker1 # [ 228.440302] nix-grpc-daemon[1804]: time=2026-09-22T10:48:45.723Z level=INFO msg="Upload complete. (307ms)"6007lb # [ 228.468058] niks3-server[1133]: 2026/09/22 10:48:45 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv6008lb # [ 228.478523] niks3-server[1133]: 2026/09/22 10:48:45 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls6009lb # [ 228.483096] niks3-server[1133]: 2026/09/22 10:48:45 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6010lb # [ 228.487007] niks3-server[1133]: 2026/09/22 10:48:45 INFO Completed upload id=506011lb # [ 228.489014] niks3-server[1133]: 2026/09/22 10:48:45 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo6012worker1 # [ 228.455486] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37536 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=16013worker1 # [ 228.470043] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:45Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=06014worker1 # [ 228.477596] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:45Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.3:50051 clients=16015worker1 # [ 228.482016] nix-daemon[921]: reaped child process 1890, status = succeeded6016worker1 # [ 228.513736] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375366017worker1 # [ 228.524434] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:375366018worker1 # [ 228.536251] nix-grpc-daemon[1804]: time=2026-09-22T10:48:45.819Z level=INFO msg="All 1 paths already cached"6019client # copying 1 paths to 'lb:50051'...6020client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...6021worker1 # [ 228.544666] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:375366022worker1 # [ 228.561544] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6023worker1 # [ 228.775930] nix-daemon[921]: accepted connection from pid 1917, user nix-grpc-daemon (trusted)6024worker1 # [ 228.797801] nix-daemon[921]: reaped child process 1920, status = succeeded6025lb # [ 228.953905] envoy[961]: conn peer=[2001:db8:1::1]:39564 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3013 tx=851 ms=35626026worker1 # [ 228.987321] nix-daemon[921]: accepted connection from pid 1922, user nix-grpc-daemon (trusted)6027worker1 # [ 229.007137] nix-daemon[921]: reaped child process 1925, status = succeeded6028lb # [ 229.056578] niks3-server[1133]: 2026/09/22 10:48:46 INFO Received uploads request method=POST path=/api/pending_closures6029worker1 # [ 229.036448] nix-grpc-daemon[1804]: time=2026-09-22T10:48:46.319Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6030worker1 # [ 229.038048] nix-grpc-daemon[1804]: time=2026-09-22T10:48:46.319Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"6031lb # [ 229.091827] niks3-server[1133]: 2026/09/22 10:48:46 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst6032lb # [ 229.102637] niks3-server[1133]: 2026/09/22 10:48:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6033worker1 # [ 229.074272] nix-grpc-daemon[1804]: time=2026-09-22T10:48:46.357Z level=INFO msg="Uploading 1 narinfos"6034lb # [ 229.110910] niks3-server[1133]: 2026/09/22 10:48:46 INFO Signed narinfos id=51 count=16035lb # [ 229.115633] niks3-server[1133]: 2026/09/22 10:48:46 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls6036lb # [ 229.123891] niks3-server[1133]: 2026/09/22 10:48:46 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6037worker1 # [ 229.095549] nix-grpc-daemon[1804]: time=2026-09-22T10:48:46.378Z level=INFO msg="Upload complete. (518ms)"6038lb # [ 229.130334] niks3-server[1133]: 2026/09/22 10:48:46 INFO Completed upload id=516039lb # [ 229.132917] niks3-server[1133]: 2026/09/22 10:48:46 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo6040worker1 # [ 229.102334] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37536 duration_s=0 paths=1 nar_bytes_in=6406041worker1 # [ 229.112403] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375366042worker1 # [ 229.126668] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6043worker1 # [ 229.127975] nix-daemon[921]: reaped child process 1915, status = succeeded6044worker1 # [ 229.137195] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6045client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...6046client # farm-b> node-a: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv6047client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds6048client # farm-b> LOG-farm-b-during-drain6049worker1 # [ 230.365637] nix-daemon[921]: reaped child process 1929, status = succeeded6050worker1 # [ 230.539425] nix-daemon[921]: accepted connection from pid 1945, user nix-grpc-daemon (trusted)6051worker1 # [ 230.563150] nix-daemon[921]: reaped child process 1948, status = succeeded6052lb # [ 230.610626] niks3-server[1133]: 2026/09/22 10:48:47 INFO Received uploads request method=POST path=/api/pending_closures6053worker1 # [ 230.587093] nix-grpc-daemon[1804]: time=2026-09-22T10:48:47.869Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6054worker1 # [ 230.588742] nix-grpc-daemon[1804]: time=2026-09-22T10:48:47.869Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"6055lb # [ 230.649999] niks3-server[1133]: 2026/09/22 10:48:47 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv6056lb # [ 230.661152] niks3-server[1133]: 2026/09/22 10:48:47 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst6057lb # [ 230.672113] niks3-server[1133]: 2026/09/22 10:48:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6058worker1 # [ 230.643687] nix-grpc-daemon[1804]: time=2026-09-22T10:48:47.926Z level=INFO msg="Uploading 1 narinfos"6059lb # [ 230.681028] niks3-server[1133]: 2026/09/22 10:48:47 INFO Signed narinfos id=52 count=16060lb # [ 230.687135] niks3-server[1133]: 2026/09/22 10:48:47 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls6061lb # [ 230.696832] niks3-server[1133]: 2026/09/22 10:48:47 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6062lb # [ 230.705227] niks3-server[1133]: 2026/09/22 10:48:47 INFO Completed upload id=526063worker1 # [ 230.670719] nix-grpc-daemon[1804]: time=2026-09-22T10:48:47.953Z level=INFO msg="Upload complete. (322ms)"6064lb # [ 230.708627] niks3-server[1133]: 2026/09/22 10:48:47 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo6065worker1 # [ 230.685679] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37536 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=16066worker1 # [ 230.704559] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:47Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=06067worker1 # [ 230.708956] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:47Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.3:50051 clients=16068worker1 # [ 230.713148] nix-daemon[921]: reaped child process 1927, status = succeeded6069worker1 # [ 230.741962] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375366070worker1 # [ 230.753277] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:375366071worker1 # [ 230.764827] nix-grpc-daemon[1804]: time=2026-09-22T10:48:48.048Z level=INFO msg="All 2 paths already cached"6072client # copying 1 paths to 'lb:50051'...6073client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...6074worker1 # [ 230.773582] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:375366075worker1 # [ 230.788532] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6076worker1 # [ 231.000378] nix-daemon[921]: accepted connection from pid 1954, user nix-grpc-daemon (trusted)6077worker1 # [ 231.018917] nix-daemon[921]: reaped child process 1957, status = succeeded6078worker1 # [ 231.205670] nix-daemon[921]: accepted connection from pid 1959, user nix-grpc-daemon (trusted)6079worker1 # [ 231.225193] nix-daemon[921]: reaped child process 1962, status = succeeded6080lb # [ 231.271200] niks3-server[1133]: 2026/09/22 10:48:48 INFO Received uploads request method=POST path=/api/pending_closures6081worker1 # [ 231.247076] nix-grpc-daemon[1804]: time=2026-09-22T10:48:48.529Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6082worker1 # [ 231.248830] nix-grpc-daemon[1804]: time=2026-09-22T10:48:48.530Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"6083lb # [ 231.301054] niks3-server[1133]: 2026/09/22 10:48:48 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst6084worker1 # [ 231.280219] nix-grpc-daemon[1804]: time=2026-09-22T10:48:48.563Z level=INFO msg="Uploading 1 narinfos"6085lb # [ 231.317853] niks3-server[1133]: 2026/09/22 10:48:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6086lb # [ 231.328058] niks3-server[1133]: 2026/09/22 10:48:48 INFO Signed narinfos id=53 count=16087lb # [ 231.330925] niks3-server[1133]: 2026/09/22 10:48:48 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls6088lb # [ 231.339991] niks3-server[1133]: 2026/09/22 10:48:48 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6089worker1 # [ 231.312530] nix-grpc-daemon[1804]: time=2026-09-22T10:48:48.595Z level=INFO msg="Upload complete. (505ms)"6090lb # [ 231.346928] niks3-server[1133]: 2026/09/22 10:48:48 INFO Completed upload id=536091lb # [ 231.350553] niks3-server[1133]: 2026/09/22 10:48:48 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo6092worker1 # [ 231.320127] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37536 duration_s=0 paths=1 nar_bytes_in=7686093worker1 # [ 231.324313] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375366094worker1 # [ 231.335550] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6095worker1 # [ 231.337208] nix-daemon[921]: reaped child process 1952, status = succeeded6096client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...6097client # farm-top> node-a: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv6098worker1 # [ 231.350123] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6099client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds6100client # farm-top> LOG-farm-top-during-drain6101worker1 # [ 232.574034] nix-daemon[921]: reaped child process 1966, status = succeeded6102worker1 # [ 232.756920] nix-daemon[921]: accepted connection from pid 1982, user nix-grpc-daemon (trusted)6103worker1 # [ 232.782031] nix-daemon[921]: reaped child process 1985, status = succeeded6104lb # [ 232.833736] niks3-server[1133]: 2026/09/22 10:48:50 INFO Received uploads request method=POST path=/api/pending_closures6105worker1 # [ 232.810756] nix-grpc-daemon[1804]: time=2026-09-22T10:48:50.091Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6106worker1 # [ 232.812377] nix-grpc-daemon[1804]: time=2026-09-22T10:48:50.091Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"6107lb # [ 232.866812] niks3-server[1133]: 2026/09/22 10:48:50 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst6108lb # [ 232.886642] niks3-server[1133]: 2026/09/22 10:48:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6109worker1 # [ 232.859007] nix-grpc-daemon[1804]: time=2026-09-22T10:48:50.141Z level=INFO msg="Uploading 1 narinfos"6110lb # [ 232.900149] niks3-server[1133]: 2026/09/22 10:48:50 INFO Signed narinfos id=54 count=16111lb # [ 232.906901] niks3-server[1133]: 2026/09/22 10:48:50 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv6112lb # [ 232.914037] niks3-server[1133]: 2026/09/22 10:48:50 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls6113lb # [ 232.923859] niks3-server[1133]: 2026/09/22 10:48:50 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6114worker1 # [ 232.894909] nix-grpc-daemon[1804]: time=2026-09-22T10:48:50.178Z level=INFO msg="Upload complete. (334ms)"6115lb # [ 232.929796] niks3-server[1133]: 2026/09/22 10:48:50 INFO Completed upload id=546116lb # [ 232.934846] niks3-server[1133]: 2026/09/22 10:48:50 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo6117worker1 # [ 232.905035] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37536 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=16118worker1 # [ 232.917377] nix-daemon[921]: reaped child process 1964, status = succeeded6119client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 6.89 seconds)6120client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath6121client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.25 seconds)6122worker2: must succeed: pkill -f 'read -t [9]0 x'6123worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.07 seconds)6124client: waiting for success: ! systemctl is-active sw6125worker2 # [ 233.423120] nix-daemon[947]: reaped child process 1760, status = succeeded6126worker2 # [ 233.598764] nix-daemon[947]: accepted connection from pid 1932, user nix-grpc-daemon (trusted)6127worker2 # [ 233.621366] nix-daemon[947]: reaped child process 1935, status = succeeded6128lb # [ 233.635029] niks3-server[1133]: 2026/09/22 10:48:50 INFO Received uploads request method=POST path=/api/pending_closures6129worker2 # [ 233.649016] nix-grpc-daemon[1699]: time=2026-09-22T10:48:50.916Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6130worker2 # [ 233.650581] nix-grpc-daemon[1699]: time=2026-09-22T10:48:50.916Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"6131lb # [ 233.681806] niks3-server[1133]: 2026/09/22 10:48:50 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv6132lb # [ 233.692459] niks3-server[1133]: 2026/09/22 10:48:50 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6133worker2 # [ 233.700176] nix-grpc-daemon[1699]: time=2026-09-22T10:48:50.967Z level=INFO msg="Uploading 1 narinfos"6134lb # [ 233.702484] niks3-server[1133]: 2026/09/22 10:48:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6135lb # [ 233.708191] niks3-server[1133]: 2026/09/22 10:48:50 INFO Signed narinfos id=55 count=16136lb # [ 233.712403] niks3-server[1133]: 2026/09/22 10:48:50 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls6137lb # [ 233.723388] niks3-server[1133]: 2026/09/22 10:48:50 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6138lb # [ 233.729211] niks3-server[1133]: 2026/09/22 10:48:50 INFO Completed upload id=556139worker2 # [ 233.729802] nix-grpc-daemon[1699]: time=2026-09-22T10:48:50.997Z level=INFO msg="Upload complete. (327ms)"6140lb # [ 233.732195] niks3-server[1133]: 2026/09/22 10:48:50 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo6141worker2 # [ 233.745192] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58182 duration_s=13 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=16142worker2 # [ 233.759527] nix-daemon[947]: reaped child process 1758, status = succeeded6143client # [ 233.742325] systemd[1]: sw.service: Deactivated successfully.6144client # [ 233.747225] systemd[1]: sw.service: Consumed 200ms CPU time over 14.136s wall clock time, 41.2M memory peak, 7.2K incoming IP traffic, 8.4K outgoing IP traffic.6145worker2 # [ 233.912675] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:51Z level=info event=signal_exit6146client: (finished: waiting for success: ! systemctl is-active sw, in 1.13 seconds)6147client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6148client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds)6149worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6150worker2 # [ 234.609619] systemd[1]: Starting scheduler-token.service...6151worker2 # [ 234.701069] systemd[1]: scheduler-token.service: Deactivated successfully.6152worker2 # [ 234.705292] systemd[1]: Finished scheduler-token.service.6153worker2 # [ 234.706760] systemd[1]: scheduler-token.service: Consumed 39ms CPU time over 92ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.6154worker2 # [ 235.062530] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:52Z level=info event=scheduler_restarting6155worker1 # [ 235.037682] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:52Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:349186156worker1 # [ 235.043100] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:52Z level=info event=worker_gone addr=192.168.1.4:500516157worker2 # [ 235.094968] nix-grpc-daemon[1533]: ts=2026-09-22T10:48:52Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6158worker2 # [ 235.121344] nix-daemon[947]: reaped child process 1592, status = succeeded6159worker2 # [ 235.993318] nix-grpc-daemon[1533]: E0000 00:00:1790074133.261050 1578 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true6160worker2 # [ 235.993813] nix-grpc-daemon[1533]: E0000 00:00:1790074133.261340 1578 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true6161worker2 # [ 236.316276] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6162worker2 # [ 236.319407] systemd[1]: nix-grpc-daemon.service: Consumed 1.139s CPU time over 46.743s wall clock time, 33.8M memory peak, 23.6K incoming IP traffic, 40.6K outgoing IP traffic.6163worker2 # [ 236.343745] systemd[1]: Starting Nix worker-protocol over gRPC...6164worker2 # [ 236.538715] nix-grpc-daemon[1952]: ts=2026-09-22T10:48:53Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6165worker2 # [ 236.541471] nix-grpc-daemon[1952]: ts=2026-09-22T10:48:53Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6166worker2 # [ 236.545926] nix-grpc-daemon[1952]: ts=2026-09-22T10:48:53Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16167worker2 # [ 236.555389] nix-grpc-daemon[1952]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6168worker2 # [ 236.566230] nix-grpc-daemon[1952]: E0000 00:00:1790074133.821014 1952 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6169worker2 # [ 236.570340] nix-grpc-daemon[1952]: E0000 00:00:1790074133.823351 1952 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6170worker2 # [ 236.588047] nix-grpc-daemon[1952]: ts=2026-09-22T10:48:53Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6171worker2 # [ 236.589942] systemd[1]: Started Nix worker-protocol over gRPC.6172worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.08 seconds)6173lb: waiting until exactly no endpoints of aarch64-linux are unhealthy6174lb: must succeed: curl -sf localhost:9901/clusters6175worker2 # [ 236.590786] nix-grpc-daemon[1952]: E0000 00:00:1790074133.843059 1991 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6176worker2 # [ 236.614446] nix-grpc-daemon[1952]: E0000 00:00:1790074133.866341 1991 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6177worker2 # [ 236.617574] nix-grpc-daemon[1952]: E0000 00:00:1790074133.866576 1991 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6178worker2 # [ 236.623242] nix-grpc-daemon[1952]: E0000 00:00:1790074133.881265 1991 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6179worker2 # [ 236.628190] nix-grpc-daemon[1952]: ts=2026-09-22T10:48:53Z level=info event=scheduler_connected addr=lb:500516180worker1 # [ 236.595568] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:53Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:349186181worker1 # [ 236.599578] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:53Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=06182lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6183lb: must succeed: curl -sf localhost:9901/clusters6184lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)6185lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.16 seconds)6186lb: must succeed: curl -sf localhost:9901/clusters6187lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)6188worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6189worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)6190(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 18.31 seconds)6191subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6192client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16193worker2 # [ 238.182172] nix-grpc-daemon[1952]: ts=2026-09-22T10:48:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:397606194worker2 # [ 238.196544] nix-daemon[947]: accepted connection from pid 1952, user nix-grpc-daemon (trusted)6195worker2 # [ 238.217870] nix-grpc-daemon[1952]: ts=2026-09-22T10:48:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:397606196worker2 # [ 238.238132] nix-grpc-daemon[1952]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 5 ms (attempt 1/5)6197worker2 # [ 238.250839] nix-grpc-daemon[1952]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 145 ms (attempt 2/5)6198worker2 # [ 238.403407] nix-grpc-daemon[1952]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 108 ms (attempt 3/5)6199worker2 # [ 238.511929] nix-grpc-daemon[1952]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 681 ms (attempt 4/5)6200lb # [ 238.954753] envoy[961]: conn peer=[2001:db8:1::1]:60518 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9651 tx=4078 ms=65556201lb # [ 238.960036] envoy[961]: conn peer=[2001:db8:1::1]:39570 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2978 tx=1430 ms=138226202lb # [ 238.964876] envoy[961]: conn peer=[2001:db8:1::4]:42086 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=9904 tx=834 ms=452176203worker2 # [ 239.194330] nix-grpc-daemon[1952]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6204worker2 # [ 239.198158] nix-grpc-daemon[1952]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6205worker1 # [ 239.218037] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:56Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=06206worker1 # [ 239.218569] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:56Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=16207worker1 # [ 239.218701] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:56Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=06208worker1 # [ 239.218811] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:56Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=06209worker1 # [ 239.264504] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375366210worker1 # [ 239.283557] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:375366211worker1 # [ 239.300876] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:375366212worker1 # [ 239.317142] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6213worker1 # [ 239.532521] nix-daemon[921]: accepted connection from pid 1994, user nix-grpc-daemon (trusted)6214worker1 # [ 239.554129] nix-daemon[921]: reaped child process 1997, status = succeeded6215worker1 # [ 239.742489] nix-daemon[921]: accepted connection from pid 1999, user nix-grpc-daemon (trusted)6216worker1 # [ 239.763830] nix-daemon[921]: reaped child process 2002, status = succeeded6217lb # [ 239.814088] niks3-server[1133]: 2026/09/22 10:48:57 INFO Received uploads request method=POST path=/api/pending_closures6218worker1 # [ 239.789355] nix-grpc-daemon[1804]: time=2026-09-22T10:48:57.071Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6219worker1 # [ 239.790880] nix-grpc-daemon[1804]: time=2026-09-22T10:48:57.071Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"6220lb # [ 239.845787] niks3-server[1133]: 2026/09/22 10:48:57 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst6221worker1 # [ 239.827133] nix-grpc-daemon[1804]: time=2026-09-22T10:48:57.110Z level=INFO msg="Uploading 1 narinfos"6222lb # [ 239.863555] niks3-server[1133]: 2026/09/22 10:48:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6223lb # [ 239.874718] niks3-server[1133]: 2026/09/22 10:48:57 INFO Signed narinfos id=56 count=16224lb # [ 239.885335] niks3-server[1133]: 2026/09/22 10:48:57 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls6225lb # [ 239.891246] niks3-server[1133]: 2026/09/22 10:48:57 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6226lb # [ 239.897041] niks3-server[1133]: 2026/09/22 10:48:57 INFO Completed upload id=566227worker1 # [ 239.861946] nix-grpc-daemon[1804]: time=2026-09-22T10:48:57.145Z level=INFO msg="Upload complete. (528ms)"6228lb # [ 239.900314] niks3-server[1133]: 2026/09/22 10:48:57 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo6229worker1 # [ 239.872337] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37536 duration_s=0 paths=1 nar_bytes_in=5126230worker1 # [ 239.887828] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375366231worker1 # [ 239.894757] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6232worker1 # [ 239.899974] nix-daemon[921]: reaped child process 1992, status = succeeded6233worker1 # [ 239.915888] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6234worker1 # [ 240.570213] nix-daemon[921]: reaped child process 2006, status = succeeded6235worker1 # [ 240.746907] nix-daemon[921]: accepted connection from pid 2022, user nix-grpc-daemon (trusted)6236worker1 # [ 240.769266] nix-daemon[921]: reaped child process 2025, status = succeeded6237lb # [ 240.816890] niks3-server[1133]: 2026/09/22 10:48:58 INFO Received uploads request method=POST path=/api/pending_closures6238worker1 # [ 240.792448] nix-grpc-daemon[1804]: time=2026-09-22T10:48:58.075Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6239worker1 # [ 240.794015] nix-grpc-daemon[1804]: time=2026-09-22T10:48:58.075Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"6240lb # [ 240.855900] niks3-server[1133]: 2026/09/22 10:48:58 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6241lb # [ 240.872990] niks3-server[1133]: 2026/09/22 10:48:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6242worker1 # [ 240.844939] nix-grpc-daemon[1804]: time=2026-09-22T10:48:58.127Z level=INFO msg="Uploading 1 narinfos"6243lb # [ 240.885148] niks3-server[1133]: 2026/09/22 10:48:58 INFO Signed narinfos id=57 count=16244lb # [ 240.887507] niks3-server[1133]: 2026/09/22 10:48:58 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls6245lb # [ 240.895379] niks3-server[1133]: 2026/09/22 10:48:58 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv6246worker1 # [ 240.868929] nix-grpc-daemon[1804]: time=2026-09-22T10:48:58.152Z level=INFO msg="Upload complete. (338ms)"6247lb # [ 240.903241] niks3-server[1133]: 2026/09/22 10:48:58 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6248lb # [ 240.906902] niks3-server[1133]: 2026/09/22 10:48:58 INFO Completed upload id=576249lb # [ 240.909893] niks3-server[1133]: 2026/09/22 10:48:58 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo6250worker1 # [ 240.885247] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37536 duration_s=0 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=7 outputs=16251worker1 # [ 240.898296] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:58Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=16252worker1 # [ 240.909238] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375366253worker1 # [ 240.914882] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:58Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=06254worker1 # [ 240.918635] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:375366255worker1 # [ 240.922984] nix-daemon[921]: reaped child process 2004, status = succeeded6256worker1 # [ 240.927270] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:375366257worker1 # [ 240.937091] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6258worker1 # [ 241.125310] nix-daemon[921]: accepted connection from pid 2031, user nix-grpc-daemon (trusted)6259worker1 # [ 241.145737] nix-daemon[921]: reaped child process 2034, status = succeeded6260worker1 # [ 241.329387] nix-daemon[921]: accepted connection from pid 2036, user nix-grpc-daemon (trusted)6261worker1 # [ 241.349811] nix-daemon[921]: reaped child process 2039, status = succeeded6262lb # [ 241.395308] niks3-server[1133]: 2026/09/22 10:48:58 INFO Received uploads request method=POST path=/api/pending_closures6263worker1 # [ 241.370685] nix-grpc-daemon[1804]: time=2026-09-22T10:48:58.653Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6264worker1 # [ 241.372341] nix-grpc-daemon[1804]: time=2026-09-22T10:48:58.653Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"6265lb # [ 241.424569] niks3-server[1133]: 2026/09/22 10:48:58 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst6266lb # [ 241.437472] niks3-server[1133]: 2026/09/22 10:48:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6267worker1 # [ 241.409381] nix-grpc-daemon[1804]: time=2026-09-22T10:48:58.692Z level=INFO msg="Uploading 1 narinfos"6268lb # [ 241.447772] niks3-server[1133]: 2026/09/22 10:48:58 INFO Signed narinfos id=58 count=16269lb # [ 241.454448] niks3-server[1133]: 2026/09/22 10:48:58 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls6270lb # [ 241.463066] niks3-server[1133]: 2026/09/22 10:48:58 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6271lb # [ 241.470097] niks3-server[1133]: 2026/09/22 10:48:58 INFO Completed upload id=586272worker1 # [ 241.435333] nix-grpc-daemon[1804]: time=2026-09-22T10:48:58.718Z level=INFO msg="Upload complete. (488ms)"6273lb # [ 241.472843] niks3-server[1133]: 2026/09/22 10:48:58 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo6274worker1 # [ 241.444305] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37536 duration_s=0 paths=1 nar_bytes_in=5126275worker1 # [ 241.458642] nix-grpc-daemon[1724]: ts=2026-09-22T10:48:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375366276worker1 # [ 241.465997] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6277worker1 # [ 241.471346] nix-daemon[921]: reaped child process 2029, status = succeeded6278worker1 # [ 241.483458] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6279worker1 # [ 242.730369] nix-daemon[921]: reaped child process 2043, status = succeeded6280worker1 # [ 242.928174] nix-daemon[921]: accepted connection from pid 2059, user nix-grpc-daemon (trusted)6281worker1 # [ 242.948786] nix-daemon[921]: reaped child process 2062, status = succeeded6282lb # [ 242.997303] niks3-server[1133]: 2026/09/22 10:49:00 INFO Received uploads request method=POST path=/api/pending_closures6283worker1 # [ 242.976527] nix-grpc-daemon[1804]: time=2026-09-22T10:49:00.255Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6284worker1 # [ 242.978309] nix-grpc-daemon[1804]: time=2026-09-22T10:49:00.255Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"6285lb # [ 243.046248] niks3-server[1133]: 2026/09/22 10:49:00 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6286worker1 # [ 243.022689] nix-grpc-daemon[1804]: time=2026-09-22T10:49:00.305Z level=INFO msg="Uploading 1 narinfos"6287lb # [ 243.060786] niks3-server[1133]: 2026/09/22 10:49:00 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv6288lb # [ 243.069205] niks3-server[1133]: 2026/09/22 10:49:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6289lb # [ 243.073976] niks3-server[1133]: 2026/09/22 10:49:00 INFO Signed narinfos id=59 count=16290lb # [ 243.080579] niks3-server[1133]: 2026/09/22 10:49:00 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls6291lb # [ 243.084127] niks3-server[1133]: 2026/09/22 10:49:00 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6292lb # [ 243.087653] niks3-server[1133]: 2026/09/22 10:49:00 INFO Completed upload id=596293worker1 # [ 243.053705] nix-grpc-daemon[1804]: time=2026-09-22T10:49:00.336Z level=INFO msg="Upload complete. (355ms)"6294lb # [ 243.089948] niks3-server[1133]: 2026/09/22 10:49:00 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo6295worker1 # [ 243.073478] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37536 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=8 outputs=16296worker1 # [ 243.096442] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:00Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=16297worker1 # [ 243.101249] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375366298worker1 # [ 243.107664] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:00Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=06299worker1 # [ 243.113155] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:375366300worker1 # [ 243.116991] nix-daemon[921]: reaped child process 2041, status = succeeded6301worker1 # [ 243.121600] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:375366302worker1 # [ 243.131724] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6303worker1 # [ 243.332583] nix-daemon[921]: accepted connection from pid 2068, user nix-grpc-daemon (trusted)6304worker1 # [ 243.355839] nix-daemon[921]: reaped child process 2071, status = succeeded6305worker1 # [ 243.540137] nix-daemon[921]: accepted connection from pid 2073, user nix-grpc-daemon (trusted)6306worker1 # [ 243.559305] nix-daemon[921]: reaped child process 2076, status = succeeded6307lb # [ 243.606449] niks3-server[1133]: 2026/09/22 10:49:00 INFO Received uploads request method=POST path=/api/pending_closures6308worker1 # [ 243.582117] nix-grpc-daemon[1804]: time=2026-09-22T10:49:00.865Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6309worker1 # [ 243.583860] nix-grpc-daemon[1804]: time=2026-09-22T10:49:00.865Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"6310lb # [ 243.635359] niks3-server[1133]: 2026/09/22 10:49:00 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst6311lb # [ 243.652126] niks3-server[1133]: 2026/09/22 10:49:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6312worker1 # [ 243.623358] nix-grpc-daemon[1804]: time=2026-09-22T10:49:00.906Z level=INFO msg="Uploading 1 narinfos"6313lb # [ 243.664409] niks3-server[1133]: 2026/09/22 10:49:00 INFO Signed narinfos id=60 count=16314lb # [ 243.672519] niks3-server[1133]: 2026/09/22 10:49:00 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls6315lb # [ 243.680216] niks3-server[1133]: 2026/09/22 10:49:00 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6316lb # [ 243.687224] niks3-server[1133]: 2026/09/22 10:49:00 INFO Completed upload id=606317worker1 # [ 243.652597] nix-grpc-daemon[1804]: time=2026-09-22T10:49:00.935Z level=INFO msg="Upload complete. (509ms)"6318lb # [ 243.690584] niks3-server[1133]: 2026/09/22 10:49:00 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo6319worker1 # [ 243.660395] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37536 duration_s=0 paths=1 nar_bytes_in=5126320worker1 # [ 243.676381] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375366321worker1 # [ 243.683582] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6322worker1 # [ 243.689591] nix-daemon[921]: reaped child process 2066, status = succeeded6323worker1 # [ 243.706796] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6324worker1 # [ 244.753563] nix-daemon[921]: reaped child process 2080, status = succeeded6325worker1 # [ 244.935418] nix-daemon[921]: accepted connection from pid 2096, user nix-grpc-daemon (trusted)6326worker1 # [ 244.957748] nix-daemon[921]: reaped child process 2099, status = succeeded6327lb # [ 245.005192] niks3-server[1133]: 2026/09/22 10:49:02 INFO Received uploads request method=POST path=/api/pending_closures6328worker1 # [ 244.982428] nix-grpc-daemon[1804]: time=2026-09-22T10:49:02.265Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6329worker1 # [ 244.985477] nix-grpc-daemon[1804]: time=2026-09-22T10:49:02.267Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"6330lb # [ 245.045479] niks3-server[1133]: 2026/09/22 10:49:02 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv6331lb # [ 245.063302] niks3-server[1133]: 2026/09/22 10:49:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6332worker1 # [ 245.034153] nix-grpc-daemon[1804]: time=2026-09-22T10:49:02.317Z level=INFO msg="Uploading 1 narinfos"6333lb # [ 245.071985] niks3-server[1133]: 2026/09/22 10:49:02 INFO Signed narinfos id=61 count=16334lb # [ 245.077953] niks3-server[1133]: 2026/09/22 10:49:02 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6335lb # [ 245.086063] niks3-server[1133]: 2026/09/22 10:49:02 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls6336lb # [ 245.094586] niks3-server[1133]: 2026/09/22 10:49:02 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6337lb # [ 245.098990] niks3-server[1133]: 2026/09/22 10:49:02 INFO Completed upload id=616338worker1 # [ 245.064193] nix-grpc-daemon[1804]: time=2026-09-22T10:49:02.347Z level=INFO msg="Upload complete. (344ms)"6339lb # [ 245.102161] niks3-server[1133]: 2026/09/22 10:49:02 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo6340worker1 # [ 245.084939] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37536 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=9 outputs=16341worker1 # [ 245.100945] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:02Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=16342worker1 # [ 245.108226] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375366343worker1 # [ 245.111338] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:02Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=06344worker1 # [ 245.117659] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:375366345worker1 # [ 245.122013] nix-grpc-daemon[1804]: time=2026-09-22T10:49:02.404Z level=INFO msg="All 1 paths already cached"6346worker1 # [ 245.124551] nix-daemon[921]: reaped child process 2078, status = succeeded6347worker1 # [ 245.127861] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:375366348worker1 # [ 245.138643] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6349worker1 # [ 245.338587] nix-daemon[921]: accepted connection from pid 2105, user nix-grpc-daemon (trusted)6350worker1 # [ 245.362010] nix-daemon[921]: reaped child process 2108, status = succeeded6351worker1 # [ 245.543436] nix-daemon[921]: accepted connection from pid 2110, user nix-grpc-daemon (trusted)6352worker1 # [ 245.562735] nix-daemon[921]: reaped child process 2113, status = succeeded6353lb # [ 245.610079] niks3-server[1133]: 2026/09/22 10:49:02 INFO Received uploads request method=POST path=/api/pending_closures6354worker1 # [ 245.581645] nix-grpc-daemon[1804]: time=2026-09-22T10:49:02.864Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6355worker1 # [ 245.583190] nix-grpc-daemon[1804]: time=2026-09-22T10:49:02.864Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"6356lb # [ 245.628908] niks3-server[1133]: 2026/09/22 10:49:02 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst6357lb # [ 245.634944] niks3-server[1133]: 2026/09/22 10:49:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6358worker1 # [ 245.603793] nix-grpc-daemon[1804]: time=2026-09-22T10:49:02.886Z level=INFO msg="Uploading 1 narinfos"6359lb # [ 245.639543] niks3-server[1133]: 2026/09/22 10:49:02 INFO Signed narinfos id=62 count=16360lb # [ 245.643038] niks3-server[1133]: 2026/09/22 10:49:02 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls6361lb # [ 245.649314] niks3-server[1133]: 2026/09/22 10:49:02 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6362lb # [ 245.654560] niks3-server[1133]: 2026/09/22 10:49:02 INFO Completed upload id=626363worker1 # [ 245.619944] nix-grpc-daemon[1804]: time=2026-09-22T10:49:02.903Z level=INFO msg="Upload complete. (469ms)"6364lb # [ 245.656458] niks3-server[1133]: 2026/09/22 10:49:02 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo6365worker1 # [ 245.624100] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37536 duration_s=0 paths=1 nar_bytes_in=6246366worker1 # [ 245.635685] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375366367worker1 # [ 245.641739] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6368worker1 # [ 245.645670] nix-daemon[921]: reaped child process 2103, status = succeeded6369worker1 # [ 245.654330] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6370worker1 # [ 246.906477] nix-daemon[921]: reaped child process 2117, status = succeeded6371worker1 # [ 247.086048] nix-daemon[921]: accepted connection from pid 2133, user nix-grpc-daemon (trusted)6372worker1 # [ 247.108217] nix-daemon[921]: reaped child process 2136, status = succeeded6373lb # [ 247.157857] niks3-server[1133]: 2026/09/22 10:49:04 INFO Received uploads request method=POST path=/api/pending_closures6374worker1 # [ 247.131992] nix-grpc-daemon[1804]: time=2026-09-22T10:49:04.414Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6375worker1 # [ 247.137541] nix-grpc-daemon[1804]: time=2026-09-22T10:49:04.417Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"6376lb # [ 247.196182] niks3-server[1133]: 2026/09/22 10:49:04 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst6377lb # [ 247.215808] niks3-server[1133]: 2026/09/22 10:49:04 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv6378lb # [ 247.224516] niks3-server[1133]: 2026/09/22 10:49:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6379worker1 # [ 247.195262] nix-grpc-daemon[1804]: time=2026-09-22T10:49:04.478Z level=INFO msg="Uploading 1 narinfos"6380lb # [ 247.232634] niks3-server[1133]: 2026/09/22 10:49:04 INFO Signed narinfos id=63 count=16381lb # [ 247.237367] niks3-server[1133]: 2026/09/22 10:49:04 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls6382lb # [ 247.244887] niks3-server[1133]: 2026/09/22 10:49:04 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6383worker1 # [ 247.216381] nix-grpc-daemon[1804]: time=2026-09-22T10:49:04.499Z level=INFO msg="Upload complete. (350ms)"6384lb # [ 247.251066] niks3-server[1133]: 2026/09/22 10:49:04 INFO Completed upload id=636385lb # [ 247.254583] niks3-server[1133]: 2026/09/22 10:49:04 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo6386worker1 # [ 247.225633] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37536 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=10 outputs=16387worker1 # [ 247.232215] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:04Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=16388worker1 # [ 247.240609] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375366389worker1 # [ 247.242426] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:04Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=06390worker1 # [ 247.245419] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:375366391worker1 # [ 247.247436] nix-daemon[921]: reaped child process 2115, status = succeeded6392worker1 # [ 247.252796] nix-grpc-daemon[1804]: time=2026-09-22T10:49:04.536Z level=INFO msg="All 1 paths already cached"6393worker1 # [ 247.258678] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:375366394worker1 # [ 247.269020] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6395worker1 # [ 247.445092] nix-daemon[921]: accepted connection from pid 2142, user nix-grpc-daemon (trusted)6396worker1 # [ 247.465746] nix-daemon[921]: reaped child process 2145, status = succeeded6397worker1 # [ 247.639526] nix-daemon[921]: accepted connection from pid 2147, user nix-grpc-daemon (trusted)6398worker1 # [ 247.662604] nix-daemon[921]: reaped child process 2150, status = succeeded6399lb # [ 247.705214] niks3-server[1133]: 2026/09/22 10:49:04 INFO Received uploads request method=POST path=/api/pending_closures6400worker1 # [ 247.681958] nix-grpc-daemon[1804]: time=2026-09-22T10:49:04.964Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6401worker1 # [ 247.683516] nix-grpc-daemon[1804]: time=2026-09-22T10:49:04.964Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"6402lb # [ 247.738665] niks3-server[1133]: 2026/09/22 10:49:04 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst6403worker1 # [ 247.717223] nix-grpc-daemon[1804]: time=2026-09-22T10:49:05.000Z level=INFO msg="Uploading 1 narinfos"6404lb # [ 247.755229] niks3-server[1133]: 2026/09/22 10:49:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6405lb # [ 247.765236] niks3-server[1133]: 2026/09/22 10:49:04 INFO Signed narinfos id=64 count=16406lb # [ 247.771144] niks3-server[1133]: 2026/09/22 10:49:04 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls6407worker1 # [ 247.745963] nix-grpc-daemon[1804]: time=2026-09-22T10:49:05.029Z level=INFO msg="Upload complete. (468ms)"6408lb # [ 247.780592] niks3-server[1133]: 2026/09/22 10:49:05 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6409worker1 # [ 247.750515] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37536 duration_s=0 paths=1 nar_bytes_in=6246410lb # [ 247.785665] niks3-server[1133]: 2026/09/22 10:49:05 INFO Completed upload id=646411worker1 # [ 247.755207] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375366412lb # [ 247.789030] niks3-server[1133]: 2026/09/22 10:49:05 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo6413worker1 # [ 247.764186] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6414worker1 # [ 247.767210] nix-daemon[921]: reaped child process 2140, status = succeeded6415worker1 # [ 247.774889] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6416worker1 # [ 248.606739] nix-daemon[921]: reaped child process 2154, status = succeeded6417worker1 # [ 248.789594] nix-daemon[921]: accepted connection from pid 2170, user nix-grpc-daemon (trusted)6418worker1 # [ 248.812710] nix-daemon[921]: reaped child process 2173, status = succeeded6419lb # [ 248.861390] niks3-server[1133]: 2026/09/22 10:49:06 INFO Received uploads request method=POST path=/api/pending_closures6420worker1 # [ 248.840164] nix-grpc-daemon[1804]: time=2026-09-22T10:49:06.121Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6421worker1 # [ 248.841814] nix-grpc-daemon[1804]: time=2026-09-22T10:49:06.122Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"6422lb # [ 248.914459] niks3-server[1133]: 2026/09/22 10:49:06 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst6423worker1 # [ 248.891523] nix-grpc-daemon[1804]: time=2026-09-22T10:49:06.174Z level=INFO msg="Uploading 1 narinfos"6424lb # [ 248.930405] niks3-server[1133]: 2026/09/22 10:49:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6425lb # [ 248.939000] niks3-server[1133]: 2026/09/22 10:49:06 INFO Signed narinfos id=65 count=16426lb # [ 248.944094] niks3-server[1133]: 2026/09/22 10:49:06 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv6427lb # [ 248.947484] niks3-server[1133]: 2026/09/22 10:49:06 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls6428lb # [ 248.955856] niks3-server[1133]: 2026/09/22 10:49:06 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6429lb # [ 248.962476] niks3-server[1133]: 2026/09/22 10:49:06 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo6430worker1 # [ 248.931935] nix-grpc-daemon[1804]: time=2026-09-22T10:49:06.215Z level=INFO msg="Upload complete. (345ms)"6431lb # [ 248.966495] niks3-server[1133]: 2026/09/22 10:49:06 INFO Completed upload id=656432worker1 # [ 248.940521] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37536 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=11 outputs=16433worker1 # [ 248.943150] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:06Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=16434worker1 # [ 248.952779] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375366435worker1 # [ 248.955498] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:06Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=06436worker1 # [ 248.961626] nix-daemon[921]: reaped child process 2152, status = succeeded6437worker1 # [ 248.964505] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:375366438worker1 # [ 248.974935] nix-grpc-daemon[1804]: time=2026-09-22T10:49:06.258Z level=INFO msg="All 1 paths already cached"6439worker1 # [ 248.980194] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:375366440worker1 # [ 248.989661] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6441worker1 # [ 249.204243] nix-daemon[921]: accepted connection from pid 2179, user nix-grpc-daemon (trusted)6442worker1 # [ 249.232813] nix-daemon[921]: reaped child process 2182, status = succeeded6443worker1 # [ 249.432065] nix-daemon[921]: accepted connection from pid 2184, user nix-grpc-daemon (trusted)6444worker1 # [ 249.454695] nix-daemon[921]: reaped child process 2187, status = succeeded6445lb # [ 249.501720] niks3-server[1133]: 2026/09/22 10:49:06 INFO Received uploads request method=POST path=/api/pending_closures6446worker1 # [ 249.478624] nix-grpc-daemon[1804]: time=2026-09-22T10:49:06.761Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6447worker1 # [ 249.480540] nix-grpc-daemon[1804]: time=2026-09-22T10:49:06.761Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"6448lb # [ 249.543347] niks3-server[1133]: 2026/09/22 10:49:06 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst6449worker1 # [ 249.523959] nix-grpc-daemon[1804]: time=2026-09-22T10:49:06.806Z level=INFO msg="Uploading 1 narinfos"6450lb # [ 249.563193] niks3-server[1133]: 2026/09/22 10:49:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6451lb # [ 249.574336] niks3-server[1133]: 2026/09/22 10:49:06 INFO Signed narinfos id=66 count=16452lb # [ 249.580098] niks3-server[1133]: 2026/09/22 10:49:06 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls6453lb # [ 249.592190] niks3-server[1133]: 2026/09/22 10:49:06 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6454worker1 # [ 249.568394] nix-grpc-daemon[1804]: time=2026-09-22T10:49:06.851Z level=INFO msg="Upload complete. (568ms)"6455lb # [ 249.602920] niks3-server[1133]: 2026/09/22 10:49:06 INFO Completed upload id=666456lb # [ 249.607123] niks3-server[1133]: 2026/09/22 10:49:06 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo6457worker1 # [ 249.576128] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37536 duration_s=0 paths=1 nar_bytes_in=6246458worker1 # [ 249.579416] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375366459worker1 # [ 249.588522] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6460worker1 # [ 249.593729] nix-daemon[921]: reaped child process 2177, status = succeeded6461worker1 # [ 249.604151] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6462worker1 # [ 250.836760] nix-daemon[921]: reaped child process 2191, status = succeeded6463worker1 # [ 251.013693] nix-daemon[921]: accepted connection from pid 2207, user nix-grpc-daemon (trusted)6464worker1 # [ 251.034770] nix-daemon[921]: reaped child process 2210, status = succeeded6465lb # [ 251.081553] niks3-server[1133]: 2026/09/22 10:49:08 INFO Received uploads request method=POST path=/api/pending_closures6466worker1 # [ 251.058735] nix-grpc-daemon[1804]: time=2026-09-22T10:49:08.340Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6467worker1 # [ 251.061098] nix-grpc-daemon[1804]: time=2026-09-22T10:49:08.340Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"6468lb # [ 251.117032] niks3-server[1133]: 2026/09/22 10:49:08 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst6469lb # [ 251.132123] niks3-server[1133]: 2026/09/22 10:49:08 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv6470lb # [ 251.143463] niks3-server[1133]: 2026/09/22 10:49:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6471worker1 # [ 251.114457] nix-grpc-daemon[1804]: time=2026-09-22T10:49:08.397Z level=INFO msg="Uploading 1 narinfos"6472lb # [ 251.150513] niks3-server[1133]: 2026/09/22 10:49:08 INFO Signed narinfos id=67 count=16473lb # [ 251.156275] niks3-server[1133]: 2026/09/22 10:49:08 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls6474lb # [ 251.167252] niks3-server[1133]: 2026/09/22 10:49:08 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6475lb # [ 251.173742] niks3-server[1133]: 2026/09/22 10:49:08 INFO Completed upload id=676476worker1 # [ 251.138895] nix-grpc-daemon[1804]: time=2026-09-22T10:49:08.422Z level=INFO msg="Upload complete. (325ms)"6477lb # [ 251.176966] niks3-server[1133]: 2026/09/22 10:49:08 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo6478worker1 # [ 251.159429] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37536 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=12 outputs=16479worker1 # [ 251.176627] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:08Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=16480worker1 # [ 251.188376] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375366481worker1 # [ 251.195691] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:08Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=06482worker1 # [ 251.200928] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:375366483worker1 # [ 251.205702] nix-daemon[921]: reaped child process 2189, status = succeeded6484worker1 # [ 251.209236] nix-grpc-daemon[1804]: time=2026-09-22T10:49:08.483Z level=INFO msg="All 2 paths already cached"6485worker1 # [ 251.218911] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:375366486worker1 # [ 251.226811] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6487worker1 # [ 251.414210] nix-daemon[921]: accepted connection from pid 2216, user nix-grpc-daemon (trusted)6488worker1 # [ 251.435598] nix-daemon[921]: reaped child process 2219, status = succeeded6489worker1 # [ 251.621414] nix-daemon[921]: accepted connection from pid 2221, user nix-grpc-daemon (trusted)6490worker1 # [ 251.641789] nix-daemon[921]: reaped child process 2224, status = succeeded6491lb # [ 251.690157] niks3-server[1133]: 2026/09/22 10:49:08 INFO Received uploads request method=POST path=/api/pending_closures6492worker1 # [ 251.666186] nix-grpc-daemon[1804]: time=2026-09-22T10:49:08.949Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6493worker1 # [ 251.668215] nix-grpc-daemon[1804]: time=2026-09-22T10:49:08.951Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"6494lb # [ 251.722382] niks3-server[1133]: 2026/09/22 10:49:08 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst6495lb # [ 251.734656] niks3-server[1133]: 2026/09/22 10:49:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6496worker1 # [ 251.706521] nix-grpc-daemon[1804]: time=2026-09-22T10:49:08.989Z level=INFO msg="Uploading 1 narinfos"6497lb # [ 251.747229] niks3-server[1133]: 2026/09/22 10:49:08 INFO Signed narinfos id=68 count=16498lb # [ 251.754467] niks3-server[1133]: 2026/09/22 10:49:08 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls6499lb # [ 251.765523] niks3-server[1133]: 2026/09/22 10:49:08 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6500lb # [ 251.775491] niks3-server[1133]: 2026/09/22 10:49:09 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo6501lb # [ 251.780738] niks3-server[1133]: 2026/09/22 10:49:09 INFO Completed upload id=686502worker1 # [ 251.746713] nix-grpc-daemon[1804]: time=2026-09-22T10:49:09.029Z level=INFO msg="Upload complete. (513ms)"6503worker1 # [ 251.757202] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37536 duration_s=0 paths=1 nar_bytes_in=7526504worker1 # [ 251.772337] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375366505worker1 # [ 251.786626] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6506worker1 # [ 251.795377] nix-daemon[921]: reaped child process 2214, status = succeeded6507worker1 # [ 251.802672] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6508worker1 # [ 253.058419] nix-daemon[921]: reaped child process 2228, status = succeeded6509worker1 # [ 253.243372] nix-daemon[921]: accepted connection from pid 2244, user nix-grpc-daemon (trusted)6510worker1 # [ 253.264931] nix-daemon[921]: reaped child process 2247, status = succeeded6511lb # [ 253.313933] niks3-server[1133]: 2026/09/22 10:49:10 INFO Received uploads request method=POST path=/api/pending_closures6512worker1 # [ 253.288451] nix-grpc-daemon[1804]: time=2026-09-22T10:49:10.570Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6513worker1 # [ 253.290088] nix-grpc-daemon[1804]: time=2026-09-22T10:49:10.570Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"6514lb # [ 253.351027] niks3-server[1133]: 2026/09/22 10:49:10 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv6515lb # [ 253.365769] niks3-server[1133]: 2026/09/22 10:49:10 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst6516lb # [ 253.376339] niks3-server[1133]: 2026/09/22 10:49:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6517worker1 # [ 253.347778] nix-grpc-daemon[1804]: time=2026-09-22T10:49:10.630Z level=INFO msg="Uploading 1 narinfos"6518lb # [ 253.383591] niks3-server[1133]: 2026/09/22 10:49:10 INFO Signed narinfos id=69 count=16519lb # [ 253.389515] niks3-server[1133]: 2026/09/22 10:49:10 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls6520lb # [ 253.399664] niks3-server[1133]: 2026/09/22 10:49:10 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6521worker1 # [ 253.370885] nix-grpc-daemon[1804]: time=2026-09-22T10:49:10.654Z level=INFO msg="Upload complete. (353ms)"6522lb # [ 253.407088] niks3-server[1133]: 2026/09/22 10:49:10 INFO Completed upload id=696523lb # [ 253.409803] niks3-server[1133]: 2026/09/22 10:49:10 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo6524worker1 # [ 253.385231] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37536 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=13 outputs=16525worker1 # [ 253.403006] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:10Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=16526worker1 # [ 253.408283] nix-daemon[921]: reaped child process 2226, status = succeeded6527worker1 # [ 253.426357] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375366528worker1 # [ 253.442206] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:375366529worker1 # [ 253.457532] nix-grpc-daemon[1804]: time=2026-09-22T10:49:10.740Z level=INFO msg="All 2 paths already cached"6530worker1 # [ 253.467214] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:375366531worker1 # [ 253.481077] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6532worker1 # [ 253.681069] nix-daemon[921]: accepted connection from pid 2251, user nix-grpc-daemon (trusted)6533worker1 # [ 253.701859] nix-daemon[921]: reaped child process 2254, status = succeeded6534worker1 # [ 253.884343] nix-daemon[921]: accepted connection from pid 2256, user nix-grpc-daemon (trusted)6535worker1 # [ 253.904142] nix-daemon[921]: reaped child process 2259, status = succeeded6536lb # [ 253.952048] niks3-server[1133]: 2026/09/22 10:49:11 INFO Received uploads request method=POST path=/api/pending_closures6537worker1 # [ 253.927212] nix-grpc-daemon[1804]: time=2026-09-22T10:49:11.210Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6538worker1 # [ 253.928896] nix-grpc-daemon[1804]: time=2026-09-22T10:49:11.210Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"6539lb # [ 253.981012] niks3-server[1133]: 2026/09/22 10:49:11 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst6540lb # [ 253.997779] niks3-server[1133]: 2026/09/22 10:49:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/70/sign6541worker1 # [ 253.969424] nix-grpc-daemon[1804]: time=2026-09-22T10:49:11.252Z level=INFO msg="Uploading 1 narinfos"6542lb # [ 254.009544] niks3-server[1133]: 2026/09/22 10:49:11 INFO Signed narinfos id=70 count=16543lb # [ 254.015830] niks3-server[1133]: 2026/09/22 10:49:11 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls6544worker1 # [ 253.989038] nix-grpc-daemon[1804]: time=2026-09-22T10:49:11.272Z level=INFO msg="Upload complete. (492ms)"6545lb # [ 254.024892] niks3-server[1133]: 2026/09/22 10:49:11 INFO Received complete upload request method=POST path=/api/pending_closures/70/complete6546lb # [ 254.030081] niks3-server[1133]: 2026/09/22 10:49:11 INFO Completed upload id=706547lb # [ 254.033358] niks3-server[1133]: 2026/09/22 10:49:11 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo6548worker1 # [ 253.999811] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37536 duration_s=0 paths=1 nar_bytes_in=7526549worker1 # [ 254.010418] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375366550worker1 # [ 254.016964] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6551worker1 # [ 254.021805] nix-daemon[921]: reaped child process 2249, status = succeeded6552worker1 # [ 254.034743] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6553worker1 # [ 255.472853] nix-daemon[921]: reaped child process 2263, status = succeeded6554worker1 # [ 255.652684] nix-daemon[921]: accepted connection from pid 2279, user nix-grpc-daemon (trusted)6555worker1 # [ 255.673243] nix-daemon[921]: reaped child process 2282, status = succeeded6556lb # [ 255.722093] niks3-server[1133]: 2026/09/22 10:49:12 INFO Received uploads request method=POST path=/api/pending_closures6557worker1 # [ 255.697693] nix-grpc-daemon[1804]: time=2026-09-22T10:49:12.978Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6558worker1 # [ 255.699267] nix-grpc-daemon[1804]: time=2026-09-22T10:49:12.978Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"6559lb # [ 255.771163] niks3-server[1133]: 2026/09/22 10:49:12 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst6560lb # [ 255.779183] niks3-server[1133]: 2026/09/22 10:49:13 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv6561worker1 # [ 255.752585] nix-grpc-daemon[1804]: time=2026-09-22T10:49:13.035Z level=INFO msg="Uploading 1 narinfos"6562lb # [ 255.789795] niks3-server[1133]: 2026/09/22 10:49:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/71/sign6563lb # [ 255.800239] niks3-server[1133]: 2026/09/22 10:49:13 INFO Signed narinfos id=71 count=16564lb # [ 255.803284] niks3-server[1133]: 2026/09/22 10:49:13 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls6565lb # [ 255.815446] niks3-server[1133]: 2026/09/22 10:49:13 INFO Received complete upload request method=POST path=/api/pending_closures/71/complete6566lb # [ 255.821451] niks3-server[1133]: 2026/09/22 10:49:13 INFO Completed upload id=716567worker1 # [ 255.786554] nix-grpc-daemon[1804]: time=2026-09-22T10:49:13.069Z level=INFO msg="Upload complete. (341ms)"6568lb # [ 255.824814] niks3-server[1133]: 2026/09/22 10:49:13 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo6569worker1 # [ 255.801322] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37536 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=14 outputs=16570worker1 # [ 255.818562] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:13Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=16571worker1 # [ 255.823376] nix-daemon[921]: reaped child process 2261, status = succeeded6572worker1 # [ 255.843751] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375366573worker1 # [ 255.860122] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:375366574worker1 # [ 255.875906] nix-grpc-daemon[1804]: time=2026-09-22T10:49:13.159Z level=INFO msg="All 2 paths already cached"6575worker1 # [ 255.882355] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:375366576worker1 # [ 255.897968] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6577worker1 # [ 256.113729] nix-daemon[921]: accepted connection from pid 2286, user nix-grpc-daemon (trusted)6578worker1 # [ 256.134686] nix-daemon[921]: reaped child process 2289, status = succeeded6579worker1 # [ 256.320119] nix-daemon[921]: accepted connection from pid 2291, user nix-grpc-daemon (trusted)6580worker1 # [ 256.339461] nix-daemon[921]: reaped child process 2294, status = succeeded6581lb # [ 256.391204] niks3-server[1133]: 2026/09/22 10:49:13 INFO Received uploads request method=POST path=/api/pending_closures6582worker1 # [ 256.368154] nix-grpc-daemon[1804]: time=2026-09-22T10:49:13.651Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6583worker1 # [ 256.369746] nix-grpc-daemon[1804]: time=2026-09-22T10:49:13.651Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"6584lb # [ 256.426854] niks3-server[1133]: 2026/09/22 10:49:13 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst6585lb # [ 256.443066] niks3-server[1133]: 2026/09/22 10:49:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/72/sign6586worker1 # [ 256.415936] nix-grpc-daemon[1804]: time=2026-09-22T10:49:13.698Z level=INFO msg="Uploading 1 narinfos"6587lb # [ 256.456224] niks3-server[1133]: 2026/09/22 10:49:13 INFO Signed narinfos id=72 count=16588lb # [ 256.458848] niks3-server[1133]: 2026/09/22 10:49:13 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls6589lb # [ 256.468353] niks3-server[1133]: 2026/09/22 10:49:13 INFO Received complete upload request method=POST path=/api/pending_closures/72/complete6590worker1 # [ 256.439936] nix-grpc-daemon[1804]: time=2026-09-22T10:49:13.723Z level=INFO msg="Upload complete. (524ms)"6591lb # [ 256.475866] niks3-server[1133]: 2026/09/22 10:49:13 INFO Completed upload id=726592worker1 # [ 256.444125] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37536 duration_s=0 paths=1 nar_bytes_in=7526593lb # [ 256.479588] niks3-server[1133]: 2026/09/22 10:49:13 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo6594worker1 # [ 256.449838] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375366595worker1 # [ 256.458521] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6596worker1 # [ 256.461866] nix-daemon[921]: reaped child process 2284, status = succeeded6597worker1 # [ 256.471591] nix-daemon[921]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6598worker1 # [ 257.090211] nix-daemon[921]: reaped child process 2298, status = succeeded6599worker1 # [ 257.249867] nix-daemon[921]: accepted connection from pid 2314, user nix-grpc-daemon (trusted)6600worker1 # [ 257.271623] nix-daemon[921]: reaped child process 2317, status = succeeded6601lb # [ 257.321011] niks3-server[1133]: 2026/09/22 10:49:14 INFO Received uploads request method=POST path=/api/pending_closures6602worker1 # [ 257.298418] nix-grpc-daemon[1804]: time=2026-09-22T10:49:14.580Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6603worker1 # [ 257.299947] nix-grpc-daemon[1804]: time=2026-09-22T10:49:14.580Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"6604lb # [ 257.360992] niks3-server[1133]: 2026/09/22 10:49:14 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv6605lb # [ 257.374709] niks3-server[1133]: 2026/09/22 10:49:14 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst6606lb # [ 257.387467] niks3-server[1133]: 2026/09/22 10:49:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/73/sign6607worker1 # [ 257.358008] nix-grpc-daemon[1804]: time=2026-09-22T10:49:14.640Z level=INFO msg="Uploading 1 narinfos"6608lb # [ 257.394152] niks3-server[1133]: 2026/09/22 10:49:14 INFO Signed narinfos id=73 count=16609lb # [ 257.399183] niks3-server[1133]: 2026/09/22 10:49:14 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls6610lb # [ 257.408133] niks3-server[1133]: 2026/09/22 10:49:14 INFO Received complete upload request method=POST path=/api/pending_closures/73/complete6611lb # [ 257.413354] niks3-server[1133]: 2026/09/22 10:49:14 INFO Completed upload id=736612worker1 # [ 257.378892] nix-grpc-daemon[1804]: time=2026-09-22T10:49:14.662Z level=INFO msg="Upload complete. (300ms)"6613lb # [ 257.415724] niks3-server[1133]: 2026/09/22 10:49:14 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo6614worker1 # [ 257.393182] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37536 duration_s=0 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=15 outputs=16615worker1 # [ 257.409427] nix-daemon[921]: reaped child process 2296, status = succeeded6616client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 19.61 seconds)6617worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6618worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)6619client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]'6620client # [ 257.615116] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features "[\"gpu\"]".6621client # Running as unit: gpu.service; invocation ID: 1a612397f5b542828755542f9eac78e86622client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.09 seconds)6623lb: must succeed: curl -sf localhost:9901/clusters6624lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6625lb: must succeed: curl -sf localhost:9901/clusters6626lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6627worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6628worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)6629worker2 # [ 257.926453] nix-grpc-daemon[1952]: ts=2026-09-22T10:49:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:397606630client # [ 257.889387] nix[1477]: don't know how to build these paths:6631client # [ 257.890528] nix[1477]: /nix/store/3i1nziwpdqq19lzpqy4rywzxnm8dlps6-farm-top.drv6632worker1 # [ 257.905053] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:375366633client # [ 257.919221] nix[1477]: warning: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, waiting up to 30s for a worker6634worker1 # [ 257.929028] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:15Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=06635lb: must succeed: curl -sf localhost:9901/clusters6636lb # [ 258.965459] envoy[961]: conn peer=[2001:db8:1::1]:54250 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27105 tx=11406 ms=192746637lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)6638lb: must succeed: curl -sf localhost:9901/clusters6639lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)6640worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6641worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)6642client: waiting for success: systemctl show -p Result gpu | grep -q exit-code6643client # [ 287.922068] nix[1477]: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}6644client # [ 287.935173] nix[1477]: error: dependency '1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv' failed6645client # [ 287.998811] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE6646client # [ 288.006398] systemd[1]: gpu.service: Failed with result 'exit-code'.6647client # [ 288.012440] systemd[1]: gpu.service: Consumed 199ms CPU time over 30.389s wall clock time, 35.4M memory peak, 5.1K incoming IP traffic, 5K outgoing IP traffic.6648client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.33 seconds)6649client: must succeed: journalctl -u gpu -o cat6650client: (finished: must succeed: journalctl -u gpu -o cat, in 0.04 seconds)6651lb: must succeed: curl -sf localhost:9901/clusters6652lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)6653lb: must succeed: curl -sf localhost:9901/clusters6654lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)6655worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6656worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.12 seconds)6657(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 50.92 seconds)6658subtest: low disk drains a worker and builds go to the other6659worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6660lb # [ 288.969279] envoy[961]: conn peer=[2001:db8:1::1]:57014 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=499 ms=300756661worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.27 seconds)6662worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6663worker1 # [ 290.533400] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:47Z level=info event=unhealthy reason=min_free6664worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.14 seconds)6665client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&26666worker1 # [ 291.468898] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:375366667client # don't know how to build these paths:6668client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6669worker1 # [ 291.479358] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:375366670worker1 # [ 291.513734] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:48Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=06671worker1 # [ 291.519505] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:48Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=16672worker2 # [ 291.601613] nix-grpc-daemon[1952]: ts=2026-09-22T10:49:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:397606673worker2 # [ 291.620436] nix-grpc-daemon[1952]: ts=2026-09-22T10:49:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:397606674client # copying 1 paths to 'lb:50051'...6675client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...6676worker2 # [ 291.636101] nix-grpc-daemon[1952]: ts=2026-09-22T10:49:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:397606677worker2 # [ 291.657906] nix-daemon[947]: accepted connection from pid 1952, user nix-grpc-daemon (trusted)6678worker2 # [ 291.691292] nix-grpc-daemon[1952]: ts=2026-09-22T10:49:48Z level=info event=niks3_push_started pid=20126679worker2 # [ 291.913013] nix-grpc-daemon[2012]: time=2026-09-22T10:49:49.180Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca=""6680worker2 # [ 292.088534] nix-daemon[947]: accepted connection from pid 2025, user nix-grpc-daemon (trusted)6681worker2 # [ 292.107271] nix-daemon[947]: reaped child process 2028, status = succeeded6682worker2 # [ 292.283561] nix-daemon[947]: accepted connection from pid 2030, user nix-grpc-daemon (trusted)6683worker2 # [ 292.301449] nix-daemon[947]: reaped child process 2033, status = succeeded6684lb # [ 292.317093] niks3-server[1133]: 2026/09/22 10:49:49 INFO Received uploads request method=POST path=/api/pending_closures6685worker2 # [ 292.333102] nix-grpc-daemon[2012]: time=2026-09-22T10:49:49.599Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6686worker2 # [ 292.334658] nix-grpc-daemon[2012]: time=2026-09-22T10:49:49.599Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6687lb # [ 292.365504] niks3-server[1133]: 2026/09/22 10:49:49 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6688worker2 # [ 292.383029] nix-grpc-daemon[2012]: time=2026-09-22T10:49:49.650Z level=INFO msg="Uploading 1 narinfos"6689lb # [ 292.381850] niks3-server[1133]: 2026/09/22 10:49:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/74/sign6690lb # [ 292.390600] niks3-server[1133]: 2026/09/22 10:49:49 INFO Signed narinfos id=74 count=16691lb # [ 292.397993] niks3-server[1133]: 2026/09/22 10:49:49 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6692lb # [ 292.407909] niks3-server[1133]: 2026/09/22 10:49:49 INFO Received complete upload request method=POST path=/api/pending_closures/74/complete6693lb # [ 292.421300] niks3-server[1133]: 2026/09/22 10:49:49 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6694lb # [ 292.426484] niks3-server[1133]: 2026/09/22 10:49:49 INFO Completed upload id=746695worker2 # [ 292.427066] nix-grpc-daemon[2012]: time=2026-09-22T10:49:49.695Z level=INFO msg="Upload complete. (509ms)"6696worker2 # [ 292.438475] nix-grpc-daemon[1952]: ts=2026-09-22T10:49:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39760 duration_s=0 paths=1 nar_bytes_in=5126697worker2 # [ 292.459476] nix-grpc-daemon[1952]: ts=2026-09-22T10:49:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:397606698worker2 # [ 292.471377] nix-daemon[947]: accepted connection from pid 1952, user nix-grpc-daemon (trusted)6699worker2 # [ 292.481251] nix-daemon[947]: reaped child process 2010, status = succeeded6700client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6701client # farm-a> worker2-next: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6702worker2 # [ 292.490753] nix-daemon[947]: accepted connection from pid 1952, user nix-grpc-daemon (trusted)6703client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds6704client # farm-a> LOG-farm-a-drain6705worker2 # [ 293.738375] nix-daemon[947]: reaped child process 2037, status = succeeded6706worker2 # [ 293.916579] nix-daemon[947]: accepted connection from pid 2053, user nix-grpc-daemon (trusted)6707worker2 # [ 293.935777] nix-daemon[947]: reaped child process 2056, status = succeeded6708lb # [ 293.948904] niks3-server[1133]: 2026/09/22 10:49:51 INFO Received uploads request method=POST path=/api/pending_closures6709worker2 # [ 293.960949] nix-grpc-daemon[2012]: time=2026-09-22T10:49:51.228Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6710worker2 # [ 293.966790] nix-grpc-daemon[2012]: time=2026-09-22T10:49:51.231Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6711lb # [ 293.986990] niks3-server[1133]: 2026/09/22 10:49:51 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6712worker2 # [ 294.010634] nix-grpc-daemon[2012]: time=2026-09-22T10:49:51.277Z level=INFO msg="Uploading 1 narinfos"6713lb # [ 294.005822] niks3-server[1133]: 2026/09/22 10:49:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/75/sign6714lb # [ 294.015943] niks3-server[1133]: 2026/09/22 10:49:51 INFO Signed narinfos id=75 count=16715lb # [ 294.019834] niks3-server[1133]: 2026/09/22 10:49:51 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6716lb # [ 294.028706] niks3-server[1133]: 2026/09/22 10:49:51 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6717lb # [ 294.031158] niks3-server[1133]: 2026/09/22 10:49:51 INFO Received complete upload request method=POST path=/api/pending_closures/75/complete6718lb # [ 294.037280] niks3-server[1133]: 2026/09/22 10:49:51 INFO Completed upload id=756719worker2 # [ 294.036469] nix-grpc-daemon[2012]: time=2026-09-22T10:49:51.304Z level=INFO msg="Upload complete. (333ms)"6720lb # [ 294.039345] niks3-server[1133]: 2026/09/22 10:49:51 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6721worker2 # [ 294.048873] nix-grpc-daemon[1952]: ts=2026-09-22T10:49:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39760 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=16 outputs=16722worker1 # [ 294.018400] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:51Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06723worker1 # [ 294.024517] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:51Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16724worker2 # [ 294.064911] nix-daemon[947]: reaped child process 2035, status = succeeded6725worker2 # [ 294.096388] nix-grpc-daemon[1952]: ts=2026-09-22T10:49:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:397606726worker2 # [ 294.112446] nix-grpc-daemon[1952]: ts=2026-09-22T10:49:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:397606727worker2 # [ 294.127287] nix-grpc-daemon[2012]: time=2026-09-22T10:49:51.395Z level=INFO msg="All 1 paths already cached"6728client # copying 1 paths to 'lb:50051'...6729client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6730worker2 # [ 294.137949] nix-grpc-daemon[1952]: ts=2026-09-22T10:49:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:397606731worker2 # [ 294.152132] nix-daemon[947]: accepted connection from pid 1952, user nix-grpc-daemon (trusted)6732worker2 # [ 294.363807] nix-daemon[947]: accepted connection from pid 2060, user nix-grpc-daemon (trusted)6733worker2 # [ 294.382283] nix-daemon[947]: reaped child process 2063, status = succeeded6734worker2 # [ 294.558681] nix-daemon[947]: accepted connection from pid 2065, user nix-grpc-daemon (trusted)6735worker2 # [ 294.575975] nix-daemon[947]: reaped child process 2068, status = succeeded6736lb # [ 294.587358] niks3-server[1133]: 2026/09/22 10:49:51 INFO Received uploads request method=POST path=/api/pending_closures6737worker2 # [ 294.597267] nix-grpc-daemon[2012]: time=2026-09-22T10:49:51.865Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6738worker2 # [ 294.598804] nix-grpc-daemon[2012]: time=2026-09-22T10:49:51.865Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6739lb # [ 294.613058] niks3-server[1133]: 2026/09/22 10:49:51 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6740lb # [ 294.627547] niks3-server[1133]: 2026/09/22 10:49:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/76/sign6741worker2 # [ 294.633662] nix-grpc-daemon[2012]: time=2026-09-22T10:49:51.901Z level=INFO msg="Uploading 1 narinfos"6742lb # [ 294.640390] niks3-server[1133]: 2026/09/22 10:49:51 INFO Signed narinfos id=76 count=16743lb # [ 294.647103] niks3-server[1133]: 2026/09/22 10:49:51 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6744lb # [ 294.656822] niks3-server[1133]: 2026/09/22 10:49:51 INFO Received complete upload request method=POST path=/api/pending_closures/76/complete6745lb # [ 294.661350] niks3-server[1133]: 2026/09/22 10:49:51 INFO Completed upload id=766746worker2 # [ 294.661721] nix-grpc-daemon[2012]: time=2026-09-22T10:49:51.929Z level=INFO msg="Upload complete. (493ms)"6747lb # [ 294.663944] niks3-server[1133]: 2026/09/22 10:49:51 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6748worker2 # [ 294.668273] nix-grpc-daemon[1952]: ts=2026-09-22T10:49:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39760 duration_s=0 paths=1 nar_bytes_in=6326749worker2 # [ 294.682062] nix-grpc-daemon[1952]: ts=2026-09-22T10:49:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:397606750worker2 # [ 294.689160] nix-daemon[947]: accepted connection from pid 1952, user nix-grpc-daemon (trusted)6751worker2 # [ 294.693823] nix-daemon[947]: reaped child process 2058, status = succeeded6752client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6753client # farm-b> worker2-next: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6754worker2 # [ 294.707843] nix-daemon[947]: accepted connection from pid 1952, user nix-grpc-daemon (trusted)6755client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds6756client # farm-b> LOG-farm-b-drain6757worker2 # [ 295.938121] nix-daemon[947]: reaped child process 2072, status = succeeded6758worker2 # [ 296.111814] nix-daemon[947]: accepted connection from pid 2088, user nix-grpc-daemon (trusted)6759worker2 # [ 296.130600] nix-daemon[947]: reaped child process 2091, status = succeeded6760lb # [ 296.145022] niks3-server[1133]: 2026/09/22 10:49:53 INFO Received uploads request method=POST path=/api/pending_closures6761worker2 # [ 296.155872] nix-grpc-daemon[2012]: time=2026-09-22T10:49:53.423Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6762worker2 # [ 296.157532] nix-grpc-daemon[2012]: time=2026-09-22T10:49:53.423Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6763lb # [ 296.177729] niks3-server[1133]: 2026/09/22 10:49:53 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6764lb # [ 296.192223] niks3-server[1133]: 2026/09/22 10:49:53 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6765lb # [ 296.200193] niks3-server[1133]: 2026/09/22 10:49:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/77/sign6766worker2 # [ 296.206105] nix-grpc-daemon[2012]: time=2026-09-22T10:49:53.473Z level=INFO msg="Uploading 1 narinfos"6767lb # [ 296.209157] niks3-server[1133]: 2026/09/22 10:49:53 INFO Signed narinfos id=77 count=16768lb # [ 296.215247] niks3-server[1133]: 2026/09/22 10:49:53 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6769lb # [ 296.225195] niks3-server[1133]: 2026/09/22 10:49:53 INFO Received complete upload request method=POST path=/api/pending_closures/77/complete6770lb # [ 296.230641] niks3-server[1133]: 2026/09/22 10:49:53 INFO Completed upload id=776771lb # [ 296.233896] niks3-server[1133]: 2026/09/22 10:49:53 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6772worker2 # [ 296.230692] nix-grpc-daemon[2012]: time=2026-09-22T10:49:53.498Z level=INFO msg="Upload complete. (312ms)"6773worker1 # [ 296.214816] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:53Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06774worker2 # [ 296.245327] nix-grpc-daemon[1952]: ts=2026-09-22T10:49:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39760 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=17 outputs=16775worker1 # [ 296.220963] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:53Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16776worker2 # [ 296.261814] nix-daemon[947]: reaped child process 2070, status = succeeded6777worker2 # [ 296.297687] nix-grpc-daemon[1952]: ts=2026-09-22T10:49:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:397606778worker2 # [ 296.313390] nix-grpc-daemon[1952]: ts=2026-09-22T10:49:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:397606779client # copying 1 paths to 'lb:50051'...6780worker2 # [ 296.328051] nix-grpc-daemon[2012]: time=2026-09-22T10:49:53.596Z level=INFO msg="All 2 paths already cached"6781client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6782worker2 # [ 296.334520] nix-grpc-daemon[1952]: ts=2026-09-22T10:49:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:397606783worker2 # [ 296.349867] nix-daemon[947]: accepted connection from pid 1952, user nix-grpc-daemon (trusted)6784worker2 # [ 296.548770] nix-daemon[947]: accepted connection from pid 2095, user nix-grpc-daemon (trusted)6785worker2 # [ 296.568934] nix-daemon[947]: reaped child process 2098, status = succeeded6786worker2 # [ 296.739222] nix-daemon[947]: accepted connection from pid 2100, user nix-grpc-daemon (trusted)6787worker2 # [ 296.758614] nix-daemon[947]: reaped child process 2103, status = succeeded6788lb # [ 296.770719] niks3-server[1133]: 2026/09/22 10:49:53 INFO Received uploads request method=POST path=/api/pending_closures6789worker2 # [ 296.781131] nix-grpc-daemon[2012]: time=2026-09-22T10:49:54.048Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6790worker2 # [ 296.782634] nix-grpc-daemon[2012]: time=2026-09-22T10:49:54.049Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6791lb # [ 296.800689] niks3-server[1133]: 2026/09/22 10:49:54 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6792worker2 # [ 296.812947] nix-grpc-daemon[2012]: time=2026-09-22T10:49:54.080Z level=INFO msg="Uploading 1 narinfos"6793lb # [ 296.816971] niks3-server[1133]: 2026/09/22 10:49:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/78/sign6794lb # [ 296.826442] niks3-server[1133]: 2026/09/22 10:49:54 INFO Signed narinfos id=78 count=16795lb # [ 296.830066] niks3-server[1133]: 2026/09/22 10:49:54 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6796worker2 # [ 296.839659] nix-grpc-daemon[2012]: time=2026-09-22T10:49:54.107Z level=INFO msg="Upload complete. (472ms)"6797lb # [ 296.839482] niks3-server[1133]: 2026/09/22 10:49:54 INFO Received complete upload request method=POST path=/api/pending_closures/78/complete6798lb # [ 296.844761] niks3-server[1133]: 2026/09/22 10:49:54 INFO Completed upload id=786799lb # [ 296.848130] niks3-server[1133]: 2026/09/22 10:49:54 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6800worker2 # [ 296.848999] nix-grpc-daemon[1952]: ts=2026-09-22T10:49:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39760 duration_s=0 paths=1 nar_bytes_in=7606801worker2 # [ 296.859767] nix-grpc-daemon[1952]: ts=2026-09-22T10:49:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:397606802worker2 # [ 296.865656] nix-daemon[947]: accepted connection from pid 1952, user nix-grpc-daemon (trusted)6803worker2 # [ 296.870320] nix-daemon[947]: reaped child process 2093, status = succeeded6804client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6805client # farm-top> worker2-next: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6806worker2 # [ 296.882941] nix-daemon[947]: accepted connection from pid 1952, user nix-grpc-daemon (trusted)6807client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds6808client # farm-top> LOG-farm-top-drain6809worker2 # [ 297.711708] nix-daemon[947]: reaped child process 2107, status = succeeded6810worker2 # [ 297.880171] nix-daemon[947]: accepted connection from pid 2123, user nix-grpc-daemon (trusted)6811worker2 # [ 297.899169] nix-daemon[947]: reaped child process 2126, status = succeeded6812lb # [ 297.913513] niks3-server[1133]: 2026/09/22 10:49:55 INFO Received uploads request method=POST path=/api/pending_closures6813worker2 # [ 297.924402] nix-grpc-daemon[2012]: time=2026-09-22T10:49:55.191Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6814worker2 # [ 297.925894] nix-grpc-daemon[2012]: time=2026-09-22T10:49:55.191Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6815lb # [ 297.951234] niks3-server[1133]: 2026/09/22 10:49:55 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6816worker2 # [ 297.965145] nix-grpc-daemon[2012]: time=2026-09-22T10:49:55.233Z level=INFO msg="Uploading 1 narinfos"6817lb # [ 297.967773] niks3-server[1133]: 2026/09/22 10:49:55 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6818lb # [ 297.976609] niks3-server[1133]: 2026/09/22 10:49:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/79/sign6819lb # [ 297.981662] niks3-server[1133]: 2026/09/22 10:49:55 INFO Signed narinfos id=79 count=16820lb # [ 297.987646] niks3-server[1133]: 2026/09/22 10:49:55 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6821lb # [ 297.991103] niks3-server[1133]: 2026/09/22 10:49:55 INFO Received complete upload request method=POST path=/api/pending_closures/79/complete6822lb # [ 297.995131] niks3-server[1133]: 2026/09/22 10:49:55 INFO Completed upload id=796823worker2 # [ 297.995128] nix-grpc-daemon[2012]: time=2026-09-22T10:49:55.263Z level=INFO msg="Upload complete. (303ms)"6824lb # [ 297.997706] niks3-server[1133]: 2026/09/22 10:49:55 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6825worker2 # [ 298.004615] nix-grpc-daemon[1952]: ts=2026-09-22T10:49:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39760 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=18 outputs=16826worker2 # [ 298.021958] nix-daemon[947]: reaped child process 2105, status = succeeded6827client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 6.84 seconds)6828client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath6829client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.23 seconds)6830worker1: must succeed: rm /nix/.rw-store/fill6831worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.16 seconds)6832worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6833worker1 # [ 298.534613] nix-grpc-daemon[1724]: ts=2026-09-22T10:49:55Z level=info event=healthy reason=min_free6834worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 0.05 seconds)6835(finished: subtest: low disk drains a worker and builds go to the other, in 9.79 seconds)6836(finished: run the VM test script, in 300.76 seconds)6837test script finished in 301.07s6838cleanup6839kill QemuMachine (pid 49)6840client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6841lb # [ 298.970719] envoy[961]: conn peer=[2001:db8:1::1]:44050 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9579 tx=4107 ms=65186842kill QemuMachine (pid 51)6843lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6844kill QemuMachine (pid 50)6845worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6846kill QemuMachine (pid 52)6847worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6848(finished: cleanup, in 1.24 seconds)6849additionally exposed symbols:6850 client, lb, worker1, worker2,6851 vlan1,6852 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh