vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #397
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12client # Disk image does not exist, creating the virtualisation disk image...13worker2 # Disk image does not exist, creating the virtualisation disk image...14client: QEMU running (pid 49)15client # Formatting '/build/vm-state-client/tmp.2wAJ6eXvh6', fmt=raw size=107374182416lb: QEMU running (pid 50)17worker2 # Formatting '/build/vm-state-worker2/tmp.h7QEpDDAuQ', fmt=raw size=107374182418worker2: QEMU running (pid 52)19client # mke2fs 1.47.4 (6-Mar-2025)20client # Discarding device blocks: 0/262144 done21lb # Disk image does not exist, creating the virtualisation disk image...22worker1: QEMU running (pid 51)23worker2 # mke2fs 1.47.4 (6-Mar-2025)24worker1 # Disk image does not exist, creating the virtualisation disk image...25client # Creating filesystem with 262144 4k blocks and 65536 inodes26lb # Formatting '/build/vm-state-lb/tmp.cN6R1CFg1X', fmt=raw size=107374182427worker2 # Discarding device blocks: 0/262144 done28worker1 # Formatting '/build/vm-state-worker1/tmp.p9PCUWzHNc', fmt=raw size=107374182429client # Filesystem UUID: dc725bd3-97d6-416b-9391-1966e68a1a5930lb # mke2fs 1.47.4 (6-Mar-2025)31worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes32client # Superblock backups stored on blocks:33lb # Discarding device blocks: 0/262144 done34worker2 # Filesystem UUID: ab082c4b-a2d8-4cfb-b471-7f4f21e2fb8435client # 32768, 98304, 163840, 22937636(finished: start all VMs, in 0.49 seconds)37worker1 # mke2fs 1.47.4 (6-Mar-2025)38lb # Creating filesystem with 262144 4k blocks and 65536 inodes39worker2 # Superblock backups stored on blocks:40client # 41client: waiting for unit network-addresses-eth1.service42worker2 # 32768, 98304, 163840, 22937643client # Allocating group tables: 0/8 done44client: waiting for the VM to finish booting45worker2 # 46client # Writing inode tables: 0/8 done47worker1 # Discarding device blocks: 0/262144 done48lb # Filesystem UUID: 93aae275-d73b-4c72-a922-d1312f5de93b49worker2 # Allocating group tables: 0/8 done50client # Creating journal (8192 blocks): done51worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes52lb # Superblock backups stored on blocks:53worker2 # Writing inode tables: 0/8 done54client # Writing superblocks and filesystem accounting information: 0/8 done55worker1 # Filesystem UUID: 60ef9c2c-da78-4db7-aca4-ba7776cfb3b756lb # 32768, 98304, 163840, 22937657worker2 # Creating journal (8192 blocks): done58client # 59worker1 # Superblock backups stored on blocks:60lb # 61worker2 # Writing superblocks and filesystem accounting information: 0/8 done62client # Virtualisation disk image created.63worker1 # 32768, 98304, 163840, 22937664lb # Allocating group tables: 0/8 done65worker1 # 66lb # Writing inode tables: 0/8 done67worker1 # Allocating group tables: 0/8 done68lb # Creating journal (8192 blocks): done69worker1 # Writing inode tables: 0/8 done70lb # Writing superblocks and filesystem accounting information: 0/8 done71worker1 # Creating journal (8192 blocks): done72lb # 73worker1 # Writing superblocks and filesystem accounting information: 0/8 done74lb # Virtualisation disk image created.75worker1 # 76worker2 # 77worker1 # Virtualisation disk image created.78worker2 # Virtualisation disk image created.79worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]80worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 202681worker2 # [ 0.000000] KASLR enabled82worker2 # [ 0.000000] random: crng init done83worker2 # [ 0.000000] Machine model: linux,dummy-virt84worker2 # [ 0.000000] efi: UEFI not found.85worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT86worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]87worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]88worker2 # [ 0.000000] Zone ranges:89worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]90worker2 # [ 0.000000] DMA32 empty91worker2 # [ 0.000000] Normal empty92worker2 # [ 0.000000] Device empty93worker2 # [ 0.000000] Movable zone start for each node94worker2 # [ 0.000000] Early memory node ranges95worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]96worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]97worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c40000098worker2 # [ 0.000000] psci: probing for conduit method from DT.99worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.100worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs101worker2 # [ 0.000000] psci: Trusted OS migration not required102worker2 # [ 0.000000] psci: SMC Calling Convention v1.1103worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)104worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296105worker2 # [ 0.000000] Detected PIPT I-cache on CPU0106worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)107worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface108worker2 # [ 0.000000] CPU features: detected: Spectre-v4109worker2 # [ 0.000000] CPU features: detected: Spectre-BHB110worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38111worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23112worker2 # [ 0.000000] alternatives: applying boot alternatives113worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/vrisk9pin8x1mpiy0byicpy6xcjcw1z3-nixos-system-worker2-test/init regInfo=/nix/store/dpfhgagzjq0zfd9wfr4ah4nmi0hjyhb6-closure-info/registration console=ttyAMA0,115200n8 console=tty0114worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/dpfhgagzjq0zfd9wfr4ah4nmi0hjyhb6-closure-info/registration", will be passed to user space.115worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes116worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)117worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)118worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB119worker2 # [ 0.000000] software IO TLB: area num 1.120worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB121worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)122worker2 # [ 0.000000] Fallback order for Node 0: 0123worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]124worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216125worker2 # [ 0.000000] Policy zone: DMA126worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026127worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off128worker1 # [ 0.000000] KASLR enabled129worker1 # [ 0.000000] random: crng init done130worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1131worker1 # [ 0.000000] Machine model: linux,dummy-virt132worker2 # [ 0.000000] allocated 3145728 bytes of page_ext133worker1 # [ 0.000000] efi: UEFI not found.134worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages135worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT136worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups137worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.138worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]139worker2 # [ 0.000000] rcu: RCU event tracing is enabled.140worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]141worker1 # [ 0.000000] Zone ranges:142worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.143worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]144worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.145worker1 # [ 0.000000] DMA32 empty146worker1 # [ 0.000000] Normal empty147worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.148worker1 # [ 0.000000] Device empty149worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.150worker1 # [ 0.000000] Movable zone start for each node151worker1 # [ 0.000000] Early memory node ranges152worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.153worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]154worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1155worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]156worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.157worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000158worker1 # [ 0.000000] psci: probing for conduit method from DT.159worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.160worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.161worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs162worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.163worker1 # [ 0.000000] psci: Trusted OS migration not required164worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0165worker1 # [ 0.000000] psci: SMC Calling Convention v1.1166worker2 # [ 0.000000] GICv3: 256 SPIs implemented167worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented168worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)169worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq170worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296171worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI172worker1 # [ 0.000000] Detected PIPT I-cache on CPU0173worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0174worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000175worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)176worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]177worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface178worker1 # [ 0.000000] CPU features: detected: Spectre-v4179worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)180worker1 # [ 0.000000] CPU features: detected: Spectre-BHB181worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)182worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38183worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000184worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23185worker1 # [ 0.000000] alternatives: applying boot alternatives186worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000187worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.188worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns189worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).190worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/1wlbp5nb33g82mfwwyy3lw2xkpbmrd2l-nixos-system-worker1-test/init regInfo=/nix/store/zmwb0gwm2vpb3cp7kpifrmfqvszghqgm-closure-info/registration console=ttyAMA0,115200n8 console=tty0191worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns192worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/zmwb0gwm2vpb3cp7kpifrmfqvszghqgm-closure-info/registration", will be passed to user space.193worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns194worker2 # [ 0.000034] arm-pv: using stolen time PV195worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes196worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)197worker2 # [ 0.000665] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)198lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]199worker2 # [ 0.000883] Console: colour dummy device 80x25200worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)201worker2 # [ 0.000891] printk: legacy console [tty0] enabled202worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB203lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026204worker1 # [ 0.000000] software IO TLB: area num 1.205lb # [ 0.000000] KASLR enabled206worker2 # [ 0.001087] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)207lb # [ 0.000000] random: crng init done208worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB209worker2 # [ 0.001094] pid_max: default: 32768 minimum: 301210lb # [ 0.000000] Machine model: linux,dummy-virt211client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]212lb # [ 0.000000] efi: UEFI not found.213worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)214worker2 # [ 0.001165] LSM: initializing lsm=capability,landlock,yama,bpf,ima215worker2 # [ 0.001335] landlock: Up and running.216worker1 # [ 0.000000] Fallback order for Node 0: 0217lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT218worker2 # [ 0.001338] Yama: becoming mindful.219worker2 # [ 0.001976] LSM support for eBPF active220worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216221client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026222lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]223client # [ 0.000000] KASLR enabled224worker1 # [ 0.000000] Policy zone: DMA225client # [ 0.000000] random: crng init done226worker2 # [ 0.002142] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)227lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]228worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off229lb # [ 0.000000] Zone ranges:230client # [ 0.000000] Machine model: linux,dummy-virt231client # [ 0.000000] efi: UEFI not found.232worker2 # [ 0.002175] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)233worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1234lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]235lb # [ 0.000000] DMA32 empty236worker1 # [ 0.000000] allocated 3145728 bytes of page_ext237client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT238worker2 # [ 0.003407] cacheinfo: Unable to detect cache hierarchy for CPU 0239lb # [ 0.000000] Normal empty240lb # [ 0.000000] Device empty241worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages242worker2 # [ 0.004215] rcu: Hierarchical SRCU implementation.243client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]244lb # [ 0.000000] Movable zone start for each node245worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups246worker2 # [ 0.004220] rcu: Max phase no-delay instances is 1000.247lb # [ 0.000000] Early memory node ranges248client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]249worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.250worker2 # [ 0.005437] fsl-mc MSI: its@8080000 domain created251client # [ 0.000000] Zone ranges:252lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]253worker2 # [ 0.005528] EFI services will not be available.254worker1 # [ 0.000000] rcu: RCU event tracing is enabled.255client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]256worker2 # [ 0.005604] smp: Bringing up secondary CPUs ...257client # [ 0.000000] DMA32 empty258worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.259lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]260worker2 # [ 0.005612] smp: Brought up 1 node, 1 CPU261client # [ 0.000000] Normal empty262worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.263lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000264client # [ 0.000000] Device empty265worker2 # [ 0.005615] SMP: Total of 1 processors activated.266worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.267lb # [ 0.000000] psci: probing for conduit method from DT.268client # [ 0.000000] Movable zone start for each node269worker2 # [ 0.005622] CPU: All CPU(s) started at EL1270client # [ 0.000000] Early memory node ranges271worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.272lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.273worker2 # [ 0.005634] CPU features: detected: Branch Target Identification274lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs275client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]276worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.277worker2 # [ 0.005639] CPU features: detected: ARMv8.4 Translation Table Level278lb # [ 0.000000] psci: Trusted OS migration not required279client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]280worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1281lb # [ 0.000000] psci: SMC Calling Convention v1.1282client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000283worker2 # [ 0.005642] CPU features: detected: Instruction cache invalidation not required for I/D coherence284worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.285client # [ 0.000000] psci: probing for conduit method from DT.286lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)287worker2 # [ 0.005646] CPU features: detected: Data cache clean to the PoU not required for I/D coherence288client # [ 0.000000] psci: PSCIv1.3 detected in firmware.289lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296290worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.291client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs292worker2 # [ 0.005650] CPU features: detected: Common not Private translations293lb # [ 0.000000] Detected PIPT I-cache on CPU0294worker2 # [ 0.005653] CPU features: detected: CRC32 instructions295client # [ 0.000000] psci: Trusted OS migration not required296worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.297client # [ 0.000000] psci: SMC Calling Convention v1.1298lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)299worker2 # [ 0.005656] CPU features: detected: Data cache clean to Point of Deep Persistence300worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0301lb # [ 0.000000] CPU features: detected: GICv3 CPU interface302worker1 # [ 0.000000] GICv3: 256 SPIs implemented303client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)304worker2 # [ 0.005660] CPU features: detected: Data cache clean to Point of Persistence305lb # [ 0.000000] CPU features: detected: Spectre-v4306worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented307lb # [ 0.000000] CPU features: detected: Spectre-BHB308client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296309worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq310worker2 # [ 0.005663] CPU features: detected: Data independent timing control (DIT)311client # [ 0.000000] Detected PIPT I-cache on CPU0312lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38313worker2 # [ 0.005666] CPU features: detected: E0PD314worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI315worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0316worker2 # [ 0.005668] CPU features: detected: Enhanced Counter Virtualization317lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23318client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)319lb # [ 0.000000] alternatives: applying boot alternatives320worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000321client # [ 0.000000] CPU features: detected: GICv3 CPU interface322worker2 # [ 0.005672] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)323worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]324client # [ 0.000000] CPU features: detected: Spectre-v4325worker2 # [ 0.005675] CPU features: detected: Enhanced Virtualization Traps326client # [ 0.000000] CPU features: detected: Spectre-BHB327worker2 # [ 0.005678] CPU features: detected: Fine Grained Traps328worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)329client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38330worker2 # [ 0.005682] CPU features: detected: Generic authentication (architected QARMA5 algorithm)331client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23332worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)333worker2 # [ 0.005687] CPU features: detected: RCpc load-acquire (LDAPR)334client # [ 0.000000] alternatives: applying boot alternatives335worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000336lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/lai4n7chb0cnvnygfis27sipihspygia-nixos-system-lb-test/init regInfo=/nix/store/qdg5w64gnxykmz82pw25fgmx46q7lp99-closure-info/registration console=ttyAMA0,115200n8 console=tty0337worker2 # [ 0.005690] CPU features: detected: LSE atomic instructions338worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000339worker2 # [ 0.005694] CPU features: detected: Privileged Access Never340worker2 # [ 0.005696] CPU features: detected: PMUv3341worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.342worker2 # [ 0.005699] CPU features: detected: RAS Extension Support343lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/qdg5w64gnxykmz82pw25fgmx46q7lp99-closure-info/registration", will be passed to user space.344worker2 # [ 0.005701] CPU features: detected: RASv1p1 Extension Support345worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns346lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes347worker2 # [ 0.005704] CPU features: detected: Random Number Generator348client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/1zplg4d2brzkh47d03ic67x3j0lywfb5-nixos-system-client-test/init regInfo=/nix/store/31j7swpv105i7yjgwjpmg6qj8z70q4wx-closure-info/registration console=ttyAMA0,115200n8 console=tty0349worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).350worker2 # [ 0.005707] CPU features: detected: Speculation barrier (SB)351lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)352worker2 # [ 0.005710] CPU features: detected: Stage-2 Force Write-Back353worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns354lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)355client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/31j7swpv105i7yjgwjpmg6qj8z70q4wx-closure-info/registration", will be passed to user space.356worker2 # [ 0.005713] CPU features: detected: TLB range maintenance instructions357worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns358lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB359worker1 # [ 0.000033] arm-pv: using stolen time PV360lb # [ 0.000000] software IO TLB: area num 1.361worker2 # [ 0.005718] CPU features: detected: Speculative Store Bypassing Safe (SSBS)362client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes363worker2 # [ 0.005761] alternatives: applying system-wide alternatives364lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB365worker1 # [ 0.000561] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)366client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)367worker2 # [ 0.008953] CPU features: detected: BBM Level 2 without TLB conflict abort368worker1 # [ 0.000723] Console: colour dummy device 80x25369lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)370worker1 # [ 0.000732] printk: legacy console [tty0] enabled371lb # [ 0.000000] Fallback order for Node 0: 0372client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)373lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216374client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB375worker2 # [ 0.009142] Memory: 1406552K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)376lb # [ 0.000000] Policy zone: DMA377worker1 # [ 0.000928] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)378worker2 # [ 0.009585] devtmpfs: initialized379client # [ 0.000000] software IO TLB: area num 1.380worker1 # [ 0.000935] pid_max: default: 32768 minimum: 301381lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off382worker2 # [ 0.011438] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)383client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB384worker1 # [ 0.001005] LSM: initializing lsm=capability,landlock,yama,bpf,ima385lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1386worker1 # [ 0.001205] landlock: Up and running.387client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)388worker2 # [ 0.011467] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).389lb # [ 0.000000] allocated 3145728 bytes of page_ext390worker1 # [ 0.001208] Yama: becoming mindful.391client # [ 0.000000] Fallback order for Node 0: 0392worker2 # [ 0.011683] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL393worker1 # [ 0.001804] LSM support for eBPF active394lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages395client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216396worker2 # [ 0.011688] 0 pages in range for non-PLT usage397lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups398worker1 # [ 0.001960] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)399client # [ 0.000000] Policy zone: DMA400worker2 # [ 0.011689] 508288 pages in range for PLT usage401lb # [ 0.000000] rcu: Hierarchical RCU implementation.402client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off403worker2 # [ 0.011810] pinctrl core: initialized pinctrl subsystem404worker1 # [ 0.001993] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)405lb # [ 0.000000] rcu: RCU event tracing is enabled.406worker2 # [ 0.012563] DMI not present or invalid.407worker1 # [ 0.003196] cacheinfo: Unable to detect cache hierarchy for CPU 0408client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1409lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.410worker2 # [ 0.016485] NET: Registered PF_NETLINK/PF_ROUTE protocol family411worker1 # [ 0.003897] rcu: Hierarchical SRCU implementation.412client # [ 0.000000] allocated 3145728 bytes of page_ext413lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.414client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages415worker1 # [ 0.003901] rcu: Max phase no-delay instances is 1000.416lb # [ 0.000000] Rude variant of Tasks RCU enabled.417worker2 # [ 0.018810] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations418client # [ 0.000000] ftrace: allocated 294 pages with 4 groups419worker1 # [ 0.005155] fsl-mc MSI: its@8080000 domain created420lb # [ 0.000000] Tracing variant of Tasks RCU enabled.421worker2 # [ 0.019017] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations422client # [ 0.000000] rcu: Hierarchical RCU implementation.423worker1 # [ 0.005247] EFI services will not be available.424lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.425client # [ 0.000000] rcu: RCU event tracing is enabled.426worker1 # [ 0.005318] smp: Bringing up secondary CPUs ...427worker2 # [ 0.019225] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations428worker1 # [ 0.005327] smp: Brought up 1 node, 1 CPU429lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1430client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.431worker2 # [ 0.019252] audit: initializing netlink subsys (disabled)432worker1 # [ 0.005329] SMP: Total of 1 processors activated.433client # [ 0.000000] Trampoline variant of Tasks RCU enabled.434worker2 # [ 0.019908] thermal_sys: Registered thermal governor 'fair_share'435worker1 # [ 0.005335] CPU: All CPU(s) started at EL1436lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.437client # [ 0.000000] Rude variant of Tasks RCU enabled.438worker1 # [ 0.005347] CPU features: detected: Branch Target Identification439worker2 # [ 0.019910] thermal_sys: Registered thermal governor 'bang_bang'440client # [ 0.000000] Tracing variant of Tasks RCU enabled.441lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.442worker2 # [ 0.019915] thermal_sys: Registered thermal governor 'step_wise'443worker1 # [ 0.005352] CPU features: detected: ARMv8.4 Translation Table Level444client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.445worker2 # [ 0.019920] thermal_sys: Registered thermal governor 'user_space'446lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.447worker1 # [ 0.005355] CPU features: detected: Instruction cache invalidation not required for I/D coherence448client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1449worker2 # [ 0.019923] thermal_sys: Registered thermal governor 'power_allocator'450lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0451lb # [ 0.000000] GICv3: 256 SPIs implemented452worker1 # [ 0.005359] CPU features: detected: Data cache clean to the PoU not required for I/D coherence453client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.454worker2 # [ 0.019950] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1455lb # [ 0.000000] GICv3: 0 Extended SPIs implemented456worker1 # [ 0.005363] CPU features: detected: Common not Private translations457worker2 # [ 0.019959] cpuidle: using governor ladder458lb # [ 0.000000] Root IRQ handler: gic_handle_irq459worker2 # [ 0.019965] cpuidle: using governor menu460client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.461worker1 # [ 0.005366] CPU features: detected: CRC32 instructions462lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI463worker2 # [ 0.020172] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.464lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0465worker1 # [ 0.005369] CPU features: detected: Data cache clean to Point of Deep Persistence466client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.467worker2 # [ 0.020190] ASID allocator initialised with 65536 entries468lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000469client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0470worker1 # [ 0.005372] CPU features: detected: Data cache clean to Point of Persistence471worker2 # [ 0.021496] Serial: AMBA PL011 UART driver472lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]473client # [ 0.000000] GICv3: 256 SPIs implemented474worker1 # [ 0.005376] CPU features: detected: Data independent timing control (DIT)475client # [ 0.000000] GICv3: 0 Extended SPIs implemented476worker2 # [ 0.026866] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1477worker1 # [ 0.005379] CPU features: detected: E0PD478client # [ 0.000000] Root IRQ handler: gic_handle_irq479lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)480worker2 # [ 0.026996] printk: console [ttyAMA0] enabled481worker1 # [ 0.005381] CPU features: detected: Enhanced Counter Virtualization482client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI483client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0484lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)485worker1 # [ 0.005384] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)486lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000487client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000488worker1 # [ 0.005388] CPU features: detected: Enhanced Virtualization Traps489client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]490worker1 # [ 0.005390] CPU features: detected: Fine Grained Traps491lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000492client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)493worker1 # [ 0.005394] CPU features: detected: Generic authentication (architected QARMA5 algorithm)494lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.495worker1 # [ 0.005399] CPU features: detected: RCpc load-acquire (LDAPR)496lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns497client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)498worker1 # [ 0.005402] CPU features: detected: LSE atomic instructions499client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000500lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).501worker1 # [ 0.005405] CPU features: detected: Privileged Access Never502worker1 # [ 0.005408] CPU features: detected: PMUv3503client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000504lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns505worker1 # [ 0.005410] CPU features: detected: RAS Extension Support506worker2 # [ 0.145717] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages507client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.508worker1 # [ 0.005413] CPU features: detected: RASv1p1 Extension Support509lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns510worker2 # [ 0.145738] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page511worker1 # [ 0.005416] CPU features: detected: Random Number Generator512lb # [ 0.000032] arm-pv: using stolen time PV513client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns514worker2 # [ 0.145743] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages515client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).516lb # [ 0.000409] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)517worker2 # [ 0.145748] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page518worker1 # [ 0.005418] CPU features: detected: Speculation barrier (SB)519lb # [ 0.000599] Console: colour dummy device 80x25520worker1 # [ 0.005421] CPU features: detected: Stage-2 Force Write-Back521worker2 # [ 0.145752] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages522client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns523lb # [ 0.000607] printk: legacy console [tty0] enabled524worker1 # [ 0.005424] CPU features: detected: TLB range maintenance instructions525worker2 # [ 0.145757] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page526client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns527lb # [ 0.000802] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)528worker1 # [ 0.005429] CPU features: detected: Speculative Store Bypassing Safe (SSBS)529worker2 # [ 0.145761] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages530client # [ 0.000030] arm-pv: using stolen time PV531lb # [ 0.000808] pid_max: default: 32768 minimum: 301532worker1 # [ 0.005469] alternatives: applying system-wide alternatives533worker2 # [ 0.145765] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page534client # [ 0.000443] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)535lb # [ 0.000878] LSM: initializing lsm=capability,landlock,yama,bpf,ima536worker1 # [ 0.008599] CPU features: detected: BBM Level 2 without TLB conflict abort537lb # [ 0.000999] landlock: Up and running.538client # [ 0.000635] Console: colour dummy device 80x25539lb # [ 0.001002] Yama: becoming mindful.540client # [ 0.000644] printk: legacy console [tty0] enabled541lb # [ 0.001448] LSM support for eBPF active542worker1 # [ 0.008783] Memory: 1406552K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved)543worker2 # [ 0.153079] fbcon: Taking over console544lb # [ 0.001593] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)545worker1 # [ 0.009187] devtmpfs: initialized546worker2 # [ 0.153095] ACPI: Interpreter disabled.547client # [ 0.000839] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)548client # [ 0.000846] pid_max: default: 32768 minimum: 301549lb # [ 0.001630] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)550worker1 # [ 0.011086] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)551client # [ 0.000914] LSM: initializing lsm=capability,landlock,yama,bpf,ima552lb # [ 0.002727] cacheinfo: Unable to detect cache hierarchy for CPU 0553client # [ 0.001087] landlock: Up and running.554worker1 # [ 0.011121] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).555lb # [ 0.003430] rcu: Hierarchical SRCU implementation.556client # [ 0.001090] Yama: becoming mindful.557client # [ 0.001569] LSM support for eBPF active558worker1 # [ 0.011321] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL559lb # [ 0.003434] rcu: Max phase no-delay instances is 1000.560worker1 # [ 0.011326] 0 pages in range for non-PLT usage561lb # [ 0.004642] fsl-mc MSI: its@8080000 domain created562client # [ 0.001710] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)563worker1 # [ 0.011327] 508288 pages in range for PLT usage564lb # [ 0.004740] EFI services will not be available.565worker1 # [ 0.011422] pinctrl core: initialized pinctrl subsystem566lb # [ 0.004806] smp: Bringing up secondary CPUs ...567client # [ 0.001743] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)568worker1 # [ 0.012212] DMI not present or invalid.569lb # [ 0.004815] smp: Brought up 1 node, 1 CPU570client # [ 0.002962] cacheinfo: Unable to detect cache hierarchy for CPU 0571lb # [ 0.004818] SMP: Total of 1 processors activated.572worker1 # [ 0.015701] NET: Registered PF_NETLINK/PF_ROUTE protocol family573client # [ 0.003667] rcu: Hierarchical SRCU implementation.574lb # [ 0.004824] CPU: All CPU(s) started at EL1575worker1 # [ 0.018034] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations576client # [ 0.003671] rcu: Max phase no-delay instances is 1000.577lb # [ 0.004835] CPU features: detected: Branch Target Identification578client # [ 0.004886] fsl-mc MSI: its@8080000 domain created579worker1 # [ 0.018236] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations580lb # [ 0.004839] CPU features: detected: ARMv8.4 Translation Table Level581client # [ 0.004977] EFI services will not be available.582client # [ 0.005060] smp: Bringing up secondary CPUs ...583worker1 # [ 0.018441] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations584lb # [ 0.004842] CPU features: detected: Instruction cache invalidation not required for I/D coherence585client # [ 0.005069] smp: Brought up 1 node, 1 CPU586worker2 # [ 0.162060] iommu: Default domain type: Translated587worker1 # [ 0.018464] audit: initializing netlink subsys (disabled)588client # [ 0.005072] SMP: Total of 1 processors activated.589worker2 # [ 0.162071] iommu: DMA domain TLB invalidation policy: strict mode590lb # [ 0.004846] CPU features: detected: Data cache clean to the PoU not required for I/D coherence591client # [ 0.005078] CPU: All CPU(s) started at EL1592worker1 # [ 0.019090] thermal_sys: Registered thermal governor 'fair_share'593worker2 # [ 0.162448] SCSI subsystem initialized594lb # [ 0.004849] CPU features: detected: Common not Private translations595worker1 # [ 0.019092] thermal_sys: Registered thermal governor 'bang_bang'596client # [ 0.005089] CPU features: detected: Branch Target Identification597lb # [ 0.004853] CPU features: detected: CRC32 instructions598worker1 # [ 0.019095] thermal_sys: Registered thermal governor 'step_wise'599client # [ 0.005094] CPU features: detected: ARMv8.4 Translation Table Level600worker2 # [ 0.164357] usbcore: registered new interface driver usbfs601lb # [ 0.004856] CPU features: detected: Data cache clean to Point of Deep Persistence602worker2 # [ 0.164389] usbcore: registered new interface driver hub603worker1 # [ 0.019101] thermal_sys: Registered thermal governor 'user_space'604client # [ 0.005097] CPU features: detected: Instruction cache invalidation not required for I/D coherence605worker2 # [ 0.164406] usbcore: registered new device driver usb606worker1 # [ 0.019103] thermal_sys: Registered thermal governor 'power_allocator'607lb # [ 0.004859] CPU features: detected: Data cache clean to Point of Persistence608worker2 # [ 0.164661] pps_core: LinuxPPS API ver. 1 registered609client # [ 0.005101] CPU features: detected: Data cache clean to the PoU not required for I/D coherence610lb # [ 0.004862] CPU features: detected: Data independent timing control (DIT)611worker1 # [ 0.019130] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1612lb # [ 0.004866] CPU features: detected: E0PD613worker1 # [ 0.019139] cpuidle: using governor ladder614client # [ 0.005104] CPU features: detected: Common not Private translations615worker2 # [ 0.164667] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>616worker1 # [ 0.019145] cpuidle: using governor menu617lb # [ 0.004868] CPU features: detected: Enhanced Counter Virtualization618worker2 # [ 0.164677] PTP clock support registered619client # [ 0.005108] CPU features: detected: CRC32 instructions620worker2 # [ 0.164726] EDAC MC: Ver: 3.0.0621worker1 # [ 0.019351] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.622lb # [ 0.004871] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)623client # [ 0.005111] CPU features: detected: Data cache clean to Point of Deep Persistence624worker1 # [ 0.019367] ASID allocator initialised with 65536 entries625worker2 # [ 0.169177] scmi_core: SCMI protocol bus registered626lb # [ 0.004874] CPU features: detected: Enhanced Virtualization Traps627client # [ 0.005115] CPU features: detected: Data cache clean to Point of Persistence628worker1 # [ 0.020672] Serial: AMBA PL011 UART driver629lb # [ 0.004877] CPU features: detected: Fine Grained Traps630worker2 # [ 0.170180] FPGA manager framework631client # [ 0.005118] CPU features: detected: Data independent timing control (DIT)632worker1 # [ 0.025900] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1633worker2 # [ 0.171113] vgaarb: loaded634client # [ 0.005121] CPU features: detected: E0PD635lb # [ 0.004881] CPU features: detected: Generic authentication (architected QARMA5 algorithm)636worker1 # [ 0.026064] printk: console [ttyAMA0] enabled637client # [ 0.005123] CPU features: detected: Enhanced Counter Virtualization638lb # [ 0.004887] CPU features: detected: RCpc load-acquire (LDAPR)639worker2 # [ 0.171736] clocksource: Switched to clocksource arch_sys_counter640lb # [ 0.004889] CPU features: detected: LSE atomic instructions641client # [ 0.005126] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)642lb # [ 0.004893] CPU features: detected: Privileged Access Never643client # [ 0.005130] CPU features: detected: Enhanced Virtualization Traps644lb # [ 0.004895] CPU features: detected: PMUv3645client # [ 0.005133] CPU features: detected: Fine Grained Traps646lb # [ 0.004898] CPU features: detected: RAS Extension Support647client # [ 0.005137] CPU features: detected: Generic authentication (architected QARMA5 algorithm)648lb # [ 0.004901] CPU features: detected: RASv1p1 Extension Support649client # [ 0.005143] CPU features: detected: RCpc load-acquire (LDAPR)650lb # [ 0.004903] CPU features: detected: Random Number Generator651client # [ 0.005146] CPU features: detected: LSE atomic instructions652lb # [ 0.004906] CPU features: detected: Speculation barrier (SB)653worker2 # [ 0.176528] VFS: Disk quotas dquot_6.6.0654client # [ 0.005149] CPU features: detected: Privileged Access Never655lb # [ 0.004909] CPU features: detected: Stage-2 Force Write-Back656worker2 # [ 0.176565] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)657client # [ 0.005151] CPU features: detected: PMUv3658lb # [ 0.004912] CPU features: detected: TLB range maintenance instructions659client # [ 0.005154] CPU features: detected: RAS Extension Support660worker1 # [ 0.144338] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages661lb # [ 0.004917] CPU features: detected: Speculative Store Bypassing Safe (SSBS)662client # [ 0.005157] CPU features: detected: RASv1p1 Extension Support663lb # [ 0.004955] alternatives: applying system-wide alternatives664worker1 # [ 0.144357] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page665client # [ 0.005160] CPU features: detected: Random Number Generator666worker2 # [ 0.180106] netfs: FS-Cache loaded667lb # [ 0.008100] CPU features: detected: BBM Level 2 without TLB conflict abort668client # [ 0.005162] CPU features: detected: Speculation barrier (SB)669worker1 # [ 0.144362] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages670worker2 # [ 0.180229] pnp: PnP ACPI: disabled671client # [ 0.005165] CPU features: detected: Stage-2 Force Write-Back672worker1 # [ 0.144367] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page673client # [ 0.005168] CPU features: detected: TLB range maintenance instructions674worker1 # [ 0.144371] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages675lb # [ 0.008348] Memory: 1406540K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved)676lb # [ 0.008763] devtmpfs: initialized677client # [ 0.005173] CPU features: detected: Speculative Store Bypassing Safe (SSBS)678worker1 # [ 0.144376] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page679client # [ 0.005210] alternatives: applying system-wide alternatives680lb # [ 0.010618] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)681worker1 # [ 0.144380] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages682client # [ 0.008228] CPU features: detected: BBM Level 2 without TLB conflict abort683worker1 # [ 0.144384] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page684client # [ 0.008390] Memory: 1406508K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved)685client # [ 0.008871] devtmpfs: initialized686worker1 # [ 0.151654] fbcon: Taking over console687worker1 # [ 0.151670] ACPI: Interpreter disabled.688client # [ 0.010693] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)689worker2 # [ 0.184079] NET: Registered PF_INET protocol family690client # [ 0.010715] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).691client # [ 0.010900] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL692worker2 # [ 0.184347] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)693client # [ 0.010904] 0 pages in range for non-PLT usage694client # [ 0.010905] 508288 pages in range for PLT usage695client # [ 0.011013] pinctrl core: initialized pinctrl subsystem696client # [ 0.011792] DMI not present or invalid.697client # [ 0.015086] NET: Registered PF_NETLINK/PF_ROUTE protocol family698lb # [ 0.010640] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).699client # [ 0.017304] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations700lb # [ 0.010834] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL701lb # [ 0.010838] 0 pages in range for non-PLT usage702client # [ 0.017482] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations703lb # [ 0.010839] 508288 pages in range for PLT usage704client # [ 0.017681] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations705lb # [ 0.010949] pinctrl core: initialized pinctrl subsystem706worker1 # [ 0.160683] iommu: Default domain type: Translated707lb # [ 0.011752] DMI not present or invalid.708client # [ 0.017702] audit: initializing netlink subsys (disabled)709worker1 # [ 0.160693] iommu: DMA domain TLB invalidation policy: strict mode710lb # [ 0.014873] NET: Registered PF_NETLINK/PF_ROUTE protocol family711client # [ 0.018355] thermal_sys: Registered thermal governor 'fair_share'712worker1 # [ 0.161047] SCSI subsystem initialized713client # [ 0.018357] thermal_sys: Registered thermal governor 'bang_bang'714lb # [ 0.017118] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations715client # [ 0.018361] thermal_sys: Registered thermal governor 'step_wise'716worker1 # [ 0.163001] usbcore: registered new interface driver usbfs717lb # [ 0.017319] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations718worker1 # [ 0.163038] usbcore: registered new interface driver hub719client # [ 0.018366] thermal_sys: Registered thermal governor 'user_space'720lb # [ 0.017524] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations721worker1 # [ 0.163056] usbcore: registered new device driver usb722client # [ 0.018369] thermal_sys: Registered thermal governor 'power_allocator'723lb # [ 0.017546] audit: initializing netlink subsys (disabled)724worker1 # [ 0.163320] pps_core: LinuxPPS API ver. 1 registered725lb # [ 0.018184] thermal_sys: Registered thermal governor 'fair_share'726client # [ 0.018396] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1727client # [ 0.018404] cpuidle: using governor ladder728worker1 # [ 0.163326] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>729lb # [ 0.018186] thermal_sys: Registered thermal governor 'bang_bang'730worker1 # [ 0.163335] PTP clock support registered731client # [ 0.018410] cpuidle: using governor menu732worker1 # [ 0.163389] EDAC MC: Ver: 3.0.0733lb # [ 0.018190] thermal_sys: Registered thermal governor 'step_wise'734client # [ 0.018595] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.735lb # [ 0.018196] thermal_sys: Registered thermal governor 'user_space'736worker1 # [ 0.167852] scmi_core: SCMI protocol bus registered737client # [ 0.018611] ASID allocator initialised with 65536 entries738lb # [ 0.018199] thermal_sys: Registered thermal governor 'power_allocator'739client # [ 0.019823] Serial: AMBA PL011 UART driver740worker1 # [ 0.168835] FPGA manager framework741worker1 # [ 0.169823] vgaarb: loaded742lb # [ 0.018225] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1743client # [ 0.024997] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1744lb # [ 0.018234] cpuidle: using governor ladder745client # [ 0.025124] printk: console [ttyAMA0] enabled746lb # [ 0.018240] cpuidle: using governor menu747worker1 # [ 0.170442] clocksource: Switched to clocksource arch_sys_counter748lb # [ 0.018442] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.749lb # [ 0.018458] ASID allocator initialised with 65536 entries750lb # [ 0.019692] Serial: AMBA PL011 UART driver751lb # [ 0.025050] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1752worker1 # [ 0.173820] VFS: Disk quotas dquot_6.6.0753lb # [ 0.025174] printk: console [ttyAMA0] enabled754worker1 # [ 0.173856] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)755lb # [ 0.145490] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages756lb # [ 0.145511] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page757lb # [ 0.145517] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages758worker1 # [ 0.177476] netfs: FS-Cache loaded759client # [ 0.144609] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages760lb # [ 0.145521] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page761worker1 # [ 0.177607] pnp: PnP ACPI: disabled762client # [ 0.144634] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page763lb # [ 0.145525] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages764client # [ 0.144639] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages765lb # [ 0.145529] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page766client # [ 0.144644] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page767lb # [ 0.145534] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages768client # [ 0.144649] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages769lb # [ 0.145538] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page770client # [ 0.144653] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page771worker1 # [ 0.181459] NET: Registered PF_INET protocol family772client # [ 0.144657] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages773client # [ 0.144662] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page774worker1 # [ 0.181720] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)775lb # [ 0.153004] fbcon: Taking over console776lb # [ 0.153020] ACPI: Interpreter disabled.777lb # [ 0.154950] iommu: Default domain type: Translated778lb # [ 0.154960] iommu: DMA domain TLB invalidation policy: strict mode779client # [ 0.152186] fbcon: Taking over console780client # [ 0.152204] ACPI: Interpreter disabled.781lb # [ 0.156637] SCSI subsystem initialized782worker2 # [ 0.214238] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)783client # [ 0.154154] iommu: Default domain type: Translated784worker2 # [ 0.214289] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)785client # [ 0.154165] iommu: DMA domain TLB invalidation policy: strict mode786worker2 # [ 0.214318] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)787client # [ 0.155910] SCSI subsystem initialized788worker2 # [ 0.214395] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)789client # [ 0.156602] usbcore: registered new interface driver usbfs790worker2 # [ 0.214539] TCP: Hash tables configured (established 16384 bind 16384)791client # [ 0.156633] usbcore: registered new interface driver hub792worker2 # [ 0.214625] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)793client # [ 0.156651] usbcore: registered new device driver usb794worker2 # [ 0.214660] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)795worker2 # [ 0.214696] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)796lb # [ 0.162678] usbcore: registered new interface driver usbfs797worker2 # [ 0.214801] NET: Registered PF_UNIX/PF_LOCAL protocol family798lb # [ 0.162711] usbcore: registered new interface driver hub799worker2 # [ 0.214824] NET: Registered PF_XDP protocol family800worker2 # [ 0.214842] PCI: CLS 0 bytes, default 64801lb # [ 0.162737] usbcore: registered new device driver usb802lb # [ 0.163017] pps_core: LinuxPPS API ver. 1 registered803worker2 # [ 0.215098] Trying to unpack rootfs image as initramfs...804lb # [ 0.163023] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>805lb # [ 0.163033] PTP clock support registered806lb # [ 0.163084] EDAC MC: Ver: 3.0.0807lb # [ 0.167724] scmi_core: SCMI protocol bus registered808worker2 # [ 0.229455] kvm [1]: HYP mode not available809client # [ 0.164970] pps_core: LinuxPPS API ver. 1 registered810lb # [ 0.168719] FPGA manager framework811client # [ 0.164981] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>812lb # [ 0.169713] vgaarb: loaded813client # [ 0.164992] PTP clock support registered814client # [ 0.165042] EDAC MC: Ver: 3.0.0815lb # [ 0.170341] clocksource: Switched to clocksource arch_sys_counter816client # [ 0.167781] scmi_core: SCMI protocol bus registered817client # [ 0.168732] FPGA manager framework818client # [ 0.169682] vgaarb: loaded819lb # [ 0.173409] VFS: Disk quotas dquot_6.6.0820client # [ 0.170337] clocksource: Switched to clocksource arch_sys_counter821lb # [ 0.173442] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)822lb # [ 0.177135] netfs: FS-Cache loaded823lb # [ 0.177273] pnp: PnP ACPI: disabled824client # [ 0.176533] VFS: Disk quotas dquot_6.6.0825client # [ 0.176580] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)826client # [ 0.178217] netfs: FS-Cache loaded827client # [ 0.178778] pnp: PnP ACPI: disabled828lb # [ 0.181199] NET: Registered PF_INET protocol family829lb # [ 0.181465] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)830client # [ 0.182172] NET: Registered PF_INET protocol family831worker1 # [ 0.211363] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)832client # [ 0.183067] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)833worker1 # [ 0.211414] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)834worker1 # [ 0.211444] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)835worker1 # [ 0.211519] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)836worker1 # [ 0.211662] TCP: Hash tables configured (established 16384 bind 16384)837worker1 # [ 0.211749] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)838worker1 # [ 0.211783] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)839worker1 # [ 0.211819] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)840worker1 # [ 0.211922] NET: Registered PF_UNIX/PF_LOCAL protocol family841worker1 # [ 0.211944] NET: Registered PF_XDP protocol family842worker1 # [ 0.211962] PCI: CLS 0 bytes, default 64843worker1 # [ 0.212195] Trying to unpack rootfs image as initramfs...844worker1 # [ 0.228089] kvm [1]: HYP mode not available845lb # [ 0.211688] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)846lb # [ 0.211740] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)847lb # [ 0.211773] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)848lb # [ 0.211850] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)849client # [ 0.212390] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)850lb # [ 0.211995] TCP: Hash tables configured (established 16384 bind 16384)851client # [ 0.212442] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)852lb # [ 0.212082] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)853client # [ 0.212470] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)854lb # [ 0.212120] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)855client # [ 0.212554] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)856lb # [ 0.212157] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)857client # [ 0.212698] TCP: Hash tables configured (established 16384 bind 16384)858lb # [ 0.212267] NET: Registered PF_UNIX/PF_LOCAL protocol family859lb # [ 0.212293] NET: Registered PF_XDP protocol family860client # [ 0.212784] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)861lb # [ 0.212313] PCI: CLS 0 bytes, default 64862client # [ 0.212819] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)863lb # [ 0.212573] Trying to unpack rootfs image as initramfs...864client # [ 0.212856] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)865client # [ 0.212961] NET: Registered PF_UNIX/PF_LOCAL protocol family866client # [ 0.212984] NET: Registered PF_XDP protocol family867client # [ 0.213002] PCI: CLS 0 bytes, default 64868client # [ 0.213239] Trying to unpack rootfs image as initramfs...869lb # [ 0.228307] kvm [1]: HYP mode not available870client # [ 0.228384] kvm [1]: HYP mode not available871worker2 # [ 0.336365] Initialise system trusted keyrings872worker2 # [ 0.337171] workingset: timestamp_bits=42 max_order=19 bucket_order=0873worker2 # [ 0.338510] squashfs: version 4.0 (2009/01/31) Phillip Lougher874worker2 # [ 0.339302] 9p: Installing v9fs 9p2000 file system support875worker1 # [ 0.325275] Initialise system trusted keyrings876worker1 # [ 0.326025] workingset: timestamp_bits=42 max_order=19 bucket_order=0877worker1 # [ 0.327360] squashfs: version 4.0 (2009/01/31) Phillip Lougher878worker2 # [ 0.368000] Key type asymmetric registered879worker1 # [ 0.328128] 9p: Installing v9fs 9p2000 file system support880worker2 # [ 0.368031] Asymmetric key parser 'x509' registered881worker2 # [ 0.368107] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)882worker2 # [ 0.370256] io scheduler mq-deadline registered883worker2 # [ 0.370268] io scheduler kyber registered884worker2 # [ 0.375220] pl061_gpio 9030000.pl061: PL061 GPIO chip registered885worker1 # [ 0.348123] Key type asymmetric registered886worker1 # [ 0.348152] Asymmetric key parser 'x509' registered887worker1 # [ 0.348227] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)888worker1 # [ 0.354497] io scheduler mq-deadline registered889worker1 # [ 0.354521] io scheduler kyber registered890worker2 # [ 0.383830] ledtrig-cpu: registered to indicate activity on CPUs891worker2 # [ 0.384263] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:892worker2 # [ 0.384283] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000893worker2 # [ 0.384295] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000894worker2 # [ 0.384303] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000895worker2 # [ 0.384329] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits896worker2 # [ 0.384352] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]897lb # [ 0.334924] Initialise system trusted keyrings898worker2 # [ 0.384433] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00899lb # [ 0.335666] workingset: timestamp_bits=42 max_order=19 bucket_order=0900worker2 # [ 0.384443] pci_bus 0000:00: root bus resource [bus 00-ff]901worker2 # [ 0.384449] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]902lb # [ 0.336939] squashfs: version 4.0 (2009/01/31) Phillip Lougher903worker2 # [ 0.384454] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]904worker1 # [ 0.366587] pl061_gpio 9030000.pl061: PL061 GPIO chip registered905client # [ 0.334926] Initialise system trusted keyrings906lb # [ 0.337741] 9p: Installing v9fs 9p2000 file system support907worker2 # [ 0.384459] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]908client # [ 0.335664] workingset: timestamp_bits=42 max_order=19 bucket_order=0909worker2 # [ 0.384533] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint910client # [ 0.336929] squashfs: version 4.0 (2009/01/31) Phillip Lougher911worker2 # [ 0.384987] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint912worker1 # [ 0.368049] ledtrig-cpu: registered to indicate activity on CPUs913worker2 # [ 0.385176] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]914client # [ 0.337724] 9p: Installing v9fs 9p2000 file system support915worker1 # [ 0.368467] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:916worker2 # [ 0.385192] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]917worker2 # [ 0.385221] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]918worker1 # [ 0.368484] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000919worker2 # [ 0.385237] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]920worker1 # [ 0.368496] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000921worker2 # [ 0.385685] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint922worker1 # [ 0.368504] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000923worker2 # [ 0.385866] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]924worker2 # [ 0.385882] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]925worker1 # [ 0.368524] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits926worker2 # [ 0.385911] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]927worker1 # [ 0.368549] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]928worker2 # [ 0.386354] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint929worker1 # [ 0.368623] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00930worker2 # [ 0.386534] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]931worker1 # [ 0.368632] pci_bus 0000:00: root bus resource [bus 00-ff]932worker2 # [ 0.386549] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]933worker1 # [ 0.368639] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]934worker2 # [ 0.386578] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]935worker1 # [ 0.368643] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]936worker2 # [ 0.387021] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint937worker1 # [ 0.368649] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]938worker2 # [ 0.387204] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]939worker1 # [ 0.368708] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint940worker2 # [ 0.387220] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]941worker2 # [ 0.387252] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]942worker1 # [ 0.369151] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint943worker1 # [ 0.369337] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]944worker2 # [ 0.387709] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint945worker1 # [ 0.369354] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]946worker2 # [ 0.387910] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]947worker2 # [ 0.387926] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]948worker1 # [ 0.369384] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]949worker1 # [ 0.369400] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]950worker2 # [ 0.387956] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]951worker1 # [ 0.369854] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint952worker2 # [ 0.388444] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint953worker1 # [ 0.370040] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]954worker2 # [ 0.388627] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]955worker1 # [ 0.370056] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]956worker2 # [ 0.388643] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]957worker1 # [ 0.370085] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]958worker2 # [ 0.388672] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]959worker2 # [ 0.389143] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint960worker2 # [ 0.389331] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]961client # [ 0.358313] Key type asymmetric registered962worker2 # [ 0.389347] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]963worker2 # [ 0.389376] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]964worker2 # [ 0.389392] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]965worker2 # [ 0.389843] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint966worker2 # [ 0.390029] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]967worker2 # [ 0.390058] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]968lb # [ 0.366404] Key type asymmetric registered969worker2 # [ 0.390507] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint970lb # [ 0.366433] Asymmetric key parser 'x509' registered971worker2 # [ 0.390699] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]972lb # [ 0.366504] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)973worker2 # [ 0.390728] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]974lb # [ 0.368638] io scheduler mq-deadline registered975lb # [ 0.368649] io scheduler kyber registered976worker1 # [ 0.394592] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint977worker2 # [ 0.391113] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint978client # [ 0.366367] Asymmetric key parser 'x509' registered979worker1 # [ 0.394807] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]980worker2 # [ 0.391297] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]981client # [ 0.366459] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)982worker1 # [ 0.394825] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]983worker2 # [ 0.391550] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint984client # [ 0.368036] io scheduler mq-deadline registered985worker1 # [ 0.394854] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]986client # [ 0.368046] io scheduler kyber registered987worker1 # [ 0.395345] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint988worker1 # [ 0.395528] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]989worker1 # [ 0.395544] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]990worker1 # [ 0.395576] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]991worker1 # [ 0.396037] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint992worker1 # [ 0.396220] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]993worker1 # [ 0.396236] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]994worker1 # [ 0.396265] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]995worker1 # [ 0.396713] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint996worker1 # [ 0.396898] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]997lb # [ 0.378475] pl061_gpio 9030000.pl061: PL061 GPIO chip registered998worker1 # [ 0.396913] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]999worker2 # [ 0.439885] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1000worker1 # [ 0.396943] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1001worker2 # [ 0.439914] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1002worker1 # [ 0.397427] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1003worker2 # [ 0.439944] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1004client # [ 0.378476] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1005worker1 # [ 0.397612] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1006lb # [ 0.379880] ledtrig-cpu: registered to indicate activity on CPUs1007worker2 # [ 0.440433] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1008worker1 # [ 0.397628] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1009lb # [ 0.380278] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1010worker2 # [ 0.440622] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1011worker1 # [ 0.397657] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1012worker2 # [ 0.440638] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1013lb # [ 0.380295] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001014worker1 # [ 0.397673] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1015worker2 # [ 0.440667] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1016lb # [ 0.380308] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001017client # [ 0.379906] ledtrig-cpu: registered to indicate activity on CPUs1018worker1 # [ 0.398124] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1019worker2 # [ 0.441270] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1020worker1 # [ 0.398311] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1021client # [ 0.380297] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1022lb # [ 0.380316] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001023worker2 # [ 0.441283] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1024worker1 # [ 0.398341] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1025client # [ 0.380313] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001026lb # [ 0.380338] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1027worker2 # [ 0.441289] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1028client # [ 0.380326] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001029lb # [ 0.380368] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1030worker2 # [ 0.441335] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1031worker1 # [ 0.417624] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1032lb # [ 0.380445] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001033worker2 # [ 0.441382] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1034client # [ 0.380334] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001035worker1 # [ 0.417818] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1036lb # [ 0.380454] pci_bus 0000:00: root bus resource [bus 00-ff]1037worker2 # [ 0.441430] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1038client # [ 0.380355] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1039worker1 # [ 0.417848] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1040lb # [ 0.380461] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1041worker2 # [ 0.441476] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1042lb # [ 0.380466] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1043client # [ 0.380380] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1044worker1 # [ 0.418235] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1045worker1 # [ 0.418418] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1046lb # [ 0.380471] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1047worker2 # [ 0.441524] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1048client # [ 0.380475] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001049client # [ 0.380485] pci_bus 0000:00: root bus resource [bus 00-ff]1050worker2 # [ 0.441572] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1051lb # [ 0.380531] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1052client # [ 0.380491] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1053worker2 # [ 0.441620] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1054lb # [ 0.380970] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1055client # [ 0.380496] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1056lb # [ 0.381157] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1057worker2 # [ 0.441668] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1058client # [ 0.380501] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1059lb # [ 0.381173] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1060worker2 # [ 0.441716] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1061client # [ 0.380590] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1062lb # [ 0.381217] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1063worker2 # [ 0.441833] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1064lb # [ 0.381237] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1065client # [ 0.381028] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1066worker2 # [ 0.441880] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1067client # [ 0.381217] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1068lb # [ 0.381705] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1069worker2 # [ 0.441902] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1070lb # [ 0.381891] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1071client # [ 0.381234] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1072lb # [ 0.381907] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1073worker2 # [ 0.441924] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1074client # [ 0.381264] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1075lb # [ 0.381936] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1076client # [ 0.381280] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1077worker2 # [ 0.441946] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1078worker2 # [ 0.441970] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1079client # [ 0.381741] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1080worker2 # [ 0.441991] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1081client # [ 0.381929] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1082client # [ 0.381946] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1083worker2 # [ 0.442013] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1084lb # [ 0.400845] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1085lb # [ 0.401033] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1086client # [ 0.381976] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1087worker2 # [ 0.442035] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1088lb # [ 0.401050] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1089worker2 # [ 0.442058] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1090lb # [ 0.401080] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1091worker2 # [ 0.442080] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1092client # [ 0.401063] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1093lb # [ 0.401553] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1094worker2 # [ 0.442103] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1095client # [ 0.401252] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f]1096lb # [ 0.401737] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1097worker2 # [ 0.442125] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1098client # [ 0.401268] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1099worker1 # [ 0.430735] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1100lb # [ 0.401753] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1101worker2 # [ 0.442147] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1102worker1 # [ 0.431054] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1103lb # [ 0.401785] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1104client # [ 0.401298] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1105worker2 # [ 0.442168] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1106worker1 # [ 0.431072] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1107worker2 # [ 0.442190] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1108client # [ 0.401764] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1109lb # [ 0.402242] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1110worker1 # [ 0.431103] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1111client # [ 0.401948] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1112worker2 # [ 0.442211] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1113worker1 # [ 0.431583] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1114client # [ 0.401964] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1115worker2 # [ 0.442232] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1116worker1 # [ 0.431767] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1117worker2 # [ 0.442254] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1118client # [ 0.401997] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1119worker1 # [ 0.431783] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1120worker2 # [ 0.442275] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1121worker1 # [ 0.431813] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1122worker2 # [ 0.442297] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1123worker2 # [ 0.442318] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1124worker1 # [ 0.432404] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1125worker2 # [ 0.442344] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1126worker1 # [ 0.432416] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1127worker2 # [ 0.442354] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1128worker1 # [ 0.432422] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1129worker2 # [ 0.442359] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1130worker1 # [ 0.432468] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1131worker2 # [ 0.443514] pci 0000:00:0a.0: enabling device (0000 -> 0002)1132worker1 # [ 0.432516] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1133worker1 # [ 0.432563] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1134worker1 # [ 0.432610] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1135worker1 # [ 0.432657] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1136worker1 # [ 0.432705] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1137worker1 # [ 0.432753] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1138lb # [ 0.414459] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1139worker1 # [ 0.432802] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1140lb # [ 0.414481] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1141lb # [ 0.414511] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1142worker1 # [ 0.432850] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1143lb # [ 0.414973] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1144worker1 # [ 0.432924] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1145lb # [ 0.415157] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1146worker1 # [ 0.432971] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1147worker2 # [ 0.487882] pci 0000:00:0a.0: quirk_usb_early_handoff+0x0/0xa60 took 43331 usecs1148client # [ 0.414508] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1149lb # [ 0.415172] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1150worker1 # [ 0.432992] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1151client # [ 0.414701] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f]1152lb # [ 0.415202] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1153client # [ 0.414718] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1154worker1 # [ 0.433014] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1155lb # [ 0.415682] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1156client # [ 0.414748] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1157worker1 # [ 0.433036] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1158lb # [ 0.415865] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1159worker1 # [ 0.433061] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1160client # [ 0.415209] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1161lb # [ 0.415881] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1162client # [ 0.415395] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]1163worker1 # [ 0.433083] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1164lb # [ 0.415910] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1165client # [ 0.415411] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1166worker1 # [ 0.433105] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1167lb # [ 0.415926] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1168worker1 # [ 0.433127] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1169client # [ 0.415440] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1170lb # [ 0.416384] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1171worker1 # [ 0.433149] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1172client # [ 0.415893] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1173lb # [ 0.416572] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1174client # [ 0.416080] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]1175worker1 # [ 0.433171] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1176lb # [ 0.416601] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1177client # [ 0.416096] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]1178worker1 # [ 0.433194] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1179lb # [ 0.417048] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1180client # [ 0.416126] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1181worker1 # [ 0.433217] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1182lb # [ 0.417244] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1183client # [ 0.416142] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]1184worker1 # [ 0.433238] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1185lb # [ 0.417274] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1186worker1 # [ 0.433260] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1187client # [ 0.416638] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1188worker1 # [ 0.433281] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1189client # [ 0.416825] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1190lb # [ 0.417679] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1191worker1 # [ 0.433303] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1192lb # [ 0.417860] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1193client # [ 0.416858] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1194worker1 # [ 0.433324] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1195lb # [ 0.418106] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1196client # [ 0.417309] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1197worker1 # [ 0.433346] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1198lb # [ 0.418411] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1199client # [ 0.417499] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1200worker1 # [ 0.433368] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1201lb # [ 0.418428] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1202client # [ 0.417529] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1203worker1 # [ 0.433390] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1204lb # [ 0.418457] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1205worker1 # [ 0.433412] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1206client # [ 0.417932] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1207worker1 # [ 0.433439] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1208lb # [ 0.418912] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1209client # [ 0.418126] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]1210lb # [ 0.419099] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1211worker1 # [ 0.433448] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1212client # [ 0.418392] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1213lb # [ 0.419115] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1214worker1 # [ 0.433453] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1215client # [ 0.418673] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1216lb # [ 0.419144] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1217worker1 # [ 0.434645] pci 0000:00:0a.0: enabling device (0000 -> 0002)1218client # [ 0.418690] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1219lb # [ 0.419723] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1220client # [ 0.418719] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1221lb # [ 0.419734] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1222client # [ 0.419177] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1223lb # [ 0.419740] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1224client # [ 0.419373] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1225lb # [ 0.419783] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1226client # [ 0.419390] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1227worker2 # [ 0.508376] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1228client # [ 0.419421] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1229lb # [ 0.419829] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1230worker2 # [ 0.510501] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1231client # [ 0.419991] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1232lb # [ 0.419875] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1233client # [ 0.420002] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1234lb # [ 0.419925] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1235client # [ 0.420008] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1236lb # [ 0.419972] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1237client # [ 0.420051] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1238lb # [ 0.420019] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1239client # [ 0.420098] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1240lb # [ 0.420065] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1241client # [ 0.420144] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1242lb # [ 0.420112] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1243client # [ 0.420191] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1244lb # [ 0.420158] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1245client # [ 0.420237] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1246lb # [ 0.420230] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1247client # [ 0.420285] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1248lb # [ 0.420276] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1249lb # [ 0.420297] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1250client # [ 0.420332] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1251lb # [ 0.420318] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1252client # [ 0.420380] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1253lb # [ 0.420340] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1254client # [ 0.420427] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1255worker2 # [ 0.521738] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1256lb # [ 0.420365] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1257client # [ 0.420496] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1258worker1 # [ 0.488898] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1259lb # [ 0.420387] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1260client # [ 0.420543] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1261lb # [ 0.420408] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1262client # [ 0.420564] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1263lb # [ 0.420430] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1264client # [ 0.420586] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1265lb # [ 0.420452] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1266client # [ 0.420608] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1267lb # [ 0.420473] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1268client # [ 0.420633] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1269lb # [ 0.420496] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1270client # [ 0.420655] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1271lb # [ 0.420518] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1272client # [ 0.420677] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned1273lb # [ 0.420539] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1274client # [ 0.420700] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1275lb # [ 0.420564] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1276client # [ 0.420722] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1277lb # [ 0.420585] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1278lb # [ 0.420607] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1279client # [ 0.420745] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned1280worker2 # [ 0.527834] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1281lb # [ 0.420628] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1282client # [ 0.420767] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1283worker2 # [ 0.529882] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1284lb # [ 0.420650] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1285client # [ 0.420790] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1286lb # [ 0.420671] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1287client # [ 0.420811] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned1288lb # [ 0.420692] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1289client # [ 0.420833] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned1290lb # [ 0.420714] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1291worker1 # [ 0.499135] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1292client # [ 0.420854] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned1293lb # [ 0.420740] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1294client # [ 0.420876] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned1295lb # [ 0.420750] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1296client # [ 0.420898] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned1297lb # [ 0.420754] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1298client # [ 0.420919] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned1299lb # [ 0.421925] pci 0000:00:0a.0: enabling device (0000 -> 0002)1300client # [ 0.420941] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned1301client # [ 0.420963] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned1302client # [ 0.420984] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned1303client # [ 0.421010] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1304client # [ 0.421020] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1305client # [ 0.421025] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1306worker2 # [ 0.539930] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1307client # [ 0.422214] pci 0000:00:0a.0: enabling device (0000 -> 0002)1308worker2 # [ 0.542027] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1309lb # [ 0.482466] pci 0000:00:0a.0: quirk_usb_early_handoff+0x0/0xa60 took 59126 usecs1310worker1 # [ 0.510677] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1311worker1 # [ 0.512876] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1312client # [ 0.482449] pci 0000:00:0a.0: quirk_usb_early_handoff+0x0/0xa60 took 58827 usecs1313worker2 # [ 0.551934] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1314worker2 # [ 0.555157] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1315worker2 # [ 0.557002] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1316worker2 # [ 0.559365] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1317worker1 # [ 0.522627] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1318worker1 # [ 0.525338] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1319worker1 # [ 0.527371] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1320worker1 # [ 0.529680] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1321lb # [ 0.503247] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1322lb # [ 0.505632] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1323worker1 # [ 0.540145] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1324client # [ 0.508932] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1325worker2 # [ 0.577007] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1326worker1 # [ 0.541984] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1327worker2 # [ 0.579645] msm_serial: driver initialized1328client # [ 0.511973] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1329lb # [ 0.516717] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1330client # [ 0.513981] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1331worker2 # [ 0.583913] SuperH (H)SCI(F) driver initialized1332worker2 # [ 0.583978] STM32 USART driver initialized1333worker1 # [ 0.553814] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1334client # [ 0.523810] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1335client # [ 0.525820] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1336lb # [ 0.526572] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1337lb # [ 0.530764] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)1338lb # [ 0.533173] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1339worker1 # [ 0.566553] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1340worker1 # [ 0.569183] msm_serial: driver initialized1341worker1 # [ 0.569323] SuperH (H)SCI(F) driver initialized1342client # [ 0.537127] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)1343worker1 # [ 0.569378] STM32 USART driver initialized1344client # [ 0.540144] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1345lb # [ 0.544391] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)1346client # [ 0.542269] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1347worker2 # [ 0.615978] loop: module loaded1348worker2 # [ 0.616195] virtio_blk virtio5: 1/0/0 default/read/poll queues1349worker2 # [ 0.617166] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1350lb # [ 0.550597] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1351lb # [ 0.552880] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1352client # [ 0.552249] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1353client # [ 0.554224] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1354lb # [ 0.562893] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1355lb # [ 0.565239] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1356worker2 # [ 0.624340] megasas: 07.734.00.00-rc11357worker2 # [ 0.625139] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1358client # [ 0.564237] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1359worker2 # [ 0.627395] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001360worker2 # [ 0.627444] Intel/Sharp Extended Query Table at 0x00311361worker2 # [ 0.629063] Using buffer write method1362worker2 # [ 0.629119] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1363worker2 # [ 0.630790] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001364worker1 # [ 0.603302] loop: module loaded1365worker2 # [ 0.630813] Intel/Sharp Extended Query Table at 0x00311366worker1 # [ 0.603491] virtio_blk virtio5: 1/0/0 default/read/poll queues1367worker1 # [ 0.604175] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1368client # [ 0.575546] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1369client # [ 0.578143] msm_serial: driver initialized1370client # [ 0.578316] SuperH (H)SCI(F) driver initialized1371lb # [ 0.583589] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1372worker2 # [ 0.649522] Using buffer write method1373lb # [ 0.586318] msm_serial: driver initialized1374worker2 # [ 0.649560] Concatenating MTD devices:1375worker2 # [ 0.649565] (0): "0.flash"1376worker2 # [ 0.649569] (1): "0.flash"1377worker2 # [ 0.649572] into device "0.flash"1378client # [ 0.579499] STM32 USART driver initialized1379lb # [ 0.587054] SuperH (H)SCI(F) driver initialized1380lb # [ 0.587115] STM32 USART driver initialized1381worker1 # [ 0.615203] megasas: 07.734.00.00-rc11382worker1 # [ 0.615953] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1383worker1 # [ 0.618328] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001384worker1 # [ 0.618387] Intel/Sharp Extended Query Table at 0x00311385worker1 # [ 0.619967] Using buffer write method1386worker1 # [ 0.620030] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1387worker1 # [ 0.621745] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001388worker1 # [ 0.621771] Intel/Sharp Extended Query Table at 0x00311389worker1 # [ 0.640563] Using buffer write method1390worker1 # [ 0.640600] Concatenating MTD devices:1391worker1 # [ 0.640604] (0): "0.flash"1392worker1 # [ 0.640608] (1): "0.flash"1393worker1 # [ 0.640611] into device "0.flash"1394client # [ 0.612249] loop: module loaded1395client # [ 0.612439] virtio_blk virtio5: 1/0/0 default/read/poll queues1396client # [ 0.613240] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1397lb # [ 0.620506] loop: module loaded1398lb # [ 0.620708] virtio_blk virtio5: 1/0/0 default/read/poll queues1399lb # [ 0.621502] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1400client # [ 0.619007] megasas: 07.734.00.00-rc11401client # [ 0.619758] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1402client # [ 0.621917] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001403client # [ 0.621942] Intel/Sharp Extended Query Table at 0x00311404lb # [ 0.627003] megasas: 07.734.00.00-rc11405lb # [ 0.627699] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1406client # [ 0.631395] Using buffer write method1407client # [ 0.631467] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1408client # [ 0.633952] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001409client # [ 0.633977] Intel/Sharp Extended Query Table at 0x00311410lb # [ 0.638396] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001411lb # [ 0.638423] Intel/Sharp Extended Query Table at 0x00311412lb # [ 0.640076] Using buffer write method1413lb # [ 0.640148] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1414lb # [ 0.641971] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001415lb # [ 0.641996] Intel/Sharp Extended Query Table at 0x00311416lb # [ 0.643767] Using buffer write method1417lb # [ 0.643790] Concatenating MTD devices:1418client # [ 0.647485] Using buffer write method1419lb # [ 0.643794] (0): "0.flash"1420client # [ 0.647544] Concatenating MTD devices:1421lb # [ 0.643798] (1): "0.flash"1422client # [ 0.647548] (0): "0.flash"1423lb # [ 0.643801] into device "0.flash"1424client # [ 0.647552] (1): "0.flash"1425client # [ 0.647556] into device "0.flash"1426worker2 # [ 0.892045] Freeing initrd memory: 26148K1427worker2 # [ 0.898132] tun: Universal TUN/TAP device driver, 1.61428worker2 # [ 0.901948] thunder_xcv, ver 1.01429worker2 # [ 0.901993] thunder_bgx, ver 1.01430worker2 # [ 0.902016] nicpf, ver 1.01431worker2 # [ 0.902575] e1000: Intel(R) PRO/1000 Network Driver1432worker2 # [ 0.902582] e1000: Copyright (c) 1999-2006 Intel Corporation.1433worker2 # [ 0.902608] e1000e: Intel(R) PRO/1000 Network Driver1434worker2 # [ 0.902616] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1435worker2 # [ 0.902645] igb: Intel(R) Gigabit Ethernet Network Driver1436worker2 # [ 0.902651] igb: Copyright (c) 2007-2014 Intel Corporation.1437worker2 # [ 0.902674] igbvf: Intel(R) Gigabit Virtual Function Network Driver1438worker2 # [ 0.902680] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1439worker2 # [ 0.902818] sky2: driver version 1.301440worker2 # [ 0.911572] usbcore: registered new interface driver usb-storage1441worker2 # [ 0.911711] usbcore: registered new interface driver usbserial_generic1442worker2 # [ 0.911726] usbserial: USB Serial support registered for generic1443worker2 # [ 0.914692] ehci-pci 0000:00:0a.0: EHCI Host Controller1444worker2 # [ 0.914722] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11445worker1 # [ 0.880814] Freeing initrd memory: 26148K1446worker2 # [ 0.914985] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001447worker2 # [ 0.918031] hv_vmbus: registering driver hyperv_keyboard1448worker2 # [ 0.919586] rtc-pl031 9010000.pl031: registered as rtc01449worker2 # [ 0.919612] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T13:28:01 UTC (1789910881)1450worker1 # [ 0.886906] tun: Universal TUN/TAP device driver, 1.61451worker2 # [ 0.921661] i2c_dev: i2c /dev entries driver1452worker2 # [ 0.924824] sdhci: Secure Digital Host Controller Interface driver1453worker2 # [ 0.924834] sdhci: Copyright(c) Pierre Ossman1454worker2 # [ 0.925109] Synopsys Designware Multimedia Card Interface Driver1455worker1 # [ 0.890714] thunder_xcv, ver 1.01456worker1 # [ 0.890753] thunder_bgx, ver 1.01457worker2 # [ 0.925479] sdhci-pltfm: SDHCI platform and OF driver helper1458worker1 # [ 0.890795] nicpf, ver 1.01459worker2 # [ 0.927167] hid: raw HID events driver (C) Jiri Kosina1460worker1 # [ 0.891379] e1000: Intel(R) PRO/1000 Network Driver1461worker2 # [ 0.927422] usbcore: registered new interface driver usbhid1462worker1 # [ 0.891386] e1000: Copyright (c) 1999-2006 Intel Corporation.1463worker2 # [ 0.927428] usbhid: USB HID core driver1464worker1 # [ 0.891410] e1000e: Intel(R) PRO/1000 Network Driver1465worker2 # [ 0.932279] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001466worker1 # [ 0.891420] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1467worker2 # [ 0.933326] hub 1-0:1.0: USB hub found1468worker1 # [ 0.891450] igb: Intel(R) Gigabit Ethernet Network Driver1469worker2 # [ 0.933827] hub 1-0:1.0: 6 ports detected1470worker1 # [ 0.891456] igb: Copyright (c) 2007-2014 Intel Corporation.1471worker1 # [ 0.891480] igbvf: Intel(R) Gigabit Virtual Function Network Driver1472worker1 # [ 0.891486] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1473worker1 # [ 0.891623] sky2: driver version 1.301474worker2 # [ 0.935500] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1475worker1 # [ 0.893267] usbcore: registered new interface driver usb-storage1476worker1 # [ 0.893375] usbcore: registered new interface driver usbserial_generic1477worker1 # [ 0.893391] usbserial: USB Serial support registered for generic1478worker2 # [ 0.938133] drop_monitor: Initializing network drop monitor service1479worker1 # [ 0.894008] hv_vmbus: registering driver hyperv_keyboard1480worker2 # [ 0.938331] NET: Registered PF_INET6 protocol family1481worker1 # [ 0.895277] ehci-pci 0000:00:0a.0: EHCI Host Controller1482worker2 # [ 0.940353] Segment Routing with IPv61483worker1 # [ 0.895304] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11484worker2 # [ 0.940375] In-situ OAM (IOAM) with IPv61485worker2 # [ 0.940414] NET: Registered PF_PACKET protocol family1486worker1 # [ 0.895466] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001487worker1 # [ 0.907063] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001488worker1 # [ 0.907444] hub 1-0:1.0: USB hub found1489worker1 # [ 0.907461] hub 1-0:1.0: 6 ports detected1490worker2 # [ 0.942076] 9pnet: Installing 9P2000 support1491worker1 # [ 0.910644] rtc-pl031 9010000.pl031: registered as rtc01492worker1 # [ 0.910674] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T13:28:02 UTC (1789910882)1493worker1 # [ 0.911091] i2c_dev: i2c /dev entries driver1494worker2 # [ 0.944944] Key type dns_resolver registered1495worker2 # [ 0.951292] registered taskstats version 11496worker2 # [ 0.951439] Loading compiled-in X.509 certificates1497worker1 # [ 0.916168] sdhci: Secure Digital Host Controller Interface driver1498worker1 # [ 0.916178] sdhci: Copyright(c) Pierre Ossman1499worker1 # [ 0.916455] Synopsys Designware Multimedia Card Interface Driver1500worker1 # [ 0.916847] sdhci-pltfm: SDHCI platform and OF driver helper1501worker1 # [ 0.921274] hid: raw HID events driver (C) Jiri Kosina1502client # [ 0.889145] Freeing initrd memory: 26160K1503worker1 # [ 0.921540] usbcore: registered new interface driver usbhid1504worker1 # [ 0.921547] usbhid: USB HID core driver1505lb # [ 0.895400] Freeing initrd memory: 26140K1506worker2 # [ 0.960286] Demotion targets for Node 0: null1507worker1 # [ 0.924471] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1508worker2 # [ 0.960413] Key type .fscrypt registered1509worker1 # [ 0.926076] drop_monitor: Initializing network drop monitor service1510worker2 # [ 0.960420] Key type fscrypt-provisioning registered1511client # [ 0.895365] tun: Universal TUN/TAP device driver, 1.61512worker1 # [ 0.926219] NET: Registered PF_INET6 protocol family1513worker2 # [ 0.960515] ima: No TPM chip found, activating TPM-bypass!1514worker2 # [ 0.960534] ima: Allocated hash algorithm: sha11515worker1 # [ 0.929352] Segment Routing with IPv61516worker2 # [ 0.960554] ima: No architecture policies found1517worker1 # [ 0.929369] In-situ OAM (IOAM) with IPv61518worker1 # [ 0.929400] NET: Registered PF_PACKET protocol family1519worker2 # [ 0.964912] input: gpio-keys as /devices/platform/gpio-keys/input/input01520lb # [ 0.901558] tun: Universal TUN/TAP device driver, 1.61521worker1 # [ 0.931293] 9pnet: Installing 9P2000 support1522worker1 # [ 0.933446] Key type dns_resolver registered1523lb # [ 0.905378] thunder_xcv, ver 1.01524client # [ 0.899165] thunder_xcv, ver 1.01525client # [ 0.899218] thunder_bgx, ver 1.01526lb # [ 0.905425] thunder_bgx, ver 1.01527client # [ 0.899240] nicpf, ver 1.01528lb # [ 0.905448] nicpf, ver 1.01529lb # [ 0.906015] e1000: Intel(R) PRO/1000 Network Driver1530client # [ 0.899793] e1000: Intel(R) PRO/1000 Network Driver1531lb # [ 0.906022] e1000: Copyright (c) 1999-2006 Intel Corporation.1532client # [ 0.899799] e1000: Copyright (c) 1999-2006 Intel Corporation.1533client # [ 0.899823] e1000e: Intel(R) PRO/1000 Network Driver1534lb # [ 0.906048] e1000e: Intel(R) PRO/1000 Network Driver1535lb # [ 0.906056] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1536client # [ 0.899831] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1537client # [ 0.899860] igb: Intel(R) Gigabit Ethernet Network Driver1538lb # [ 0.906086] igb: Intel(R) Gigabit Ethernet Network Driver1539client # [ 0.899866] igb: Copyright (c) 2007-2014 Intel Corporation.1540lb # [ 0.906092] igb: Copyright (c) 2007-2014 Intel Corporation.1541client # [ 0.899888] igbvf: Intel(R) Gigabit Virtual Function Network Driver1542lb # [ 0.906116] igbvf: Intel(R) Gigabit Virtual Function Network Driver1543client # [ 0.899894] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1544lb # [ 0.906122] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1545client # [ 0.900032] sky2: driver version 1.301546lb # [ 0.906261] sky2: driver version 1.301547worker1 # [ 0.940188] registered taskstats version 11548worker1 # [ 0.940354] Loading compiled-in X.509 certificates1549client # [ 0.901617] usbcore: registered new interface driver usb-storage1550client # [ 0.901700] usbcore: registered new interface driver usbserial_generic1551client # [ 0.901714] usbserial: USB Serial support registered for generic1552client # [ 0.903029] ehci-pci 0000:00:0a.0: EHCI Host Controller1553client # [ 0.903059] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11554client # [ 0.903262] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001555lb # [ 0.915145] usbcore: registered new interface driver usb-storage1556lb # [ 0.915240] usbcore: registered new interface driver usbserial_generic1557client # [ 0.915131] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001558lb # [ 0.915256] usbserial: USB Serial support registered for generic1559client # [ 0.915463] hub 1-0:1.0: USB hub found1560lb # [ 0.915872] hv_vmbus: registering driver hyperv_keyboard1561worker1 # [ 0.949035] Demotion targets for Node 0: null1562client # [ 0.915477] hub 1-0:1.0: 6 ports detected1563worker1 # [ 0.949141] Key type .fscrypt registered1564lb # [ 0.917148] ehci-pci 0000:00:0a.0: EHCI Host Controller1565worker1 # [ 0.949148] Key type fscrypt-provisioning registered1566lb # [ 0.917175] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 11567client # [ 0.917552] hv_vmbus: registering driver hyperv_keyboard1568worker1 # [ 0.949243] ima: No TPM chip found, activating TPM-bypass!1569lb # [ 0.917402] ehci-pci 0000:00:0a.0: irq 15, io mem 0x100890001570worker1 # [ 0.949261] ima: Allocated hash algorithm: sha11571worker2 # [ 0.983969] clk: Disabling unused clocks1572worker1 # [ 0.949283] ima: No architecture policies found1573worker2 # [ 0.983996] PM: genpd: Disabling unused power domains1574client # [ 0.919250] rtc-pl031 9010000.pl031: registered as rtc01575worker1 # [ 0.953400] input: gpio-keys as /devices/platform/gpio-keys/input/input01576lb # [ 0.922938] rtc-pl031 9010000.pl031: registered as rtc01577client # [ 0.919285] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T13:28:02 UTC (1789910882)1578client # [ 0.919628] i2c_dev: i2c /dev entries driver1579worker2 # [ 0.988257] Freeing unused kernel memory: 4736K1580lb # [ 0.922966] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T13:28:02 UTC (1789910882)1581worker2 # [ 0.988440] Run /init as init process1582lb # [ 0.923325] i2c_dev: i2c /dev entries driver1583client # [ 0.924564] sdhci: Secure Digital Host Controller Interface driver1584client # [ 0.924577] sdhci: Copyright(c) Pierre Ossman1585lb # [ 0.928362] sdhci: Secure Digital Host Controller Interface driver1586client # [ 0.924845] Synopsys Designware Multimedia Card Interface Driver1587lb # [ 0.928372] sdhci: Copyright(c) Pierre Ossman1588client # [ 0.925225] sdhci-pltfm: SDHCI platform and OF driver helper1589lb # [ 0.928651] Synopsys Designware Multimedia Card Interface Driver1590lb # [ 0.929036] sdhci-pltfm: SDHCI platform and OF driver helper1591lb # [ 0.933063] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.001592client # [ 0.929704] hid: raw HID events driver (C) Jiri Kosina1593lb # [ 0.934113] hub 1-0:1.0: USB hub found1594client # [ 0.929953] usbcore: registered new interface driver usbhid1595client # [ 0.929960] usbhid: USB HID core driver1596lb # [ 0.934665] hub 1-0:1.0: 6 ports detected1597lb # [ 0.935920] hid: raw HID events driver (C) Jiri Kosina1598client # [ 0.932915] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1599lb # [ 0.936193] usbcore: registered new interface driver usbhid1600lb # [ 0.936200] usbhid: USB HID core driver1601client # [ 0.935597] drop_monitor: Initializing network drop monitor service1602client # [ 0.935765] NET: Registered PF_INET6 protocol family1603client # [ 0.937754] Segment Routing with IPv61604client # [ 0.937775] In-situ OAM (IOAM) with IPv61605lb # [ 0.939171] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1606client # [ 0.937802] NET: Registered PF_PACKET protocol family1607lb # [ 0.940778] drop_monitor: Initializing network drop monitor service1608worker2 # [ 1.006074] systemd[1]: Successfully made /usr/ read-only.1609lb # [ 0.940933] NET: Registered PF_INET6 protocol family1610lb # [ 0.944003] Segment Routing with IPv61611worker1 # [ 0.971473] clk: Disabling unused clocks1612lb # [ 0.944024] In-situ OAM (IOAM) with IPv61613worker1 # [ 0.971508] PM: genpd: Disabling unused power domains1614lb # [ 0.944052] NET: Registered PF_PACKET protocol family1615client # [ 0.939695] 9pnet: Installing 9P2000 support1616client # [ 0.941845] Key type dns_resolver registered1617lb # [ 0.945740] 9pnet: Installing 9P2000 support1618worker1 # [ 0.975874] Freeing unused kernel memory: 4736K1619worker1 # [ 0.976104] Run /init as init process1620lb # [ 0.948535] Key type dns_resolver registered1621client # [ 0.948739] registered taskstats version 11622client # [ 0.948889] Loading compiled-in X.509 certificates1623lb # [ 0.955203] registered taskstats version 11624lb # [ 0.955377] Loading compiled-in X.509 certificates1625client # [ 0.957356] Demotion targets for Node 0: null1626client # [ 0.957463] Key type .fscrypt registered1627client # [ 0.957470] Key type fscrypt-provisioning registered1628client # [ 0.957562] ima: No TPM chip found, activating TPM-bypass!1629worker1 # [ 0.992684] systemd[1]: Successfully made /usr/ read-only.1630client # [ 0.957581] ima: Allocated hash algorithm: sha11631client # [ 0.957603] ima: No architecture policies found1632lb # [ 0.964343] Demotion targets for Node 0: null1633lb # [ 0.964494] Key type .fscrypt registered1634client # [ 0.961862] input: gpio-keys as /devices/platform/gpio-keys/input/input01635lb # [ 0.964500] Key type fscrypt-provisioning registered1636lb # [ 0.964600] ima: No TPM chip found, activating TPM-bypass!1637lb # [ 0.964620] ima: Allocated hash algorithm: sha11638lb # [ 0.964651] ima: No architecture policies found1639lb # [ 0.968711] input: gpio-keys as /devices/platform/gpio-keys/input/input01640client # [ 0.980060] clk: Disabling unused clocks1641client # [ 0.980090] PM: genpd: Disabling unused power domains1642client # [ 0.984448] Freeing unused kernel memory: 4736K1643client # [ 0.984659] Run /init as init process1644lb # [ 0.987363] clk: Disabling unused clocks1645lb # [ 0.987394] PM: genpd: Disabling unused power domains1646lb # [ 0.991689] Freeing unused kernel memory: 4736K1647lb # [ 0.991903] Run /init as init process1648client # [ 1.000568] systemd[1]: Successfully made /usr/ read-only.1649lb # [ 1.008573] systemd[1]: Successfully made /usr/ read-only.1650worker2 # [ 1.183825] usb 1-1: new high-speed USB device number 2 using ehci-pci1651worker1 # [ 1.154529] usb 1-1: new high-speed USB device number 2 using ehci-pci1652client # [ 1.162424] usb 1-1: new high-speed USB device number 2 using ehci-pci1653lb # [ 1.182437] usb 1-1: new high-speed USB device number 2 using ehci-pci1654worker1 # [ 1.304278] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11655worker2 # [ 1.336012] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11656worker2 # [ 1.341921] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1657worker2 # [ 1.341979] systemd[1]: Detected virtualization qemu.1658worker2 # [ 1.342054] systemd[1]: Detected architecture arm64.1659worker2 # [ 1.342078] systemd[1]: Running in initrd.1660worker2 # [ 1.342991] systemd[1]: Initializing machine ID from random generator.1661worker2 # [ 1.343265] systemd[1]: Hostname set to <worker2>.1662worker1 # [ 1.327397] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1663worker1 # [ 1.333110] systemd[1]: Detected virtualization qemu.1664worker1 # [ 1.334047] systemd[1]: Detected architecture arm64.1665worker1 # [ 1.334975] systemd[1]: Running in initrd.1666worker1 # [ 1.336223] systemd[1]: Initializing machine ID from random generator.1667worker1 # [ 1.337456] systemd[1]: Hostname set to <worker1>.1668client # [ 1.312308] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11669lb # [ 1.334745] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11670client # [ 1.335256] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1671client # [ 1.340618] systemd[1]: Detected virtualization qemu.1672client # [ 1.341495] systemd[1]: Detected architecture arm64.1673client # [ 1.342332] systemd[1]: Running in initrd.1674client # [ 1.343576] systemd[1]: Initializing machine ID from random generator.1675client # [ 1.344804] systemd[1]: Hostname set to <client>.1676lb # [ 1.343411] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1677lb # [ 1.355614] systemd[1]: Detected virtualization qemu.1678lb # [ 1.357674] systemd[1]: Detected architecture arm64.1679lb # [ 1.359628] systemd[1]: Running in initrd.1680lb # [ 1.362217] systemd[1]: Initializing machine ID from random generator.1681lb # [ 1.365156] systemd[1]: Hostname set to <lb>.1682worker2 # [ 1.427972] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01683worker1 # [ 1.394711] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01684client # [ 1.398565] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01685lb # [ 1.422613] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input01686worker1 # [ 1.514545] usb 1-2: new high-speed USB device number 3 using ehci-pci1687worker2 # [ 1.551815] usb 1-2: new high-speed USB device number 3 using ehci-pci1688client # [ 1.518398] usb 1-2: new high-speed USB device number 3 using ehci-pci1689lb # [ 1.542435] usb 1-2: new high-speed USB device number 3 using ehci-pci1690worker1 # [ 1.631445] systemd[1]: bpf-restrict-fs: LSM BPF program attached1691worker2 # [ 1.684559] systemd[1]: bpf-restrict-fs: LSM BPF program attached1692client # [ 1.626630] systemd[1]: bpf-restrict-fs: LSM BPF program attached1693worker1 # [ 1.675679] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21694worker1 # [ 1.679548] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01695worker2 # [ 1.712077] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21696worker2 # [ 1.717242] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01697lb # [ 1.662246] systemd[1]: bpf-restrict-fs: LSM BPF program attached1698client # [ 1.677662] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21699client # [ 1.681457] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01700lb # [ 1.702796] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21701lb # [ 1.707165] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input01702worker1 # [ 1.739783] systemd[1]: Queued start job for default target Initrd Default Target.1703worker1 # [ 1.748956] systemd[1]: Created slice Slice /system/modprobe.1704worker1 # [ 1.750214] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1705worker1 # [ 1.751715] systemd[1]: Expecting device /dev/disk/by-label/nixos...1706worker1 # [ 1.752815] systemd[1]: Reached target Path Units.1707worker1 # [ 1.753657] systemd[1]: Reached target Slice Units.1708worker1 # [ 1.754551] systemd[1]: Reached target Swaps.1709worker1 # [ 1.755336] systemd[1]: Reached target Timer Units.1710worker1 # [ 1.756383] systemd[1]: Listening on D-Bus System Message Bus Socket.1711worker1 # [ 1.757738] systemd[1]: Listening on Journal Socket (/dev/log).1712worker1 # [ 1.758972] systemd[1]: Listening on Journal Sockets.1713worker1 # [ 1.759999] systemd[1]: Listening on udev Control Socket.1714worker1 # [ 1.761061] systemd[1]: Listening on udev Kernel Socket.1715worker1 # [ 1.762003] systemd[1]: Reached target Socket Units.1716worker2 # [ 1.799515] systemd[1]: Queued start job for default target Initrd Default Target.1717worker1 # [ 1.764650] systemd[1]: Starting Create List of Static Device Nodes...1718client # [ 1.733293] systemd[1]: Queued start job for default target Initrd Default Target.1719worker1 # [ 1.774676] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1720worker2 # [ 1.810325] systemd[1]: Created slice Slice /system/modprobe.1721client # [ 1.744891] systemd[1]: Created slice Slice /system/modprobe.1722worker1 # [ 1.774806] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1723worker2 # [ 1.811540] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1724client # [ 1.746186] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1725worker2 # [ 1.812999] systemd[1]: Expecting device /dev/disk/by-label/nixos...1726worker2 # [ 1.813037] systemd[1]: Reached target Path Units.1727worker2 # [ 1.813058] systemd[1]: Reached target Slice Units.1728client # [ 1.747715] systemd[1]: Expecting device /dev/disk/by-label/nixos...1729worker1 # [ 1.782759] systemd[1]: Mounting Kernel Configuration File System...1730worker2 # [ 1.813077] systemd[1]: Reached target Swaps.1731client # [ 1.747754] systemd[1]: Reached target Path Units.1732worker2 # [ 1.813096] systemd[1]: Reached target Timer Units.1733client # [ 1.747777] systemd[1]: Reached target Slice Units.1734client # [ 1.747798] systemd[1]: Reached target Swaps.1735worker2 # [ 1.813286] systemd[1]: Listening on D-Bus System Message Bus Socket.1736client # [ 1.747820] systemd[1]: Reached target Timer Units.1737worker2 # [ 1.813435] systemd[1]: Listening on Journal Socket (/dev/log).1738worker2 # [ 1.813581] systemd[1]: Listening on Journal Sockets.1739client # [ 1.748049] systemd[1]: Listening on D-Bus System Message Bus Socket.1740worker2 # [ 1.813712] systemd[1]: Listening on udev Control Socket.1741client # [ 1.748219] systemd[1]: Listening on Journal Socket (/dev/log).1742worker2 # [ 1.813824] systemd[1]: Listening on udev Kernel Socket.1743client # [ 1.748374] systemd[1]: Listening on Journal Sockets.1744worker2 # [ 1.813848] systemd[1]: Reached target Socket Units.1745client # [ 1.748515] systemd[1]: Listening on udev Control Socket.1746client # [ 1.748640] systemd[1]: Listening on udev Kernel Socket.1747worker2 # [ 1.825025] systemd[1]: Starting Create List of Static Device Nodes...1748client # [ 1.748663] systemd[1]: Reached target Socket Units.1749client # [ 1.760471] systemd[1]: Starting Create List of Static Device Nodes...1750client # [ 1.767682] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1751worker2 # [ 1.834881] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1752client # [ 1.768916] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1753worker2 # [ 1.836154] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1754worker2 # [ 1.839665] systemd[1]: Mounting Kernel Configuration File System...1755lb # [ 1.776293] systemd[1]: Queued start job for default target Initrd Default Target.1756worker1 # [ 1.805484] systemd[1]: Starting Journal Service...1757client # [ 1.778543] systemd[1]: Mounting Kernel Configuration File System...1758lb # [ 1.784864] systemd[1]: Created slice Slice /system/modprobe.1759worker2 # [ 1.850093] systemd[1]: Starting Journal Service...1760lb # [ 1.786173] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1761lb # [ 1.787677] systemd[1]: Expecting device /dev/disk/by-label/nixos...1762lb # [ 1.788771] systemd[1]: Reached target Path Units.1763lb # [ 1.789622] systemd[1]: Reached target Slice Units.1764lb # [ 1.790512] systemd[1]: Reached target Swaps.1765lb # [ 1.791278] systemd[1]: Reached target Timer Units.1766lb # [ 1.792329] systemd[1]: Listening on D-Bus System Message Bus Socket.1767lb # [ 1.793629] systemd[1]: Listening on Journal Socket (/dev/log).1768worker1 # [ 1.822967] systemd[1]: Starting Load Kernel Modules...1769worker1 # [ 1.823109] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1770lb # [ 1.794862] systemd[1]: Listening on Journal Sockets.1771lb # [ 1.795008] systemd[1]: Listening on udev Control Socket.1772lb # [ 1.795128] systemd[1]: Listening on udev Kernel Socket.1773lb # [ 1.795151] systemd[1]: Reached target Socket Units.1774lb # [ 1.800376] systemd[1]: Starting Create List of Static Device Nodes...1775client # [ 1.800991] systemd[1]: Starting Journal Service...1776lb # [ 1.807429] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1777lb # [ 1.808706] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1778worker2 # [ 1.874529] systemd[1]: Starting Load Kernel Modules...1779worker1 # [ 1.842331] systemd[1]: Starting Coldplug All udev Devices...1780worker2 # [ 1.874659] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1781lb # [ 1.818537] systemd[1]: Mounting Kernel Configuration File System...1782client # [ 1.818823] systemd[1]: Starting Load Kernel Modules...1783client # [ 1.819688] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1784lb # [ 1.828356] systemd[1]: Starting Journal Service...1785worker1 # [ 1.857432] systemd-journald[73]: Collecting audit messages is disabled.1786worker2 # [ 1.893953] systemd[1]: Starting Coldplug All udev Devices...1787client # [ 1.834523] systemd[1]: Starting Coldplug All udev Devices...1788worker1 # [ 1.866633] systemd[1]: Finished Create List of Static Device Nodes.1789worker1 # [ 1.867640] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1790worker1 # [ 1.867948] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1791worker2 # [ 1.906988] systemd[1]: Finished Create List of Static Device Nodes.1792client # [ 1.840363] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1793client # [ 1.844463] systemd[1]: Finished Create List of Static Device Nodes.1794client # [ 1.845288] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1795client # [ 1.845573] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1796client # [ 1.845793] systemd[1]: Mounted Kernel Configuration File System.1797worker1 # [ 1.882973] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1798worker2 # [ 1.913896] systemd-journald[73]: Collecting audit messages is disabled.1799worker2 # [ 1.916047] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1800worker2 # [ 1.916398] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1801worker2 # [ 1.916734] systemd[1]: Mounted Kernel Configuration File System.1802lb # [ 1.858232] systemd[1]: Starting Load Kernel Modules...1803lb # [ 1.859351] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1804client # [ 1.859590] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1805worker1 # [ 1.894029] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1806worker1 # [ 1.894978] systemd[1]: Mounted Kernel Configuration File System.1807client # [ 1.863515] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1808worker2 # [ 1.928224] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1809lb # [ 1.870794] systemd[1]: Starting Coldplug All udev Devices...1810lb # [ 1.882259] systemd-journald[73]: Collecting audit messages is disabled.1811client # [ 1.878536] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01812client # [ 1.878783] [drm] features: -virgl +edid -resource_blob -host_visible1813client # [ 1.878793] [drm] features: -context_init1814client # [ 1.879540] [drm] number of scanouts: 11815client # [ 1.879559] [drm] number of cap sets: 01816worker1 # [ 1.910948] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1817worker1 # [ 1.915657] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01818worker1 # [ 1.915894] [drm] features: -virgl +edid -resource_blob -host_visible1819worker1 # [ 1.915905] [drm] features: -context_init1820worker1 # [ 1.916605] [drm] number of scanouts: 11821worker1 # [ 1.916624] [drm] number of cap sets: 01822lb # [ 1.898509] systemd[1]: Finished Create List of Static Device Nodes.1823client # [ 1.895065] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1824lb # [ 1.899430] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1825client # [ 1.895092] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01826lb # [ 1.899732] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1827lb # [ 1.899968] systemd[1]: Mounted Kernel Configuration File System.1828worker2 # [ 1.968020] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1829client # [ 1.904386] systemd-journald[73]: Collecting audit messages is disabled.1830worker2 # [ 1.968962] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1831worker1 # [ 1.934811] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1832worker2 # [ 1.973150] systemd[1]: Starting Create Static Device Nodes in /dev...1833worker1 # [ 1.934842] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01834lb # [ 1.910873] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1835worker1 # [ 1.943213] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1836worker1 # [ 1.945712] systemd[1]: Starting Create Static Device Nodes in /dev...1837worker2 # [ 1.983807] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1838worker2 # [ 1.988474] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01839client # [ 1.923109] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1840worker2 # [ 1.988706] [drm] features: -virgl +edid -resource_blob -host_visible1841worker2 # [ 1.988716] [drm] features: -context_init1842worker2 # [ 1.989474] [drm] number of scanouts: 11843worker2 # [ 1.989492] [drm] number of cap sets: 01844client # [ 1.926739] systemd[1]: Starting Create Static Device Nodes in /dev...1845lb # [ 1.932360] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1846client # [ 1.934777] Console: switching to colour frame buffer device 160x501847client # [ 1.941427] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1848lb # [ 1.950458] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1849worker2 # [ 2.008095] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1850worker1 # [ 1.974742] Console: switching to colour frame buffer device 160x501851worker2 # [ 2.008119] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01852worker1 # [ 1.981582] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1853lb # [ 1.963010] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1854worker1 # [ 1.995129] systemd[1]: Finished Create Static Device Nodes in /dev.1855lb # [ 1.967451] [drm] pci: virtio-gpu-pci detected at 0000:00:08.01856worker1 # [ 1.995323] systemd[1]: Reached target Preparation for Local File Systems.1857lb # [ 1.967680] [drm] features: -virgl +edid -resource_blob -host_visible1858worker1 # [ 1.995358] systemd[1]: Reached target Local File Systems.1859lb # [ 1.967689] [drm] features: -context_init1860lb # [ 1.968411] [drm] number of scanouts: 11861lb # [ 1.968429] [drm] number of cap sets: 01862client # [ 1.966946] systemd[1]: Finished Load Kernel Modules.1863worker1 # [ 2.000296] systemd[1]: Starting Rule-based Manager for Device Events and Files...1864lb # [ 1.972005] systemd[1]: Starting Create Static Device Nodes in /dev...1865client # [ 1.974500] systemd[1]: Starting Apply Kernel Variables...1866worker2 # [ 2.040020] Console: switching to colour frame buffer device 160x501867worker2 # [ 2.048936] systemd[1]: Finished Create Static Device Nodes in /dev.1868worker2 # [ 2.049310] systemd[1]: Reached target Preparation for Local File Systems.1869worker2 # [ 2.049336] systemd[1]: Reached target Local File Systems.1870lb # [ 1.984314] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic1871lb # [ 1.984338] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 01872client # [ 1.991044] systemd[1]: Finished Create Static Device Nodes in /dev.1873worker2 # [ 2.056198] systemd[1]: Starting Rule-based Manager for Device Events and Files...1874client # [ 1.993339] systemd[1]: Reached target Preparation for Local File Systems.1875worker1 # [ 2.026788] systemd[1]: Finished Load Kernel Modules.1876client # [ 1.998444] systemd[1]: Reached target Local File Systems.1877worker1 # [ 2.030166] systemd[1]: Starting Apply Kernel Variables...1878worker2 # [ 2.073984] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1879client # [ 2.007975] systemd[1]: Starting Rule-based Manager for Device Events and Files...1880worker2 # [ 2.085186] systemd[1]: Finished Load Kernel Modules.1881worker1 # [ 2.054122] systemd[1]: Started Journal Service.1882lb # [ 2.018693] Console: switching to colour frame buffer device 160x501883lb # [ 2.025469] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device1884worker2 # [ 2.090243] systemd[1]: Starting Apply Kernel Variables...1885lb # [ 2.039048] systemd[1]: Finished Create Static Device Nodes in /dev.1886lb # [ 2.039452] systemd[1]: Reached target Preparation for Local File Systems.1887lb # [ 2.039488] systemd[1]: Reached target Local File Systems.1888worker1 # [ 2.058884] systemd-modules-load[74]: Inserted module 'dm_mod'1889worker1 # [ 2.060235] systemd-modules-load[74]: Module 'virtio_balloon' is built in1890lb # [ 2.044852] systemd[1]: Starting Rule-based Manager for Device Events and Files...1891worker1 # [ 2.061343] systemd-modules-load[74]: Module 'virtio_console' is built in1892client # [ 2.042758] systemd[1]: Finished Apply Kernel Variables.1893worker1 # [ 2.062444] systemd-modules-load[74]: Inserted module 'virtio_gpu'1894worker1 # [ 2.063427] systemd-modules-load[74]: Module 'virtio_rng' is built in1895worker2 # [ 2.112719] systemd[1]: Started Journal Service.1896worker2 # [ 2.099485] systemd-modules-load[74]: Inserted module 'dm_mod'1897worker2 # [ 2.103557] systemd-modules-load[74]: Module 'virtio_balloon' is built in1898worker1 # [ 2.074352] systemd[1]: Starting Create System Files and Directories...1899worker1 # [ 2.075411] systemd[1]: Finished Apply Kernel Variables.1900worker2 # [ 2.109415] systemd-modules-load[74]: Module 'virtio_console' is built in1901worker2 # [ 2.110521] systemd-modules-load[74]: Inserted module 'virtio_gpu'1902worker2 # [ 2.111502] systemd-modules-load[74]: Module 'virtio_rng' is built in1903lb # [ 2.070595] systemd[1]: Finished Load Kernel Modules.1904worker1 # [ 2.092128] systemd-udevd[79]: Using default interface naming scheme 'v261'.1905worker2 # [ 2.128308] systemd[1]: Starting Create System Files and Directories...1906lb # [ 2.079721] systemd[1]: Starting Apply Kernel Variables...1907lb # [ 2.070351] systemd-modules-load[75]: Inserted module 'dm_mod'1908lb # [ 2.071568] systemd-modules-load[75]: Module 'virtio_balloon' is built in1909client # [ 2.082564] systemd[1]: Started Journal Service.1910client # [ 2.072268] systemd-modules-load[74]: Inserted module 'dm_mod'1911client # [ 2.073411] systemd-modules-load[74]: Module 'virtio_balloon' is built in1912lb # [ 2.090563] systemd[1]: Started Journal Service.1913lb # [ 2.079939] systemd-modules-load[75]: Module 'virtio_console' is built in1914worker1 # [ 2.111110] systemd[1]: Finished Create System Files and Directories.1915worker2 # [ 2.145456] systemd[1]: Finished Apply Kernel Variables.1916lb # [ 2.084470] systemd-modules-load[75]: Inserted module 'virtio_gpu'1917client # [ 2.083257] systemd-modules-load[74]: Module 'virtio_console' is built in1918lb # [ 2.088346] systemd-modules-load[75]: Module 'virtio_rng' is built in1919client # [ 2.087774] systemd-modules-load[74]: Inserted module 'virtio_gpu'1920client # [ 2.089045] systemd-modules-load[74]: Module 'virtio_rng' is built in1921worker2 # [ 2.156623] systemd-udevd[79]: Using default interface naming scheme 'v261'.1922worker1 # [ 2.130962] systemd[1]: Started Rule-based Manager for Device Events and Files.1923client # [ 2.100376] systemd[1]: Starting Create System Files and Directories...1924worker2 # [ 2.167271] systemd[1]: Finished Create System Files and Directories.1925client # [ 2.106367] systemd-udevd[81]: Using default interface naming scheme 'v261'.1926lb # [ 2.121940] systemd[1]: Starting Create System Files and Directories...1927worker2 # [ 2.193506] systemd[1]: Started Rule-based Manager for Device Events and Files.1928client # [ 2.128682] systemd[1]: Finished Create System Files and Directories.1929lb # [ 2.132842] systemd[1]: Finished Apply Kernel Variables.1930lb # [ 2.134678] systemd-udevd[79]: Using default interface naming scheme 'v261'.1931client # [ 2.146263] systemd[1]: Started Rule-based Manager for Device Events and Files.1932worker1 # [ 2.188719] systemd[1]: Starting Virtual Console Setup...1933lb # [ 2.161147] systemd[1]: Finished Create System Files and Directories.1934lb # [ 2.177065] systemd[1]: Started Rule-based Manager for Device Events and Files.1935worker2 # [ 2.250217] systemd[1]: Starting Virtual Console Setup...1936client # [ 2.197931] systemd[1]: Starting Virtual Console Setup...1937worker1 # [ 2.240553] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1938worker1 # [ 2.244086] systemd[1]: Finished Virtual Console Setup.1939lb # [ 2.229777] systemd[1]: Starting Virtual Console Setup...1940worker2 # [ 2.296497] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1941worker2 # [ 2.302080] systemd[1]: Finished Virtual Console Setup.1942client # [ 2.260533] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones.1943client # [ 2.264136] systemd[1]: Finished Virtual Console Setup.1944lb # [ 2.292538] systemd-vconsole-setup[104]: Configuration of first virtual console was skipped, ignoring remaining ones.1945lb # [ 2.296145] systemd[1]: Finished Virtual Console Setup.1946worker1 # [ 2.864639] systemd[1]: Finished Coldplug All udev Devices.1947worker1 # [ 2.868137] systemd[1]: Reached target System Initialization.1948worker1 # [ 2.869209] systemd[1]: Reached target Basic System.1949worker2 # [ 2.916138] systemd[1]: Finished Coldplug All udev Devices.1950worker2 # [ 2.917135] systemd[1]: Reached target System Initialization.1951worker2 # [ 2.920107] systemd[1]: Reached target Basic System.1952client # [ 2.866095] systemd[1]: Finished Coldplug All udev Devices.1953client # [ 2.867130] systemd[1]: Reached target System Initialization.1954client # [ 2.868391] systemd[1]: Reached target Basic System.1955lb # [ 2.894759] systemd[1]: Finished Coldplug All udev Devices.1956lb # [ 2.895977] systemd[1]: Reached target System Initialization.1957lb # [ 2.900130] systemd[1]: Reached target Basic System.1958worker1 # [ 3.016079] (udev-worker)[92]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1959worker2 # [ 3.064109] (udev-worker)[102]: Network interface NamePolicy= disabled on kernel command line.1960client # [ 3.011987] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1961worker1 # [ 3.056001] (udev-worker)[102]: Network interface NamePolicy= disabled on kernel command line.1962worker1 # [ 3.058681] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line.1963worker2 # [ 3.102256] (udev-worker)[92]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1964client # [ 3.041968] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line.1965worker2 # [ 3.108307] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line.1966client # [ 3.057298] (udev-worker)[106]: Network interface NamePolicy= disabled on kernel command line.1967lb # [ 3.061587] (udev-worker)[102]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1968lb # [ 3.075746] (udev-worker)[102]: Network interface NamePolicy= disabled on kernel command line.1969lb # [ 3.079760] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line.1970worker1 # [ 3.139894] systemd[1]: Found device /dev/disk/by-label/nixos.1971worker1 # [ 3.142986] systemd[1]: Reached target Initrd Root Device.1972worker2 # [ 3.184762] systemd[1]: Found device /dev/disk/by-label/nixos.1973worker1 # [ 3.152106] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1974worker2 # [ 3.191290] systemd[1]: Reached target Initrd Root Device.1975client # [ 3.131002] systemd[1]: Found device /dev/disk/by-label/nixos.1976worker2 # [ 3.197378] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1977client # [ 3.137856] systemd[1]: Reached target Initrd Root Device.1978client # [ 3.141696] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1979lb # [ 3.149355] systemd[1]: Found device /dev/disk/by-label/nixos.1980lb # [ 3.156729] systemd[1]: Reached target Initrd Root Device.1981lb # [ 3.162669] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1982worker1 # [ 3.195336] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1983worker1 # [ 3.203091] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1984worker1 # [ 3.208349] systemd[1]: Mounting /sysroot...1985worker2 # [ 3.243976] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1986worker2 # [ 3.250694] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1987worker2 # [ 3.255180] systemd[1]: Mounting /sysroot...1988client # [ 3.197667] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks1989client # [ 3.205635] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1990worker1 # [ 3.250957] EXT4-fs (vda): mounted filesystem 60ef9c2c-da78-4db7-aca4-ba7776cfb3b7 r/w with ordered data mode. Quota mode: none.1991client # [ 3.208193] systemd[1]: Mounting /sysroot...1992lb # [ 3.212242] systemd-fsck[113]: nixos: clean, 12/65536 files, 13019/262144 blocks1993worker1 # [ 3.242392] systemd[1]: Mounted /sysroot.1994worker1 # [ 3.244799] systemd[1]: Reached target Initrd Root File System.1995lb # [ 3.218588] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1996worker1 # [ 3.250162] systemd[1]: Starting Mountpoints Configured in the Real Root...1997lb # [ 3.232428] systemd[1]: Mounting /sysroot...1998worker2 # [ 3.309444] EXT4-fs (vda): mounted filesystem ab082c4b-a2d8-4cfb-b471-7f4f21e2fb84 r/w with ordered data mode. Quota mode: none.1999worker2 # [ 3.298469] systemd[1]: Mounted /sysroot.2000worker2 # [ 3.301574] systemd[1]: Reached target Initrd Root File System.
loading 1,382 hidden lines…
3383client # [ 15.047618] dhcpcd[533]: eth0: soliciting an IPv6 router3384client # [ 15.051489] dhcpcd[533]: eth0: Router Advertisement from fe80::23385client # [ 15.054239] dhcpcd[533]: eth0: adding address fec0::5054:ff:fe12:3456/643386client # [ 15.057176] dhcpcd[533]: eth0: adding route to fec0::/643387client # [ 15.059432] dhcpcd[533]: eth0: adding default route via fe80::23388worker1 # [ 15.714351] dhcpcd[640]: eth0: soliciting an IPv6 router3389worker1 # [ 15.717807] dhcpcd[640]: eth0: Router Advertisement from fe80::23390worker1 # [ 15.720613] dhcpcd[640]: eth0: adding address fec0::5054:ff:fe12:3456/643391worker1 # [ 15.723316] dhcpcd[640]: eth0: adding route to fec0::/643392worker1 # [ 15.725656] dhcpcd[640]: eth0: adding default route via fe80::23393lb # [ 15.968579] postgresql-pre-start[680]: selecting default time zone ... UTC3394lb # [ 15.973390] postgresql-pre-start[680]: creating configuration files ... ok3395lb # [ 16.114367] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3396lb # [ 16.144092] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3397lb # [ 16.145196] systemd[1]: Stopped Virtual Console Setup.3398lb # [ 16.145894] systemd[1]: Stopping Virtual Console Setup...3399lb # [ 16.151035] systemd[1]: Starting Virtual Console Setup...3400lb # [ 16.199551] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3401lb # [ 16.204466] systemd[1]: Stopped Virtual Console Setup.3402lb # [ 16.210007] systemd[1]: Starting Virtual Console Setup...3403lb # [ 16.234516] systemd-logind[524]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3404lb # [ 16.434858] postgresql-pre-start[680]: running bootstrap script ... ok3405lb # [ 16.512616] dhcpcd[653]: eth0: soliciting an IPv6 router3406lb # [ 16.513618] dhcpcd[653]: eth0: Router Advertisement from fe80::23407lb # [ 16.515388] dhcpcd[653]: eth0: adding address fec0::5054:ff:fe12:3456/643408lb # [ 16.518021] dhcpcd[653]: eth0: adding route to fec0::/643409lb # [ 16.520136] dhcpcd[653]: eth0: adding default route via fe80::23410lb # [ 16.623565] systemd-vconsole-setup[789]: Configuration of first virtual console was skipped, ignoring remaining ones.3411lb # [ 16.629228] systemd[1]: Finished Virtual Console Setup.3412lb # [ 17.139831] postgresql-pre-start[680]: performing post-bootstrap initialization ... ok3413lb # [ 17.283852] postgresql-pre-start[680]: syncing data to disk ... ok3414lb # [ 17.286137] postgresql-pre-start[680]: initdb: warning: enabling "trust" authentication for local connections3415lb # [ 17.287420] postgresql-pre-start[680]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3416lb # [ 17.289505] postgresql-pre-start[680]: Success. You can now start the database server using:3417lb # [ 17.290653] postgresql-pre-start[680]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3418lb # [ 17.437701] postgres[807]: [807] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit3419lb # [ 17.441992] postgres[807]: [807] LOG: listening on IPv6 address "::1", port 54323420lb # [ 17.443178] postgres[807]: [807] LOG: listening on IPv4 address "127.0.0.1", port 54323421lb # [ 17.445198] postgres[807]: [807] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3422lb # [ 17.459148] postgres[816]: [816] LOG: database system was shut down at 2026-09-20 13:28:18 GMT3423lb # [ 17.464131] postgres[807]: [807] LOG: database system is ready to accept connections3424lb # [ 17.468543] systemd[1]: Started PostgreSQL Server.3425lb # [ 17.477140] systemd[1]: Starting PostgreSQL Setup Scripts...3426lb # [ 17.694848] postgresql-setup-start[827]: CREATE DATABASE3427lb # [ 17.749286] postgresql-setup-start[832]: CREATE ROLE3428lb # [ 17.774391] postgresql-setup-start[834]: ALTER DATABASE3429lb # [ 17.780002] systemd[1]: Finished PostgreSQL Setup Scripts.3430lb # [ 17.782185] systemd[1]: Reached target PostgreSQL.3431worker1 # [ 17.918703] dhcpcd[640]: eth0: leased 10.0.2.15 for 86400 seconds3432worker1 # [ 17.922695] dhcpcd[640]: eth0: adding route to 10.0.2.0/243433worker1 # [ 17.926094] dhcpcd[640]: eth0: adding default route via 10.0.2.23434worker1 # [ 18.110533] systemd[1]: Started DHCP Client.3435worker1 # [ 18.112656] systemd[1]: Reached target Multi-User System.3436worker1 # [ 18.113523] systemd[1]: Startup finished in 966ms (kernel) + 5.538s (initrd) + 11.607s (userspace) = 18.112s.3437client # [ 19.000866] dhcpcd[533]: eth0: leased 10.0.2.15 for 86400 seconds3438client # [ 19.004602] dhcpcd[533]: eth0: adding route to 10.0.2.0/243439client # [ 19.004772] dhcpcd[533]: eth0: adding default route via 10.0.2.23440client # [ 19.161603] systemd[1]: Started DHCP Client.3441client # [ 19.166508] systemd[1]: Reached target Multi-User System.3442client # [ 19.167459] systemd[1]: Startup finished in 974ms (kernel) + 4.681s (initrd) + 13.509s (userspace) = 19.166s.3443worker2 # [ 19.618520] dhcpcd[632]: eth0: leased 10.0.2.15 for 86400 seconds3444worker2 # [ 19.622127] dhcpcd[632]: eth0: adding route to 10.0.2.0/243445worker2 # [ 19.625365] dhcpcd[632]: eth0: adding default route via 10.0.2.23446worker2 # [ 19.777034] systemd[1]: Started DHCP Client.3447worker2 # [ 19.779599] systemd[1]: Reached target Multi-User System.3448worker2 # [ 19.780795] systemd[1]: Startup finished in 977ms (kernel) + 4.733s (initrd) + 14.068s (userspace) = 19.778s.3449lb # [ 19.966470] dhcpcd[653]: eth0: leased 10.0.2.15 for 86400 seconds3450lb # [ 19.966805] dhcpcd[653]: eth0: adding route to 10.0.2.0/243451lb # [ 19.966940] dhcpcd[653]: eth0: adding default route via 10.0.2.23452lb # [ 20.132164] systemd[1]: Started DHCP Client.3453lb # [ 20.134246] systemd[1]: Reached target Network is Online.3454lb # [ 20.139577] systemd[1]: Started Envoy reverse proxy.3455lb # [ 20.144933] systemd[1]: Started mock-oidc.service.3456lb # [ 20.289500] mock-oidc-server[916]: Mock OIDC Server running3457lb # [ 20.294487] mock-oidc-server[916]: OIDC Address: 192.168.1.2:80803458lb # [ 20.298358] mock-oidc-server[916]: Issue Address: 0.0.0.0:80813459lb # [ 20.302804] mock-oidc-server[916]: Issuer: http://192.168.1.2:8080/oidc3460lb # [ 20.303781] mock-oidc-server[916]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3461lb # [ 20.307551] mock-oidc-server[916]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3462lb # [ 20.309817] mock-oidc-server[916]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3463lb # [ 20.868427] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120)3464lb # [ 20.870277] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:469] statically linked extensions:3465lb # [ 20.871700] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3466lb # [ 20.874030] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls3467lb # [ 20.891520] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3468lb # [ 20.897321] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3469lb # [ 20.901112] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3470lb # [ 20.904794] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default3471lb # [ 20.907135] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v83472lb # [ 20.909286] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3473lb # [ 20.912063] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router3474lb # [ 20.943100] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3475lb # [ 20.946823] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san3476lb # [ 20.954301] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3477lb # [ 20.956531] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3478lb # [ 20.962967] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3479lb # [ 20.964852] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3480lb # [ 20.967705] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3481lb # [ 20.970001] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats3482lb # [ 20.972828] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3483lb # [ 20.981699] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3484lb # [ 20.985648] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3485lb # [ 20.987937] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3486lb # [ 20.993446] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3487lb # [ 20.995385] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3488lb # [ 21.000582] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name3489lb # [ 21.002991] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override3490lb # [ 21.005954] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default3491lb # [ 21.007806] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert3492lb # [ 21.011050] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3493lb # [ 21.013769] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3494lb # [ 21.016938] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3495lb # [ 21.018938] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log3496lb # [ 21.028208] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector3497lb # [ 21.036048] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3498lb # [ 21.037909] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection3499lb # [ 21.043454] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3500lb # [ 21.046114] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource3501lb # [ 21.049569] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23502lb # [ 21.051434] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm3503lb # [ 21.058868] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3504lb # [ 21.062528] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor3505lb # [ 21.065356] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3506lb # [ 21.067663] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit3507lb # [ 21.071088] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3508lb # [ 21.074163] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo3509lb # [ 21.075772] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3510lb # [ 21.081492] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port3511lb # [ 21.089719] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple3512lb # [ 21.092086] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default3513lb # [ 21.094182] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy3514lb # [ 21.096993] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff3515lb # [ 21.099474] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based3516lb # [ 21.104376] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3517lb # [ 21.106304] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default3518lb # [ 21.108039] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3519lb # [ 21.111637] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter3520lb # [ 21.114098] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator3521lb # [ 21.116728] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection3522lb # [ 21.118803] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3523lb # [ 21.121501] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction3524lb # [ 21.126287] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3525lb # [ 21.128482] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3526lb # [ 21.130563] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3527lb # [ 21.135797] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3528lb # [ 21.138677] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3529lb # [ 21.140880] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3530lb # [ 21.142747] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3531lb # [ 21.145532] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3532lb # [ 21.147680] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default3533lb # [ 21.149642] envoy[915]: [2026-09-20 13:28:22.458][915][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3534lb # [ 21.153124] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr3535lb # [ 21.155413] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case3536lb # [ 21.158798] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3537lb # [ 21.160800] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder3538lb # [ 21.163163] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest3539lb # [ 21.169136] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso3540lb # [ 21.171269] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3541lb # [ 21.173194] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3542lb # [ 21.176635] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3543lb # [ 21.181554] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable3544lb # [ 21.183750] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default3545lb # [ 21.186375] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy3546lb # [ 21.200978] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23547lb # [ 21.202863] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3548lb # [ 21.205749] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input3549lb # [ 21.207722] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind3550lb # [ 21.210051] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth23551lb # [ 21.212585] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13552lb # [ 21.214818] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic3553lb # [ 21.217212] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3554lb # [ 21.220322] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy3555lb # [ 21.223146] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3556lb # [ 21.225685] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3557lb # [ 21.228366] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override3558lb # [ 21.231448] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid3559lb # [ 21.233272] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift3560lb # [ 21.237026] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action3561lb # [ 21.239116] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3562lb # [ 21.241264] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3563lb # [ 21.243595] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params3564lb # [ 21.254898] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua3565lb # [ 21.256728] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3566lb # [ 21.259248] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal3567lb # [ 21.261466] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3568lb # [ 21.263488] envoy[915]: [2026-09-20 13:28:22.459][915][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default3569lb # [ 21.265769] envoy[915]: [2026-09-20 13:28:22.479][915][info][main] [source/server/server.cc:531] HTTP header map info:3570lb # [ 21.267248] envoy[915]: [2026-09-20 13:28:22.481][915][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id3571lb # [ 21.283462] envoy[915]: [2026-09-20 13:28:22.481][915][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:3572lb # [ 21.285216] envoy[915]: [2026-09-20 13:28:22.481][915][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id3573lb # [ 21.294083] envoy[915]: [2026-09-20 13:28:22.481][915][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status3574lb # [ 21.296106] envoy[915]: [2026-09-20 13:28:22.731][915][info][main] [source/server/server.cc:968] runtime: {}3575lb # [ 21.297461] envoy[915]: [2026-09-20 13:28:22.749][915][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.3576lb # [ 21.299263] envoy[915]: [2026-09-20 13:28:22.749][915][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99013577lb # [ 21.301082] envoy[915]: [2026-09-20 13:28:22.749][915][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99013578lb # [ 21.302787] envoy[915]: [2026-09-20 13:28:22.760][915][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration3579lb # [ 21.304577] envoy[915]: [2026-09-20 13:28:22.760][915][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)3580lb # [ 21.306206] envoy[915]: [2026-09-20 13:28:22.760][915][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)3581lb # [ 21.328520] envoy[915]: [2026-09-20 13:28:22.919][915][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)3582lb # [ 21.339102] envoy[915]: [2026-09-20 13:28:22.930][915][info][config] [source/server/configuration_impl.cc:164] loading stats configuration3583worker2 # [ 21.400792] systemd[1]: Reached target Network is Online.3584worker1 # [ 21.370592] systemd[1]: Starting Nix worker-protocol over gRPC...3585lb # [ 21.341765] envoy[915]: [2026-09-20 13:28:22.932][915][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.3586lb # [ 21.346887] envoy[915]: [2026-09-20 13:28:22.932][915][info][main] [source/server/server.cc:1077] starting main dispatch loop3587worker2 # [ 21.409062] systemd[1]: Starting scheduler-token.service...3588worker2 # [ 21.519331] systemd[1]: scheduler-token.service: Deactivated successfully.3589worker2 # [ 21.522479] systemd[1]: Finished scheduler-token.service.3590worker2 # [ 21.523626] systemd[1]: scheduler-token.service: Consumed 49ms CPU time over 113ms wall clock time, 2.9M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.3591worker2 # [ 21.531535] systemd[1]: Starting Nix worker-protocol over gRPC...3592worker1 # [ 21.614365] nix-grpc-daemon[774]: ts=2026-09-20T13:28:23Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"3593worker1 # [ 21.626285] nix-grpc-daemon[774]: ts=2026-09-20T13:28:23Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3594worker1 # [ 21.628634] nix-grpc-daemon[774]: ts=2026-09-20T13:28:23Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=13595worker1 # [ 21.673394] nix-grpc-daemon[774]: ts=2026-09-20T13:28:23Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3596worker1 # [ 21.677982] systemd[1]: Started Nix worker-protocol over gRPC.3597worker1 # [ 21.705906] nix-grpc-daemon[774]: ts=2026-09-20T13:28:23Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3598lb # [ 21.677514] envoy[915]: [2026-09-20 13:28:23.268][915][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization3599worker2 # [ 21.750010] nix-grpc-daemon[779]: ts=2026-09-20T13:28:22Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"3600lb # [ 21.684603] envoy[915]: [2026-09-20 13:28:23.268][915][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized3601lb # [ 21.690128] envoy[915]: [2026-09-20 13:28:23.268][915][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager3602worker2 # [ 21.761755] nix-grpc-daemon[779]: ts=2026-09-20T13:28:22Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc3603lb # [ 21.695313] envoy[915]: [2026-09-20 13:28:23.268][915][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers3604worker2 # [ 21.764009] nix-grpc-daemon[779]: ts=2026-09-20T13:28:22Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=13605worker2 # [ 21.809062] nix-grpc-daemon[779]: ts=2026-09-20T13:28:22Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket3606worker2 # [ 21.810828] systemd[1]: Started Nix worker-protocol over gRPC.3607worker2 # [ 21.852395] nix-grpc-daemon[779]: ts=2026-09-20T13:28:22Z level=info event=scheduler_connected addr=lb:500513608worker2 # [ 21.856745] nix-grpc-daemon[779]: ts=2026-09-20T13:28:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3609worker1 # [ 21.906878] nix-grpc-daemon[774]: ts=2026-09-20T13:28:23Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3610worker2 # [ 22.058178] nix-grpc-daemon[779]: ts=2026-09-20T13:28:22Z level=info event=scheduler_connected addr=lb:500513611worker2 # [ 22.061211] nix-grpc-daemon[779]: ts=2026-09-20T13:28:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3612worker2 # [ 22.262636] nix-grpc-daemon[779]: ts=2026-09-20T13:28:22Z level=info event=scheduler_connected addr=lb:500513613worker2 # [ 22.267820] nix-grpc-daemon[779]: ts=2026-09-20T13:28:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3614worker1 # [ 22.307527] nix-grpc-daemon[774]: ts=2026-09-20T13:28:23Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"3615worker2 # [ 22.469153] nix-grpc-daemon[779]: ts=2026-09-20T13:28:23Z level=info event=scheduler_connected addr=lb:500513616worker2 # [ 22.474748] nix-grpc-daemon[779]: ts=2026-09-20T13:28:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3617worker2 # [ 22.675856] nix-grpc-daemon[779]: ts=2026-09-20T13:28:23Z level=info event=scheduler_connected addr=lb:500513618worker2 # [ 22.681105] nix-grpc-daemon[779]: ts=2026-09-20T13:28:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3619worker2 # [ 22.883139] nix-grpc-daemon[779]: ts=2026-09-20T13:28:23Z level=info event=scheduler_connected addr=lb:500513620worker2 # [ 22.886124] nix-grpc-daemon[779]: ts=2026-09-20T13:28:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3621worker2 # [ 23.084505] nix-grpc-daemon[779]: ts=2026-09-20T13:28:23Z level=info event=scheduler_connected addr=lb:500513622worker2 # [ 23.089582] nix-grpc-daemon[779]: ts=2026-09-20T13:28:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3623worker1 # [ 23.110875] nix-grpc-daemon[774]: ts=2026-09-20T13:28:24Z level=info event=scheduler_connected addr=lb:500513624worker1 # [ 23.111230] nix-grpc-daemon[774]: ts=2026-09-20T13:28:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3625worker2 # [ 23.290835] nix-grpc-daemon[779]: ts=2026-09-20T13:28:23Z level=info event=scheduler_connected addr=lb:500513626worker2 # [ 23.296388] nix-grpc-daemon[779]: ts=2026-09-20T13:28:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3627worker1 # [ 23.311726] nix-grpc-daemon[774]: ts=2026-09-20T13:28:24Z level=info event=scheduler_connected addr=lb:500513628worker1 # [ 23.317082] nix-grpc-daemon[774]: ts=2026-09-20T13:28:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3629worker2 # [ 23.497642] nix-grpc-daemon[779]: ts=2026-09-20T13:28:24Z level=info event=scheduler_connected addr=lb:500513630worker2 # [ 23.502803] nix-grpc-daemon[779]: ts=2026-09-20T13:28:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3631worker1 # [ 23.518143] nix-grpc-daemon[774]: ts=2026-09-20T13:28:25Z level=info event=scheduler_connected addr=lb:500513632worker1 # [ 23.524093] nix-grpc-daemon[774]: ts=2026-09-20T13:28:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3633worker2 # [ 23.704232] nix-grpc-daemon[779]: ts=2026-09-20T13:28:24Z level=info event=scheduler_connected addr=lb:500513634worker2 # [ 23.709309] nix-grpc-daemon[779]: ts=2026-09-20T13:28:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3635worker1 # [ 23.724789] nix-grpc-daemon[774]: ts=2026-09-20T13:28:25Z level=info event=scheduler_connected addr=lb:500513636worker1 # [ 23.730040] nix-grpc-daemon[774]: ts=2026-09-20T13:28:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3637worker2 # [ 23.912158] nix-grpc-daemon[779]: ts=2026-09-20T13:28:24Z level=info event=scheduler_connected addr=lb:500513638worker2 # [ 23.916237] nix-grpc-daemon[779]: ts=2026-09-20T13:28:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3639worker1 # [ 23.931019] nix-grpc-daemon[774]: ts=2026-09-20T13:28:25Z level=info event=scheduler_connected addr=lb:500513640worker1 # [ 23.936703] nix-grpc-daemon[774]: ts=2026-09-20T13:28:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3641worker2 # [ 24.113109] nix-grpc-daemon[779]: ts=2026-09-20T13:28:24Z level=info event=scheduler_connected addr=lb:500513642worker2 # [ 24.118484] nix-grpc-daemon[779]: ts=2026-09-20T13:28:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3643worker1 # [ 24.139653] nix-grpc-daemon[774]: ts=2026-09-20T13:28:25Z level=info event=scheduler_connected addr=lb:500513644worker1 # [ 24.144003] nix-grpc-daemon[774]: ts=2026-09-20T13:28:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3645worker2 # [ 24.319315] nix-grpc-daemon[779]: ts=2026-09-20T13:28:24Z level=info event=scheduler_connected addr=lb:500513646worker2 # [ 24.324517] nix-grpc-daemon[779]: ts=2026-09-20T13:28:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3647worker1 # [ 24.340654] nix-grpc-daemon[774]: ts=2026-09-20T13:28:25Z level=info event=scheduler_connected addr=lb:500513648worker1 # [ 24.345834] nix-grpc-daemon[774]: ts=2026-09-20T13:28:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3649worker2 # [ 24.525798] nix-grpc-daemon[779]: ts=2026-09-20T13:28:25Z level=info event=scheduler_connected addr=lb:500513650worker2 # [ 24.531072] nix-grpc-daemon[779]: ts=2026-09-20T13:28:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3651worker1 # [ 24.546757] nix-grpc-daemon[774]: ts=2026-09-20T13:28:26Z level=info event=scheduler_connected addr=lb:500513652worker1 # [ 24.552171] nix-grpc-daemon[774]: ts=2026-09-20T13:28:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3653worker2 # [ 24.732326] nix-grpc-daemon[779]: ts=2026-09-20T13:28:25Z level=info event=scheduler_connected addr=lb:500513654worker2 # [ 24.737513] nix-grpc-daemon[779]: ts=2026-09-20T13:28:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3655worker1 # [ 24.753309] nix-grpc-daemon[774]: ts=2026-09-20T13:28:26Z level=info event=scheduler_connected addr=lb:500513656worker1 # [ 24.758611] nix-grpc-daemon[774]: ts=2026-09-20T13:28:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3657worker2 # [ 24.940542] nix-grpc-daemon[779]: ts=2026-09-20T13:28:25Z level=info event=scheduler_connected addr=lb:500513658worker2 # [ 24.944644] nix-grpc-daemon[779]: ts=2026-09-20T13:28:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3659worker1 # [ 24.959650] nix-grpc-daemon[774]: ts=2026-09-20T13:28:26Z level=info event=scheduler_connected addr=lb:500513660worker1 # [ 24.965171] nix-grpc-daemon[774]: ts=2026-09-20T13:28:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3661worker2 # [ 25.141621] nix-grpc-daemon[779]: ts=2026-09-20T13:28:25Z level=info event=scheduler_connected addr=lb:500513662worker2 # [ 25.146759] nix-grpc-daemon[779]: ts=2026-09-20T13:28:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3663worker1 # [ 25.168160] nix-grpc-daemon[774]: ts=2026-09-20T13:28:26Z level=info event=scheduler_connected addr=lb:500513664worker1 # [ 25.172306] nix-grpc-daemon[774]: ts=2026-09-20T13:28:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3665worker2 # [ 25.348074] nix-grpc-daemon[779]: ts=2026-09-20T13:28:25Z level=info event=scheduler_connected addr=lb:500513666worker2 # [ 25.353288] nix-grpc-daemon[779]: ts=2026-09-20T13:28:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3667worker1 # [ 25.368594] nix-grpc-daemon[774]: ts=2026-09-20T13:28:26Z level=info event=scheduler_connected addr=lb:500513668worker1 # [ 25.373830] nix-grpc-daemon[774]: ts=2026-09-20T13:28:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3669worker2 # [ 25.554466] nix-grpc-daemon[779]: ts=2026-09-20T13:28:26Z level=info event=scheduler_connected addr=lb:500513670worker2 # [ 25.559655] nix-grpc-daemon[779]: ts=2026-09-20T13:28:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3671worker1 # [ 25.574887] nix-grpc-daemon[774]: ts=2026-09-20T13:28:27Z level=info event=scheduler_connected addr=lb:500513672worker1 # [ 25.580402] nix-grpc-daemon[774]: ts=2026-09-20T13:28:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3673worker2 # [ 25.761057] nix-grpc-daemon[779]: ts=2026-09-20T13:28:26Z level=info event=scheduler_connected addr=lb:500513674worker2 # [ 25.766077] nix-grpc-daemon[779]: ts=2026-09-20T13:28:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3675worker1 # [ 25.781129] nix-grpc-daemon[774]: ts=2026-09-20T13:28:27Z level=info event=scheduler_connected addr=lb:500513676worker1 # [ 25.786318] nix-grpc-daemon[774]: ts=2026-09-20T13:28:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3677worker2 # [ 25.968970] nix-grpc-daemon[779]: ts=2026-09-20T13:28:26Z level=info event=scheduler_connected addr=lb:500513678worker2 # [ 25.973175] nix-grpc-daemon[779]: ts=2026-09-20T13:28:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3679worker1 # [ 25.987294] nix-grpc-daemon[774]: ts=2026-09-20T13:28:27Z level=info event=scheduler_connected addr=lb:500513680worker1 # [ 25.992715] nix-grpc-daemon[774]: ts=2026-09-20T13:28:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3681worker2 # [ 26.169831] nix-grpc-daemon[779]: ts=2026-09-20T13:28:26Z level=info event=scheduler_connected addr=lb:500513682worker2 # [ 26.173572] nix-grpc-daemon[779]: ts=2026-09-20T13:28:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3683worker1 # [ 26.193860] nix-grpc-daemon[774]: ts=2026-09-20T13:28:27Z level=info event=scheduler_connected addr=lb:500513684worker1 # [ 26.196485] nix-grpc-daemon[774]: ts=2026-09-20T13:28:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3685worker2 # [ 26.374823] nix-grpc-daemon[779]: ts=2026-09-20T13:28:26Z level=info event=scheduler_connected addr=lb:500513686worker2 # [ 26.380124] nix-grpc-daemon[779]: ts=2026-09-20T13:28:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3687worker1 # [ 26.397724] nix-grpc-daemon[774]: ts=2026-09-20T13:28:28Z level=info event=scheduler_connected addr=lb:500513688worker1 # [ 26.403144] nix-grpc-daemon[774]: ts=2026-09-20T13:28:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3689worker2 # [ 26.581341] nix-grpc-daemon[779]: ts=2026-09-20T13:28:27Z level=info event=scheduler_connected addr=lb:500513690worker2 # [ 26.586443] nix-grpc-daemon[779]: ts=2026-09-20T13:28:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3691worker1 # [ 26.603969] nix-grpc-daemon[774]: ts=2026-09-20T13:28:28Z level=info event=scheduler_connected addr=lb:500513692worker1 # [ 26.609160] nix-grpc-daemon[774]: ts=2026-09-20T13:28:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3693worker2 # [ 26.787637] nix-grpc-daemon[779]: ts=2026-09-20T13:28:27Z level=info event=scheduler_connected addr=lb:500513694worker2 # [ 26.792837] nix-grpc-daemon[779]: ts=2026-09-20T13:28:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3695worker1 # [ 26.809951] nix-grpc-daemon[774]: ts=2026-09-20T13:28:28Z level=info event=scheduler_connected addr=lb:500513696worker1 # [ 26.815677] nix-grpc-daemon[774]: ts=2026-09-20T13:28:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3697worker2 # [ 26.995253] nix-grpc-daemon[779]: ts=2026-09-20T13:28:27Z level=info event=scheduler_connected addr=lb:500513698worker2 # [ 27.000395] nix-grpc-daemon[779]: ts=2026-09-20T13:28:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3699worker1 # [ 27.016874] nix-grpc-daemon[774]: ts=2026-09-20T13:28:28Z level=info event=scheduler_connected addr=lb:500513700worker1 # [ 27.022203] nix-grpc-daemon[774]: ts=2026-09-20T13:28:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3701worker2 # [ 27.201567] nix-grpc-daemon[779]: ts=2026-09-20T13:28:27Z level=info event=scheduler_connected addr=lb:500513702worker2 # [ 27.206684] nix-grpc-daemon[779]: ts=2026-09-20T13:28:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3703worker1 # [ 27.225332] nix-grpc-daemon[774]: ts=2026-09-20T13:28:28Z level=info event=scheduler_connected addr=lb:500513704worker1 # [ 27.229503] nix-grpc-daemon[774]: ts=2026-09-20T13:28:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3705worker2 # [ 27.408200] nix-grpc-daemon[779]: ts=2026-09-20T13:28:28Z level=info event=scheduler_connected addr=lb:500513706worker2 # [ 27.413408] nix-grpc-daemon[779]: ts=2026-09-20T13:28:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3707worker1 # [ 27.425915] nix-grpc-daemon[774]: ts=2026-09-20T13:28:29Z level=info event=scheduler_connected addr=lb:500513708worker1 # [ 27.431345] nix-grpc-daemon[774]: ts=2026-09-20T13:28:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3709worker2 # [ 27.614670] nix-grpc-daemon[779]: ts=2026-09-20T13:28:28Z level=info event=scheduler_connected addr=lb:500513710worker2 # [ 27.620297] nix-grpc-daemon[779]: ts=2026-09-20T13:28:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3711worker1 # [ 27.632659] nix-grpc-daemon[774]: ts=2026-09-20T13:28:29Z level=info event=scheduler_connected addr=lb:500513712worker1 # [ 27.637865] nix-grpc-daemon[774]: ts=2026-09-20T13:28:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3713worker2 # [ 27.821725] nix-grpc-daemon[779]: ts=2026-09-20T13:28:28Z level=info event=scheduler_connected addr=lb:500513714worker2 # [ 27.827368] nix-grpc-daemon[779]: ts=2026-09-20T13:28:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3715worker1 # [ 27.838710] nix-grpc-daemon[774]: ts=2026-09-20T13:28:29Z level=info event=scheduler_connected addr=lb:500513716worker1 # [ 27.844277] nix-grpc-daemon[774]: ts=2026-09-20T13:28:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3717worker2 # [ 28.030597] nix-grpc-daemon[779]: ts=2026-09-20T13:28:28Z level=info event=scheduler_connected addr=lb:500513718worker2 # [ 28.034854] nix-grpc-daemon[779]: ts=2026-09-20T13:28:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3719worker1 # [ 28.045270] nix-grpc-daemon[774]: ts=2026-09-20T13:28:29Z level=info event=scheduler_connected addr=lb:500513720worker1 # [ 28.050642] nix-grpc-daemon[774]: ts=2026-09-20T13:28:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3721worker2 # [ 28.231689] nix-grpc-daemon[779]: ts=2026-09-20T13:28:28Z level=info event=scheduler_connected addr=lb:500513722worker2 # [ 28.237102] nix-grpc-daemon[779]: ts=2026-09-20T13:28:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3723worker1 # [ 28.253152] nix-grpc-daemon[774]: ts=2026-09-20T13:28:29Z level=info event=scheduler_connected addr=lb:500513724worker1 # [ 28.257567] nix-grpc-daemon[774]: ts=2026-09-20T13:28:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3725worker2 # [ 28.438146] nix-grpc-daemon[779]: ts=2026-09-20T13:28:29Z level=info event=scheduler_connected addr=lb:500513726worker2 # [ 28.443357] nix-grpc-daemon[779]: ts=2026-09-20T13:28:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3727worker1 # [ 28.458563] nix-grpc-daemon[774]: ts=2026-09-20T13:28:30Z level=info event=scheduler_connected addr=lb:500513728worker1 # [ 28.463726] nix-grpc-daemon[774]: ts=2026-09-20T13:28:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3729worker2 # [ 28.644701] nix-grpc-daemon[779]: ts=2026-09-20T13:28:29Z level=info event=scheduler_connected addr=lb:500513730worker2 # [ 28.649898] nix-grpc-daemon[779]: ts=2026-09-20T13:28:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3731worker1 # [ 28.664646] nix-grpc-daemon[774]: ts=2026-09-20T13:28:30Z level=info event=scheduler_connected addr=lb:500513732worker1 # [ 28.669725] nix-grpc-daemon[774]: ts=2026-09-20T13:28:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3733worker2 # [ 28.853113] nix-grpc-daemon[779]: ts=2026-09-20T13:28:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3734worker1 # [ 28.870614] nix-grpc-daemon[774]: ts=2026-09-20T13:28:30Z level=info event=scheduler_connected addr=lb:500513735worker1 # [ 28.876182] nix-grpc-daemon[774]: ts=2026-09-20T13:28:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3736worker1 # [ 29.076997] nix-grpc-daemon[774]: ts=2026-09-20T13:28:30Z level=info event=scheduler_connected addr=lb:500513737worker1 # [ 29.082111] nix-grpc-daemon[774]: ts=2026-09-20T13:28:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3738worker2 # [ 29.256597] nix-grpc-daemon[779]: ts=2026-09-20T13:28:29Z level=info event=scheduler_connected addr=lb:500513739worker2 # [ 29.260738] nix-grpc-daemon[779]: ts=2026-09-20T13:28:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3740worker1 # [ 29.284988] nix-grpc-daemon[774]: ts=2026-09-20T13:28:30Z level=info event=scheduler_connected addr=lb:500513741worker1 # [ 29.289156] nix-grpc-daemon[774]: ts=2026-09-20T13:28:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3742worker2 # [ 29.457441] nix-grpc-daemon[779]: ts=2026-09-20T13:28:30Z level=info event=scheduler_connected addr=lb:500513743worker2 # [ 29.464145] nix-grpc-daemon[779]: ts=2026-09-20T13:28:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3744worker1 # [ 29.485382] nix-grpc-daemon[774]: ts=2026-09-20T13:28:31Z level=info event=scheduler_connected addr=lb:500513745worker1 # [ 29.490018] nix-grpc-daemon[774]: ts=2026-09-20T13:28:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3746worker2 # [ 29.663981] nix-grpc-daemon[779]: ts=2026-09-20T13:28:30Z level=info event=scheduler_connected addr=lb:500513747worker2 # [ 29.669412] nix-grpc-daemon[779]: ts=2026-09-20T13:28:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3748worker1 # [ 29.691068] nix-grpc-daemon[774]: ts=2026-09-20T13:28:31Z level=info event=scheduler_connected addr=lb:500513749worker1 # [ 29.696524] nix-grpc-daemon[774]: ts=2026-09-20T13:28:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3750worker2 # [ 29.870390] nix-grpc-daemon[779]: ts=2026-09-20T13:28:30Z level=info event=scheduler_connected addr=lb:500513751worker2 # [ 29.875798] nix-grpc-daemon[779]: ts=2026-09-20T13:28:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3752worker1 # [ 29.897459] nix-grpc-daemon[774]: ts=2026-09-20T13:28:31Z level=info event=scheduler_connected addr=lb:500513753worker1 # [ 29.902799] nix-grpc-daemon[774]: ts=2026-09-20T13:28:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3754worker2 # [ 30.077364] nix-grpc-daemon[779]: ts=2026-09-20T13:28:30Z level=info event=scheduler_connected addr=lb:500513755worker2 # [ 30.082594] nix-grpc-daemon[779]: ts=2026-09-20T13:28:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3756worker1 # [ 30.103674] nix-grpc-daemon[774]: ts=2026-09-20T13:28:31Z level=info event=scheduler_connected addr=lb:500513757worker1 # [ 30.108920] nix-grpc-daemon[774]: ts=2026-09-20T13:28:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3758worker2 # [ 30.285314] nix-grpc-daemon[779]: ts=2026-09-20T13:28:30Z level=info event=scheduler_connected addr=lb:500513759worker2 # [ 30.290013] nix-grpc-daemon[779]: ts=2026-09-20T13:28:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3760worker1 # [ 30.311413] nix-grpc-daemon[774]: ts=2026-09-20T13:28:31Z level=info event=scheduler_connected addr=lb:500513761lb # [ 30.289746] rustfs-bucket-start[1015]: mb s3://farm3762worker1 # [ 30.315565] nix-grpc-daemon[774]: ts=2026-09-20T13:28:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3763lb # [ 30.300626] systemd[1]: Finished rustfs-bucket.service.3764lb # [ 30.314180] systemd[1]: Starting niks3 server...3765worker2 # [ 30.491470] nix-grpc-daemon[779]: ts=2026-09-20T13:28:31Z level=info event=scheduler_connected addr=lb:500513766worker2 # [ 30.496954] nix-grpc-daemon[779]: ts=2026-09-20T13:28:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3767worker1 # [ 30.511944] nix-grpc-daemon[774]: ts=2026-09-20T13:28:32Z level=info event=scheduler_connected addr=lb:500513768worker1 # [ 30.517266] nix-grpc-daemon[774]: ts=2026-09-20T13:28:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3769lb # [ 30.526445] postgres[1035]: [1035] ERROR: relation "goose_db_version" does not exist at character 363770lb # [ 30.527792] postgres[1035]: [1035] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC3771lb # [ 30.560730] niks3-server[1030]: 2026/09/20 13:28:32 OK 20241026095416_initial_model.sql (18.55ms)3772lb # [ 30.563522] niks3-server[1030]: 2026/09/20 13:28:32 OK 20251210153512_drop_unused_gin_index.sql (3.81ms)3773lb # [ 30.569670] niks3-server[1030]: 2026/09/20 13:28:32 OK 20251218171726_add_pins.sql (6.09ms)3774lb # [ 30.574414] niks3-server[1030]: 2026/09/20 13:28:32 OK 20260628120000_add_object_size_and_stats.sql (4.7ms)3775lb # [ 30.579376] niks3-server[1030]: 2026/09/20 13:28:32 OK 20260905000000_add_claims.sql (4.92ms)3776lb # [ 30.585454] niks3-server[1030]: 2026/09/20 13:28:32 OK 20260920000000_drop_claims.sql (5.95ms)3777lb # [ 30.587472] niks3-server[1030]: 2026/09/20 13:28:32 goose: successfully migrated database to version: 202609200000003778lb # [ 30.592338] niks3-server[1030]: 2026/09/20 13:28:32 OK 1_commit_pending_closure.sql (6.65ms)3779lb # [ 30.595061] niks3-server[1030]: 2026/09/20 13:28:32 OK 2_object_stats_trigger.sql (2.77ms)3780lb # [ 30.596615] niks3-server[1030]: 2026/09/20 13:28:32 goose: up to current file version: 23781lb # [ 30.601005] niks3-server[1030]: 2026/09/20 13:28:32 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key3782worker2 # [ 30.698218] nix-grpc-daemon[779]: ts=2026-09-20T13:28:31Z level=info event=scheduler_connected addr=lb:500513783lb # [ 30.642903] niks3-server[1030]: 2026/09/20 13:28:32 INFO Read proxy enabled — serving cache objects from S33784worker2 # [ 30.703767] nix-grpc-daemon[779]: ts=2026-09-20T13:28:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3785lb # [ 30.645715] niks3-server[1030]: 2026/09/20 13:28:32 INFO Using socket-activated listener address=0.0.0.0:57513786lb # [ 30.649551] systemd[1]: Started niks3 server.3787lb # [ 30.650454] niks3-server[1030]: 2026/09/20 13:28:32 INFO systemd watchdog enabled interval=15s3788lb # [ 30.654166] systemd[1]: Reached target Multi-User System.3789lb # [ 30.656922] niks3-server[1030]: 2026/09/20 13:28:32 INFO Starting HTTP server address=0.0.0.0:57513790lb # [ 30.658549] systemd[1]: Startup finished in 982ms (kernel) + 4.708s (initrd) + 24.963s (userspace) = 30.653s.3791lb # [ 30.665644] niks3-server[1030]: 2026/09/20 13:28:32 INFO lead: acquired remote=192.168.1.4:370983792worker2 # [ 30.728382] nix-grpc-daemon[779]: ts=2026-09-20T13:28:31Z level=info event=scheduler_take_over3793worker1 # [ 30.718245] nix-grpc-daemon[774]: ts=2026-09-20T13:28:32Z level=info event=scheduler_connected addr=lb:500513794worker1 # [ 30.725215] nix-grpc-daemon[774]: ts=2026-09-20T13:28:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"3795worker2 # [ 30.904950] nix-grpc-daemon[779]: ts=2026-09-20T13:28:31Z level=info event=scheduler_connected addr=lb:500513796worker2 # [ 30.928166] nix-grpc-daemon[779]: ts=2026-09-20T13:28:31Z level=info event=oidc_jwks provider=mock keys=13797worker2 # [ 30.933878] nix-grpc-daemon[779]: ts=2026-09-20T13:28:31Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:425043798worker2 # [ 30.939380] nix-grpc-daemon[779]: ts=2026-09-20T13:28:31Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=03799worker1 # [ 30.925006] nix-grpc-daemon[774]: ts=2026-09-20T13:28:32Z level=info event=scheduler_connected addr=lb:500513800worker2 # [ 30.959567] nix-grpc-daemon[779]: ts=2026-09-20T13:28:31Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:425043801worker2 # [ 30.964662] nix-grpc-daemon[779]: ts=2026-09-20T13:28:31Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=03802lb: (finished: waiting for unit niks3.service, in 17.01 seconds)3803lb: waiting for TCP port 5751 on localhost3804lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!3805lb: (finished: waiting for TCP port 5751 on localhost, in 0.09 seconds)3806lb: waiting for unit envoy.service3807lb: (finished: waiting for unit envoy.service, in 0.06 seconds)3808lb: waiting for TCP port 50051 on localhost3809lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!3810lb # [ 31.660205] envoy[915]: conn peer=[::1]:59852 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=33811lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds)3812worker2 # [ 31.911585] systemd[1]: Starting scheduler-token.service...3813worker2 # [ 32.005177] systemd[1]: scheduler-token.service: Deactivated successfully.3814worker2 # [ 32.010361] systemd[1]: Finished scheduler-token.service.3815worker2 # [ 32.011556] systemd[1]: scheduler-token.service: Consumed 38ms CPU time over 98ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.3816lb: waiting until exactly no endpoints of aarch64-linux are unhealthy3817??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.3818 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1283819lb: must succeed: curl -sf localhost:9901/clusters3820lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)3821lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.10 seconds)3822subtest: one node schedules and both builders hold a WorkerSession on it3823lb: must succeed: curl -sf localhost:9901/clusters3824lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)3825worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics3826worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)3827lb: must succeed: curl -sf localhost:9901/clusters3828lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)3829lb: must succeed: curl -sf localhost:9901/clusters3830lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)3831worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open'3832worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.06 seconds)3833(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.34 seconds)3834subtest: balancer auth: client cert, bearer token, nothing, unknown CN3835worker2 # [ 32.828509] nix-grpc-daemon[779]: ts=2026-09-20T13:28:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:425063836worker2 # [ 32.841245] systemd[1]: Started Nix Daemon.3837worker2 # [ 33.098498] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted)3838worker2 # [ 33.131042] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 10 ms (attempt 1/5)3839worker2 # [ 33.144403] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 88 ms (attempt 2/5)3840worker2 # [ 33.236297] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 250 ms (attempt 3/5)3841worker2 # [ 33.486945] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 319 ms (attempt 4/5)3842worker2 # [ 33.808515] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3843worker2 # [ 33.834296] nix-grpc-daemon[779]: ts=2026-09-20T13:28:34Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:425063844worker2 # [ 33.847717] nix-grpc-daemon[779]: ts=2026-09-20T13:28:34Z level=debug event=path_info_miss path=1zplg4d2brzkh47d03ic67x3j0lywfb5-nixos-system-client-test error="error: path '/nix/store/1zplg4d2brzkh47d03ic67x3j0lywfb5-nixos-system-client-test' is required, but there is no substituter that can build it"3845worker1 # [ 33.841370] nix-grpc-daemon[774]: ts=2026-09-20T13:28:35Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:417183846worker1 # [ 33.860957] systemd[1]: Started Nix Daemon.3847worker1 # [ 34.133083] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)3848worker1 # [ 34.160847] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 68 ms (attempt 1/5)3849worker1 # [ 34.232234] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 172 ms (attempt 2/5)3850worker1 # [ 34.410618] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 83 ms (attempt 3/5)3851worker1 # [ 34.501753] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 470 ms (attempt 4/5)3852worker1 # [ 34.983027] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org3853worker1 # [ 34.998986] nix-grpc-daemon[774]: ts=2026-09-20T13:28:36Z level=debug event=path_info_miss path=1zplg4d2brzkh47d03ic67x3j0lywfb5-nixos-system-client-test error="error: path '/nix/store/1zplg4d2brzkh47d03ic67x3j0lywfb5-nixos-system-client-test' is required, but there is no substituter that can build it"3854client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt3855client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.11 seconds)3856client: must succeed: install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key3857client: (finished: must succeed: install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds)3858worker1 # [ 35.444731] nix-grpc-daemon[774]: ts=2026-09-20T13:28:37Z level=info event=oidc_jwks provider=mock keys=13859worker1 # [ 35.449210] nix-grpc-daemon[774]: ts=2026-09-20T13:28:37Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:417183860worker2 # [ 35.498805] nix-grpc-daemon[779]: ts=2026-09-20T13:28:36Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:425063861worker2 # [ 35.511556] nix-grpc-daemon[779]: ts=2026-09-20T13:28:36Z level=debug event=path_info_miss path=1zplg4d2brzkh47d03ic67x3j0lywfb5-nixos-system-client-test error="error: path '/nix/store/1zplg4d2brzkh47d03ic67x3j0lywfb5-nixos-system-client-test' is required, but there is no substituter that can build it"3862worker2 # [ 35.526417] nix-grpc-daemon[779]: ts=2026-09-20T13:28:36Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:425063863worker2 # [ 35.534402] nix-grpc-daemon[779]: ts=2026-09-20T13:28:36Z level=debug event=path_info_miss path=1zplg4d2brzkh47d03ic67x3j0lywfb5-nixos-system-client-test error="error: path '/nix/store/1zplg4d2brzkh47d03ic67x3j0lywfb5-nixos-system-client-test' is required, but there is no substituter that can build it"3864client: must succeed: rm -r /var/lib/nix-grpc-store3865client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.04 seconds)3866worker1 # [ 35.805451] nix-grpc-daemon[774]: ts=2026-09-20T13:28:37Z level=info event=denied method=QueryMissing cn=- role=none3867worker2 # [ 36.119781] nix-grpc-daemon[779]: ts=2026-09-20T13:28:36Z level=info event=denied method=QueryMissing cn=stranger role=none3868(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.68 seconds)3869subtest: DAG build is scheduled across workers and lands in the cache3870client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&23871worker1 # [ 36.334306] nix-grpc-daemon[774]: ts=2026-09-20T13:28:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:417183872client # don't know how to build these paths:3873client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv3874worker1 # [ 36.347677] nix-grpc-daemon[774]: ts=2026-09-20T13:28:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417183875worker2 # [ 36.419480] nix-grpc-daemon[779]: ts=2026-09-20T13:28:37Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=03876worker2 # [ 36.426866] nix-grpc-daemon[779]: ts=2026-09-20T13:28:37Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.4:50051 clients=13877worker2 # [ 36.473156] nix-grpc-daemon[779]: ts=2026-09-20T13:28:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425063878worker2 # [ 36.493245] nix-grpc-daemon[779]: ts=2026-09-20T13:28:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425063879client # copying 1 paths to 'lb:50051'...3880worker2 # [ 36.510740] nix-grpc-daemon[779]: ts=2026-09-20T13:28:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:425063881client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'...3882worker2 # [ 36.541072] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted)3883worker2 # [ 36.713555] nix-grpc-daemon[779]: ts=2026-09-20T13:28:37Z level=info event=niks3_push_started pid=8603884worker2 # [ 37.011315] nix-grpc-daemon[860]: time=2026-09-20T13:28:37.605Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""3885worker2 # [ 37.205740] nix-daemon[847]: accepted connection from pid 873, user nix-grpc-daemon (trusted)3886worker2 # [ 37.225448] nix-daemon[847]: reaped child process 876, status = succeeded3887worker2 # [ 37.399756] nix-daemon[847]: accepted connection from pid 878, user nix-grpc-daemon (trusted)3888worker2 # [ 37.420156] nix-daemon[847]: reaped child process 881, status = succeeded3889lb # [ 37.370011] niks3-server[1030]: 2026/09/20 13:28:38 INFO Received uploads request method=POST path=/api/pending_closures3890worker2 # [ 37.456553] nix-grpc-daemon[860]: time=2026-09-20T13:28:38.052Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3891worker2 # [ 37.459876] nix-grpc-daemon[860]: time=2026-09-20T13:28:38.054Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)"3892lb # [ 37.441731] niks3-server[1030]: 2026/09/20 13:28:39 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst3893lb # [ 37.451514] niks3-server[1030]: 2026/09/20 13:28:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign3894lb # [ 37.469655] niks3-server[1030]: 2026/09/20 13:28:39 INFO Signed narinfos id=1 count=13895worker2 # [ 37.532748] nix-grpc-daemon[860]: time=2026-09-20T13:28:38.128Z level=INFO msg="Uploading 1 narinfos"3896lb # [ 37.491343] niks3-server[1030]: 2026/09/20 13:28:39 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete3897lb # [ 37.505889] niks3-server[1030]: 2026/09/20 13:28:39 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls3898lb # [ 37.528430] niks3-server[1030]: 2026/09/20 13:28:39 INFO Completed upload id=13899worker2 # [ 37.591232] nix-grpc-daemon[860]: time=2026-09-20T13:28:38.187Z level=INFO msg="Upload complete. (572ms)"3900lb # [ 37.538479] niks3-server[1030]: 2026/09/20 13:28:39 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo3901worker2 # [ 37.603824] nix-grpc-daemon[779]: ts=2026-09-20T13:28:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42506 duration_s=1 paths=1 nar_bytes_in=5043902worker2 # [ 37.624774] nix-grpc-daemon[779]: ts=2026-09-20T13:28:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425063903worker2 # [ 37.633848] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted)3904worker2 # [ 37.646013] nix-daemon[847]: reaped child process 858, status = succeeded3905client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051...3906worker2 # [ 37.655411] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted)3907client # farm-a> worker2: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3908client # farm-a> LOG-farm-a-t13909worker2 # [ 39.100680] nix-daemon[847]: reaped child process 885, status = succeeded3910worker2 # [ 39.284714] nix-daemon[847]: accepted connection from pid 900, user nix-grpc-daemon (trusted)3911worker2 # [ 39.303661] nix-daemon[847]: reaped child process 903, status = succeeded3912lb # [ 39.253605] niks3-server[1030]: 2026/09/20 13:28:40 INFO Received uploads request method=POST path=/api/pending_closures3913worker2 # [ 39.334647] nix-grpc-daemon[860]: time=2026-09-20T13:28:39.928Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"3914worker2 # [ 39.340120] nix-grpc-daemon[860]: time=2026-09-20T13:28:39.928Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)"3915lb # [ 39.308393] niks3-server[1030]: 2026/09/20 13:28:40 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv3916lb # [ 39.324129] niks3-server[1030]: 2026/09/20 13:28:40 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst3917lb # [ 39.338379] niks3-server[1030]: 2026/09/20 13:28:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign3918worker2 # [ 39.408665] nix-grpc-daemon[860]: time=2026-09-20T13:28:40.004Z level=INFO msg="Uploading 1 narinfos"3919lb # [ 39.348199] niks3-server[1030]: 2026/09/20 13:28:40 INFO Signed narinfos id=2 count=13920lb # [ 39.351711] niks3-server[1030]: 2026/09/20 13:28:40 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls3921lb # [ 39.368400] niks3-server[1030]: 2026/09/20 13:28:40 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete3922lb # [ 39.375512] niks3-server[1030]: 2026/09/20 13:28:40 INFO Completed upload id=23923worker2 # [ 39.440146] nix-grpc-daemon[860]: time=2026-09-20T13:28:40.033Z level=INFO msg="Upload complete. (369ms)"3924lb # [ 39.379849] niks3-server[1030]: 2026/09/20 13:28:40 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo3925worker2 # [ 39.464355] nix-grpc-daemon[779]: ts=2026-09-20T13:28:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42506 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=13926worker2 # [ 39.477367] nix-grpc-daemon[779]: ts=2026-09-20T13:28:40Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=03927worker2 # [ 39.481237] nix-grpc-daemon[779]: ts=2026-09-20T13:28:40Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.4:50051 clients=13928worker2 # [ 39.485317] nix-daemon[847]: reaped child process 883, status = succeeded3929worker2 # [ 39.503767] nix-grpc-daemon[779]: ts=2026-09-20T13:28:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425063930worker2 # [ 39.521405] nix-grpc-daemon[779]: ts=2026-09-20T13:28:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425063931worker2 # [ 39.531082] nix-grpc-daemon[860]: time=2026-09-20T13:28:40.126Z level=INFO msg="All 1 paths already cached"3932client # copying 1 paths to 'lb:50051'...3933worker2 # [ 39.536672] nix-grpc-daemon[779]: ts=2026-09-20T13:28:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:425063934client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'...3935worker2 # [ 39.556476] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted)3936worker2 # [ 39.739562] nix-daemon[847]: accepted connection from pid 909, user nix-grpc-daemon (trusted)3937worker2 # [ 39.760178] nix-daemon[847]: reaped child process 913, status = succeeded3938worker2 # [ 39.938192] nix-daemon[847]: accepted connection from pid 915, user nix-grpc-daemon (trusted)3939worker2 # [ 39.955473] nix-daemon[847]: reaped child process 918, status = succeeded3940lb # [ 39.909297] niks3-server[1030]: 2026/09/20 13:28:41 INFO Received uploads request method=POST path=/api/pending_closures3941worker2 # [ 39.984942] nix-grpc-daemon[860]: time=2026-09-20T13:28:40.580Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3942worker2 # [ 39.986483] nix-grpc-daemon[860]: time=2026-09-20T13:28:40.580Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)"3943lb # [ 39.947460] niks3-server[1030]: 2026/09/20 13:28:41 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst3944worker2 # [ 40.018645] nix-grpc-daemon[860]: time=2026-09-20T13:28:40.614Z level=INFO msg="Uploading 1 narinfos"3945lb # [ 39.962657] niks3-server[1030]: 2026/09/20 13:28:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign3946lb # [ 39.971750] niks3-server[1030]: 2026/09/20 13:28:41 INFO Signed narinfos id=3 count=13947lb # [ 39.979416] niks3-server[1030]: 2026/09/20 13:28:41 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls3948lb # [ 39.987262] niks3-server[1030]: 2026/09/20 13:28:41 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete3949lb # [ 39.993130] niks3-server[1030]: 2026/09/20 13:28:41 INFO Completed upload id=33950worker2 # [ 40.054898] nix-grpc-daemon[860]: time=2026-09-20T13:28:40.650Z level=INFO msg="Upload complete. (489ms)"3951lb # [ 39.996111] niks3-server[1030]: 2026/09/20 13:28:41 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo3952worker2 # [ 40.063789] nix-grpc-daemon[779]: ts=2026-09-20T13:28:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42506 duration_s=0 paths=1 nar_bytes_in=6243953worker2 # [ 40.080497] nix-grpc-daemon[779]: ts=2026-09-20T13:28:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425063954worker2 # [ 40.091857] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted)3955worker2 # [ 40.094451] nix-daemon[847]: reaped child process 907, status = succeeded3956client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051...3957client # farm-b> worker2: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3958worker2 # [ 40.110664] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted)3959client # farm-b> LOG-farm-b-t13960worker2 # [ 40.956206] nix-daemon[847]: reaped child process 922, status = succeeded3961worker2 # [ 41.140638] nix-daemon[847]: accepted connection from pid 937, user nix-grpc-daemon (trusted)3962worker2 # [ 41.161919] nix-daemon[847]: reaped child process 940, status = succeeded3963lb # [ 41.111765] niks3-server[1030]: 2026/09/20 13:28:42 INFO Received uploads request method=POST path=/api/pending_closures3964worker2 # [ 41.188520] nix-grpc-daemon[860]: time=2026-09-20T13:28:41.784Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"3965worker2 # [ 41.191369] nix-grpc-daemon[860]: time=2026-09-20T13:28:41.786Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)"3966lb # [ 41.155439] niks3-server[1030]: 2026/09/20 13:28:42 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst3967lb # [ 41.168660] niks3-server[1030]: 2026/09/20 13:28:42 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv3968lb # [ 41.175593] niks3-server[1030]: 2026/09/20 13:28:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign3969worker2 # [ 41.243332] nix-grpc-daemon[860]: time=2026-09-20T13:28:41.838Z level=INFO msg="Uploading 1 narinfos"3970lb # [ 41.183341] niks3-server[1030]: 2026/09/20 13:28:42 INFO Signed narinfos id=4 count=13971lb # [ 41.190904] niks3-server[1030]: 2026/09/20 13:28:42 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls3972lb # [ 41.201519] niks3-server[1030]: 2026/09/20 13:28:42 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete3973lb # [ 41.208145] niks3-server[1030]: 2026/09/20 13:28:42 INFO Completed upload id=43974worker2 # [ 41.270119] nix-grpc-daemon[860]: time=2026-09-20T13:28:41.866Z level=INFO msg="Upload complete. (348ms)"3975lb # [ 41.211332] niks3-server[1030]: 2026/09/20 13:28:42 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo3976worker2 # [ 41.288539] nix-grpc-daemon[779]: ts=2026-09-20T13:28:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42506 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=13977worker2 # [ 41.304434] nix-grpc-daemon[779]: ts=2026-09-20T13:28:41Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=03978worker2 # [ 41.310676] nix-grpc-daemon[779]: ts=2026-09-20T13:28:41Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.4:50051 clients=13979worker2 # [ 41.315088] nix-daemon[847]: reaped child process 920, status = succeeded3980worker2 # [ 41.335096] nix-grpc-daemon[779]: ts=2026-09-20T13:28:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425063981worker2 # [ 41.350630] nix-grpc-daemon[779]: ts=2026-09-20T13:28:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425063982client # copying 1 paths to 'lb:50051'...3983worker2 # [ 41.365257] nix-grpc-daemon[860]: time=2026-09-20T13:28:41.961Z level=INFO msg="All 2 paths already cached"3984worker2 # [ 41.372940] nix-grpc-daemon[779]: ts=2026-09-20T13:28:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:425063985client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'...3986lb # [ 41.330248] envoy[915]: conn peer=[2001:db8:1::1]:58918 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=749 tx=423 ms=22413987worker2 # [ 41.396553] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted)3988lb # [ 41.335327] envoy[915]: conn peer=[2001:db8:1::1]:58934 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=853989lb # [ 41.341112] envoy[915]: conn peer=[2001:db8:1::1]:58946 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=173990lb # [ 41.345612] envoy[915]: conn peer=[2001:db8:1::1]:58962 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=133991worker2 # [ 41.595294] nix-daemon[847]: accepted connection from pid 946, user nix-grpc-daemon (trusted)3992worker2 # [ 41.615825] nix-daemon[847]: reaped child process 949, status = succeeded3993worker2 # [ 41.786732] nix-daemon[847]: accepted connection from pid 951, user nix-grpc-daemon (trusted)3994worker2 # [ 41.803503] nix-daemon[847]: reaped child process 954, status = succeeded3995lb # [ 41.757211] niks3-server[1030]: 2026/09/20 13:28:43 INFO Received uploads request method=POST path=/api/pending_closures3996worker2 # [ 41.828991] nix-grpc-daemon[860]: time=2026-09-20T13:28:42.424Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"3997worker2 # [ 41.830517] nix-grpc-daemon[860]: time=2026-09-20T13:28:42.424Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)"3998lb # [ 41.786571] niks3-server[1030]: 2026/09/20 13:28:43 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst3999worker2 # [ 41.859796] nix-grpc-daemon[860]: time=2026-09-20T13:28:42.455Z level=INFO msg="Uploading 1 narinfos"4000lb # [ 41.801199] niks3-server[1030]: 2026/09/20 13:28:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4001lb # [ 41.812359] niks3-server[1030]: 2026/09/20 13:28:43 INFO Signed narinfos id=5 count=14002lb # [ 41.822391] niks3-server[1030]: 2026/09/20 13:28:43 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls4003worker2 # [ 41.889367] nix-grpc-daemon[860]: time=2026-09-20T13:28:42.485Z level=INFO msg="Upload complete. (474ms)"4004lb # [ 41.827537] niks3-server[1030]: 2026/09/20 13:28:43 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4005lb # [ 41.833457] niks3-server[1030]: 2026/09/20 13:28:43 INFO Completed upload id=54006worker2 # [ 41.895408] nix-grpc-daemon[779]: ts=2026-09-20T13:28:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42506 duration_s=0 paths=1 nar_bytes_in=7524007lb # [ 41.836929] niks3-server[1030]: 2026/09/20 13:28:43 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo4008worker2 # [ 41.908867] nix-grpc-daemon[779]: ts=2026-09-20T13:28:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425064009worker2 # [ 41.915228] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted)4010worker2 # [ 41.920755] nix-daemon[847]: reaped child process 944, status = succeeded4011client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051...4012client # farm-top> worker2: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4013worker2 # [ 41.934488] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted)4014client # farm-top> LOG-farm-top-t14015worker2 # [ 43.779102] nix-daemon[847]: reaped child process 958, status = succeeded4016worker2 # [ 43.957564] nix-daemon[847]: accepted connection from pid 974, user nix-grpc-daemon (trusted)4017worker2 # [ 43.976676] nix-daemon[847]: reaped child process 977, status = succeeded4018lb # [ 43.926385] niks3-server[1030]: 2026/09/20 13:28:45 INFO Received uploads request method=POST path=/api/pending_closures4019worker2 # [ 44.001340] nix-grpc-daemon[860]: time=2026-09-20T13:28:44.595Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4020worker2 # [ 44.003437] nix-grpc-daemon[860]: time=2026-09-20T13:28:44.595Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)"4021lb # [ 43.964320] niks3-server[1030]: 2026/09/20 13:28:45 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4022lb # [ 43.984299] niks3-server[1030]: 2026/09/20 13:28:45 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst4023worker2 # [ 44.068066] nix-grpc-daemon[860]: time=2026-09-20T13:28:44.663Z level=INFO msg="Uploading 1 narinfos"4024lb # [ 43.999033] niks3-server[1030]: 2026/09/20 13:28:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4025lb # [ 44.011499] niks3-server[1030]: 2026/09/20 13:28:45 INFO Signed narinfos id=6 count=14026lb # [ 44.018405] niks3-server[1030]: 2026/09/20 13:28:45 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls4027lb # [ 44.028509] niks3-server[1030]: 2026/09/20 13:28:45 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4028lb # [ 44.033313] niks3-server[1030]: 2026/09/20 13:28:45 INFO Completed upload id=64029worker2 # [ 44.095114] nix-grpc-daemon[860]: time=2026-09-20T13:28:44.691Z level=INFO msg="Upload complete. (349ms)"4030lb # [ 44.036472] niks3-server[1030]: 2026/09/20 13:28:45 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo4031worker2 # [ 44.109325] nix-grpc-daemon[779]: ts=2026-09-20T13:28:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42506 duration_s=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=14032worker2 # [ 44.127742] nix-daemon[847]: reaped child process 956, status = succeeded4033client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 8.01 seconds)4034client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4035client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.25 seconds)4036client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4037client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.03 seconds)4038client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4039client # copying 3 paths...4040client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...4041client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...4042client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...4043client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.30 seconds)4044(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 8.69 seconds)4045subtest: repeat is answered Cached by the scheduler without building4046worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4047worker1 # finding garbage collector roots...4048worker1 # deleting specified paths...4049worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4050worker1 # deleting unused links...4051worker1 # note: hard linking is currently saving 0.0 KiB4052worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.29 seconds)4053worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4054worker2 # finding garbage collector roots...4055worker2 # deleting specified paths...4056worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4057worker2 # deleting unused links...4058worker2 # note: hard linking is currently saving 0.0 KiB4059worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.28 seconds)4060client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&24061worker2 # [ 45.673379] nix-grpc-daemon[779]: ts=2026-09-20T13:28:46Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:425064062client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):4063client # /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4064worker1 # [ 45.670653] nix-grpc-daemon[774]: ts=2026-09-20T13:28:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417184065worker2 # [ 45.749849] nix-grpc-daemon[779]: ts=2026-09-20T13:28:46Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=14066client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.38 seconds)4067client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath4068client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.29 seconds)4069lb: must succeed: curl -sf localhost:9901/clusters4070lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4071lb: must succeed: curl -sf localhost:9901/clusters4072lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4073worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4074worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds)4075(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.62 seconds)4076subtest: inputs already in the cache are not sent to the scheduler4077lb: must succeed: curl -sf localhost:9901/clusters4078lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)4079lb: must succeed: curl -sf localhost:9901/clusters4080lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4081worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4082worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds)4083client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&24084client # don't know how to build these paths:4085client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4086worker2 # [ 46.974010] nix-grpc-daemon[779]: ts=2026-09-20T13:28:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:425064087worker2 # [ 46.983923] nix-grpc-daemon[779]: ts=2026-09-20T13:28:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425064088worker2 # [ 46.993325] nix-grpc-daemon[860]: time=2026-09-20T13:28:47.588Z level=INFO msg="All 2 paths already cached"4089worker2 # [ 47.012132] nix-grpc-daemon[779]: ts=2026-09-20T13:28:47Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=04090worker2 # [ 47.020127] nix-grpc-daemon[779]: ts=2026-09-20T13:28:47Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.4:50051 clients=14091worker2 # [ 47.063199] nix-grpc-daemon[779]: ts=2026-09-20T13:28:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425064092worker2 # [ 47.081083] nix-grpc-daemon[779]: ts=2026-09-20T13:28:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425064093worker2 # [ 47.095453] nix-grpc-daemon[860]: time=2026-09-20T13:28:47.691Z level=INFO msg="All 2 paths already cached"4094client # copying 1 paths to 'lb:50051'...4095worker2 # [ 47.106608] nix-grpc-daemon[779]: ts=2026-09-20T13:28:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:425064096client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'...4097worker2 # [ 47.128785] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted)4098worker2 # [ 47.368702] nix-daemon[847]: accepted connection from pid 1007, user nix-grpc-daemon (trusted)4099worker2 # [ 47.390081] nix-daemon[847]: reaped child process 1010, status = succeeded4100worker2 # [ 47.583027] nix-daemon[847]: accepted connection from pid 1012, user nix-grpc-daemon (trusted)4101worker2 # [ 47.602600] nix-daemon[847]: reaped child process 1015, status = succeeded4102lb # [ 47.554800] niks3-server[1030]: 2026/09/20 13:28:49 INFO Received uploads request method=POST path=/api/pending_closures4103worker2 # [ 47.629257] nix-grpc-daemon[860]: time=2026-09-20T13:28:48.224Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4104worker2 # [ 47.630779] nix-grpc-daemon[860]: time=2026-09-20T13:28:48.224Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)"4105lb # [ 47.603793] niks3-server[1030]: 2026/09/20 13:28:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4106worker2 # [ 47.678085] nix-grpc-daemon[860]: time=2026-09-20T13:28:48.273Z level=INFO msg="Uploading 1 narinfos"4107lb # [ 47.622217] niks3-server[1030]: 2026/09/20 13:28:49 INFO Signed narinfos id=7 count=14108lb # [ 47.628330] niks3-server[1030]: 2026/09/20 13:28:49 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst4109lb # [ 47.636164] niks3-server[1030]: 2026/09/20 13:28:49 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls4110lb # [ 47.642905] niks3-server[1030]: 2026/09/20 13:28:49 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4111lb # [ 47.649971] niks3-server[1030]: 2026/09/20 13:28:49 INFO Completed upload id=74112worker2 # [ 47.711863] nix-grpc-daemon[860]: time=2026-09-20T13:28:48.307Z level=INFO msg="Upload complete. (562ms)"4113lb # [ 47.652792] niks3-server[1030]: 2026/09/20 13:28:49 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo4114worker2 # [ 47.724689] nix-grpc-daemon[779]: ts=2026-09-20T13:28:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42506 duration_s=0 paths=1 nar_bytes_in=7524115worker2 # [ 47.740486] nix-grpc-daemon[779]: ts=2026-09-20T13:28:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425064116worker2 # [ 47.750046] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted)4117worker2 # [ 47.755429] nix-daemon[847]: reaped child process 1005, status = succeeded4118client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051...4119worker2 # [ 47.769602] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted)4120client # farm-top> worker2: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4121client # farm-top> LOG-farm-top-t1b4122worker2 # [ 49.427865] nix-daemon[847]: reaped child process 1019, status = succeeded4123worker2 # [ 49.637517] nix-daemon[847]: accepted connection from pid 1034, user nix-grpc-daemon (trusted)4124worker2 # [ 49.655743] nix-daemon[847]: reaped child process 1037, status = succeeded4125lb # [ 49.606037] niks3-server[1030]: 2026/09/20 13:28:51 INFO Received uploads request method=POST path=/api/pending_closures4126worker2 # [ 49.680472] nix-grpc-daemon[860]: time=2026-09-20T13:28:50.275Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4127worker2 # [ 49.682007] nix-grpc-daemon[860]: time=2026-09-20T13:28:50.275Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)"4128lb # [ 49.647719] niks3-server[1030]: 2026/09/20 13:28:51 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4129lb # [ 49.666695] niks3-server[1030]: 2026/09/20 13:28:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4130worker2 # [ 49.735189] nix-grpc-daemon[860]: time=2026-09-20T13:28:50.330Z level=INFO msg="Uploading 1 narinfos"4131lb # [ 49.675662] niks3-server[1030]: 2026/09/20 13:28:51 INFO Signed narinfos id=8 count=14132lb # [ 49.682756] niks3-server[1030]: 2026/09/20 13:28:51 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst4133lb # [ 49.691212] niks3-server[1030]: 2026/09/20 13:28:51 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls4134lb # [ 49.698635] niks3-server[1030]: 2026/09/20 13:28:51 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4135worker2 # [ 49.760923] nix-grpc-daemon[860]: time=2026-09-20T13:28:50.356Z level=INFO msg="Upload complete. (374ms)"4136lb # [ 49.706079] niks3-server[1030]: 2026/09/20 13:28:51 INFO Completed upload id=84137lb # [ 49.710060] niks3-server[1030]: 2026/09/20 13:28:51 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo4138worker2 # [ 49.774369] nix-grpc-daemon[779]: ts=2026-09-20T13:28:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42506 duration_s=2 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=14139worker2 # [ 49.796151] nix-daemon[847]: reaped child process 1017, status = succeeded4140client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 3.13 seconds)4141client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath4142client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.24 seconds)4143lb: must succeed: curl -sf localhost:9901/clusters4144lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4145lb: must succeed: curl -sf localhost:9901/clusters4146lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4147worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4148worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds)4149(finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.80 seconds)4150subtest: two clients wanting the same drv build it once4151client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4152client # [ 50.270375] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4153client # Running as unit: dedup1.service; invocation ID: 58d2546c80304f8fa99628715e8bf9484154client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.09 seconds)4155client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup4156worker2 # [ 50.578530] nix-grpc-daemon[779]: ts=2026-09-20T13:28:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:425064157client # [ 50.521529] nix[881]: don't know how to build these paths:4158client # [ 50.522502] nix[881]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4159worker2 # [ 50.599647] nix-grpc-daemon[779]: ts=2026-09-20T13:28:51Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04160worker2 # [ 50.605840] nix-grpc-daemon[779]: ts=2026-09-20T13:28:51Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.3:50051 clients=14161worker1 # [ 50.618521] nix-grpc-daemon[774]: ts=2026-09-20T13:28:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417184162worker1 # [ 50.637277] nix-grpc-daemon[774]: ts=2026-09-20T13:28:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417184163client # [ 50.620826] nix[881]: copying 1 paths to 'lb:50051'...4164worker1 # [ 50.653156] nix-grpc-daemon[774]: ts=2026-09-20T13:28:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417184165client # [ 50.624103] nix[881]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4166worker1 # [ 50.674098] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4167worker1 # [ 50.705405] nix-grpc-daemon[774]: ts=2026-09-20T13:28:52Z level=info event=niks3_push_started pid=8584168worker1 # [ 50.979048] nix-grpc-daemon[858]: time=2026-09-20T13:28:52.580Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca=""4169worker1 # [ 51.173395] nix-daemon[832]: accepted connection from pid 871, user nix-grpc-daemon (trusted)4170worker1 # [ 51.192984] nix-daemon[832]: reaped child process 874, status = succeeded4171worker1 # [ 51.363538] nix-daemon[832]: accepted connection from pid 876, user nix-grpc-daemon (trusted)4172lb # [ 51.333045] envoy[915]: conn peer=[2001:db8:1::1]:58966 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9523 tx=3843 ms=77684173lb # [ 51.338133] envoy[915]: conn peer=[2001:db8:1::1]:55030 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=1024174lb # [ 51.343170] envoy[915]: conn peer=[2001:db8:1::1]:55034 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4172 tx=1705 ms=28314175worker1 # [ 51.383922] nix-daemon[832]: reaped child process 879, status = succeeded4176lb # [ 51.366941] niks3-server[1030]: 2026/09/20 13:28:52 INFO Received uploads request method=POST path=/api/pending_closures4177worker1 # [ 51.407165] nix-grpc-daemon[858]: time=2026-09-20T13:28:53.010Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4178worker1 # [ 51.410868] nix-grpc-daemon[858]: time=2026-09-20T13:28:53.012Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4179client # [ 51.385463] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup.4180lb # [ 51.402650] niks3-server[1030]: 2026/09/20 13:28:52 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4181client # Running as unit: dedup2.service; invocation ID: 54005cfb2b86406a8fb604865ac68f5f4182lb # [ 51.416302] niks3-server[1030]: 2026/09/20 13:28:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4183worker1 # [ 51.453189] nix-grpc-daemon[858]: time=2026-09-20T13:28:53.056Z level=INFO msg="Uploading 1 narinfos"4184client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.13 seconds)4185lb # [ 51.429171] niks3-server[1030]: 2026/09/20 13:28:53 INFO Signed narinfos id=9 count=14186lb # [ 51.434675] niks3-server[1030]: 2026/09/20 13:28:53 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4187lb # [ 51.446310] niks3-server[1030]: 2026/09/20 13:28:53 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4188worker1 # [ 51.484963] nix-grpc-daemon[858]: time=2026-09-20T13:28:53.088Z level=INFO msg="Upload complete. (498ms)"4189lb # [ 51.455078] niks3-server[1030]: 2026/09/20 13:28:53 INFO Completed upload id=94190lb # [ 51.460000] niks3-server[1030]: 2026/09/20 13:28:53 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4191worker1 # [ 51.492183] nix-grpc-daemon[774]: ts=2026-09-20T13:28:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41718 duration_s=0 paths=1 nar_bytes_in=4324192worker1 # [ 51.497324] nix-grpc-daemon[774]: ts=2026-09-20T13:28:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417184193worker1 # [ 51.503800] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4194worker1 # [ 51.514935] nix-daemon[832]: reaped child process 856, status = succeeded4195client # [ 51.487370] nix[881]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4196worker1 # [ 51.523487] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4197worker2 # [ 51.807144] nix-grpc-daemon[779]: ts=2026-09-20T13:28:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:425064198client # [ 51.750102] nix[896]: don't know how to build these paths:4199client # [ 51.751446] nix[896]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4200worker2 # [ 51.828271] nix-grpc-daemon[779]: ts=2026-09-20T13:28:52Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04201worker1 # [ 51.809085] nix-grpc-daemon[774]: ts=2026-09-20T13:28:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417184202client # [ 51.777044] nix[896]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4203client: must succeed: sleep 24204client: (finished: must succeed: sleep 2, in 2.06 seconds)4205??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4206 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394207client: waiting for success: ! systemctl is-active dedup1 dedup24208??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4209 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394210worker1 # [ 55.173460] nix-daemon[832]: reaped child process 887, status = succeeded4211worker1 # [ 55.366491] nix-daemon[832]: accepted connection from pid 912, user nix-grpc-daemon (trusted)4212worker1 # [ 55.386142] nix-daemon[832]: reaped child process 915, status = succeeded4213lb # [ 55.369521] niks3-server[1030]: 2026/09/20 13:28:56 INFO Received uploads request method=POST path=/api/pending_closures4214worker1 # [ 55.421212] nix-grpc-daemon[858]: time=2026-09-20T13:28:57.022Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4215worker1 # [ 55.424353] nix-grpc-daemon[858]: time=2026-09-20T13:28:57.022Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4216lb # [ 55.442632] niks3-server[1030]: 2026/09/20 13:28:57 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4217lb # [ 55.454759] niks3-server[1030]: 2026/09/20 13:28:57 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4218worker1 # [ 55.494360] nix-grpc-daemon[858]: time=2026-09-20T13:28:57.096Z level=INFO msg="Uploading 1 narinfos"4219lb # [ 55.465551] niks3-server[1030]: 2026/09/20 13:28:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4220lb # [ 55.471368] niks3-server[1030]: 2026/09/20 13:28:57 INFO Signed narinfos id=10 count=14221lb # [ 55.475967] niks3-server[1030]: 2026/09/20 13:28:57 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4222lb # [ 55.487377] niks3-server[1030]: 2026/09/20 13:28:57 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4223lb # [ 55.495331] niks3-server[1030]: 2026/09/20 13:28:57 INFO Completed upload id=104224worker1 # [ 55.523523] nix-grpc-daemon[858]: time=2026-09-20T13:28:57.127Z level=INFO msg="Upload complete. (387ms)"4225lb # [ 55.498803] niks3-server[1030]: 2026/09/20 13:28:57 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4226worker1 # [ 55.537248] nix-grpc-daemon[774]: ts=2026-09-20T13:28:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41718 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14227worker1 # [ 55.555598] nix-grpc-daemon[774]: ts=2026-09-20T13:28:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41718 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=14228worker1 # [ 55.563743] nix-daemon[832]: reaped child process 885, status = succeeded4229client # [ 55.562311] systemd[1]: dedup2.service: Deactivated successfully.4230client # [ 55.568183] systemd[1]: dedup2.service: Consumed 196ms CPU time over 4.182s wall clock time, 31M memory peak, 7.3K incoming IP traffic, 6.4K outgoing IP traffic.4231client # [ 55.578807] systemd[1]: dedup1.service: Deactivated successfully.4232client # [ 55.581451] systemd[1]: dedup1.service: Consumed 155ms CPU time over 5.305s wall clock time, 37.1M memory peak, 8.5K incoming IP traffic, 8.9K outgoing IP traffic.4233client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.14 seconds)4234client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4235client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds)4236worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4237worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4238worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4239worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4240worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4241worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds)4242worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4243worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)4244(finished: subtest: two clients wanting the same drv build it once, in 6.31 seconds)4245subtest: build hook: nix-daemon with builders = grpc://lb4246client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log4247client # [ 56.745070] systemd[1]: Started Nix Daemon.4248client # [ 56.942339] nix-daemon[937]: accepted connection from pid 934, user root (trusted)4249worker1 # [ 57.173297] nix-grpc-daemon[774]: ts=2026-09-20T13:28:58Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:417184250worker1 # [ 57.181062] nix-grpc-daemon[774]: ts=2026-09-20T13:28:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417184251worker2 # [ 57.229123] nix-grpc-daemon[779]: ts=2026-09-20T13:28:57Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04252worker2 # [ 57.229506] nix-grpc-daemon[779]: ts=2026-09-20T13:28:57Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.4:50051 clients=14253worker2 # [ 57.275267] nix-grpc-daemon[779]: ts=2026-09-20T13:28:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425064254worker2 # [ 57.291953] nix-grpc-daemon[779]: ts=2026-09-20T13:28:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425064255worker2 # [ 57.307042] nix-grpc-daemon[779]: ts=2026-09-20T13:28:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:425064256worker2 # [ 57.326423] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted)4257worker2 # [ 57.535116] nix-daemon[847]: accepted connection from pid 1073, user nix-grpc-daemon (trusted)4258worker2 # [ 57.556678] nix-daemon[847]: reaped child process 1076, status = succeeded4259worker2 # [ 57.733121] nix-daemon[847]: accepted connection from pid 1078, user nix-grpc-daemon (trusted)4260worker2 # [ 57.750915] nix-daemon[847]: reaped child process 1081, status = succeeded4261lb # [ 57.700867] niks3-server[1030]: 2026/09/20 13:28:59 INFO Received uploads request method=POST path=/api/pending_closures4262worker2 # [ 57.773136] nix-grpc-daemon[860]: time=2026-09-20T13:28:58.368Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4263worker2 # [ 57.774613] nix-grpc-daemon[860]: time=2026-09-20T13:28:58.368Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4264lb # [ 57.734364] niks3-server[1030]: 2026/09/20 13:28:59 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4265worker2 # [ 57.810182] nix-grpc-daemon[860]: time=2026-09-20T13:28:58.405Z level=INFO msg="Uploading 1 narinfos"4266lb # [ 57.753127] niks3-server[1030]: 2026/09/20 13:28:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4267lb # [ 57.761810] niks3-server[1030]: 2026/09/20 13:28:59 INFO Signed narinfos id=11 count=14268lb # [ 57.765722] niks3-server[1030]: 2026/09/20 13:28:59 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4269worker2 # [ 57.835690] nix-grpc-daemon[860]: time=2026-09-20T13:28:58.431Z level=INFO msg="Upload complete. (492ms)"4270lb # [ 57.773886] niks3-server[1030]: 2026/09/20 13:28:59 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4271lb # [ 57.779315] niks3-server[1030]: 2026/09/20 13:28:59 INFO Completed upload id=114272worker2 # [ 57.842490] nix-grpc-daemon[779]: ts=2026-09-20T13:28:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42506 duration_s=0 paths=1 nar_bytes_in=5124273lb # [ 57.783286] niks3-server[1030]: 2026/09/20 13:28:59 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4274worker2 # [ 57.856474] nix-grpc-daemon[779]: ts=2026-09-20T13:28:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425064275worker2 # [ 57.862748] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted)4276worker2 # [ 57.867565] nix-daemon[847]: reaped child process 1071, status = succeeded4277worker2 # [ 57.881023] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted)4278worker2 # [ 59.527514] nix-daemon[847]: reaped child process 1085, status = succeeded4279worker2 # [ 59.709648] nix-daemon[847]: accepted connection from pid 1100, user nix-grpc-daemon (trusted)4280worker2 # [ 59.727190] nix-daemon[847]: reaped child process 1103, status = succeeded4281lb # [ 59.677077] niks3-server[1030]: 2026/09/20 13:29:01 INFO Received uploads request method=POST path=/api/pending_closures4282worker2 # [ 59.752152] nix-grpc-daemon[860]: time=2026-09-20T13:29:00.347Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4283worker2 # [ 59.757815] nix-grpc-daemon[860]: time=2026-09-20T13:29:00.349Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4284lb # [ 59.723827] niks3-server[1030]: 2026/09/20 13:29:01 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4285lb # [ 59.736889] niks3-server[1030]: 2026/09/20 13:29:01 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4286lb # [ 59.744866] niks3-server[1030]: 2026/09/20 13:29:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4287worker2 # [ 59.812584] nix-grpc-daemon[860]: time=2026-09-20T13:29:00.408Z level=INFO msg="Uploading 1 narinfos"4288lb # [ 59.751502] niks3-server[1030]: 2026/09/20 13:29:01 INFO Signed narinfos id=12 count=14289lb # [ 59.757913] niks3-server[1030]: 2026/09/20 13:29:01 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4290lb # [ 59.767849] niks3-server[1030]: 2026/09/20 13:29:01 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4291lb # [ 59.775510] niks3-server[1030]: 2026/09/20 13:29:01 INFO Completed upload id=124292worker2 # [ 59.837293] nix-grpc-daemon[860]: time=2026-09-20T13:29:00.433Z level=INFO msg="Upload complete. (345ms)"4293lb # [ 59.778602] niks3-server[1030]: 2026/09/20 13:29:01 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4294worker2 # [ 59.853234] nix-grpc-daemon[779]: ts=2026-09-20T13:29:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42506 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=14295worker2 # [ 59.868485] nix-grpc-daemon[779]: ts=2026-09-20T13:29:00Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:425064296worker2 # [ 59.875740] nix-daemon[847]: reaped child process 1083, status = succeeded4297worker2 # [ 59.879286] nix-grpc-daemon[779]: ts=2026-09-20T13:29:00Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:425064298worker2 # [ 59.883502] nix-grpc-daemon[779]: ts=2026-09-20T13:29:00Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42506 duration_s=0 paths=1 nar_bytes_out=1284299worker1 # [ 60.152564] nix-grpc-daemon[774]: ts=2026-09-20T13:29:01Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:417184300worker1 # [ 60.159142] nix-grpc-daemon[774]: ts=2026-09-20T13:29:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417184301worker2 # [ 60.223990] nix-grpc-daemon[779]: ts=2026-09-20T13:29:00Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04302worker2 # [ 60.232655] nix-grpc-daemon[779]: ts=2026-09-20T13:29:00Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.4:50051 clients=14303worker2 # [ 60.239417] nix-grpc-daemon[779]: ts=2026-09-20T13:29:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425064304worker2 # [ 60.250362] nix-grpc-daemon[779]: ts=2026-09-20T13:29:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425064305worker2 # [ 60.264747] nix-grpc-daemon[860]: time=2026-09-20T13:29:00.860Z level=INFO msg="All 1 paths already cached"4306worker2 # [ 60.274196] nix-grpc-daemon[779]: ts=2026-09-20T13:29:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:425064307worker2 # [ 60.288127] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted)4308worker2 # [ 60.499209] nix-daemon[847]: accepted connection from pid 1109, user nix-grpc-daemon (trusted)4309worker2 # [ 60.518364] nix-daemon[847]: reaped child process 1112, status = succeeded4310worker2 # [ 60.692706] nix-daemon[847]: accepted connection from pid 1114, user nix-grpc-daemon (trusted)4311worker2 # [ 60.710379] nix-daemon[847]: reaped child process 1117, status = succeeded4312lb # [ 60.660075] niks3-server[1030]: 2026/09/20 13:29:02 INFO Received uploads request method=POST path=/api/pending_closures4313worker2 # [ 60.731285] nix-grpc-daemon[860]: time=2026-09-20T13:29:01.327Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4314worker2 # [ 60.732955] nix-grpc-daemon[860]: time=2026-09-20T13:29:01.327Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4315lb # [ 60.687342] niks3-server[1030]: 2026/09/20 13:29:02 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4316lb # [ 60.702152] niks3-server[1030]: 2026/09/20 13:29:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4317worker2 # [ 60.770947] nix-grpc-daemon[860]: time=2026-09-20T13:29:01.366Z level=INFO msg="Uploading 1 narinfos"4318lb # [ 60.711152] niks3-server[1030]: 2026/09/20 13:29:02 INFO Signed narinfos id=13 count=14319lb # [ 60.716911] niks3-server[1030]: 2026/09/20 13:29:02 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4320lb # [ 60.723018] niks3-server[1030]: 2026/09/20 13:29:02 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4321lb # [ 60.729718] niks3-server[1030]: 2026/09/20 13:29:02 INFO Completed upload id=134322worker2 # [ 60.791543] nix-grpc-daemon[860]: time=2026-09-20T13:29:01.387Z level=INFO msg="Upload complete. (485ms)"4323lb # [ 60.732049] niks3-server[1030]: 2026/09/20 13:29:02 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4324worker2 # [ 60.800236] nix-grpc-daemon[779]: ts=2026-09-20T13:29:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42506 duration_s=0 paths=1 nar_bytes_in=6244325worker2 # [ 60.809951] nix-grpc-daemon[779]: ts=2026-09-20T13:29:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425064326worker2 # [ 60.816429] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted)4327worker2 # [ 60.820968] nix-daemon[847]: reaped child process 1107, status = succeeded4328worker2 # [ 60.833930] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted)4329lb # [ 61.333059] envoy[915]: conn peer=[2001:db8:1::1]:32854 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1430 tx=1085 ms=37834330lb # [ 61.337997] envoy[915]: conn peer=[2001:db8:1::1]:55040 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2979 tx=1372 ms=50084331lb # [ 61.343041] envoy[915]: conn peer=[2001:db8:1::1]:32862 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3418 tx=1664 ms=27344332lb # [ 61.348820] envoy[915]: conn peer=[2001:db8:1::1]:32864 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=333 ms=664333worker2 # [ 62.477365] nix-daemon[847]: reaped child process 1121, status = succeeded4334worker2 # [ 62.653164] nix-daemon[847]: accepted connection from pid 1136, user nix-grpc-daemon (trusted)4335worker2 # [ 62.672710] nix-daemon[847]: reaped child process 1139, status = succeeded4336lb # [ 62.622497] niks3-server[1030]: 2026/09/20 13:29:04 INFO Received uploads request method=POST path=/api/pending_closures4337worker2 # [ 62.695414] nix-grpc-daemon[860]: time=2026-09-20T13:29:03.289Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4338worker2 # [ 62.697217] nix-grpc-daemon[860]: time=2026-09-20T13:29:03.290Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4339lb # [ 62.660518] niks3-server[1030]: 2026/09/20 13:29:04 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4340lb # [ 62.676245] niks3-server[1030]: 2026/09/20 13:29:04 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4341worker2 # [ 62.751762] nix-grpc-daemon[860]: time=2026-09-20T13:29:03.347Z level=INFO msg="Uploading 1 narinfos"4342lb # [ 62.688970] niks3-server[1030]: 2026/09/20 13:29:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4343lb # [ 62.698147] niks3-server[1030]: 2026/09/20 13:29:04 INFO Signed narinfos id=14 count=14344lb # [ 62.705614] niks3-server[1030]: 2026/09/20 13:29:04 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4345lb # [ 62.712375] niks3-server[1030]: 2026/09/20 13:29:04 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4346lb # [ 62.721937] niks3-server[1030]: 2026/09/20 13:29:04 INFO Completed upload id=144347worker2 # [ 62.784542] nix-grpc-daemon[860]: time=2026-09-20T13:29:03.380Z level=INFO msg="Upload complete. (339ms)"4348lb # [ 62.725768] niks3-server[1030]: 2026/09/20 13:29:04 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4349worker2 # [ 62.797275] nix-grpc-daemon[779]: ts=2026-09-20T13:29:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42506 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=14350worker1 # [ 62.768959] nix-grpc-daemon[774]: ts=2026-09-20T13:29:04Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:417184351worker2 # [ 62.817502] nix-daemon[847]: reaped child process 1119, status = succeeded4352worker1 # [ 62.784889] nix-grpc-daemon[774]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4353worker1 # [ 62.807274] nix-grpc-daemon[774]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4354worker2 # [ 62.885201] nix-grpc-daemon[779]: ts=2026-09-20T13:29:03Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:425064355worker2 # [ 62.891925] nix-grpc-daemon[779]: ts=2026-09-20T13:29:03Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42506 duration_s=0 paths=1 nar_bytes_out=1764356worker2 # [ 63.196141] nix-grpc-daemon[779]: ts=2026-09-20T13:29:03Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:425064357worker1 # [ 63.172649] nix-grpc-daemon[774]: ts=2026-09-20T13:29:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417184358worker1 # [ 63.185066] nix-grpc-daemon[858]: time=2026-09-20T13:29:04.786Z level=INFO msg="All 2 paths already cached"4359worker2 # [ 63.230784] nix-grpc-daemon[779]: ts=2026-09-20T13:29:03Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04360worker2 # [ 63.238038] nix-grpc-daemon[779]: ts=2026-09-20T13:29:03Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.4:50051 clients=14361worker2 # [ 63.247925] nix-grpc-daemon[779]: ts=2026-09-20T13:29:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425064362worker2 # [ 63.259647] nix-grpc-daemon[779]: ts=2026-09-20T13:29:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425064363worker2 # [ 63.273990] nix-grpc-daemon[860]: time=2026-09-20T13:29:03.869Z level=INFO msg="All 2 paths already cached"4364worker2 # [ 63.284113] nix-grpc-daemon[779]: ts=2026-09-20T13:29:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:425064365worker2 # [ 63.298685] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted)4366worker2 # [ 63.505315] nix-daemon[847]: accepted connection from pid 1145, user nix-grpc-daemon (trusted)4367worker2 # [ 63.523619] nix-daemon[847]: reaped child process 1148, status = succeeded4368worker2 # [ 63.701414] nix-daemon[847]: accepted connection from pid 1150, user nix-grpc-daemon (trusted)4369worker2 # [ 63.720159] nix-daemon[847]: reaped child process 1153, status = succeeded4370lb # [ 63.669595] niks3-server[1030]: 2026/09/20 13:29:05 INFO Received uploads request method=POST path=/api/pending_closures4371worker2 # [ 63.743360] nix-grpc-daemon[860]: time=2026-09-20T13:29:04.338Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4372worker2 # [ 63.745072] nix-grpc-daemon[860]: time=2026-09-20T13:29:04.338Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4373lb # [ 63.701378] niks3-server[1030]: 2026/09/20 13:29:05 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4374lb # [ 63.713343] niks3-server[1030]: 2026/09/20 13:29:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4375worker2 # [ 63.782407] nix-grpc-daemon[860]: time=2026-09-20T13:29:04.378Z level=INFO msg="Uploading 1 narinfos"4376lb # [ 63.724654] niks3-server[1030]: 2026/09/20 13:29:05 INFO Signed narinfos id=15 count=14377lb # [ 63.727601] niks3-server[1030]: 2026/09/20 13:29:05 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4378lb # [ 63.737462] niks3-server[1030]: 2026/09/20 13:29:05 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4379worker2 # [ 63.804822] nix-grpc-daemon[860]: time=2026-09-20T13:29:04.400Z level=INFO msg="Upload complete. (486ms)"4380lb # [ 63.744983] niks3-server[1030]: 2026/09/20 13:29:05 INFO Completed upload id=154381lb # [ 63.748653] niks3-server[1030]: 2026/09/20 13:29:05 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4382worker2 # [ 63.811535] nix-grpc-daemon[779]: ts=2026-09-20T13:29:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42506 duration_s=0 paths=1 nar_bytes_in=7524383worker2 # [ 63.825691] nix-grpc-daemon[779]: ts=2026-09-20T13:29:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425064384worker2 # [ 63.833034] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted)4385worker2 # [ 63.838017] nix-daemon[847]: reaped child process 1143, status = succeeded4386worker2 # [ 63.854715] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted)4387worker2 # [ 64.900625] nix-daemon[847]: reaped child process 1157, status = succeeded4388worker2 # [ 65.079104] nix-daemon[847]: accepted connection from pid 1172, user nix-grpc-daemon (trusted)4389worker2 # [ 65.097464] nix-daemon[847]: reaped child process 1175, status = succeeded4390lb # [ 65.047223] niks3-server[1030]: 2026/09/20 13:29:06 INFO Received uploads request method=POST path=/api/pending_closures4391worker2 # [ 65.120545] nix-grpc-daemon[860]: time=2026-09-20T13:29:05.714Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4392worker2 # [ 65.122524] nix-grpc-daemon[860]: time=2026-09-20T13:29:05.714Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4393lb # [ 65.085262] niks3-server[1030]: 2026/09/20 13:29:06 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4394lb # [ 65.098531] niks3-server[1030]: 2026/09/20 13:29:06 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4395lb # [ 65.110900] niks3-server[1030]: 2026/09/20 13:29:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4396worker2 # [ 65.178163] nix-grpc-daemon[860]: time=2026-09-20T13:29:05.773Z level=INFO msg="Uploading 1 narinfos"4397lb # [ 65.117563] niks3-server[1030]: 2026/09/20 13:29:06 INFO Signed narinfos id=16 count=14398lb # [ 65.124513] niks3-server[1030]: 2026/09/20 13:29:06 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4399lb # [ 65.132398] niks3-server[1030]: 2026/09/20 13:29:06 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4400lb # [ 65.139275] niks3-server[1030]: 2026/09/20 13:29:06 INFO Completed upload id=164401worker2 # [ 65.201337] nix-grpc-daemon[860]: time=2026-09-20T13:29:05.797Z level=INFO msg="Upload complete. (334ms)"4402lb # [ 65.142092] niks3-server[1030]: 2026/09/20 13:29:06 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4403worker2 # [ 65.216890] nix-grpc-daemon[779]: ts=2026-09-20T13:29:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42506 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=14404worker2 # [ 65.232413] nix-grpc-daemon[779]: ts=2026-09-20T13:29:05Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:425064405worker2 # [ 65.237844] nix-daemon[847]: reaped child process 1155, status = succeeded4406worker2 # [ 65.242832] nix-grpc-daemon[779]: ts=2026-09-20T13:29:05Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:425064407worker2 # [ 65.247965] nix-grpc-daemon[779]: ts=2026-09-20T13:29:05Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42506 duration_s=0 paths=1 nar_bytes_out=2324408client # [ 65.309615] nix-daemon[937]: reaped child process 939, status = succeeded4409client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.82 seconds)4410client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4411client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.05 seconds)4412client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4413client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.06 seconds)4414client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4415client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4416(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 8.96 seconds)4417subtest: an input only one worker has still reaches the builder4418client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only4419client # this derivation will be built:4420client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4421client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4422client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.44 seconds)4423client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4424client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.20 seconds)4425worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4426worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.25 seconds)4427worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4428worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds)4429client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&24430client # [ 66.625817] nix-daemon[937]: accepted connection from pid 1017, user root (trusted)4431client # this derivation will be built:4432client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4433worker1 # [ 66.910677] nix-grpc-daemon[774]: ts=2026-09-20T13:29:08Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:417184434client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'...4435worker2 # [ 66.947199] nix-grpc-daemon[779]: ts=2026-09-20T13:29:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425064436client # copying 1 paths...4437client # copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' to 'grpc://lb:50051'...4438worker1 # [ 66.931021] nix-grpc-daemon[774]: ts=2026-09-20T13:29:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417184439worker1 # [ 66.947019] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4440worker1 # [ 67.154423] nix-daemon[832]: accepted connection from pid 936, user nix-grpc-daemon (trusted)4441worker1 # [ 67.174332] nix-daemon[832]: reaped child process 939, status = succeeded4442lb # [ 67.158318] niks3-server[1030]: 2026/09/20 13:29:08 INFO Received uploads request method=POST path=/api/pending_closures4443worker1 # [ 67.197415] nix-grpc-daemon[858]: time=2026-09-20T13:29:08.800Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4444worker1 # [ 67.199102] nix-grpc-daemon[858]: time=2026-09-20T13:29:08.800Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4445lb # [ 67.186677] niks3-server[1030]: 2026/09/20 13:29:08 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4446worker1 # [ 67.230814] nix-grpc-daemon[858]: time=2026-09-20T13:29:08.834Z level=INFO msg="Uploading 1 narinfos"4447lb # [ 67.200770] niks3-server[1030]: 2026/09/20 13:29:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4448lb # [ 67.213371] niks3-server[1030]: 2026/09/20 13:29:08 INFO Signed narinfos id=17 count=14449lb # [ 67.220876] niks3-server[1030]: 2026/09/20 13:29:08 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4450lb # [ 67.229283] niks3-server[1030]: 2026/09/20 13:29:08 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4451lb # [ 67.237534] niks3-server[1030]: 2026/09/20 13:29:08 INFO Completed upload id=174452worker1 # [ 67.266382] nix-grpc-daemon[858]: time=2026-09-20T13:29:08.869Z level=INFO msg="Upload complete. (305ms)"4453lb # [ 67.240873] niks3-server[1030]: 2026/09/20 13:29:08 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4454worker1 # [ 67.276496] nix-grpc-daemon[774]: ts=2026-09-20T13:29:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41718 duration_s=0 paths=1 nar_bytes_in=1204455worker1 # [ 67.295530] nix-daemon[832]: reaped child process 934, status = succeeded4456worker2 # [ 67.325660] nix-grpc-daemon[779]: ts=2026-09-20T13:29:07Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04457worker2 # [ 67.332235] nix-grpc-daemon[779]: ts=2026-09-20T13:29:07Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=14458worker1 # [ 67.338299] nix-grpc-daemon[774]: ts=2026-09-20T13:29:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417184459worker1 # [ 67.354160] nix-grpc-daemon[774]: ts=2026-09-20T13:29:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417184460client # copying 2 paths to 'lb:50051'...4461client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4462worker1 # [ 67.373279] nix-grpc-daemon[774]: ts=2026-09-20T13:29:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417184463client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4464worker1 # [ 67.388499] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4465worker1 # [ 67.605293] nix-daemon[832]: accepted connection from pid 943, user nix-grpc-daemon (trusted)4466worker1 # [ 67.626678] nix-daemon[832]: reaped child process 946, status = succeeded4467worker1 # [ 67.798712] nix-daemon[832]: accepted connection from pid 948, user nix-grpc-daemon (trusted)4468worker1 # [ 67.818981] nix-daemon[832]: reaped child process 951, status = succeeded4469lb # [ 67.800193] niks3-server[1030]: 2026/09/20 13:29:09 INFO Received uploads request method=POST path=/api/pending_closures4470lb # [ 67.809719] niks3-server[1030]: 2026/09/20 13:29:09 INFO Received uploads request method=POST path=/api/pending_closures4471worker1 # [ 67.848116] nix-grpc-daemon[858]: time=2026-09-20T13:29:09.451Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4472worker1 # [ 67.849641] nix-grpc-daemon[858]: time=2026-09-20T13:29:09.451Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4473worker1 # [ 67.851341] nix-grpc-daemon[858]: time=2026-09-20T13:29:09.451Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4474lb # [ 67.841581] niks3-server[1030]: 2026/09/20 13:29:09 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4475lb # [ 67.859973] niks3-server[1030]: 2026/09/20 13:29:09 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4476lb # [ 67.870946] niks3-server[1030]: 2026/09/20 13:29:09 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4477lb # [ 67.876629] niks3-server[1030]: 2026/09/20 13:29:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4478lb # [ 67.881131] niks3-server[1030]: 2026/09/20 13:29:09 INFO Signed narinfos id=18 count=14479lb # [ 67.884533] niks3-server[1030]: 2026/09/20 13:29:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4480worker1 # [ 67.915506] nix-grpc-daemon[858]: time=2026-09-20T13:29:09.517Z level=INFO msg="Uploading 3 narinfos"4481lb # [ 67.889279] niks3-server[1030]: 2026/09/20 13:29:09 INFO Signed narinfos id=19 count=24482lb # [ 67.893542] niks3-server[1030]: 2026/09/20 13:29:09 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4483lb # [ 67.909409] niks3-server[1030]: 2026/09/20 13:29:09 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4484lb # [ 67.916584] niks3-server[1030]: 2026/09/20 13:29:09 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4485lb # [ 67.920444] niks3-server[1030]: 2026/09/20 13:29:09 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4486lb # [ 67.926222] niks3-server[1030]: 2026/09/20 13:29:09 INFO Completed upload id=184487lb # [ 67.929309] niks3-server[1030]: 2026/09/20 13:29:09 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4488lb # [ 67.932431] niks3-server[1030]: 2026/09/20 13:29:09 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4489lb # [ 67.934878] niks3-server[1030]: 2026/09/20 13:29:09 INFO Completed upload id=194490worker1 # [ 67.962298] nix-grpc-daemon[858]: time=2026-09-20T13:29:09.565Z level=INFO msg="Upload complete. (553ms)"4491worker1 # [ 67.973407] nix-grpc-daemon[774]: ts=2026-09-20T13:29:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41718 duration_s=0 paths=2 nar_bytes_in=9844492worker1 # [ 67.988813] nix-grpc-daemon[774]: ts=2026-09-20T13:29:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417184493worker1 # [ 68.002545] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4494worker1 # [ 68.009617] nix-daemon[832]: reaped child process 941, status = succeeded4495client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4496client # uses-input-w1onlya> node-a: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4497worker1 # [ 68.023227] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4498worker1 # [ 69.070434] nix-daemon[832]: reaped child process 955, status = succeeded4499worker1 # [ 69.243332] nix-daemon[832]: accepted connection from pid 970, user nix-grpc-daemon (trusted)4500worker1 # [ 69.261568] nix-daemon[832]: reaped child process 973, status = succeeded4501lb # [ 69.246424] niks3-server[1030]: 2026/09/20 13:29:10 INFO Received uploads request method=POST path=/api/pending_closures4502worker1 # [ 69.306543] nix-grpc-daemon[858]: time=2026-09-20T13:29:10.908Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4503lb # [ 69.307954] niks3-server[1030]: 2026/09/20 13:29:10 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4504worker1 # [ 69.345958] nix-grpc-daemon[858]: time=2026-09-20T13:29:10.949Z level=INFO msg="Uploading 1 narinfos"4505lb # [ 69.322168] niks3-server[1030]: 2026/09/20 13:29:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4506lb # [ 69.331150] niks3-server[1030]: 2026/09/20 13:29:10 INFO Signed narinfos id=20 count=14507lb # [ 69.339057] niks3-server[1030]: 2026/09/20 13:29:10 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls4508worker1 # [ 69.373706] nix-grpc-daemon[858]: time=2026-09-20T13:29:10.977Z level=INFO msg="Upload complete. (337ms)"4509lb # [ 69.344160] niks3-server[1030]: 2026/09/20 13:29:10 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4510lb # [ 69.349851] niks3-server[1030]: 2026/09/20 13:29:10 INFO Completed upload id=204511lb # [ 69.354608] niks3-server[1030]: 2026/09/20 13:29:10 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo4512worker1 # [ 69.385195] nix-grpc-daemon[774]: ts=2026-09-20T13:29:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41718 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=14513worker1 # [ 69.405056] nix-daemon[832]: reaped child process 953, status = succeeded4514client # copying 1 paths...4515worker2 # [ 69.470297] nix-grpc-daemon[779]: ts=2026-09-20T13:29:10Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:425064516worker2 # [ 69.486227] nix-grpc-daemon[779]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'...4517client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...4518worker2 # [ 69.540247] nix-grpc-daemon[779]: ts=2026-09-20T13:29:10Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:425064519worker2 # [ 69.546064] nix-grpc-daemon[779]: ts=2026-09-20T13:29:10Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42506 duration_s=0 paths=1 nar_bytes_out=1204520client # [ 69.606448] nix-daemon[937]: reaped child process 1020, status = succeeded4521client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.22 seconds)4522client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&24523client # [ 69.831783] nix-daemon[937]: accepted connection from pid 1037, user root (trusted)4524client # this derivation will be built:4525client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4526worker1 # [ 70.068042] nix-grpc-daemon[774]: ts=2026-09-20T13:29:11Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:417184527client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'...4528worker1 # [ 70.075607] nix-grpc-daemon[774]: ts=2026-09-20T13:29:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417184529worker1 # [ 70.082458] nix-grpc-daemon[858]: time=2026-09-20T13:29:11.685Z level=INFO msg="All 1 paths already cached"4530worker2 # [ 70.127837] nix-grpc-daemon[779]: ts=2026-09-20T13:29:10Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=04531worker2 # [ 70.135737] nix-grpc-daemon[779]: ts=2026-09-20T13:29:10Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=14532worker2 # [ 70.144842] nix-grpc-daemon[779]: ts=2026-09-20T13:29:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425064533worker2 # [ 70.160474] nix-grpc-daemon[779]: ts=2026-09-20T13:29:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425064534client # copying 1 paths to 'lb:50051'...4535client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...4536worker2 # [ 70.182592] nix-grpc-daemon[779]: ts=2026-09-20T13:29:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:425064537worker2 # [ 70.198357] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted)4538worker2 # [ 70.221243] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 59 ms (attempt 1/5)4539worker2 # [ 70.280649] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 37 ms (attempt 2/5)4540worker2 # [ 70.325259] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 203 ms (attempt 3/5)4541worker2 # [ 70.529920] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 453 ms (attempt 4/5)4542worker2 # [ 70.991150] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4543worker2 # [ 71.001839] nix-grpc-daemon[779]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...4544worker2 # [ 71.249033] nix-daemon[847]: accepted connection from pid 1191, user nix-grpc-daemon (trusted)4545worker2 # [ 71.269726] nix-daemon[847]: reaped child process 1194, status = succeeded4546lb # [ 71.328997] envoy[915]: conn peer=[2001:db8:1::1]:32874 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3901 tx=1990 ms=27684547worker2 # [ 71.447012] nix-daemon[847]: accepted connection from pid 1196, user nix-grpc-daemon (trusted)4548worker2 # [ 71.467841] nix-daemon[847]: reaped child process 1199, status = succeeded4549lb # [ 71.334163] envoy[915]: conn peer=[2001:db8:1::1]:54152 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=375 ms=764550lb # [ 71.334332] envoy[915]: conn peer=[2001:db8:1::1]:54168 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4352 tx=2111 ms=21074551lb # [ 71.334449] envoy[915]: conn peer=[2001:db8:1::1]:54176 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=406 ms=674552lb # [ 71.334588] envoy[915]: conn peer=[2001:db8:1::1]:54202 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=694553lb # [ 71.334705] envoy[915]: conn peer=[2001:db8:1::1]:54190 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4237 tx=1881 ms=26604554lb # [ 71.418040] niks3-server[1030]: 2026/09/20 13:29:13 INFO Received uploads request method=POST path=/api/pending_closures4555worker2 # [ 71.515340] nix-grpc-daemon[860]: time=2026-09-20T13:29:12.110Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4556worker2 # [ 71.517107] nix-grpc-daemon[860]: time=2026-09-20T13:29:12.110Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"4557lb # [ 71.474450] niks3-server[1030]: 2026/09/20 13:29:13 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst4558lb # [ 71.487012] niks3-server[1030]: 2026/09/20 13:29:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4559worker2 # [ 71.555670] nix-grpc-daemon[860]: time=2026-09-20T13:29:12.151Z level=INFO msg="Uploading 1 narinfos"4560lb # [ 71.498945] niks3-server[1030]: 2026/09/20 13:29:13 INFO Signed narinfos id=21 count=14561lb # [ 71.503791] niks3-server[1030]: 2026/09/20 13:29:13 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls4562lb # [ 71.510364] niks3-server[1030]: 2026/09/20 13:29:13 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4563lb # [ 71.517208] niks3-server[1030]: 2026/09/20 13:29:13 INFO Completed upload id=214564worker2 # [ 71.579627] nix-grpc-daemon[860]: time=2026-09-20T13:29:12.175Z level=INFO msg="Upload complete. (544ms)"4565lb # [ 71.519560] niks3-server[1030]: 2026/09/20 13:29:13 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo4566worker2 # [ 71.590974] nix-grpc-daemon[779]: ts=2026-09-20T13:29:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42506 duration_s=1 paths=1 nar_bytes_in=5684567worker2 # [ 71.608890] nix-grpc-daemon[779]: ts=2026-09-20T13:29:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:425064568worker2 # [ 71.616739] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted)4569worker2 # [ 71.626696] nix-daemon[847]: reaped child process 1185, status = succeeded4570worker2 # [ 71.637274] nix-grpc-daemon[779]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...4571client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...4572worker2 # [ 71.656278] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted)4573client # uses-input-w1onlyb> worker2: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4574worker2 # [ 72.889139] nix-daemon[847]: reaped child process 1204, status = succeeded4575worker2 # [ 73.050757] nix-daemon[847]: accepted connection from pid 1219, user nix-grpc-daemon (trusted)4576worker2 # [ 73.070451] nix-daemon[847]: reaped child process 1222, status = succeeded4577lb # [ 73.021247] niks3-server[1030]: 2026/09/20 13:29:14 INFO Received uploads request method=POST path=/api/pending_closures4578worker2 # [ 73.095385] nix-grpc-daemon[860]: time=2026-09-20T13:29:13.690Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4579worker2 # [ 73.126129] nix-grpc-daemon[860]: time=2026-09-20T13:29:13.721Z level=INFO msg="Uploading 1 narinfos"4580lb # [ 73.053068] niks3-server[1030]: 2026/09/20 13:29:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4581lb # [ 73.069849] niks3-server[1030]: 2026/09/20 13:29:14 INFO Signed narinfos id=22 count=14582lb # [ 73.075815] niks3-server[1030]: 2026/09/20 13:29:14 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls4583lb # [ 73.082313] niks3-server[1030]: 2026/09/20 13:29:14 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv4584lb # [ 73.090150] niks3-server[1030]: 2026/09/20 13:29:14 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4585worker2 # [ 73.156475] nix-grpc-daemon[860]: time=2026-09-20T13:29:13.752Z level=INFO msg="Upload complete. (283ms)"4586lb # [ 73.094430] niks3-server[1030]: 2026/09/20 13:29:14 INFO Completed upload id=224587lb # [ 73.097048] niks3-server[1030]: 2026/09/20 13:29:14 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo4588client # copying 1 paths...4589worker2 # [ 73.167101] nix-grpc-daemon[779]: ts=2026-09-20T13:29:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42506 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=14590worker2 # [ 73.181080] nix-grpc-daemon[779]: ts=2026-09-20T13:29:13Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:425064591worker2 # [ 73.185020] nix-daemon[847]: reaped child process 1201, status = succeeded4592client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...4593worker2 # [ 73.211444] nix-grpc-daemon[779]: ts=2026-09-20T13:29:13Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:425064594worker2 # [ 73.216346] nix-grpc-daemon[779]: ts=2026-09-20T13:29:13Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42506 duration_s=0 paths=1 nar_bytes_out=1204595client # [ 73.277509] nix-daemon[937]: reaped child process 1040, status = succeeded4596client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.67 seconds)4597client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&24598client # [ 73.503871] nix-daemon[937]: accepted connection from pid 1058, user root (trusted)4599client # this derivation will be built:4600client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4601worker1 # [ 73.738466] nix-grpc-daemon[774]: ts=2026-09-20T13:29:15Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:417184602client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'...4603worker2 # [ 73.774315] nix-grpc-daemon[779]: ts=2026-09-20T13:29:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:425064604worker2 # [ 73.786643] nix-grpc-daemon[860]: time=2026-09-20T13:29:14.382Z level=INFO msg="All 1 paths already cached"4605worker2 # [ 73.805942] nix-grpc-daemon[779]: ts=2026-09-20T13:29:14Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=04606worker2 # [ 73.812787] nix-grpc-daemon[779]: ts=2026-09-20T13:29:14Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=14607worker1 # [ 73.783639] nix-grpc-daemon[774]: ts=2026-09-20T13:29:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417184608worker1 # [ 73.799900] nix-grpc-daemon[774]: ts=2026-09-20T13:29:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:417184609worker1 # [ 73.817005] nix-grpc-daemon[858]: time=2026-09-20T13:29:15.419Z level=INFO msg="All 1 paths already cached"4610client # copying 1 paths to 'lb:50051'...4611client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...4612worker1 # [ 73.827433] nix-grpc-daemon[774]: ts=2026-09-20T13:29:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:417184613worker1 # [ 73.843105] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4614worker1 # [ 74.050330] nix-daemon[832]: accepted connection from pid 977, user nix-grpc-daemon (trusted)4615worker1 # [ 74.073429] nix-daemon[832]: reaped child process 980, status = succeeded4616worker1 # [ 74.252131] nix-daemon[832]: accepted connection from pid 982, user nix-grpc-daemon (trusted)4617worker1 # [ 74.272923] nix-daemon[832]: reaped child process 985, status = succeeded4618lb # [ 74.255368] niks3-server[1030]: 2026/09/20 13:29:15 INFO Received uploads request method=POST path=/api/pending_closures4619worker1 # [ 74.363111] nix-grpc-daemon[858]: time=2026-09-20T13:29:15.966Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4620worker1 # [ 74.365653] nix-grpc-daemon[858]: time=2026-09-20T13:29:15.966Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"4621lb # [ 74.349837] niks3-server[1030]: 2026/09/20 13:29:15 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst4622lb # [ 74.365077] niks3-server[1030]: 2026/09/20 13:29:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4623worker1 # [ 74.402289] nix-grpc-daemon[858]: time=2026-09-20T13:29:16.005Z level=INFO msg="Uploading 1 narinfos"4624lb # [ 74.376931] niks3-server[1030]: 2026/09/20 13:29:15 INFO Signed narinfos id=23 count=14625lb # [ 74.384787] niks3-server[1030]: 2026/09/20 13:29:15 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls4626lb # [ 74.393374] niks3-server[1030]: 2026/09/20 13:29:15 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4627lb # [ 74.403218] niks3-server[1030]: 2026/09/20 13:29:15 INFO Completed upload id=234628worker1 # [ 74.433074] nix-grpc-daemon[858]: time=2026-09-20T13:29:16.036Z level=INFO msg="Upload complete. (572ms)"4629lb # [ 74.406512] niks3-server[1030]: 2026/09/20 13:29:15 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo4630worker1 # [ 74.445187] nix-grpc-daemon[774]: ts=2026-09-20T13:29:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41718 duration_s=0 paths=1 nar_bytes_in=5684631worker1 # [ 74.460502] nix-grpc-daemon[774]: ts=2026-09-20T13:29:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:417184632worker1 # [ 74.471884] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4633worker1 # [ 74.478958] nix-daemon[832]: reaped child process 975, status = succeeded4634client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...4635client # uses-input-w1onlyc> node-a: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4636worker1 # [ 74.499032] nix-daemon[832]: accepted connection from pid 774, user nix-grpc-daemon (trusted)4637worker1 # [ 75.946342] nix-daemon[832]: reaped child process 989, status = succeeded4638worker1 # [ 76.117156] nix-daemon[832]: accepted connection from pid 1004, user nix-grpc-daemon (trusted)4639worker1 # [ 76.134668] nix-daemon[832]: reaped child process 1007, status = succeeded4640lb # [ 76.117563] niks3-server[1030]: 2026/09/20 13:29:17 INFO Received uploads request method=POST path=/api/pending_closures4641worker1 # [ 76.157904] nix-grpc-daemon[858]: time=2026-09-20T13:29:17.760Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4642lb # [ 76.145669] niks3-server[1030]: 2026/09/20 13:29:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4643worker1 # [ 76.185320] nix-grpc-daemon[858]: time=2026-09-20T13:29:17.788Z level=INFO msg="Uploading 1 narinfos"4644lb # [ 76.157048] niks3-server[1030]: 2026/09/20 13:29:17 INFO Signed narinfos id=24 count=14645lb # [ 76.167083] niks3-server[1030]: 2026/09/20 13:29:17 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls4646lb # [ 76.176095] niks3-server[1030]: 2026/09/20 13:29:17 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv4647lb # [ 76.183913] niks3-server[1030]: 2026/09/20 13:29:17 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4648worker1 # [ 76.219456] nix-grpc-daemon[858]: time=2026-09-20T13:29:17.823Z level=INFO msg="Upload complete. (306ms)"4649lb # [ 76.190023] niks3-server[1030]: 2026/09/20 13:29:17 INFO Completed upload id=244650lb # [ 76.193327] niks3-server[1030]: 2026/09/20 13:29:17 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo4651worker1 # [ 76.228901] nix-grpc-daemon[774]: ts=2026-09-20T13:29:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41718 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=14652worker1 # [ 76.242598] nix-daemon[832]: reaped child process 987, status = succeeded4653client # copying 1 paths...4654worker2 # [ 76.313164] nix-grpc-daemon[779]: ts=2026-09-20T13:29:16Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:425064655worker2 # [ 76.327466] nix-grpc-daemon[779]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'...4656client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...4657worker1 # [ 76.341890] nix-grpc-daemon[774]: ts=2026-09-20T13:29:17Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:417184658worker1 # [ 76.350027] nix-grpc-daemon[774]: ts=2026-09-20T13:29:17Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:41718 duration_s=0 paths=1 nar_bytes_out=1204659client # [ 76.405433] nix-daemon[937]: reaped child process 1061, status = succeeded4660client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 3.13 seconds)4661(finished: subtest: an input only one worker has still reaches the builder, in 10.95 seconds)4662subtest: upload whose reference the worker lacks is completed from the cache4663client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache4664client # this derivation will be built:4665client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv4666client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...4667client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.46 seconds)4668client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache4669client # this derivation will be built:4670client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv4671client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...4672client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.44 seconds)4673client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure4674client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.21 seconds)4675worker1: must succeed: nix-store --import < /tmp/shared/ref.closure4676worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.25 seconds)4677worker2 # [ 77.898814] systemd[1]: Stopping Nix worker-protocol over gRPC...4678worker2 # [ 78.843012] nix-grpc-daemon[779]: ts=2026-09-20T13:29:19Z level=info event=signal_exit4679worker2 # [ 79.092601] nix-grpc-daemon[779]: ts=2026-09-20T13:29:19Z level=info event=scheduler_yield4680worker1 # [ 79.065184] nix-grpc-daemon[774]: ts=2026-09-20T13:29:20Z level=info event=scheduler_restarting addr=lb:500514681worker2 # [ 79.099140] nix-grpc-daemon[779]: ts=2026-09-20T13:29:19Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:425044682lb # [ 79.036003] niks3-server[1030]: 2026/09/20 13:29:20 INFO lead: released remote=192.168.1.4:370984683worker2 # [ 79.103867] nix-grpc-daemon[779]: ts=2026-09-20T13:29:19Z level=info event=worker_gone addr=192.168.1.3:500514684worker2 # [ 79.110150] nix-grpc-daemon[779]: ts=2026-09-20T13:29:19Z level=info event=scheduler_restarting addr=lb:500514685worker2 # [ 79.114369] nix-grpc-daemon[779]: ts=2026-09-20T13:29:19Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:425044686worker2 # [ 79.118918] nix-grpc-daemon[779]: ts=2026-09-20T13:29:19Z level=info event=worker_gone addr=192.168.1.4:500514687worker1 # [ 79.265532] nix-grpc-daemon[774]: ts=2026-09-20T13:29:20Z level=info event=scheduler_connected addr=lb:500514688worker2 # [ 79.300553] nix-grpc-daemon[779]: ts=2026-09-20T13:29:19Z level=info event=scheduler_connected addr=lb:500514689worker1 # [ 79.271374] nix-grpc-daemon[774]: ts=2026-09-20T13:29:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4690worker2 # [ 79.306070] nix-grpc-daemon[779]: ts=2026-09-20T13:29:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4691worker1 # [ 79.472143] nix-grpc-daemon[774]: ts=2026-09-20T13:29:21Z level=info event=scheduler_connected addr=lb:500514692worker2 # [ 79.507668] nix-grpc-daemon[779]: ts=2026-09-20T13:29:20Z level=info event=scheduler_connected addr=lb:500514693worker1 # [ 79.477639] nix-grpc-daemon[774]: ts=2026-09-20T13:29:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4694worker2 # [ 79.512689] nix-grpc-daemon[779]: ts=2026-09-20T13:29:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4695worker2 # [ 79.710200] nix-grpc-daemon[779]: ts=2026-09-20T13:29:20Z level=info event=scheduler_connected addr=lb:500514696worker1 # [ 79.678517] nix-grpc-daemon[774]: ts=2026-09-20T13:29:21Z level=info event=scheduler_connected addr=lb:500514697worker2 # [ 79.715848] nix-grpc-daemon[779]: ts=2026-09-20T13:29:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4698worker1 # [ 79.683702] nix-grpc-daemon[774]: ts=2026-09-20T13:29:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4699worker1 # [ 79.880548] nix-grpc-daemon[774]: ts=2026-09-20T13:29:21Z level=info event=scheduler_connected addr=lb:500514700worker2 # [ 79.919219] nix-grpc-daemon[779]: ts=2026-09-20T13:29:20Z level=info event=scheduler_connected addr=lb:500514701worker1 # [ 79.885968] nix-grpc-daemon[774]: ts=2026-09-20T13:29:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4702worker2 # [ 79.923568] nix-grpc-daemon[779]: ts=2026-09-20T13:29:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4703worker2 # [ 80.098739] nix-grpc-daemon[779]: ts=2026-09-20T13:29:20Z level=info event=scheduler_restarting4704worker1 # [ 80.088620] nix-grpc-daemon[774]: ts=2026-09-20T13:29:21Z level=info event=scheduler_connected addr=lb:500514705worker1 # [ 80.092903] nix-grpc-daemon[774]: ts=2026-09-20T13:29:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4706worker2 # [ 80.142496] nix-grpc-daemon[779]: ts=2026-09-20T13:29:20Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4707worker2 # [ 80.162114] nix-daemon[847]: reaped child process 850, status = succeeded4708worker1 # [ 80.289471] nix-grpc-daemon[774]: ts=2026-09-20T13:29:21Z level=info event=scheduler_connected addr=lb:500514709worker1 # [ 80.295089] nix-grpc-daemon[774]: ts=2026-09-20T13:29:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4710worker1 # [ 80.495838] nix-grpc-daemon[774]: ts=2026-09-20T13:29:22Z level=info event=scheduler_connected addr=lb:500514711worker1 # [ 80.501408] nix-grpc-daemon[774]: ts=2026-09-20T13:29:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4712worker2 # [ 80.648162] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4713worker2 # [ 80.651402] systemd[1]: Stopped Nix worker-protocol over gRPC.4714worker2 # [ 80.660594] systemd[1]: nix-grpc-daemon.service: Consumed 3.689s CPU time over 59.108s wall clock time, 63.2M memory peak, 89.2K incoming IP traffic, 201.1K outgoing IP traffic.4715worker2 # [ 80.673095] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4716worker2 # [ 80.675370] systemd[1]: Closed Nix worker-protocol over gRPC.4717worker2 # [ 80.678923] systemd[1]: nix-grpc-daemon.socket: Consumed 663us CPU time over 1min 9.444s wall clock time, 256K memory peak, 90.8K incoming IP traffic, 72.2K outgoing IP traffic.4718lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy4719lb: must succeed: curl -sf localhost:9901/clusters4720worker1 # [ 80.690125] nix-grpc-daemon[774]: ts=2026-09-20T13:29:22Z level=info event=scheduler_take_over4721lb # [ 80.662487] niks3-server[1030]: 2026/09/20 13:29:22 INFO lead: acquired remote=192.168.1.3:605784722worker1 # [ 80.702169] nix-grpc-daemon[774]: ts=2026-09-20T13:29:22Z level=info event=scheduler_connected addr=lb:500514723worker1 # [ 80.708465] nix-grpc-daemon[774]: ts=2026-09-20T13:29:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4724lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4725lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4726client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&24727worker1 # [ 80.908632] nix-grpc-daemon[774]: ts=2026-09-20T13:29:22Z level=info event=scheduler_connected addr=lb:500514728worker1 # [ 80.930458] nix-grpc-daemon[774]: ts=2026-09-20T13:29:22Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:548064729worker1 # [ 80.935961] nix-grpc-daemon[774]: ts=2026-09-20T13:29:22Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04730worker1 # [ 80.985637] nix-grpc-daemon[774]: ts=2026-09-20T13:29:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:417184731worker1 # [ 80.996653] nix-grpc-daemon[774]: ts=2026-09-20T13:29:22Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:417184732client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4733client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.29 seconds)4734worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache4735worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds)4736worker2 # [ 81.174216] systemd[1]: Listening on Nix worker-protocol over gRPC.4737worker1 # [ 81.226597] systemd[1]: Stopping Nix worker-protocol over gRPC...4738lb # [ 81.331200] envoy[915]: conn peer=[2001:db8:1::1]:54212 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3713 tx=1807 ms=31724739lb # [ 81.336511] envoy[915]: conn peer=[2001:db8:1::1]:42484 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=664740lb # [ 81.341340] envoy[915]: conn peer=[2001:db8:1::1]:42504 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=304741lb # [ 81.346204] envoy[915]: conn peer=[2001:db8:1::1]:42496 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3726 tx=1891 ms=26304742lb # [ 81.352193] envoy[915]: conn peer=[2001:db8:1::4]:53702 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=38332 tx=2480 ms=582834743lb # [ 81.357339] envoy[915]: conn peer=[2001:db8:1::1]:38172 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=334744worker1 # [ 81.710143] nix-grpc-daemon[774]: ts=2026-09-20T13:29:23Z level=info event=signal_exit4745worker2 # [ 81.978778] systemd[1]: Starting scheduler-token.service...4746worker1 # [ 81.961364] nix-grpc-daemon[774]: ts=2026-09-20T13:29:23Z level=info event=scheduler_yield4747lb # [ 81.939879] niks3-server[1030]: 2026/09/20 13:29:23 INFO lead: released remote=192.168.1.3:605784748worker1 # [ 81.975804] nix-grpc-daemon[774]: ts=2026-09-20T13:29:23Z level=info event=scheduler_restarting addr=lb:500514749worker1 # [ 81.982107] nix-grpc-daemon[774]: ts=2026-09-20T13:29:23Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:548064750worker1 # [ 81.986987] nix-grpc-daemon[774]: ts=2026-09-20T13:29:23Z level=info event=worker_gone addr=192.168.1.3:500514751worker2 # [ 82.086849] systemd[1]: scheduler-token.service: Deactivated successfully.4752worker2 # [ 82.092454] systemd[1]: Finished scheduler-token.service.4753worker2 # [ 82.094053] systemd[1]: scheduler-token.service: Consumed 52ms CPU time over 112ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.4754worker2 # [ 82.103242] systemd[1]: Starting Nix worker-protocol over gRPC...4755worker1 # [ 82.181372] nix-grpc-daemon[774]: ts=2026-09-20T13:29:23Z level=info event=scheduler_connected addr=lb:500514756worker1 # [ 82.184867] nix-grpc-daemon[774]: ts=2026-09-20T13:29:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4757worker2 # [ 82.297500] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:22Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4758worker2 # [ 82.300190] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:22Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4759worker2 # [ 82.304339] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:22Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14760worker2 # [ 82.312799] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:22Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4761worker2 # [ 82.314591] systemd[1]: Started Nix worker-protocol over gRPC.4762worker2 # [ 82.327562] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:22Z level=info event=scheduler_take_over4763lb # [ 82.265232] niks3-server[1030]: 2026/09/20 13:29:23 INFO lead: acquired remote=192.168.1.4:359004764worker2 # [ 82.340177] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:22Z level=info event=scheduler_connected addr=lb:500514765worker2 # [ 82.342172] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4766worker1 # [ 82.385894] nix-grpc-daemon[774]: ts=2026-09-20T13:29:23Z level=info event=scheduler_connected addr=lb:500514767worker1 # [ 82.391958] nix-grpc-daemon[774]: ts=2026-09-20T13:29:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4768worker2 # [ 82.544097] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:23Z level=info event=scheduler_connected addr=lb:500514769worker2 # [ 82.550085] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4770worker1 # [ 82.593647] nix-grpc-daemon[774]: ts=2026-09-20T13:29:24Z level=info event=scheduler_connected addr=lb:500514771worker1 # [ 82.599318] nix-grpc-daemon[774]: ts=2026-09-20T13:29:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4772worker2 # [ 82.751577] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:23Z level=info event=scheduler_connected addr=lb:500514773worker2 # [ 82.757304] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4774worker1 # [ 82.802649] nix-grpc-daemon[774]: ts=2026-09-20T13:29:24Z level=info event=scheduler_connected addr=lb:500514775worker1 # [ 82.807265] nix-grpc-daemon[774]: ts=2026-09-20T13:29:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4776worker2 # [ 82.958952] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:23Z level=info event=scheduler_connected addr=lb:500514777worker2 # [ 82.964509] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4778worker1 # [ 82.966491] nix-grpc-daemon[774]: ts=2026-09-20T13:29:24Z level=info event=scheduler_restarting4779worker1 # [ 83.016677] nix-daemon[832]: reaped child process 834, status = succeeded4780worker1 # [ 83.027497] nix-grpc-daemon[774]: ts=2026-09-20T13:29:24Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4781worker2 # [ 83.165805] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:23Z level=info event=scheduler_connected addr=lb:500514782worker2 # [ 83.171227] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4783worker2 # [ 83.376104] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:23Z level=info event=scheduler_connected addr=lb:500514784worker2 # [ 83.391615] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:23Z level=info event=oidc_jwks provider=mock keys=14785worker2 # [ 83.396555] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:23Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:419584786worker2 # [ 83.402060] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:23Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=04787worker1 # [ 83.841429] nix-grpc-daemon[774]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4788worker1 # [ 83.846388] nix-grpc-daemon[774]: E0000 00:00:1789910965.442186 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true4789worker1 # [ 83.853265] nix-grpc-daemon[774]: E0000 00:00:1789910965.442861 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4790worker1 # [ 84.542931] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4791worker1 # [ 84.549706] systemd[1]: Stopped Nix worker-protocol over gRPC.4792worker1 # [ 84.554977] systemd[1]: nix-grpc-daemon.service: Consumed 1.938s CPU time over 1min 3.169s wall clock time, 48.1M memory peak, 49.5K incoming IP traffic, 86.8K outgoing IP traffic.4793worker1 # [ 84.569881] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4794worker1 # [ 84.575582] systemd[1]: Closed Nix worker-protocol over gRPC.4795worker1 # [ 84.578354] systemd[1]: nix-grpc-daemon.socket: Consumed 565us CPU time over 1min 12.793s wall clock time, 256K memory peak, 65.4K incoming IP traffic, 58.7K outgoing IP traffic.4796lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy4797lb: must succeed: curl -sf localhost:9901/clusters4798lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4799lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds)4800client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&24801worker2 # [ 85.037681] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:419624802worker2 # [ 85.059601] nix-daemon[847]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)4803worker2 # [ 85.098910] nix-grpc-daemon[1249]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 98 ms (attempt 1/5)4804worker2 # [ 85.203535] nix-grpc-daemon[1249]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 32 ms (attempt 2/5)4805worker2 # [ 85.244427] nix-grpc-daemon[1249]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 112 ms (attempt 3/5)4806worker2 # [ 85.364629] nix-grpc-daemon[1249]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 260 ms (attempt 4/5)4807worker2 # [ 85.630201] nix-grpc-daemon[1249]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4808client # copying 2 paths...4809worker2 # [ 85.669297] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:419624810client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...4811client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...4812worker2 # [ 85.692702] nix-daemon[847]: accepted connection from pid 1249, user nix-grpc-daemon (trusted)4813worker2 # [ 85.741125] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:26Z level=info event=niks3_push_started pid=13054814worker2 # [ 86.025607] nix-grpc-daemon[1305]: time=2026-09-20T13:29:26.620Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""4815worker2 # [ 86.244705] nix-daemon[847]: accepted connection from pid 1318, user nix-grpc-daemon (trusted)4816worker2 # [ 86.269485] nix-daemon[847]: reaped child process 1321, status = succeeded4817lb # [ 86.222333] niks3-server[1030]: 2026/09/20 13:29:27 INFO Received uploads request method=POST path=/api/pending_closures4818lb # [ 86.238737] niks3-server[1030]: 2026/09/20 13:29:27 INFO Received uploads request method=POST path=/api/pending_closures4819worker2 # [ 86.315478] nix-grpc-daemon[1305]: time=2026-09-20T13:29:26.910Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4820worker2 # [ 86.321392] nix-grpc-daemon[1305]: time=2026-09-20T13:29:26.910Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"4821worker2 # [ 86.325233] nix-grpc-daemon[1305]: time=2026-09-20T13:29:26.911Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"4822lb # [ 86.323279] niks3-server[1030]: 2026/09/20 13:29:27 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst4823lb # [ 86.360082] niks3-server[1030]: 2026/09/20 13:29:27 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls4824lb # [ 86.368099] niks3-server[1030]: 2026/09/20 13:29:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4825lb # [ 86.378262] niks3-server[1030]: 2026/09/20 13:29:27 INFO Signed narinfos id=25 count=14826worker2 # [ 86.448270] nix-grpc-daemon[1305]: time=2026-09-20T13:29:27.040Z level=INFO msg="Uploading 3 narinfos"4827lb # [ 86.388162] niks3-server[1030]: 2026/09/20 13:29:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4828lb # [ 86.390672] niks3-server[1030]: 2026/09/20 13:29:27 INFO Signed narinfos id=26 count=24829lb # [ 86.400005] niks3-server[1030]: 2026/09/20 13:29:27 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls4830lb # [ 86.421986] niks3-server[1030]: 2026/09/20 13:29:28 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst4831lb # [ 86.432323] niks3-server[1030]: 2026/09/20 13:29:28 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4832lb # [ 86.434216] niks3-server[1030]: 2026/09/20 13:29:28 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4833lb # [ 86.446042] niks3-server[1030]: 2026/09/20 13:29:28 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo4834lb # [ 86.449554] niks3-server[1030]: 2026/09/20 13:29:28 INFO Completed upload id=254835lb # [ 86.454975] niks3-server[1030]: 2026/09/20 13:29:28 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4836lb # [ 86.457695] niks3-server[1030]: 2026/09/20 13:29:28 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo4837lb # [ 86.461606] niks3-server[1030]: 2026/09/20 13:29:28 INFO Completed upload id=264838worker2 # [ 86.524467] nix-grpc-daemon[1305]: time=2026-09-20T13:29:27.120Z level=INFO msg="Upload complete. (493ms)"4839worker2 # [ 86.538137] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41962 duration_s=0 paths=2 nar_bytes_in=3124840worker2 # [ 86.561182] nix-daemon[847]: reaped child process 1303, status = succeeded4841client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.88 seconds)4842worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache4843worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.05 seconds)4844worker1 # [ 86.721117] systemd[1]: Listening on Nix worker-protocol over gRPC.4845worker1 # [ 86.730710] systemd[1]: Starting Nix worker-protocol over gRPC...4846worker1 # [ 86.968725] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:28Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4847worker1 # [ 86.971783] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:28Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4848worker1 # [ 86.976769] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:28Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14849worker1 # [ 86.985244] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:28Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4850worker1 # [ 86.995618] systemd[1]: Started Nix worker-protocol over gRPC.4851lb: waiting until exactly no endpoints of aarch64-linux are unhealthy4852lb: must succeed: curl -sf localhost:9901/clusters4853worker1 # [ 87.018666] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:28Z level=info event=scheduler_connected addr=lb:500514854worker2 # [ 87.060166] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:27Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:419584855worker2 # [ 87.066497] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:27Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04856lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.14 seconds)4857lb: must succeed: curl -sf localhost:9901/clusters4858lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.12 seconds)4859lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.27 seconds)4860(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 11.82 seconds)4861subtest: scheduler down: the other node takes the lock and keeps it4862lb: must succeed: curl -sf localhost:9901/clusters4863lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4864lb: must succeed: curl -sf localhost:9901/clusters4865lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4866lb: must succeed: curl -sf localhost:9901/clusters4867lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4868lb: must succeed: curl -sf localhost:9901/clusters4869lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4870worker2 # [ 88.598498] systemd[1]: Stopping Nix worker-protocol over gRPC...4871worker2 # [ 89.328540] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:29Z level=info event=signal_exit4872worker2 # [ 89.535191] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:30Z level=info event=scheduler_yield4873lb # [ 89.477851] niks3-server[1030]: 2026/09/20 13:29:31 INFO lead: released remote=192.168.1.4:359004874worker1 # [ 89.511860] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:31Z level=info event=scheduler_restarting addr=lb:500514875worker2 # [ 89.547212] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:30Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:419584876worker2 # [ 89.550861] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:30Z level=info event=worker_gone addr=192.168.1.3:500514877worker2 # [ 89.553107] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:30Z level=info event=scheduler_restarting addr=lb:500514878worker2 # [ 89.557622] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:30Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:419584879worker2 # [ 89.559720] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:30Z level=info event=worker_gone addr=192.168.1.4:500514880worker1 # [ 89.711851] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:31Z level=info event=scheduler_connected addr=lb:500514881worker1 # [ 89.717693] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4882worker2 # [ 89.753289] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:30Z level=info event=scheduler_connected addr=lb:500514883worker2 # [ 89.759768] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4884worker1 # [ 89.919030] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:31Z level=info event=scheduler_connected addr=lb:500514885worker1 # [ 89.924539] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4886worker2 # [ 89.961380] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:30Z level=info event=scheduler_connected addr=lb:500514887worker2 # [ 89.967461] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4888worker1 # [ 90.125510] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:31Z level=info event=scheduler_connected addr=lb:500514889worker1 # [ 90.131070] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4890worker2 # [ 90.168327] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:30Z level=info event=scheduler_connected addr=lb:500514891worker2 # [ 90.172443] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4892worker1 # [ 90.332341] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:31Z level=info event=scheduler_connected addr=lb:500514893worker1 # [ 90.338419] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4894worker2 # [ 90.375558] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:30Z level=info event=scheduler_connected addr=lb:500514895worker2 # [ 90.380217] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4896worker2 # [ 90.541497] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:31Z level=info event=scheduler_restarting4897worker1 # [ 90.540839] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:32Z level=info event=scheduler_connected addr=lb:500514898worker1 # [ 90.546297] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4899worker2 # [ 90.598084] nix-grpc-daemon[1249]: ts=2026-09-20T13:29:31Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"4900worker2 # [ 90.603580] nix-daemon[847]: reaped child process 1298, status = succeeded4901worker1 # [ 90.747289] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:32Z level=info event=scheduler_connected addr=lb:500514902worker1 # [ 90.753104] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4903worker1 # [ 90.954391] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:32Z level=info event=scheduler_connected addr=lb:500514904worker1 # [ 90.960231] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4905worker1 # [ 91.161207] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:32Z level=info event=scheduler_connected addr=lb:500514906worker1 # [ 91.167157] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4907worker2 # [ 91.361139] nix-grpc-daemon[1249]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR4908worker2 # [ 91.361558] nix-grpc-daemon[1249]: E0000 00:00:1789910971.956827 1292 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true4909worker2 # [ 91.375011] nix-grpc-daemon[1249]: E0000 00:00:1789910971.969601 1292 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true4910lb # [ 91.332994] envoy[915]: conn peer=192.168.1.3:37666 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=8057 tx=2236 ms=604184911worker1 # [ 91.368143] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:32Z level=info event=scheduler_connected addr=lb:500514912worker1 # [ 91.373632] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4913worker1 # [ 91.576725] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:33Z level=info event=scheduler_connected addr=lb:500514914worker1 # [ 91.580990] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4915worker1 # [ 91.777477] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:33Z level=info event=scheduler_connected addr=lb:500514916worker1 # [ 91.783277] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4917worker1 # [ 91.984388] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:33Z level=info event=scheduler_connected addr=lb:500514918lb # [ 91.338245] envoy[915]: conn peer=[2001:db8:1::1]:38182 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1008 tx=282 ms=15294919worker1 # [ 91.990253] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4920lb # [ 91.338649] envoy[915]: conn peer=[2001:db8:1::4]:37030 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=7963 tx=535 ms=82544921lb # [ 91.972693] niks3-server[1030]: 2026/09/20 13:29:33 INFO lead: acquired remote=192.168.1.3:603264922worker1 # [ 92.006702] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:33Z level=info event=scheduler_take_over4923worker1 # [ 92.190534] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:33Z level=info event=scheduler_connected addr=lb:500514924worker1 # [ 92.193685] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4925worker2 # [ 92.354055] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.4926worker2 # [ 92.358582] systemd[1]: Stopped Nix worker-protocol over gRPC.4927worker2 # [ 92.363977] systemd[1]: nix-grpc-daemon.service: Consumed 602ms CPU time over 10.254s wall clock time, 31.1M memory peak, 20.7K incoming IP traffic, 30.9K outgoing IP traffic.4928worker2 # [ 92.377792] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.4929worker2 # [ 92.383819] systemd[1]: Closed Nix worker-protocol over gRPC.4930worker2 # [ 92.388648] systemd[1]: nix-grpc-daemon.socket: Consumed 916us CPU time over 11.219s wall clock time, 256K memory peak, 20.4K incoming IP traffic, 15.4K outgoing IP traffic.4931worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over4932worker1 # [ 92.397349] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:33Z level=info event=scheduler_connected addr=lb:500514933worker1 # [ 92.407830] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"4934worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.10 seconds)4935worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4936worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)4937worker1 # [ 92.599785] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:34Z level=info event=scheduler_connected addr=lb:500514938worker1 # [ 92.610538] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:34Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:550464939worker1 # [ 92.616657] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:34Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=04940worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4941worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)4942client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&24943worker1 # [ 93.898215] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:35Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:550604944worker1 # [ 93.914170] nix-daemon[832]: accepted connection from pid 1030, user nix-grpc-daemon (trusted)4945client # don't know how to build these paths:4946client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv4947worker1 # [ 93.939701] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:550604948worker1 # [ 93.950817] nix-grpc-daemon[1030]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 84 ms (attempt 1/5)4949worker1 # [ 94.038388] nix-grpc-daemon[1030]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 88 ms (attempt 2/5)4950worker1 # [ 94.134245] nix-grpc-daemon[1030]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 345 ms (attempt 3/5)4951worker1 # [ 94.484505] nix-grpc-daemon[1030]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 25 ms (attempt 4/5)4952worker1 # [ 94.511096] nix-grpc-daemon[1030]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4953worker1 # [ 94.553531] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:36Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=04954worker1 # [ 94.556790] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:36Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=14955worker1 # [ 94.602316] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:550604956worker1 # [ 94.622910] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:550604957client # copying 1 paths to 'lb:50051'...4958worker1 # [ 94.637439] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:550604959client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...4960worker1 # [ 94.656230] nix-daemon[832]: accepted connection from pid 1030, user nix-grpc-daemon (trusted)4961worker1 # [ 94.676866] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:36Z level=info event=niks3_push_started pid=11004962worker1 # [ 94.909837] nix-grpc-daemon[1100]: time=2026-09-20T13:29:36.512Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca=""4963worker1 # [ 95.109043] nix-daemon[832]: accepted connection from pid 1113, user nix-grpc-daemon (trusted)4964worker1 # [ 95.135641] nix-daemon[832]: reaped child process 1116, status = succeeded4965worker1 # [ 95.315729] nix-daemon[832]: accepted connection from pid 1118, user nix-grpc-daemon (trusted)4966worker1 # [ 95.337832] nix-daemon[832]: reaped child process 1121, status = succeeded4967lb # [ 95.319566] niks3-server[1030]: 2026/09/20 13:29:36 INFO Received uploads request method=POST path=/api/pending_closures4968worker1 # [ 95.367530] nix-grpc-daemon[1100]: time=2026-09-20T13:29:36.969Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4969worker1 # [ 95.369613] nix-grpc-daemon[1100]: time=2026-09-20T13:29:36.969Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"4970lb # [ 95.371120] niks3-server[1030]: 2026/09/20 13:29:36 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst4971worker1 # [ 95.422278] nix-grpc-daemon[1100]: time=2026-09-20T13:29:37.025Z level=INFO msg="Uploading 1 narinfos"4972lb # [ 95.385440] niks3-server[1030]: 2026/09/20 13:29:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign4973lb # [ 95.395672] niks3-server[1030]: 2026/09/20 13:29:36 INFO Signed narinfos id=27 count=14974lb # [ 95.406180] niks3-server[1030]: 2026/09/20 13:29:36 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls4975lb # [ 95.419778] niks3-server[1030]: 2026/09/20 13:29:37 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete4976lb # [ 95.430905] niks3-server[1030]: 2026/09/20 13:29:37 INFO Completed upload id=274977lb # [ 95.435196] niks3-server[1030]: 2026/09/20 13:29:37 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo4978worker1 # [ 95.460993] nix-grpc-daemon[1100]: time=2026-09-20T13:29:37.064Z level=INFO msg="Upload complete. (546ms)"4979worker1 # [ 95.475664] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55060 duration_s=0 paths=1 nar_bytes_in=5204980worker1 # [ 95.492591] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:550604981worker1 # [ 95.501061] nix-daemon[832]: accepted connection from pid 1030, user nix-grpc-daemon (trusted)4982worker1 # [ 95.507889] nix-daemon[832]: reaped child process 1098, status = succeeded4983client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...4984worker1 # [ 95.520887] nix-daemon[832]: accepted connection from pid 1030, user nix-grpc-daemon (trusted)4985client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4986client # farm-a> LOG-farm-a-on-standby4987worker1 # [ 97.173534] nix-daemon[832]: reaped child process 1125, status = succeeded4988worker1 # [ 97.365773] nix-daemon[832]: accepted connection from pid 1140, user nix-grpc-daemon (trusted)4989worker1 # [ 97.387887] nix-daemon[832]: reaped child process 1143, status = succeeded4990lb # [ 97.370328] niks3-server[1030]: 2026/09/20 13:29:38 INFO Received uploads request method=POST path=/api/pending_closures4991worker1 # [ 97.412524] nix-grpc-daemon[1100]: time=2026-09-20T13:29:39.014Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4992worker1 # [ 97.414097] nix-grpc-daemon[1100]: time=2026-09-20T13:29:39.014Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"4993lb # [ 97.413713] niks3-server[1030]: 2026/09/20 13:29:39 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv4994lb # [ 97.435529] niks3-server[1030]: 2026/09/20 13:29:39 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst4995lb # [ 97.447971] niks3-server[1030]: 2026/09/20 13:29:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign4996worker1 # [ 97.484120] nix-grpc-daemon[1100]: time=2026-09-20T13:29:39.086Z level=INFO msg="Uploading 1 narinfos"4997lb # [ 97.455788] niks3-server[1030]: 2026/09/20 13:29:39 INFO Signed narinfos id=28 count=14998lb # [ 97.462317] niks3-server[1030]: 2026/09/20 13:29:39 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls4999lb # [ 97.474764] niks3-server[1030]: 2026/09/20 13:29:39 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5000lb # [ 97.486935] niks3-server[1030]: 2026/09/20 13:29:39 INFO Completed upload id=285001lb # [ 97.490220] niks3-server[1030]: 2026/09/20 13:29:39 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo5002worker1 # [ 97.516996] nix-grpc-daemon[1100]: time=2026-09-20T13:29:39.120Z level=INFO msg="Upload complete. (379ms)"5003worker1 # [ 97.545342] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55060 duration_s=2 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=15004worker1 # [ 97.562578] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:39Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=05005worker1 # [ 97.567229] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:39Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=15006worker1 # [ 97.571842] nix-daemon[832]: reaped child process 1123, status = succeeded5007worker1 # [ 97.592407] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:550605008worker1 # [ 97.616335] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:550605009worker1 # [ 97.634488] nix-grpc-daemon[1100]: time=2026-09-20T13:29:39.238Z level=INFO msg="All 1 paths already cached"5010client # copying 1 paths to 'lb:50051'...5011worker1 # [ 97.645566] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:550605012client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...5013worker1 # [ 97.664286] nix-daemon[832]: accepted connection from pid 1030, user nix-grpc-daemon (trusted)5014worker1 # [ 97.879467] nix-daemon[832]: accepted connection from pid 1149, user nix-grpc-daemon (trusted)5015worker1 # [ 97.905490] nix-daemon[832]: reaped child process 1152, status = succeeded5016worker1 # [ 98.092906] nix-daemon[832]: accepted connection from pid 1154, user nix-grpc-daemon (trusted)5017worker1 # [ 98.115675] nix-daemon[832]: reaped child process 1157, status = succeeded5018lb # [ 98.096659] niks3-server[1030]: 2026/09/20 13:29:39 INFO Received uploads request method=POST path=/api/pending_closures5019worker1 # [ 98.138746] nix-grpc-daemon[1100]: time=2026-09-20T13:29:39.741Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5020worker1 # [ 98.140842] nix-grpc-daemon[1100]: time=2026-09-20T13:29:39.741Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"5021worker1 # [ 98.176068] nix-grpc-daemon[1100]: time=2026-09-20T13:29:39.779Z level=INFO msg="Uploading 1 narinfos"5022lb # [ 98.138285] niks3-server[1030]: 2026/09/20 13:29:39 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst5023lb # [ 98.151310] niks3-server[1030]: 2026/09/20 13:29:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5024lb # [ 98.164828] niks3-server[1030]: 2026/09/20 13:29:39 INFO Signed narinfos id=29 count=15025lb # [ 98.170285] niks3-server[1030]: 2026/09/20 13:29:39 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls5026lb # [ 98.182739] niks3-server[1030]: 2026/09/20 13:29:39 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5027lb # [ 98.189793] niks3-server[1030]: 2026/09/20 13:29:39 INFO Completed upload id=295028worker1 # [ 98.219648] nix-grpc-daemon[1100]: time=2026-09-20T13:29:39.823Z level=INFO msg="Upload complete. (537ms)"5029lb # [ 98.193180] niks3-server[1030]: 2026/09/20 13:29:39 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo5030worker1 # [ 98.228486] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55060 duration_s=0 paths=1 nar_bytes_in=6405031worker1 # [ 98.244417] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:550605032worker1 # [ 98.257992] nix-daemon[832]: accepted connection from pid 1030, user nix-grpc-daemon (trusted)5033worker1 # [ 98.261844] nix-daemon[832]: reaped child process 1147, status = succeeded5034client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...5035client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5036worker1 # [ 98.279446] nix-daemon[832]: accepted connection from pid 1030, user nix-grpc-daemon (trusted)5037client # farm-b> LOG-farm-b-on-standby5038worker1 # [ 99.517344] nix-daemon[832]: reaped child process 1161, status = succeeded5039worker1 # [ 99.700129] nix-daemon[832]: accepted connection from pid 1176, user nix-grpc-daemon (trusted)5040worker1 # [ 99.725556] nix-daemon[832]: reaped child process 1179, status = succeeded5041lb # [ 99.709403] niks3-server[1030]: 2026/09/20 13:29:41 INFO Received uploads request method=POST path=/api/pending_closures5042worker1 # [ 99.755857] nix-grpc-daemon[1100]: time=2026-09-20T13:29:41.358Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5043worker1 # [ 99.757674] nix-grpc-daemon[1100]: time=2026-09-20T13:29:41.358Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"5044lb # [ 99.761853] niks3-server[1030]: 2026/09/20 13:29:41 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5045worker1 # [ 99.804906] nix-grpc-daemon[1100]: time=2026-09-20T13:29:41.408Z level=INFO msg="Uploading 1 narinfos"5046lb # [ 99.778468] niks3-server[1030]: 2026/09/20 13:29:41 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst5047lb # [ 99.789384] niks3-server[1030]: 2026/09/20 13:29:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5048lb # [ 99.796154] niks3-server[1030]: 2026/09/20 13:29:41 INFO Signed narinfos id=30 count=15049lb # [ 99.805362] niks3-server[1030]: 2026/09/20 13:29:41 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls5050worker1 # [ 99.840064] nix-grpc-daemon[1100]: time=2026-09-20T13:29:41.443Z level=INFO msg="Upload complete. (347ms)"5051lb # [ 99.810254] niks3-server[1030]: 2026/09/20 13:29:41 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5052lb # [ 99.814845] niks3-server[1030]: 2026/09/20 13:29:41 INFO Completed upload id=305053lb # [ 99.818424] niks3-server[1030]: 2026/09/20 13:29:41 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo5054worker1 # [ 99.856687] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55060 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=15055worker1 # [ 99.876869] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:41Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=05056worker1 # [ 99.882559] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:41Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=15057worker1 # [ 99.887196] nix-daemon[832]: reaped child process 1159, status = succeeded5058worker1 # [ 99.914881] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:550605059worker1 # [ 99.932617] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:550605060worker1 # [ 99.951396] nix-grpc-daemon[1100]: time=2026-09-20T13:29:41.554Z level=INFO msg="All 2 paths already cached"5061client # copying 1 paths to 'lb:50051'...5062client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...5063worker1 # [ 99.964144] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:550605064worker1 # [ 99.978965] nix-daemon[832]: accepted connection from pid 1030, user nix-grpc-daemon (trusted)5065worker1 # [ 100.203210] nix-daemon[832]: accepted connection from pid 1185, user nix-grpc-daemon (trusted)5066worker1 # [ 100.229749] nix-daemon[832]: reaped child process 1188, status = succeeded5067worker1 # [ 100.425627] nix-daemon[832]: accepted connection from pid 1190, user nix-grpc-daemon (trusted)5068worker1 # [ 100.449040] nix-daemon[832]: reaped child process 1193, status = succeeded5069lb # [ 100.429555] niks3-server[1030]: 2026/09/20 13:29:42 INFO Received uploads request method=POST path=/api/pending_closures5070worker1 # [ 100.470451] nix-grpc-daemon[1100]: time=2026-09-20T13:29:42.073Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5071worker1 # [ 100.472139] nix-grpc-daemon[1100]: time=2026-09-20T13:29:42.073Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"5072lb # [ 100.460106] niks3-server[1030]: 2026/09/20 13:29:42 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst5073lb # [ 100.478779] niks3-server[1030]: 2026/09/20 13:29:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5074worker1 # [ 100.514465] nix-grpc-daemon[1100]: time=2026-09-20T13:29:42.117Z level=INFO msg="Uploading 1 narinfos"5075lb # [ 100.492383] niks3-server[1030]: 2026/09/20 13:29:42 INFO Signed narinfos id=31 count=15076lb # [ 100.495616] niks3-server[1030]: 2026/09/20 13:29:42 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls5077lb # [ 100.508618] niks3-server[1030]: 2026/09/20 13:29:42 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5078lb # [ 100.516208] niks3-server[1030]: 2026/09/20 13:29:42 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo5079lb # [ 100.522590] niks3-server[1030]: 2026/09/20 13:29:42 INFO Completed upload id=315080worker1 # [ 100.552499] nix-grpc-daemon[1100]: time=2026-09-20T13:29:42.156Z level=INFO msg="Upload complete. (555ms)"5081worker1 # [ 100.563049] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55060 duration_s=0 paths=1 nar_bytes_in=7685082worker1 # [ 100.580464] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:550605083worker1 # [ 100.590943] nix-daemon[832]: accepted connection from pid 1030, user nix-grpc-daemon (trusted)5084worker1 # [ 100.597298] nix-daemon[832]: reaped child process 1183, status = succeeded5085client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...5086client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5087worker1 # [ 100.614640] nix-daemon[832]: accepted connection from pid 1030, user nix-grpc-daemon (trusted)5088client # farm-top> LOG-farm-top-on-standby5089worker1 # [ 102.052172] nix-daemon[832]: reaped child process 1197, status = succeeded5090worker1 # [ 102.235839] nix-daemon[832]: accepted connection from pid 1212, user nix-grpc-daemon (trusted)5091worker1 # [ 102.260548] nix-daemon[832]: reaped child process 1215, status = succeeded5092lb # [ 102.243507] niks3-server[1030]: 2026/09/20 13:29:43 INFO Received uploads request method=POST path=/api/pending_closures5093worker1 # [ 102.290785] nix-grpc-daemon[1100]: time=2026-09-20T13:29:43.892Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5094worker1 # [ 102.292640] nix-grpc-daemon[1100]: time=2026-09-20T13:29:43.892Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"5095lb # [ 102.298936] niks3-server[1030]: 2026/09/20 13:29:43 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5096worker1 # [ 102.342280] nix-grpc-daemon[1100]: time=2026-09-20T13:29:43.945Z level=INFO msg="Uploading 1 narinfos"5097lb # [ 102.313329] niks3-server[1030]: 2026/09/20 13:29:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5098lb # [ 102.322364] niks3-server[1030]: 2026/09/20 13:29:43 INFO Signed narinfos id=32 count=15099lb # [ 102.329193] niks3-server[1030]: 2026/09/20 13:29:43 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst5100lb # [ 102.337637] niks3-server[1030]: 2026/09/20 13:29:43 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls5101lb # [ 102.346658] niks3-server[1030]: 2026/09/20 13:29:43 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5102worker1 # [ 102.377627] nix-grpc-daemon[1100]: time=2026-09-20T13:29:43.981Z level=INFO msg="Upload complete. (349ms)"5103lb # [ 102.351696] niks3-server[1030]: 2026/09/20 13:29:43 INFO Completed upload id=325104lb # [ 102.355311] niks3-server[1030]: 2026/09/20 13:29:43 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo5105worker1 # [ 102.393252] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55060 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=15106worker1 # [ 102.410970] nix-daemon[832]: reaped child process 1195, status = succeeded5107client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 8.83 seconds)5108client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath5109client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.26 seconds)5110worker2 # [ 102.828943] systemd[1]: Listening on Nix worker-protocol over gRPC.5111worker2 # [ 102.836680] systemd[1]: Starting scheduler-token.service...5112worker2 # [ 102.939489] systemd[1]: scheduler-token.service: Deactivated successfully.5113worker2 # [ 102.943629] systemd[1]: Finished scheduler-token.service.5114worker2 # [ 102.945592] systemd[1]: scheduler-token.service: Consumed 40ms CPU time over 102ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5115worker2 # [ 102.949729] systemd[1]: Starting Nix worker-protocol over gRPC...5116worker2 # [ 103.140465] nix-grpc-daemon[1345]: ts=2026-09-20T13:29:43Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5117worker2 # [ 103.143628] nix-grpc-daemon[1345]: ts=2026-09-20T13:29:43Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5118worker2 # [ 103.148624] nix-grpc-daemon[1345]: ts=2026-09-20T13:29:43Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15119worker2 # [ 103.158438] nix-grpc-daemon[1345]: ts=2026-09-20T13:29:43Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5120worker2 # [ 103.169793] systemd[1]: Started Nix worker-protocol over gRPC.5121lb: must succeed: curl -sf localhost:9901/clusters5122worker2 # [ 103.186510] nix-grpc-daemon[1345]: ts=2026-09-20T13:29:43Z level=info event=scheduler_connected addr=lb:500515123worker1 # [ 103.167698] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:44Z level=info event=oidc_jwks provider=mock keys=15124worker1 # [ 103.172407] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:44Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:550465125worker1 # [ 103.177825] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:44Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05126lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5127worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5128worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5129lb: must succeed: curl -sf localhost:9901/clusters5130lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)5131lb: must succeed: curl -sf localhost:9901/clusters5132lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5133worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5134worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds)5135(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 15.28 seconds)5136subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5137client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs5138client # [ 103.597546] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs.5139client # Running as unit: rs.service; invocation ID: ea47ff4c3ff740bca016870919d4a2645140client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.11 seconds)5141worker2 # [ 103.939257] nix-grpc-daemon[1345]: ts=2026-09-20T13:29:44Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:504225142worker2 # [ 103.956687] nix-daemon[847]: accepted connection from pid 1345, user nix-grpc-daemon (trusted)5143client # [ 103.911368] nix[1160]: don't know how to build these paths:5144client # [ 103.912862] nix[1160]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5145worker1 # [ 103.961972] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:45Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=05146worker1 # [ 103.962297] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:45Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=15147worker1 # [ 104.008901] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:550605148worker1 # [ 104.027982] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:550605149client # [ 104.008270] nix[1160]: copying 1 paths to 'lb:50051'...5150worker1 # [ 104.042414] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:550605151client # [ 104.012152] nix[1160]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...5152worker1 # [ 104.057723] nix-daemon[832]: accepted connection from pid 1030, user nix-grpc-daemon (trusted)5153worker1 # [ 104.262002] nix-daemon[832]: accepted connection from pid 1228, user nix-grpc-daemon (trusted)5154worker1 # [ 104.285075] nix-daemon[832]: reaped child process 1231, status = succeeded5155worker1 # [ 104.488179] nix-daemon[832]: accepted connection from pid 1233, user nix-grpc-daemon (trusted)5156worker1 # [ 104.513733] nix-daemon[832]: reaped child process 1236, status = succeeded5157lb # [ 104.493789] niks3-server[1030]: 2026/09/20 13:29:46 INFO Received uploads request method=POST path=/api/pending_closures5158worker1 # [ 104.540536] nix-grpc-daemon[1100]: time=2026-09-20T13:29:46.143Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5159worker1 # [ 104.542161] nix-grpc-daemon[1100]: time=2026-09-20T13:29:46.143Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"5160lb # [ 104.533153] niks3-server[1030]: 2026/09/20 13:29:46 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst5161lb # [ 104.549634] niks3-server[1030]: 2026/09/20 13:29:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5162worker1 # [ 104.586817] nix-grpc-daemon[1100]: time=2026-09-20T13:29:46.190Z level=INFO msg="Uploading 1 narinfos"5163lb # [ 104.565757] niks3-server[1030]: 2026/09/20 13:29:46 INFO Signed narinfos id=33 count=15164lb # [ 104.573396] niks3-server[1030]: 2026/09/20 13:29:46 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls5165lb # [ 104.585226] niks3-server[1030]: 2026/09/20 13:29:46 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5166worker1 # [ 104.624297] nix-grpc-daemon[1100]: time=2026-09-20T13:29:46.227Z level=INFO msg="Upload complete. (557ms)"5167lb # [ 104.594276] niks3-server[1030]: 2026/09/20 13:29:46 INFO Completed upload id=335168lb # [ 104.598573] niks3-server[1030]: 2026/09/20 13:29:46 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5169worker1 # [ 104.632175] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55060 duration_s=0 paths=1 nar_bytes_in=4165170worker1 # [ 104.635981] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:550605171worker1 # [ 104.650408] nix-daemon[832]: accepted connection from pid 1030, user nix-grpc-daemon (trusted)5172worker1 # [ 104.654195] nix-daemon[832]: reaped child process 1226, status = succeeded5173client # [ 104.632931] nix[1160]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5174worker1 # [ 104.670250] nix-daemon[832]: accepted connection from pid 1030, user nix-grpc-daemon (trusted)5175lb: must succeed: curl -sf localhost:9901/clusters5176lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5177lb: must succeed: curl -sf localhost:9901/clusters5178lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5179lb: must succeed: curl -sf localhost:9901/clusters5180lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5181lb: must succeed: curl -sf localhost:9901/clusters5182lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5183worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5184worker2 # [ 107.902640] systemd-journald[267]: Received client request to rotate journal, rotating.5185worker2 # [ 107.926489] systemd-journald[267]: Vacuuming done, freed 0B of archived journals from /var/log/journal/bfbd953cdcd341edbc911284b2febc1e.5186worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.11 seconds)5187worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5188worker1 # [ 107.960272] systemd[1]: Stopping Nix worker-protocol over gRPC...5189worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.07 seconds)5190??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5191 File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735192client: must succeed: sleep 5.05193worker1 # [ 108.006966] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:49Z level=info event=draining5194lb # [ 111.333451] envoy[915]: conn peer=[2001:db8:1::1]:45874 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9636 tx=3863 ms=85185195client: (finished: must succeed: sleep 5.0, in 5.05 seconds)5196worker1 # [ 113.301705] nix-daemon[832]: reaped child process 1240, status = succeeded5197worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5198worker1 # [ 113.479212] nix-daemon[832]: accepted connection from pid 1284, user nix-grpc-daemon (trusted)5199worker1 # [ 113.503752] nix-daemon[832]: reaped child process 1287, status = succeeded5200lb # [ 113.481881] niks3-server[1030]: 2026/09/20 13:29:55 INFO Received uploads request method=POST path=/api/pending_closures5201worker1 # [ 113.517072] nix-grpc-daemon[1100]: time=2026-09-20T13:29:55.120Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5202worker1 # [ 113.522054] nix-grpc-daemon[1100]: time=2026-09-20T13:29:55.122Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5203lb # [ 113.508658] niks3-server[1030]: 2026/09/20 13:29:55 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5204lb # [ 113.517628] niks3-server[1030]: 2026/09/20 13:29:55 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5205lb # [ 113.522765] niks3-server[1030]: 2026/09/20 13:29:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5206worker1 # [ 113.556226] nix-grpc-daemon[1100]: time=2026-09-20T13:29:55.159Z level=INFO msg="Uploading 1 narinfos"5207lb # [ 113.527100] niks3-server[1030]: 2026/09/20 13:29:55 INFO Signed narinfos id=34 count=15208lb # [ 113.536651] niks3-server[1030]: 2026/09/20 13:29:55 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5209lb # [ 113.542138] niks3-server[1030]: 2026/09/20 13:29:55 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5210lb # [ 113.555181] niks3-server[1030]: 2026/09/20 13:29:55 INFO Completed upload id=345211worker1 # [ 113.585406] nix-grpc-daemon[1100]: time=2026-09-20T13:29:55.189Z level=INFO msg="Upload complete. (298ms)"5212worker1 # [ 113.591690] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55060 duration_s=8 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15213lb # [ 113.565422] niks3-server[1030]: 2026/09/20 13:29:55 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5214worker1 # [ 113.602616] nix-daemon[832]: reaped child process 1238, status = succeeded5215client # [ 113.594897] systemd[1]: rs.service: Deactivated successfully.5216client # [ 113.597334] systemd[1]: rs.service: Consumed 176ms CPU time over 9.999s wall clock time, 37M memory peak, 8.4K incoming IP traffic, 8.7K outgoing IP traffic.5217worker1 # [ 114.009386] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:55Z level=info event=signal_exit5218worker1 # [ 114.225827] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:55Z level=info event=scheduler_yield5219lb # [ 114.205367] niks3-server[1030]: 2026/09/20 13:29:55 INFO lead: released remote=192.168.1.3:603265220worker1 # [ 114.236224] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:55Z level=info event=scheduler_restarting addr=lb:500515221worker2 # [ 114.270304] nix-grpc-daemon[1345]: ts=2026-09-20T13:29:54Z level=info event=scheduler_restarting addr=lb:500515222worker1 # [ 114.241902] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:55Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:550465223worker1 # [ 114.246616] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:55Z level=info event=worker_gone addr=192.168.1.3:500515224worker1 # [ 114.250683] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:55Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:550465225worker1 # [ 114.255187] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:55Z level=info event=worker_gone addr=192.168.1.4:500515226worker1 # [ 114.437721] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:56Z level=info event=scheduler_connected addr=lb:500515227worker2 # [ 114.470893] nix-grpc-daemon[1345]: ts=2026-09-20T13:29:55Z level=info event=scheduler_connected addr=lb:500515228worker1 # [ 114.445771] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5229worker2 # [ 114.480971] nix-grpc-daemon[1345]: ts=2026-09-20T13:29:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5230worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 1.15 seconds)5231client: waiting for success: ! systemctl is-active rs5232client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds)5233client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5234client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.06 seconds)5235client: must fail: journalctl -u rs | grep -q 'reconnecting'5236worker2 # [ 114.680492] nix-grpc-daemon[1345]: ts=2026-09-20T13:29:55Z level=info event=scheduler_connected addr=lb:500515237worker1 # [ 114.649103] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:56Z level=info event=scheduler_connected addr=lb:500515238worker1 # [ 114.653562] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5239worker2 # [ 114.686166] nix-grpc-daemon[1345]: ts=2026-09-20T13:29:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5240client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.04 seconds)5241lb: must succeed: curl -sf localhost:9901/clusters5242lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5243worker1 # [ 114.850135] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:56Z level=info event=scheduler_connected addr=lb:500515244worker2 # [ 114.887751] nix-grpc-daemon[1345]: ts=2026-09-20T13:29:55Z level=info event=scheduler_connected addr=lb:500515245worker1 # [ 114.856328] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5246worker2 # [ 114.893701] nix-grpc-daemon[1345]: ts=2026-09-20T13:29:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5247worker1 # [ 115.057277] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:56Z level=info event=scheduler_connected addr=lb:500515248worker2 # [ 115.095063] nix-grpc-daemon[1345]: ts=2026-09-20T13:29:55Z level=info event=scheduler_connected addr=lb:500515249worker1 # [ 115.062949] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5250worker2 # [ 115.100761] nix-grpc-daemon[1345]: ts=2026-09-20T13:29:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5251worker1 # [ 115.232173] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:56Z level=info event=scheduler_restarting5252worker2 # [ 115.303646] nix-grpc-daemon[1345]: ts=2026-09-20T13:29:55Z level=info event=scheduler_connected addr=lb:500515253worker2 # [ 115.307981] nix-grpc-daemon[1345]: ts=2026-09-20T13:29:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5254worker1 # [ 115.284722] nix-daemon[832]: reaped child process 1091, status = succeeded5255worker1 # [ 115.287514] nix-grpc-daemon[1030]: ts=2026-09-20T13:29:56Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5256worker1 # [ 115.359221] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5257worker1 # [ 115.364956] systemd[1]: Stopped Nix worker-protocol over gRPC.5258worker1 # [ 115.367019] systemd[1]: nix-grpc-daemon.service: Consumed 2.017s CPU time over 28.624s wall clock time, 34.4M memory peak, 48.4K incoming IP traffic, 87.8K outgoing IP traffic.5259worker1 # [ 115.380627] systemd[1]: Starting Nix worker-protocol over gRPC...5260worker2 # [ 115.504754] nix-grpc-daemon[1345]: ts=2026-09-20T13:29:56Z level=info event=scheduler_connected addr=lb:500515261worker2 # [ 115.510347] nix-grpc-daemon[1345]: ts=2026-09-20T13:29:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5262worker1 # [ 115.583455] nix-grpc-daemon[1294]: ts=2026-09-20T13:29:57Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5263worker1 # [ 115.586484] nix-grpc-daemon[1294]: ts=2026-09-20T13:29:57Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5264worker1 # [ 115.590764] nix-grpc-daemon[1294]: ts=2026-09-20T13:29:57Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15265worker1 # [ 115.600313] nix-grpc-daemon[1294]: ts=2026-09-20T13:29:57Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5266worker1 # [ 115.602258] systemd[1]: Started Nix worker-protocol over gRPC.5267lb # [ 115.583238] niks3-server[1030]: 2026/09/20 13:29:57 INFO lead: acquired remote=192.168.1.3:379645268worker1 # [ 115.619359] nix-grpc-daemon[1294]: ts=2026-09-20T13:29:57Z level=info event=scheduler_take_over5269worker1 # [ 115.627625] nix-grpc-daemon[1294]: ts=2026-09-20T13:29:57Z level=info event=scheduler_connected addr=lb:500515270worker1 # [ 115.632303] nix-grpc-daemon[1294]: ts=2026-09-20T13:29:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5271worker2 # [ 115.712224] nix-grpc-daemon[1345]: ts=2026-09-20T13:29:56Z level=info event=scheduler_connected addr=lb:500515272worker1 # [ 115.692173] nix-grpc-daemon[1294]: ts=2026-09-20T13:29:57Z level=info event=oidc_jwks provider=mock keys=15273worker1 # [ 115.695264] nix-grpc-daemon[1294]: ts=2026-09-20T13:29:57Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:599945274worker1 # [ 115.698395] nix-grpc-daemon[1294]: ts=2026-09-20T13:29:57Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05275lb: must succeed: curl -sf localhost:9901/clusters5276worker1 # [ 115.831291] nix-grpc-daemon[1294]: ts=2026-09-20T13:29:57Z level=info event=scheduler_connected addr=lb:500515277worker1 # [ 115.838603] nix-grpc-daemon[1294]: ts=2026-09-20T13:29:57Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:599945278worker1 # [ 115.844089] nix-grpc-daemon[1294]: ts=2026-09-20T13:29:57Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05279lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5280worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5281worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)5282(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.39 seconds)5283subtest: scheduler restart mid-build: build finishes, no double build5284client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid5285client # [ 115.979060] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid.5286client # Running as unit: mid.service; invocation ID: 12506540dc50456e97befd61772b7c6d5287client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.11 seconds)5288worker1 # [ 116.315156] nix-grpc-daemon[1294]: ts=2026-09-20T13:29:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:600045289worker1 # [ 116.337258] nix-daemon[832]: accepted connection from pid 1294, user nix-grpc-daemon (trusted)5290client # [ 116.318117] nix[1195]: don't know how to build these paths:5291client # [ 116.319197] nix[1195]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5292worker1 # [ 116.363502] nix-grpc-daemon[1294]: ts=2026-09-20T13:29:57Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05293worker1 # [ 116.367256] nix-grpc-daemon[1294]: ts=2026-09-20T13:29:57Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=15294worker2 # [ 116.447290] nix-grpc-daemon[1345]: ts=2026-09-20T13:29:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504225295worker2 # [ 116.469972] nix-grpc-daemon[1345]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 40 ms (attempt 1/5)5296worker2 # [ 116.518098] nix-grpc-daemon[1345]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 103 ms (attempt 2/5)5297worker2 # [ 116.629152] nix-grpc-daemon[1345]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 74 ms (attempt 3/5)5298worker2 # [ 116.707558] nix-grpc-daemon[1345]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 199 ms (attempt 4/5)5299worker2 # [ 116.915509] nix-grpc-daemon[1345]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5300worker2 # [ 116.939782] nix-grpc-daemon[1345]: ts=2026-09-20T13:29:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:504225301client # [ 116.889017] nix[1195]: copying 1 paths to 'lb:50051'...5302client # [ 116.894844] nix[1195]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5303worker2 # [ 116.961418] nix-grpc-daemon[1345]: ts=2026-09-20T13:29:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:504225304worker2 # [ 116.978223] nix-daemon[847]: accepted connection from pid 1345, user nix-grpc-daemon (trusted)5305worker2 # [ 117.011815] nix-grpc-daemon[1345]: ts=2026-09-20T13:29:57Z level=info event=niks3_push_started pid=14535306worker2 # [ 117.249115] nix-grpc-daemon[1453]: time=2026-09-20T13:29:57.844Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""5307worker2 # [ 117.468511] nix-daemon[847]: accepted connection from pid 1466, user nix-grpc-daemon (trusted)5308worker2 # [ 117.495169] nix-daemon[847]: reaped child process 1473, status = succeeded5309worker2 # [ 117.689480] nix-daemon[847]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)5310worker2 # [ 117.714234] nix-daemon[847]: reaped child process 1478, status = succeeded5311lb # [ 117.672998] niks3-server[1030]: 2026/09/20 13:29:59 INFO Received uploads request method=POST path=/api/pending_closures5312worker2 # [ 117.746480] nix-grpc-daemon[1453]: time=2026-09-20T13:29:58.340Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5313worker2 # [ 117.748609] nix-grpc-daemon[1453]: time=2026-09-20T13:29:58.341Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"5314lb # [ 117.709733] niks3-server[1030]: 2026/09/20 13:29:59 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst5315lb # [ 117.717173] niks3-server[1030]: 2026/09/20 13:29:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5316worker2 # [ 117.785195] nix-grpc-daemon[1453]: time=2026-09-20T13:29:58.380Z level=INFO msg="Uploading 1 narinfos"5317lb # [ 117.725346] niks3-server[1030]: 2026/09/20 13:29:59 INFO Signed narinfos id=35 count=15318lb # [ 117.734742] niks3-server[1030]: 2026/09/20 13:29:59 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls5319lb # [ 117.743537] niks3-server[1030]: 2026/09/20 13:29:59 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5320worker2 # [ 117.812888] nix-grpc-daemon[1453]: time=2026-09-20T13:29:58.408Z level=INFO msg="Upload complete. (559ms)"5321lb # [ 117.750997] niks3-server[1030]: 2026/09/20 13:29:59 INFO Completed upload id=355322worker2 # [ 117.820713] nix-grpc-daemon[1345]: ts=2026-09-20T13:29:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50422 duration_s=0 paths=1 nar_bytes_in=4245323worker2 # [ 117.824360] nix-grpc-daemon[1345]: ts=2026-09-20T13:29:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504225324worker2 # [ 117.832708] nix-grpc-daemon[1453]: time=2026-09-20T13:29:58.428Z level=WARN msg="Failed to register uploaded object" key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo error="server returned 404: object is not pending upload\n"5325worker2 # [ 117.838229] nix-daemon[847]: accepted connection from pid 1345, user nix-grpc-daemon (trusted)5326worker2 # [ 117.842581] nix-daemon[847]: reaped child process 1451, status = succeeded5327worker2 # [ 117.853110] nix-daemon[847]: accepted connection from pid 1345, user nix-grpc-daemon (trusted)5328client # [ 117.788971] nix[1195]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...5329lb: must succeed: curl -sf localhost:9901/clusters5330lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds)5331lb: must succeed: curl -sf localhost:9901/clusters5332lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5333worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5334worker1 # [ 120.059878] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1294 (nix-grpc-daemon) on client request.5335lb # [ 120.037342] niks3-server[1030]: 2026/09/20 13:30:01 INFO lead: released remote=192.168.1.3:379645336worker1 # [ 120.067631] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5337worker2 # [ 120.108487] nix-grpc-daemon[1345]: ts=2026-09-20T13:30:00Z level=info event=scheduler_disconnected addr=lb:50051 error="Stream removed (RST_STREAM (Received RST_STREAM with error code 2))"5338client # [ 120.045156] nix[1195]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5339worker1 # [ 120.083127] nix-daemon[832]: reaped child process 1350, status = succeeded5340worker1 # [ 120.106706] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5341worker1 # [ 120.113249] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5342worker1 # [ 120.117229] systemd[1]: nix-grpc-daemon.service: Consumed 179ms CPU time over 4.725s wall clock time, 11.6M memory peak, 9.3K incoming IP traffic, 8.7K outgoing IP traffic.5343worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.10 seconds)5344client: must succeed: sleep 5.05345worker2 # [ 120.309048] nix-grpc-daemon[1345]: ts=2026-09-20T13:30:00Z level=info event=scheduler_connected addr=lb:500515346worker1 # [ 120.284232] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5347worker1 # [ 120.292824] systemd[1]: Starting Nix worker-protocol over gRPC...5348worker1 # [ 120.457999] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:02Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5349worker1 # [ 120.461233] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:02Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5350worker1 # [ 120.466050] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:02Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15351worker1 # [ 120.478784] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:02Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5352worker1 # [ 120.488529] systemd[1]: Started Nix worker-protocol over gRPC.5353lb # [ 120.471292] niks3-server[1030]: 2026/09/20 13:30:02 INFO lead: acquired remote=192.168.1.3:379865354worker1 # [ 120.501017] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:02Z level=info event=scheduler_take_over5355worker2 # [ 120.534133] nix-grpc-daemon[1345]: ts=2026-09-20T13:30:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5356worker1 # [ 120.510096] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:02Z level=info event=scheduler_connected addr=lb:500515357worker1 # [ 120.514170] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:02Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:600205358worker1 # [ 120.516720] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:02Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05359worker2 # [ 120.735189] nix-grpc-daemon[1345]: ts=2026-09-20T13:30:01Z level=info event=scheduler_connected addr=lb:500515360worker1 # [ 120.713509] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:02Z level=info event=oidc_jwks provider=mock keys=15361worker1 # [ 120.715845] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:02Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:600205362worker1 # [ 120.719160] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:02Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=15363lb # [ 121.334968] envoy[915]: conn peer=[2001:db8:1::1]:47370 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2923 tx=1333 ms=97055364lb # [ 121.338236] envoy[915]: conn peer=[2001:db8:1::3]:34248 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3890 tx=1265 ms=282645365lb # [ 121.341080] envoy[915]: conn peer=[2001:db8:1::3]:43846 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=567 tx=278 ms=44605366client: (finished: must succeed: sleep 5.0, in 5.05 seconds)5367client: waiting for success: ! systemctl is-active mid5368worker2 # [ 125.712779] nix-daemon[847]: reaped child process 1482, status = succeeded5369worker2 # [ 125.896172] nix-daemon[847]: accepted connection from pid 1518, user nix-grpc-daemon (trusted)5370worker2 # [ 125.921787] nix-daemon[847]: reaped child process 1521, status = succeeded5371lb # [ 125.873512] niks3-server[1030]: 2026/09/20 13:30:07 INFO Received uploads request method=POST path=/api/pending_closures5372worker2 # [ 125.948566] nix-grpc-daemon[1453]: time=2026-09-20T13:30:06.542Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5373worker2 # [ 125.950911] nix-grpc-daemon[1453]: time=2026-09-20T13:30:06.542Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"5374lb # [ 125.929334] niks3-server[1030]: 2026/09/20 13:30:07 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5375lb # [ 125.946978] niks3-server[1030]: 2026/09/20 13:30:07 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5376lb # [ 125.962603] niks3-server[1030]: 2026/09/20 13:30:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5377lb # [ 125.969924] niks3-server[1030]: 2026/09/20 13:30:07 INFO Signed narinfos id=36 count=15378worker2 # [ 126.032272] nix-grpc-daemon[1453]: time=2026-09-20T13:30:06.626Z level=INFO msg="Uploading 1 narinfos"5379lb # [ 125.972983] niks3-server[1030]: 2026/09/20 13:30:07 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls5380lb # [ 125.987146] niks3-server[1030]: 2026/09/20 13:30:07 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5381worker2 # [ 126.058033] nix-grpc-daemon[1453]: time=2026-09-20T13:30:06.653Z level=INFO msg="Upload complete. (385ms)"5382lb # [ 125.998422] niks3-server[1030]: 2026/09/20 13:30:07 INFO Completed upload id=365383worker2 # [ 126.074521] nix-grpc-daemon[1345]: ts=2026-09-20T13:30:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50422 duration_s=8 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=15384worker2 # [ 126.096496] nix-grpc-daemon[1453]: time=2026-09-20T13:30:06.684Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo error="server returned 404: object is not pending upload\n"5385worker2 # [ 126.103406] nix-daemon[847]: reaped child process 1480, status = succeeded5386client # [ 126.060708] systemd[1]: mid.service: Deactivated successfully.5387client # [ 126.066064] systemd[1]: mid.service: Consumed 197ms CPU time over 10.086s wall clock time, 37M memory peak, 9.1K incoming IP traffic, 9.3K outgoing IP traffic.5388client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds)5389client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5390client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.05 seconds)5391(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.79 seconds)5392subtest: interrupting the client stops the build on the worker5393client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr5394client # [ 126.736488] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr.5395client # Running as unit: intr.service; invocation ID: 453131794dde47ae9076f1ffddff6fec5396client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds)5397worker1 # [ 127.036714] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:398085398worker1 # [ 127.042697] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5399client # [ 127.022153] nix[1230]: don't know how to build these paths:5400client # [ 127.023650] nix[1230]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv5401worker1 # [ 127.075415] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:08Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=05402worker1 # [ 127.081479] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:08Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.3:50051 clients=15403worker1 # [ 127.123880] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398085404worker1 # [ 127.144231] nix-grpc-daemon[1378]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 66 ms (attempt 1/5)5405worker1 # [ 127.217427] nix-grpc-daemon[1378]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 189 ms (attempt 2/5)5406worker1 # [ 127.407273] nix-grpc-daemon[1378]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 150 ms (attempt 3/5)5407worker1 # [ 127.557691] nix-grpc-daemon[1378]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 520 ms (attempt 4/5)5408worker1 # [ 128.079134] nix-grpc-daemon[1378]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5409worker1 # [ 128.098031] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:398085410worker1 # [ 128.112949] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:398085411client # [ 128.079871] nix[1230]: copying 1 paths to 'lb:50051'...5412client # [ 128.087511] nix[1230]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...5413worker1 # [ 128.127319] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5414worker1 # [ 128.174446] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:09Z level=info event=niks3_push_started pid=14525415worker1 # [ 128.400749] nix-grpc-daemon[1452]: time=2026-09-20T13:30:10.001Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca=""5416worker1 # [ 128.636876] nix-daemon[832]: accepted connection from pid 1465, user nix-grpc-daemon (trusted)5417worker1 # [ 128.668874] nix-daemon[832]: reaped child process 1468, status = succeeded5418worker1 # [ 128.911988] nix-daemon[832]: accepted connection from pid 1470, user nix-grpc-daemon (trusted)5419worker1 # [ 128.938317] nix-daemon[832]: reaped child process 1473, status = succeeded5420lb # [ 128.926342] niks3-server[1030]: 2026/09/20 13:30:10 INFO Received uploads request method=POST path=/api/pending_closures5421worker1 # [ 128.976080] nix-grpc-daemon[1452]: time=2026-09-20T13:30:10.578Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5422worker1 # [ 128.978488] nix-grpc-daemon[1452]: time=2026-09-20T13:30:10.578Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"5423lb # [ 128.988143] niks3-server[1030]: 2026/09/20 13:30:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5424worker1 # [ 129.025646] nix-grpc-daemon[1452]: time=2026-09-20T13:30:10.628Z level=INFO msg="Uploading 1 narinfos"5425lb # [ 128.995560] niks3-server[1030]: 2026/09/20 13:30:10 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst5426lb # [ 129.001248] niks3-server[1030]: 2026/09/20 13:30:10 INFO Signed narinfos id=37 count=15427lb # [ 129.005553] niks3-server[1030]: 2026/09/20 13:30:10 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls5428lb # [ 129.021327] niks3-server[1030]: 2026/09/20 13:30:10 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5429lb # [ 129.034701] niks3-server[1030]: 2026/09/20 13:30:10 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo5430lb # [ 129.040792] niks3-server[1030]: 2026/09/20 13:30:10 INFO Completed upload id=375431worker1 # [ 129.077830] nix-grpc-daemon[1452]: time=2026-09-20T13:30:10.681Z level=INFO msg="Upload complete. (678ms)"5432worker1 # [ 129.085614] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39808 duration_s=0 paths=1 nar_bytes_in=4245433worker1 # [ 129.092484] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398085434worker1 # [ 129.102408] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5435worker1 # [ 129.110138] nix-daemon[832]: reaped child process 1450, status = succeeded5436client # [ 129.091460] nix[1230]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...5437worker1 # [ 129.127578] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5438lb # [ 131.336391] envoy[915]: conn peer=[2001:db8:1::1]:37686 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3035 tx=1424 ms=97505439client: must succeed: systemctl kill -s INT intr5440client # [ 131.667509] systemd[1]: intr.service: Sent signal SIGINT to main process 1230 (nix) on client request.5441client # [ 131.678878] nix[1230]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5442client: (finished: must succeed: systemctl kill -s INT intr, in 0.10 seconds)5443client # [ 131.691285] nix[1230]: error: interrupted by the user5444client # [ 131.728878] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5445client # [ 131.735564] systemd[1]: intr.service: Failed with result 'exit-code'.5446client # [ 131.737975] systemd[1]: intr.service: Consumed 173ms CPU time over 4.996s wall clock time, 39.2M memory peak, 7.6K incoming IP traffic, 8.7K outgoing IP traffic.5447worker1 # [ 131.782039] nix-daemon[1480]: unexpected Nix daemon error: error: interrupted by the user5448worker1 # [ 131.803086] nix-daemon[832]: reaped child process 1475, status = succeeded5449worker1 # [ 131.806849] nix-daemon[832]: reaped child process 1480, status = failed with exit code 15450(finished: subtest: interrupting the client stops the build on the worker, in 5.18 seconds)5451subtest: a deploy mid-build drains: the build finishes, the new generation takes over5452client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw5453client # [ 131.944517] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw.5454client # Running as unit: sw.service; invocation ID: 33daabcc753d48acbcb3f6ba9e4d96aa5455client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.10 seconds)5456worker2 # [ 132.291106] nix-grpc-daemon[1345]: ts=2026-09-20T13:30:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:504225457client # [ 132.238127] nix[1250]: don't know how to build these paths:5458client # [ 132.239630] nix[1250]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5459worker1 # [ 132.284683] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:13Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=05460worker1 # [ 132.291110] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:13Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.4:50051 clients=15461worker2 # [ 132.365549] nix-grpc-daemon[1345]: ts=2026-09-20T13:30:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504225462worker2 # [ 132.388450] nix-grpc-daemon[1345]: ts=2026-09-20T13:30:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:504225463client # [ 132.343741] nix[1250]: copying 1 paths to 'lb:50051'...5464client # [ 132.351332] nix[1250]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...5465worker2 # [ 132.416177] nix-grpc-daemon[1345]: ts=2026-09-20T13:30:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:504225466worker2 # [ 132.434349] nix-daemon[847]: accepted connection from pid 1345, user nix-grpc-daemon (trusted)5467worker2 # [ 132.687226] nix-daemon[847]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)5468worker2 # [ 132.710547] nix-daemon[847]: reaped child process 1556, status = succeeded5469worker2 # [ 132.937728] nix-daemon[847]: accepted connection from pid 1558, user nix-grpc-daemon (trusted)5470worker2 # [ 132.962899] nix-daemon[847]: reaped child process 1561, status = succeeded5471lb # [ 132.915147] niks3-server[1030]: 2026/09/20 13:30:14 INFO Received uploads request method=POST path=/api/pending_closures5472worker2 # [ 132.986271] nix-grpc-daemon[1453]: time=2026-09-20T13:30:13.581Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5473worker2 # [ 132.987832] nix-grpc-daemon[1453]: time=2026-09-20T13:30:13.581Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"5474lb # [ 132.942425] niks3-server[1030]: 2026/09/20 13:30:14 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst5475lb # [ 132.954366] niks3-server[1030]: 2026/09/20 13:30:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5476worker2 # [ 133.020912] nix-grpc-daemon[1453]: time=2026-09-20T13:30:13.616Z level=INFO msg="Uploading 1 narinfos"5477lb # [ 132.961112] niks3-server[1030]: 2026/09/20 13:30:14 INFO Signed narinfos id=38 count=15478lb # [ 132.965980] niks3-server[1030]: 2026/09/20 13:30:14 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls5479lb # [ 132.978848] niks3-server[1030]: 2026/09/20 13:30:14 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5480lb # [ 132.984469] niks3-server[1030]: 2026/09/20 13:30:14 INFO Completed upload id=385481worker2 # [ 133.046238] nix-grpc-daemon[1453]: time=2026-09-20T13:30:13.642Z level=INFO msg="Upload complete. (590ms)"5482lb # [ 132.988199] niks3-server[1030]: 2026/09/20 13:30:14 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo5483worker2 # [ 133.052357] nix-grpc-daemon[1345]: ts=2026-09-20T13:30:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50422 duration_s=0 paths=1 nar_bytes_in=4165484worker2 # [ 133.068277] nix-grpc-daemon[1345]: ts=2026-09-20T13:30:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504225485worker2 # [ 133.074726] nix-daemon[847]: accepted connection from pid 1345, user nix-grpc-daemon (trusted)5486worker2 # [ 133.079818] nix-daemon[847]: reaped child process 1551, status = succeeded5487worker2 # [ 133.093153] nix-daemon[847]: accepted connection from pid 1345, user nix-grpc-daemon (trusted)5488client # [ 133.026433] nix[1250]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...5489worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&25490worker2 # Checking switch inhibitors... done5491worker2 # activating the configuration...5492worker2 # [ 135.604512] nixos[1596]: switching to system configuration /nix/store/9ap52lxmrd9ngqpz6679ivass316y6a3-nixos-system-worker2-test5493worker2 # [ 135.606375] systemd[1]: Stopped target Local File Systems.5494worker2 # [ 135.607215] systemd[1]: Stopped target Remote File Systems.5495worker2 # setting up /etc...5496worker2 # [ 136.541382] systemd[1]: Reload requested from client PID 1596 ('.switch-to-conf') (unit backdoor.service)...5497worker2 # [ 136.543603] systemd[1]: Reloading...5498worker2 # [ 137.524558] systemd[1]: Reloading finished in 976 ms.5499worker2 # restarting sysinit-reactivation.target5500worker2 # [ 137.609514] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....5501worker2 # [ 137.779771] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..5502worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service5503worker2 # [ 137.786014] systemd[1]: Reached target Reactivate sysinit units.5504worker2 # [ 137.789017] systemd[1]: Reloading D-Bus System Message Bus...5505worker2 # [ 137.794691] dbus-broker-launch[493]: Caught SIGHUP, trigger reload.5506worker2 # [ 137.804882] systemd[1]: Reloading Nix worker-protocol over gRPC...5507worker2 # [ 137.832140] dbus-broker-launch[493]: Looking up NSS user entry for 'systemd-timesync'...5508worker2 # [ 137.845414] dbus-broker-launch[493]: NSS returned no entry for 'systemd-timesync'5509worker2 # [ 137.846829] dbus-broker-launch[493]: Invalid user-name in /nix/store/c8a4kacp5lnfwrcxrjmwczbl8ba32m4a-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"5510worker2 # [ 137.863222] systemd[1]: Reloaded Nix worker-protocol over gRPC.5511worker2 # [ 137.898529] systemd[1]: Reloaded D-Bus System Message Bus.5512worker2 # [ 137.909462] systemd[1]: Reached target Local File Systems.5513worker2 # [ 137.910468] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore5514worker2 # [ 137.918931] systemd[1]: Starting Create SUID/SGID Wrappers...5515worker2 # [ 137.919999] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.5516worker2 # [ 137.929787] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc675517worker2 # [ 137.941356] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore5518worker2 # [ 137.948303] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5519worker2 # [ 137.951265] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5520worker2 # [ 137.956508] systemd[1]: Reached target Remote File Systems.5521worker2 # [ 137.957594] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os5522worker2 # [ 137.959603] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki5523worker2 # [ 138.182937] nix-grpc-daemon[1345]: ts=2026-09-20T13:30:18Z level=info event=draining5524worker2 # [ 138.572473] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.5525worker2 # [ 138.573619] systemd[1]: Finished Create SUID/SGID Wrappers.5526worker2 # [ 138.577860] systemd[1]: Starting linger-users.service...5527worker2 # [ 138.655621] systemd[1]: linger-users.service: Deactivated successfully.5528worker2 # [ 138.660233] systemd[1]: Finished linger-users.service.5529worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service5530worker2 # [ 138.913532] nixos[1596]: finished switching to system configuration /nix/store/9ap52lxmrd9ngqpz6679ivass316y6a3-nixos-system-worker2-test5531worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 4.20 seconds)5532worker2: must succeed: pgrep -f 'read -t [9]0 x'5533worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.07 seconds)5534client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&25535worker1 # [ 139.275562] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:398085536client # don't know how to build these paths:5537client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5538worker1 # [ 139.288356] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:398085539worker1 # [ 139.325781] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:20Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=05540worker1 # [ 139.334075] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:20Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.3:50051 clients=15541worker1 # [ 139.377911] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398085542worker1 # [ 139.398404] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:398085543client # copying 1 paths to 'lb:50051'...5544client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...5545worker1 # [ 139.416926] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:398085546worker1 # [ 139.434172] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5547worker1 # [ 139.676122] nix-daemon[832]: accepted connection from pid 1531, user nix-grpc-daemon (trusted)5548worker1 # [ 139.703660] nix-daemon[832]: reaped child process 1534, status = succeeded5549worker1 # [ 139.909050] nix-daemon[832]: accepted connection from pid 1536, user nix-grpc-daemon (trusted)5550worker1 # [ 139.933851] nix-daemon[832]: reaped child process 1539, status = succeeded5551lb # [ 139.918304] niks3-server[1030]: 2026/09/20 13:30:21 INFO Received uploads request method=POST path=/api/pending_closures5552worker1 # [ 139.960565] nix-grpc-daemon[1452]: time=2026-09-20T13:30:21.563Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5553worker1 # [ 139.962249] nix-grpc-daemon[1452]: time=2026-09-20T13:30:21.563Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"5554lb # [ 139.955345] niks3-server[1030]: 2026/09/20 13:30:21 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst5555lb # [ 139.976948] niks3-server[1030]: 2026/09/20 13:30:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5556worker1 # [ 140.013016] nix-grpc-daemon[1452]: time=2026-09-20T13:30:21.616Z level=INFO msg="Uploading 1 narinfos"5557lb # [ 139.988083] niks3-server[1030]: 2026/09/20 13:30:21 INFO Signed narinfos id=39 count=15558lb # [ 139.990208] niks3-server[1030]: 2026/09/20 13:30:21 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls5559lb # [ 140.001512] niks3-server[1030]: 2026/09/20 13:30:21 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5560worker1 # [ 140.037039] nix-grpc-daemon[1452]: time=2026-09-20T13:30:21.640Z level=INFO msg="Upload complete. (584ms)"5561lb # [ 140.008429] niks3-server[1030]: 2026/09/20 13:30:21 INFO Completed upload id=395562lb # [ 140.015756] niks3-server[1030]: 2026/09/20 13:30:21 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo5563worker1 # [ 140.044250] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39808 duration_s=0 paths=1 nar_bytes_in=5285564worker1 # [ 140.052593] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398085565worker1 # [ 140.061986] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5566worker1 # [ 140.066283] nix-daemon[832]: reaped child process 1529, status = succeeded5567client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...5568client # farm-a> node-a: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5569worker1 # [ 140.082351] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5570lb # [ 141.341694] envoy[915]: conn peer=[2001:db8:1::1]:34482 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2931 tx=755 ms=47085571client # farm-a> LOG-farm-a-during-drain5572worker1 # [ 141.715448] nix-daemon[832]: reaped child process 1543, status = succeeded5573worker1 # [ 141.890715] nix-daemon[832]: accepted connection from pid 1558, user nix-grpc-daemon (trusted)5574worker1 # [ 141.915336] nix-daemon[832]: reaped child process 1561, status = succeeded5575lb # [ 141.898724] niks3-server[1030]: 2026/09/20 13:30:23 INFO Received uploads request method=POST path=/api/pending_closures5576worker1 # [ 141.940520] nix-grpc-daemon[1452]: time=2026-09-20T13:30:23.543Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5577worker1 # [ 141.942129] nix-grpc-daemon[1452]: time=2026-09-20T13:30:23.543Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"5578lb # [ 141.951320] niks3-server[1030]: 2026/09/20 13:30:23 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv5579lb # [ 141.965221] niks3-server[1030]: 2026/09/20 13:30:23 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5580lb # [ 141.977138] niks3-server[1030]: 2026/09/20 13:30:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5581worker1 # [ 142.015542] nix-grpc-daemon[1452]: time=2026-09-20T13:30:23.617Z level=INFO msg="Uploading 1 narinfos"5582lb # [ 141.991455] niks3-server[1030]: 2026/09/20 13:30:23 INFO Signed narinfos id=40 count=15583lb # [ 141.997529] niks3-server[1030]: 2026/09/20 13:30:23 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls5584lb # [ 142.008243] niks3-server[1030]: 2026/09/20 13:30:23 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5585lb # [ 142.015755] niks3-server[1030]: 2026/09/20 13:30:23 INFO Completed upload id=405586worker1 # [ 142.045694] nix-grpc-daemon[1452]: time=2026-09-20T13:30:23.649Z level=INFO msg="Upload complete. (348ms)"5587lb # [ 142.018762] niks3-server[1030]: 2026/09/20 13:30:23 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo5588worker1 # [ 142.068264] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39808 duration_s=2 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=3 outputs=15589worker1 # [ 142.080452] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:23Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=05590worker1 # [ 142.086907] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:23Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.3:50051 clients=15591worker1 # [ 142.091409] nix-daemon[832]: reaped child process 1541, status = succeeded5592worker1 # [ 142.112779] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398085593worker1 # [ 142.130735] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:398085594worker1 # [ 142.147867] nix-grpc-daemon[1452]: time=2026-09-20T13:30:23.751Z level=INFO msg="All 1 paths already cached"5595client # copying 1 paths to 'lb:50051'...5596worker1 # [ 142.159844] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:398085597client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...5598worker1 # [ 142.184005] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5599worker1 # [ 142.395135] nix-daemon[832]: accepted connection from pid 1567, user nix-grpc-daemon (trusted)5600worker1 # [ 142.418478] nix-daemon[832]: reaped child process 1570, status = succeeded5601worker1 # [ 142.610266] nix-daemon[832]: accepted connection from pid 1572, user nix-grpc-daemon (trusted)5602worker1 # [ 142.631899] nix-daemon[832]: reaped child process 1575, status = succeeded5603lb # [ 142.619693] niks3-server[1030]: 2026/09/20 13:30:24 INFO Received uploads request method=POST path=/api/pending_closures5604worker1 # [ 142.660135] nix-grpc-daemon[1452]: time=2026-09-20T13:30:24.263Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5605worker1 # [ 142.661710] nix-grpc-daemon[1452]: time=2026-09-20T13:30:24.263Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"5606lb # [ 142.653821] niks3-server[1030]: 2026/09/20 13:30:24 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst5607worker1 # [ 142.700347] nix-grpc-daemon[1452]: time=2026-09-20T13:30:24.303Z level=INFO msg="Uploading 1 narinfos"5608lb # [ 142.673670] niks3-server[1030]: 2026/09/20 13:30:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5609lb # [ 142.685284] niks3-server[1030]: 2026/09/20 13:30:24 INFO Signed narinfos id=41 count=15610lb # [ 142.696191] niks3-server[1030]: 2026/09/20 13:30:24 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls5611worker1 # [ 142.732501] nix-grpc-daemon[1452]: time=2026-09-20T13:30:24.336Z level=INFO msg="Upload complete. (528ms)"5612lb # [ 142.703462] niks3-server[1030]: 2026/09/20 13:30:24 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5613lb # [ 142.709053] niks3-server[1030]: 2026/09/20 13:30:24 INFO Completed upload id=415614worker1 # [ 142.740191] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39808 duration_s=0 paths=1 nar_bytes_in=6405615lb # [ 142.713543] niks3-server[1030]: 2026/09/20 13:30:24 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo5616worker1 # [ 142.752618] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398085617worker1 # [ 142.767774] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5618worker1 # [ 142.773834] nix-daemon[832]: reaped child process 1565, status = succeeded5619client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...5620client # farm-b> node-a: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5621worker1 # [ 142.790297] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5622client # farm-b> LOG-farm-b-during-drain5623worker1 # [ 143.623671] nix-daemon[832]: reaped child process 1579, status = succeeded5624worker1 # [ 143.828529] nix-daemon[832]: accepted connection from pid 1594, user nix-grpc-daemon (trusted)5625worker1 # [ 143.852195] nix-daemon[832]: reaped child process 1597, status = succeeded5626lb # [ 143.835663] niks3-server[1030]: 2026/09/20 13:30:25 INFO Received uploads request method=POST path=/api/pending_closures5627worker1 # [ 143.877060] nix-grpc-daemon[1452]: time=2026-09-20T13:30:25.480Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5628worker1 # [ 143.879649] nix-grpc-daemon[1452]: time=2026-09-20T13:30:25.482Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"5629lb # [ 143.884382] niks3-server[1030]: 2026/09/20 13:30:25 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv5630worker1 # [ 143.928284] nix-grpc-daemon[1452]: time=2026-09-20T13:30:25.531Z level=INFO msg="Uploading 1 narinfos"5631lb # [ 143.898764] niks3-server[1030]: 2026/09/20 13:30:25 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst5632lb # [ 143.908759] niks3-server[1030]: 2026/09/20 13:30:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5633lb # [ 143.915357] niks3-server[1030]: 2026/09/20 13:30:25 INFO Signed narinfos id=42 count=15634lb # [ 143.922102] niks3-server[1030]: 2026/09/20 13:30:25 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls5635worker1 # [ 143.955228] nix-grpc-daemon[1452]: time=2026-09-20T13:30:25.558Z level=INFO msg="Upload complete. (350ms)"5636lb # [ 143.926178] niks3-server[1030]: 2026/09/20 13:30:25 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5637lb # [ 143.929963] niks3-server[1030]: 2026/09/20 13:30:25 INFO Completed upload id=425638lb # [ 143.932931] niks3-server[1030]: 2026/09/20 13:30:25 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo5639worker1 # [ 143.970523] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39808 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=4 outputs=15640worker1 # [ 143.990890] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:25Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=05641worker1 # [ 143.995389] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:25Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.3:50051 clients=15642worker1 # [ 143.999889] nix-daemon[832]: reaped child process 1577, status = succeeded5643worker1 # [ 144.030812] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398085644worker1 # [ 144.049423] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:398085645worker1 # [ 144.066191] nix-grpc-daemon[1452]: time=2026-09-20T13:30:25.669Z level=INFO msg="All 2 paths already cached"5646client # copying 1 paths to 'lb:50051'...5647worker1 # [ 144.084128] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:398085648client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...5649worker1 # [ 144.108679] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5650worker1 # [ 144.328998] nix-daemon[832]: accepted connection from pid 1603, user nix-grpc-daemon (trusted)5651worker1 # [ 144.352855] nix-daemon[832]: reaped child process 1606, status = succeeded5652worker1 # [ 144.537818] nix-daemon[832]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)5653worker1 # [ 144.560645] nix-daemon[832]: reaped child process 1611, status = succeeded5654lb # [ 144.543406] niks3-server[1030]: 2026/09/20 13:30:26 INFO Received uploads request method=POST path=/api/pending_closures5655worker1 # [ 144.584190] nix-grpc-daemon[1452]: time=2026-09-20T13:30:26.187Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5656worker1 # [ 144.585826] nix-grpc-daemon[1452]: time=2026-09-20T13:30:26.187Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"5657lb # [ 144.579363] niks3-server[1030]: 2026/09/20 13:30:26 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst5658worker1 # [ 144.625123] nix-grpc-daemon[1452]: time=2026-09-20T13:30:26.228Z level=INFO msg="Uploading 1 narinfos"5659lb # [ 144.596337] niks3-server[1030]: 2026/09/20 13:30:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5660lb # [ 144.608451] niks3-server[1030]: 2026/09/20 13:30:26 INFO Signed narinfos id=43 count=15661lb # [ 144.611224] niks3-server[1030]: 2026/09/20 13:30:26 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls5662lb # [ 144.623243] niks3-server[1030]: 2026/09/20 13:30:26 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5663lb # [ 144.630749] niks3-server[1030]: 2026/09/20 13:30:26 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo5664lb # [ 144.636068] niks3-server[1030]: 2026/09/20 13:30:26 INFO Completed upload id=435665worker1 # [ 144.665899] nix-grpc-daemon[1452]: time=2026-09-20T13:30:26.269Z level=INFO msg="Upload complete. (538ms)"5666worker1 # [ 144.675624] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39808 duration_s=0 paths=1 nar_bytes_in=7685667worker1 # [ 144.691871] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398085668worker1 # [ 144.699280] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5669worker1 # [ 144.705400] nix-daemon[832]: reaped child process 1601, status = succeeded5670client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...5671client # farm-top> node-a: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5672worker1 # [ 144.722131] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5673client # farm-top> LOG-farm-top-during-drain5674worker1 # [ 145.569196] nix-daemon[832]: reaped child process 1615, status = succeeded5675worker1 # [ 145.778737] nix-daemon[832]: accepted connection from pid 1630, user nix-grpc-daemon (trusted)5676worker1 # [ 145.801884] nix-daemon[832]: reaped child process 1633, status = succeeded5677worker1 # [ 145.835929] nix-grpc-daemon[1452]: time=2026-09-20T13:30:27.437Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5678worker1 # [ 145.837862] nix-grpc-daemon[1452]: time=2026-09-20T13:30:27.437Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"5679lb # [ 145.791903] niks3-server[1030]: 2026/09/20 13:30:27 INFO Received uploads request method=POST path=/api/pending_closures5680lb # [ 145.834179] niks3-server[1030]: 2026/09/20 13:30:27 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst5681lb # [ 145.852819] niks3-server[1030]: 2026/09/20 13:30:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5682lb # [ 145.868762] niks3-server[1030]: 2026/09/20 13:30:27 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv5683lb # [ 145.876125] niks3-server[1030]: 2026/09/20 13:30:27 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls5684lb # [ 145.888320] niks3-server[1030]: 2026/09/20 13:30:27 INFO Signed narinfos id=44 count=15685worker1 # [ 145.918829] nix-grpc-daemon[1452]: time=2026-09-20T13:30:27.522Z level=INFO msg="Uploading 1 narinfos"5686lb # [ 145.901396] niks3-server[1030]: 2026/09/20 13:30:27 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5687lb # [ 145.909497] niks3-server[1030]: 2026/09/20 13:30:27 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo5688lb # [ 145.925343] niks3-server[1030]: 2026/09/20 13:30:27 INFO Completed upload id=445689worker1 # [ 145.957981] nix-grpc-daemon[1452]: time=2026-09-20T13:30:27.561Z level=INFO msg="Upload complete. (424ms)"5690worker1 # [ 145.973618] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39808 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=5 outputs=15691worker1 # [ 145.994490] nix-daemon[832]: reaped child process 1613, status = succeeded5692client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 7.06 seconds)5693client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath5694client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.25 seconds)5695worker2: must succeed: pkill -f 'read -t [9]0 x'5696worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds)5697client: waiting for success: ! systemctl is-active sw5698worker2 # [ 146.555981] nix-daemon[847]: reaped child process 1565, status = succeeded5699worker2 # [ 146.748654] nix-daemon[847]: accepted connection from pid 1736, user nix-grpc-daemon (trusted)5700worker2 # [ 146.774896] nix-daemon[847]: reaped child process 1739, status = succeeded5701lb # [ 146.724539] niks3-server[1030]: 2026/09/20 13:30:28 INFO Received uploads request method=POST path=/api/pending_closures5702worker2 # [ 146.803351] nix-grpc-daemon[1453]: time=2026-09-20T13:30:27.397Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5703worker2 # [ 146.805413] nix-grpc-daemon[1453]: time=2026-09-20T13:30:27.398Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"5704lb # [ 146.784509] niks3-server[1030]: 2026/09/20 13:30:28 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv5705worker2 # [ 146.854585] nix-grpc-daemon[1453]: time=2026-09-20T13:30:27.449Z level=INFO msg="Uploading 1 narinfos"5706lb # [ 146.794937] niks3-server[1030]: 2026/09/20 13:30:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5707lb # [ 146.805892] niks3-server[1030]: 2026/09/20 13:30:28 INFO Signed narinfos id=45 count=15708lb # [ 146.810886] niks3-server[1030]: 2026/09/20 13:30:28 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5709lb # [ 146.816060] niks3-server[1030]: 2026/09/20 13:30:28 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls5710lb # [ 146.824295] niks3-server[1030]: 2026/09/20 13:30:28 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5711worker2 # [ 146.892252] nix-grpc-daemon[1453]: time=2026-09-20T13:30:27.488Z level=INFO msg="Upload complete. (367ms)"5712lb # [ 146.830428] niks3-server[1030]: 2026/09/20 13:30:28 INFO Completed upload id=455713lb # [ 146.833722] niks3-server[1030]: 2026/09/20 13:30:28 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo5714worker2 # [ 146.905015] nix-grpc-daemon[1345]: ts=2026-09-20T13:30:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50422 duration_s=13 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=2 outputs=15715worker2 # [ 146.920685] nix-daemon[847]: reaped child process 1563, status = succeeded5716client # [ 146.889268] systemd[1]: sw.service: Deactivated successfully.5717client # [ 146.894542] systemd[1]: sw.service: Consumed 189ms CPU time over 14.948s wall clock time, 36.9M memory peak, 8.6K incoming IP traffic, 8.9K outgoing IP traffic.5718worker2 # [ 147.185272] nix-grpc-daemon[1345]: ts=2026-09-20T13:30:27Z level=info event=signal_exit5719client: (finished: waiting for success: ! systemctl is-active sw, in 1.12 seconds)5720client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5721client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.05 seconds)5722worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5723worker2 # [ 147.594623] systemd[1]: Starting scheduler-token.service...5724worker2 # [ 147.682523] systemd[1]: scheduler-token.service: Deactivated successfully.5725worker2 # [ 147.685814] systemd[1]: Finished scheduler-token.service.5726worker2 # [ 147.686820] systemd[1]: scheduler-token.service: Consumed 31ms CPU time over 90ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5727worker1 # [ 148.389282] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:29Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:600205728worker2 # [ 148.425265] nix-grpc-daemon[1345]: ts=2026-09-20T13:30:29Z level=info event=scheduler_restarting5729worker1 # [ 148.394536] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:29Z level=info event=worker_gone addr=192.168.1.4:500515730worker2 # [ 148.445747] nix-grpc-daemon[1345]: ts=2026-09-20T13:30:29Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5731worker2 # [ 148.466520] nix-grpc-daemon[1345]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5732worker2 # [ 148.480349] nix-grpc-daemon[1345]: E0000 00:00:1789911029.062208 1388 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true5733worker2 # [ 148.484532] nix-grpc-daemon[1345]: E0000 00:00:1789911029.062451 1388 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5734worker2 # [ 148.490009] nix-daemon[847]: reaped child process 1401, status = succeeded5735worker2 # [ 149.666532] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5736worker2 # [ 149.669866] systemd[1]: nix-grpc-daemon.service: Consumed 1.315s CPU time over 46.714s wall clock time, 31.2M memory peak, 26.3K incoming IP traffic, 44.2K outgoing IP traffic.5737worker2 # [ 149.680645] systemd[1]: Starting Nix worker-protocol over gRPC...5738worker2 # [ 149.853701] nix-grpc-daemon[1756]: ts=2026-09-20T13:30:30Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5739worker2 # [ 149.856956] nix-grpc-daemon[1756]: ts=2026-09-20T13:30:30Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5740worker2 # [ 149.861402] nix-grpc-daemon[1756]: ts=2026-09-20T13:30:30Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15741worker2 # [ 149.870785] nix-grpc-daemon[1756]: ts=2026-09-20T13:30:30Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5742worker2 # [ 149.878682] systemd[1]: Started Nix worker-protocol over gRPC.5743worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.35 seconds)5744lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5745lb: must succeed: curl -sf localhost:9901/clusters5746worker2 # [ 149.901493] nix-grpc-daemon[1756]: ts=2026-09-20T13:30:30Z level=info event=scheduler_connected addr=lb:500515747worker1 # [ 149.872707] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:31Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:600205748worker1 # [ 149.872902] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:31Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05749lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds)5750lb: must succeed: curl -sf localhost:9901/clusters5751lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5752lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.18 seconds)5753lb: must succeed: curl -sf localhost:9901/clusters5754lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5755worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5756worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds)5757(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 19.28 seconds)5758subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does5759client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&15760lb # [ 151.341226] envoy[915]: conn peer=[2001:db8:1::1]:55050 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9599 tx=3893 ms=67135761worker1 # [ 151.467463] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:398085762worker1 # [ 151.479102] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:398085763worker1 # [ 151.535854] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:33Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=05764worker1 # [ 151.544478] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:33Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=15765worker1 # [ 151.550802] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:33Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=05766worker1 # [ 151.556384] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:33Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=05767worker1 # [ 151.582877] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398085768worker1 # [ 151.602246] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:398085769worker1 # [ 151.620272] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:398085770worker1 # [ 151.637322] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5771worker1 # [ 151.868999] nix-daemon[832]: accepted connection from pid 1642, user nix-grpc-daemon (trusted)5772worker1 # [ 151.893580] nix-daemon[832]: reaped child process 1645, status = succeeded5773lb # [ 151.346516] envoy[915]: conn peer=[2001:db8:1::1]:55044 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2939 tx=1353 ms=146375774lb # [ 151.346661] envoy[915]: conn peer=[2001:db8:1::4]:55012 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=8488 tx=738 ms=452555775worker1 # [ 152.109026] nix-daemon[832]: accepted connection from pid 1647, user nix-grpc-daemon (trusted)5776worker1 # [ 152.132652] nix-daemon[832]: reaped child process 1650, status = succeeded5777lb # [ 152.116256] niks3-server[1030]: 2026/09/20 13:30:33 INFO Received uploads request method=POST path=/api/pending_closures5778worker1 # [ 152.157622] nix-grpc-daemon[1452]: time=2026-09-20T13:30:33.760Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5779worker1 # [ 152.159279] nix-grpc-daemon[1452]: time=2026-09-20T13:30:33.760Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"5780lb # [ 152.151834] niks3-server[1030]: 2026/09/20 13:30:33 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst5781lb # [ 152.167101] niks3-server[1030]: 2026/09/20 13:30:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5782worker1 # [ 152.204590] nix-grpc-daemon[1452]: time=2026-09-20T13:30:33.807Z level=INFO msg="Uploading 1 narinfos"5783lb # [ 152.179735] niks3-server[1030]: 2026/09/20 13:30:33 INFO Signed narinfos id=46 count=15784lb # [ 152.189130] niks3-server[1030]: 2026/09/20 13:30:33 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls5785worker1 # [ 152.236251] nix-grpc-daemon[1452]: time=2026-09-20T13:30:33.839Z level=INFO msg="Upload complete. (579ms)"5786lb # [ 152.208222] niks3-server[1030]: 2026/09/20 13:30:33 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5787lb # [ 152.212771] niks3-server[1030]: 2026/09/20 13:30:33 INFO Completed upload id=465788lb # [ 152.217083] niks3-server[1030]: 2026/09/20 13:30:33 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo5789worker1 # [ 152.247255] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39808 duration_s=0 paths=1 nar_bytes_in=5125790worker1 # [ 152.256461] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398085791worker1 # [ 152.268907] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5792worker1 # [ 152.274770] nix-daemon[832]: reaped child process 1640, status = succeeded5793worker1 # [ 152.291696] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5794worker1 # [ 153.124900] nix-daemon[832]: reaped child process 1654, status = succeeded5795worker1 # [ 153.300943] nix-daemon[832]: accepted connection from pid 1669, user nix-grpc-daemon (trusted)5796worker1 # [ 153.326331] nix-daemon[832]: reaped child process 1672, status = succeeded5797lb # [ 153.309807] niks3-server[1030]: 2026/09/20 13:30:34 INFO Received uploads request method=POST path=/api/pending_closures5798worker1 # [ 153.350239] nix-grpc-daemon[1452]: time=2026-09-20T13:30:34.953Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5799worker1 # [ 153.355255] nix-grpc-daemon[1452]: time=2026-09-20T13:30:34.955Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"5800lb # [ 153.354097] niks3-server[1030]: 2026/09/20 13:30:34 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv5801lb # [ 153.366823] niks3-server[1030]: 2026/09/20 13:30:34 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst5802lb # [ 153.379101] niks3-server[1030]: 2026/09/20 13:30:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5803lb # [ 153.386260] niks3-server[1030]: 2026/09/20 13:30:34 INFO Signed narinfos id=47 count=15804worker1 # [ 153.416323] nix-grpc-daemon[1452]: time=2026-09-20T13:30:35.019Z level=INFO msg="Uploading 1 narinfos"5805lb # [ 153.392543] niks3-server[1030]: 2026/09/20 13:30:34 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls5806lb # [ 153.404183] niks3-server[1030]: 2026/09/20 13:30:34 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5807worker1 # [ 153.441642] nix-grpc-daemon[1452]: time=2026-09-20T13:30:35.045Z level=INFO msg="Upload complete. (334ms)"5808lb # [ 153.413836] niks3-server[1030]: 2026/09/20 13:30:35 INFO Completed upload id=475809lb # [ 153.418936] niks3-server[1030]: 2026/09/20 13:30:35 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo5810worker1 # [ 153.458939] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39808 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=6 outputs=15811worker1 # [ 153.480465] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:35Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=15812worker1 # [ 153.485739] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398085813worker1 # [ 153.493415] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:35Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=05814worker1 # [ 153.499240] nix-daemon[832]: reaped child process 1652, status = succeeded5815worker1 # [ 153.501228] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:398085816worker1 # [ 153.511087] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:398085817worker1 # [ 153.522631] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5818worker1 # [ 153.723421] nix-daemon[832]: accepted connection from pid 1678, user nix-grpc-daemon (trusted)5819worker1 # [ 153.744705] nix-daemon[832]: reaped child process 1681, status = succeeded5820worker1 # [ 153.935848] nix-daemon[832]: accepted connection from pid 1683, user nix-grpc-daemon (trusted)5821worker1 # [ 153.956112] nix-daemon[832]: reaped child process 1686, status = succeeded5822lb # [ 153.943232] niks3-server[1030]: 2026/09/20 13:30:35 INFO Received uploads request method=POST path=/api/pending_closures5823worker1 # [ 153.982809] nix-grpc-daemon[1452]: time=2026-09-20T13:30:35.585Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5824worker1 # [ 153.984576] nix-grpc-daemon[1452]: time=2026-09-20T13:30:35.586Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"5825lb # [ 153.973376] niks3-server[1030]: 2026/09/20 13:30:35 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst5826lb # [ 153.990204] niks3-server[1030]: 2026/09/20 13:30:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5827worker1 # [ 154.026477] nix-grpc-daemon[1452]: time=2026-09-20T13:30:35.629Z level=INFO msg="Uploading 1 narinfos"5828lb # [ 154.004512] niks3-server[1030]: 2026/09/20 13:30:35 INFO Signed narinfos id=48 count=15829lb # [ 154.011936] niks3-server[1030]: 2026/09/20 13:30:35 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls5830lb # [ 154.023596] niks3-server[1030]: 2026/09/20 13:30:35 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5831lb # [ 154.032405] niks3-server[1030]: 2026/09/20 13:30:35 INFO Completed upload id=485832worker1 # [ 154.062208] nix-grpc-daemon[1452]: time=2026-09-20T13:30:35.665Z level=INFO msg="Upload complete. (527ms)"5833lb # [ 154.035761] niks3-server[1030]: 2026/09/20 13:30:35 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo5834worker1 # [ 154.072441] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39808 duration_s=0 paths=1 nar_bytes_in=5125835worker1 # [ 154.088358] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398085836worker1 # [ 154.095644] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5837worker1 # [ 154.101927] nix-daemon[832]: reaped child process 1676, status = succeeded5838worker1 # [ 154.119058] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5839worker1 # [ 155.558124] nix-daemon[832]: reaped child process 1690, status = succeeded5840worker1 # [ 155.745354] nix-daemon[832]: accepted connection from pid 1705, user nix-grpc-daemon (trusted)5841worker1 # [ 155.768166] nix-daemon[832]: reaped child process 1708, status = succeeded5842lb # [ 155.754548] niks3-server[1030]: 2026/09/20 13:30:37 INFO Received uploads request method=POST path=/api/pending_closures5843worker1 # [ 155.792517] nix-grpc-daemon[1452]: time=2026-09-20T13:30:37.395Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5844worker1 # [ 155.799861] nix-grpc-daemon[1452]: time=2026-09-20T13:30:37.398Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"5845lb # [ 155.793564] niks3-server[1030]: 2026/09/20 13:30:37 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv5846lb # [ 155.812986] niks3-server[1030]: 2026/09/20 13:30:37 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst5847lb # [ 155.825049] niks3-server[1030]: 2026/09/20 13:30:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5848worker1 # [ 155.859534] nix-grpc-daemon[1452]: time=2026-09-20T13:30:37.462Z level=INFO msg="Uploading 1 narinfos"5849lb # [ 155.834888] niks3-server[1030]: 2026/09/20 13:30:37 INFO Signed narinfos id=49 count=15850lb # [ 155.840660] niks3-server[1030]: 2026/09/20 13:30:37 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls5851lb # [ 155.849411] niks3-server[1030]: 2026/09/20 13:30:37 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5852lb # [ 155.858689] niks3-server[1030]: 2026/09/20 13:30:37 INFO Completed upload id=495853worker1 # [ 155.888591] nix-grpc-daemon[1452]: time=2026-09-20T13:30:37.492Z level=INFO msg="Upload complete. (356ms)"5854lb # [ 155.861939] niks3-server[1030]: 2026/09/20 13:30:37 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo5855worker1 # [ 155.912449] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39808 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=7 outputs=15856worker1 # [ 155.922936] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:37Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=15857worker1 # [ 155.935204] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398085858worker1 # [ 155.942087] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:37Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=05859worker1 # [ 155.948178] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:398085860worker1 # [ 155.952329] nix-daemon[832]: reaped child process 1688, status = succeeded5861worker1 # [ 155.957588] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:398085862worker1 # [ 155.971526] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5863worker1 # [ 156.176219] nix-daemon[832]: accepted connection from pid 1714, user nix-grpc-daemon (trusted)5864worker1 # [ 156.198391] nix-daemon[832]: reaped child process 1717, status = succeeded5865worker1 # [ 156.386131] nix-daemon[832]: accepted connection from pid 1719, user nix-grpc-daemon (trusted)5866worker1 # [ 156.408681] nix-daemon[832]: reaped child process 1722, status = succeeded5867lb # [ 156.395765] niks3-server[1030]: 2026/09/20 13:30:37 INFO Received uploads request method=POST path=/api/pending_closures5868worker1 # [ 156.434478] nix-grpc-daemon[1452]: time=2026-09-20T13:30:38.037Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5869worker1 # [ 156.436276] nix-grpc-daemon[1452]: time=2026-09-20T13:30:38.037Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"5870lb # [ 156.423821] niks3-server[1030]: 2026/09/20 13:30:38 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst5871worker1 # [ 156.468726] nix-grpc-daemon[1452]: time=2026-09-20T13:30:38.072Z level=INFO msg="Uploading 1 narinfos"5872lb # [ 156.438674] niks3-server[1030]: 2026/09/20 13:30:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5873lb # [ 156.448551] niks3-server[1030]: 2026/09/20 13:30:38 INFO Signed narinfos id=50 count=15874lb # [ 156.450933] niks3-server[1030]: 2026/09/20 13:30:38 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls5875lb # [ 156.464635] niks3-server[1030]: 2026/09/20 13:30:38 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5876lb # [ 156.473240] niks3-server[1030]: 2026/09/20 13:30:38 INFO Completed upload id=505877worker1 # [ 156.502824] nix-grpc-daemon[1452]: time=2026-09-20T13:30:38.106Z level=INFO msg="Upload complete. (522ms)"5878lb # [ 156.476381] niks3-server[1030]: 2026/09/20 13:30:38 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo5879worker1 # [ 156.512436] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39808 duration_s=0 paths=1 nar_bytes_in=5125880worker1 # [ 156.521129] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398085881worker1 # [ 156.531803] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5882worker1 # [ 156.537122] nix-daemon[832]: reaped child process 1712, status = succeeded5883worker1 # [ 156.551682] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5884worker1 # [ 157.996461] nix-daemon[832]: reaped child process 1726, status = succeeded5885worker1 # [ 158.202028] nix-daemon[832]: accepted connection from pid 1741, user nix-grpc-daemon (trusted)5886worker1 # [ 158.226554] nix-daemon[832]: reaped child process 1744, status = succeeded5887lb # [ 158.211590] niks3-server[1030]: 2026/09/20 13:30:39 INFO Received uploads request method=POST path=/api/pending_closures5888worker1 # [ 158.260639] nix-grpc-daemon[1452]: time=2026-09-20T13:30:39.862Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5889worker1 # [ 158.262321] nix-grpc-daemon[1452]: time=2026-09-20T13:30:39.862Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"5890lb # [ 158.264118] niks3-server[1030]: 2026/09/20 13:30:39 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst5891worker1 # [ 158.307041] nix-grpc-daemon[1452]: time=2026-09-20T13:30:39.910Z level=INFO msg="Uploading 1 narinfos"5892lb # [ 158.277289] niks3-server[1030]: 2026/09/20 13:30:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign5893lb # [ 158.288578] niks3-server[1030]: 2026/09/20 13:30:39 INFO Signed narinfos id=51 count=15894lb # [ 158.294568] niks3-server[1030]: 2026/09/20 13:30:39 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv5895lb # [ 158.303537] niks3-server[1030]: 2026/09/20 13:30:39 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls5896lb # [ 158.311617] niks3-server[1030]: 2026/09/20 13:30:39 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete5897lb # [ 158.319923] niks3-server[1030]: 2026/09/20 13:30:39 INFO Completed upload id=515898lb # [ 158.322876] niks3-server[1030]: 2026/09/20 13:30:39 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo5899worker1 # [ 158.349898] nix-grpc-daemon[1452]: time=2026-09-20T13:30:39.953Z level=INFO msg="Upload complete. (386ms)"5900worker1 # [ 158.370912] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39808 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=8 outputs=15901worker1 # [ 158.388315] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:39Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=15902worker1 # [ 158.400187] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398085903worker1 # [ 158.405851] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:39Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=05904worker1 # [ 158.412344] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:398085905worker1 # [ 158.415369] nix-daemon[832]: reaped child process 1724, status = succeeded5906worker1 # [ 158.418534] nix-grpc-daemon[1452]: time=2026-09-20T13:30:40.021Z level=INFO msg="All 1 paths already cached"5907worker1 # [ 158.426758] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:398085908worker1 # [ 158.437065] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5909worker1 # [ 158.651015] nix-daemon[832]: accepted connection from pid 1750, user nix-grpc-daemon (trusted)5910worker1 # [ 158.674956] nix-daemon[832]: reaped child process 1753, status = succeeded5911worker1 # [ 158.863261] nix-daemon[832]: accepted connection from pid 1755, user nix-grpc-daemon (trusted)5912worker1 # [ 158.889035] nix-daemon[832]: reaped child process 1758, status = succeeded5913lb # [ 158.871447] niks3-server[1030]: 2026/09/20 13:30:40 INFO Received uploads request method=POST path=/api/pending_closures5914worker1 # [ 158.918599] nix-grpc-daemon[1452]: time=2026-09-20T13:30:40.521Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5915worker1 # [ 158.920523] nix-grpc-daemon[1452]: time=2026-09-20T13:30:40.521Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"5916lb # [ 158.910967] niks3-server[1030]: 2026/09/20 13:30:40 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst5917lb # [ 158.928384] niks3-server[1030]: 2026/09/20 13:30:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign5918worker1 # [ 158.967646] nix-grpc-daemon[1452]: time=2026-09-20T13:30:40.571Z level=INFO msg="Uploading 1 narinfos"5919lb # [ 158.943624] niks3-server[1030]: 2026/09/20 13:30:40 INFO Signed narinfos id=52 count=15920lb # [ 158.949880] niks3-server[1030]: 2026/09/20 13:30:40 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls5921lb # [ 158.957073] niks3-server[1030]: 2026/09/20 13:30:40 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete5922lb # [ 158.967917] niks3-server[1030]: 2026/09/20 13:30:40 INFO Completed upload id=525923worker1 # [ 158.997604] nix-grpc-daemon[1452]: time=2026-09-20T13:30:40.601Z level=INFO msg="Upload complete. (547ms)"5924lb # [ 158.972261] niks3-server[1030]: 2026/09/20 13:30:40 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo5925worker1 # [ 159.004412] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39808 duration_s=0 paths=1 nar_bytes_in=6245926worker1 # [ 159.016444] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398085927worker1 # [ 159.019814] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5928worker1 # [ 159.029348] nix-daemon[832]: reaped child process 1748, status = succeeded5929worker1 # [ 159.039097] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5930worker1 # [ 160.672608] nix-daemon[832]: reaped child process 1762, status = succeeded5931worker1 # [ 160.863599] nix-daemon[832]: accepted connection from pid 1777, user nix-grpc-daemon (trusted)5932worker1 # [ 160.889776] nix-daemon[832]: reaped child process 1780, status = succeeded5933lb # [ 160.879443] niks3-server[1030]: 2026/09/20 13:30:42 INFO Received uploads request method=POST path=/api/pending_closures5934worker1 # [ 160.924658] nix-grpc-daemon[1452]: time=2026-09-20T13:30:42.523Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5935worker1 # [ 160.926262] nix-grpc-daemon[1452]: time=2026-09-20T13:30:42.523Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"5936lb # [ 160.916201] niks3-server[1030]: 2026/09/20 13:30:42 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv5937lb # [ 160.926213] niks3-server[1030]: 2026/09/20 13:30:42 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst5938lb # [ 160.937105] niks3-server[1030]: 2026/09/20 13:30:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign5939lb # [ 160.946114] niks3-server[1030]: 2026/09/20 13:30:42 INFO Signed narinfos id=53 count=15940worker1 # [ 160.976963] nix-grpc-daemon[1452]: time=2026-09-20T13:30:42.580Z level=INFO msg="Uploading 1 narinfos"5941lb # [ 160.951108] niks3-server[1030]: 2026/09/20 13:30:42 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls5942lb # [ 160.965925] niks3-server[1030]: 2026/09/20 13:30:42 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete5943lb # [ 160.973159] niks3-server[1030]: 2026/09/20 13:30:42 INFO Completed upload id=535944worker1 # [ 161.003313] nix-grpc-daemon[1452]: time=2026-09-20T13:30:42.606Z level=INFO msg="Upload complete. (346ms)"5945lb # [ 160.977056] niks3-server[1030]: 2026/09/20 13:30:42 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo5946worker1 # [ 161.008792] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39808 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=9 outputs=15947worker1 # [ 161.020753] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:42Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=15948worker1 # [ 161.028817] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:42Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=05949worker1 # [ 161.030997] nix-daemon[832]: reaped child process 1760, status = succeeded5950worker1 # [ 161.066493] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398085951worker1 # [ 161.079692] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:398085952worker1 # [ 161.092376] nix-grpc-daemon[1452]: time=2026-09-20T13:30:42.695Z level=INFO msg="All 1 paths already cached"5953worker1 # [ 161.099914] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:398085954worker1 # [ 161.110198] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5955worker1 # [ 161.330159] nix-daemon[832]: accepted connection from pid 1786, user nix-grpc-daemon (trusted)5956worker1 # [ 161.358056] nix-daemon[832]: reaped child process 1789, status = succeeded5957worker1 # [ 161.572000] nix-daemon[832]: accepted connection from pid 1791, user nix-grpc-daemon (trusted)5958worker1 # [ 161.599073] nix-daemon[832]: reaped child process 1794, status = succeeded5959lb # [ 161.581935] niks3-server[1030]: 2026/09/20 13:30:43 INFO Received uploads request method=POST path=/api/pending_closures5960worker1 # [ 161.619294] nix-grpc-daemon[1452]: time=2026-09-20T13:30:43.222Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5961worker1 # [ 161.621280] nix-grpc-daemon[1452]: time=2026-09-20T13:30:43.224Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"5962lb # [ 161.622131] niks3-server[1030]: 2026/09/20 13:30:43 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst5963worker1 # [ 161.676209] nix-grpc-daemon[1452]: time=2026-09-20T13:30:43.279Z level=INFO msg="Uploading 1 narinfos"5964lb # [ 161.640156] niks3-server[1030]: 2026/09/20 13:30:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign5965lb # [ 161.659112] niks3-server[1030]: 2026/09/20 13:30:43 INFO Signed narinfos id=54 count=15966lb # [ 161.666677] niks3-server[1030]: 2026/09/20 13:30:43 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls5967lb # [ 161.677807] niks3-server[1030]: 2026/09/20 13:30:43 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete5968worker1 # [ 161.713920] nix-grpc-daemon[1452]: time=2026-09-20T13:30:43.317Z level=INFO msg="Upload complete. (589ms)"5969lb # [ 161.687120] niks3-server[1030]: 2026/09/20 13:30:43 INFO Completed upload id=545970worker1 # [ 161.720415] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39808 duration_s=0 paths=1 nar_bytes_in=6245971lb # [ 161.693272] niks3-server[1030]: 2026/09/20 13:30:43 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo5972worker1 # [ 161.731250] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398085973worker1 # [ 161.735618] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5974worker1 # [ 161.740081] nix-daemon[832]: reaped child process 1784, status = succeeded5975worker1 # [ 161.752240] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)5976worker1 # [ 163.001771] nix-daemon[832]: reaped child process 1798, status = succeeded5977worker1 # [ 163.213532] nix-daemon[832]: accepted connection from pid 1813, user nix-grpc-daemon (trusted)5978worker1 # [ 163.236323] nix-daemon[832]: reaped child process 1816, status = succeeded5979lb # [ 163.219511] niks3-server[1030]: 2026/09/20 13:30:44 INFO Received uploads request method=POST path=/api/pending_closures5980worker1 # [ 163.263135] nix-grpc-daemon[1452]: time=2026-09-20T13:30:44.865Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5981worker1 # [ 163.264885] nix-grpc-daemon[1452]: time=2026-09-20T13:30:44.865Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"5982lb # [ 163.275882] niks3-server[1030]: 2026/09/20 13:30:44 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst5983lb # [ 163.288391] niks3-server[1030]: 2026/09/20 13:30:44 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv5984lb # [ 163.300291] niks3-server[1030]: 2026/09/20 13:30:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign5985worker1 # [ 163.335429] nix-grpc-daemon[1452]: time=2026-09-20T13:30:44.938Z level=INFO msg="Uploading 1 narinfos"5986lb # [ 163.309221] niks3-server[1030]: 2026/09/20 13:30:44 INFO Signed narinfos id=55 count=15987lb # [ 163.314619] niks3-server[1030]: 2026/09/20 13:30:44 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls5988lb # [ 163.323980] niks3-server[1030]: 2026/09/20 13:30:44 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete5989lb # [ 163.332491] niks3-server[1030]: 2026/09/20 13:30:44 INFO Completed upload id=555990worker1 # [ 163.359666] nix-grpc-daemon[1452]: time=2026-09-20T13:30:44.963Z level=INFO msg="Upload complete. (397ms)"5991lb # [ 163.336601] niks3-server[1030]: 2026/09/20 13:30:44 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo5992worker1 # [ 163.377447] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39808 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=10 outputs=15993worker1 # [ 163.396349] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:44Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=15994worker1 # [ 163.403421] nix-daemon[832]: reaped child process 1796, status = succeeded5995worker1 # [ 163.421110] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398085996worker1 # [ 163.438845] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:398085997worker1 # [ 163.446567] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:45Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=05998worker1 # [ 163.453488] nix-grpc-daemon[1452]: time=2026-09-20T13:30:45.056Z level=INFO msg="All 1 paths already cached"5999worker1 # [ 163.459798] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:398086000worker1 # [ 163.479643] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)6001worker1 # [ 163.688983] nix-daemon[832]: accepted connection from pid 1822, user nix-grpc-daemon (trusted)6002worker1 # [ 163.713328] nix-daemon[832]: reaped child process 1825, status = succeeded6003worker1 # [ 163.915166] nix-daemon[832]: accepted connection from pid 1827, user nix-grpc-daemon (trusted)6004worker1 # [ 163.936761] nix-daemon[832]: reaped child process 1830, status = succeeded6005lb # [ 163.922583] niks3-server[1030]: 2026/09/20 13:30:45 INFO Received uploads request method=POST path=/api/pending_closures6006worker1 # [ 163.962952] nix-grpc-daemon[1452]: time=2026-09-20T13:30:45.566Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6007worker1 # [ 163.964724] nix-grpc-daemon[1452]: time=2026-09-20T13:30:45.566Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"6008lb # [ 163.956847] niks3-server[1030]: 2026/09/20 13:30:45 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst6009lb # [ 163.967479] niks3-server[1030]: 2026/09/20 13:30:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6010worker1 # [ 164.003564] nix-grpc-daemon[1452]: time=2026-09-20T13:30:45.606Z level=INFO msg="Uploading 1 narinfos"6011lb # [ 163.980371] niks3-server[1030]: 2026/09/20 13:30:45 INFO Signed narinfos id=56 count=16012lb # [ 163.987740] niks3-server[1030]: 2026/09/20 13:30:45 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls6013lb # [ 164.000828] niks3-server[1030]: 2026/09/20 13:30:45 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6014lb # [ 164.007457] niks3-server[1030]: 2026/09/20 13:30:45 INFO Completed upload id=566015lb # [ 164.010940] niks3-server[1030]: 2026/09/20 13:30:45 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo6016worker1 # [ 164.037351] nix-grpc-daemon[1452]: time=2026-09-20T13:30:45.640Z level=INFO msg="Upload complete. (541ms)"6017worker1 # [ 164.047402] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39808 duration_s=0 paths=1 nar_bytes_in=6246018worker1 # [ 164.057243] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398086019worker1 # [ 164.070604] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)6020worker1 # [ 164.076311] nix-daemon[832]: reaped child process 1820, status = succeeded6021worker1 # [ 164.092992] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)6022worker1 # [ 165.345276] nix-daemon[832]: reaped child process 1834, status = succeeded6023worker1 # [ 165.542513] nix-daemon[832]: accepted connection from pid 1849, user nix-grpc-daemon (trusted)6024worker1 # [ 165.568586] nix-daemon[832]: reaped child process 1852, status = succeeded6025lb # [ 165.552973] niks3-server[1030]: 2026/09/20 13:30:47 INFO Received uploads request method=POST path=/api/pending_closures6026worker1 # [ 165.599446] nix-grpc-daemon[1452]: time=2026-09-20T13:30:47.200Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6027worker1 # [ 165.601470] nix-grpc-daemon[1452]: time=2026-09-20T13:30:47.200Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"6028lb # [ 165.600616] niks3-server[1030]: 2026/09/20 13:30:47 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv6029lb # [ 165.612259] niks3-server[1030]: 2026/09/20 13:30:47 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst6030lb # [ 165.623871] niks3-server[1030]: 2026/09/20 13:30:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6031worker1 # [ 165.660285] nix-grpc-daemon[1452]: time=2026-09-20T13:30:47.263Z level=INFO msg="Uploading 1 narinfos"6032lb # [ 165.630220] niks3-server[1030]: 2026/09/20 13:30:47 INFO Signed narinfos id=57 count=16033lb # [ 165.634991] niks3-server[1030]: 2026/09/20 13:30:47 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls6034lb # [ 165.650176] niks3-server[1030]: 2026/09/20 13:30:47 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6035lb # [ 165.659718] niks3-server[1030]: 2026/09/20 13:30:47 INFO Completed upload id=576036worker1 # [ 165.689762] nix-grpc-daemon[1452]: time=2026-09-20T13:30:47.293Z level=INFO msg="Upload complete. (384ms)"6037lb # [ 165.665530] niks3-server[1030]: 2026/09/20 13:30:47 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo6038worker1 # [ 165.709291] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39808 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=11 outputs=16039worker1 # [ 165.737320] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:47Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=16040worker1 # [ 165.742348] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398086041worker1 # [ 165.749644] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:47Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=06042worker1 # [ 165.756261] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:398086043worker1 # [ 165.760593] nix-daemon[832]: reaped child process 1832, status = succeeded6044worker1 # [ 165.765182] nix-grpc-daemon[1452]: time=2026-09-20T13:30:47.367Z level=INFO msg="All 2 paths already cached"6045worker1 # [ 165.771220] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:398086046worker1 # [ 165.784513] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)6047worker1 # [ 165.987219] nix-daemon[832]: accepted connection from pid 1858, user nix-grpc-daemon (trusted)6048worker1 # [ 166.012164] nix-daemon[832]: reaped child process 1861, status = succeeded6049worker1 # [ 166.204736] nix-daemon[832]: accepted connection from pid 1863, user nix-grpc-daemon (trusted)6050worker1 # [ 166.228975] nix-daemon[832]: reaped child process 1866, status = succeeded6051lb # [ 166.209709] niks3-server[1030]: 2026/09/20 13:30:47 INFO Received uploads request method=POST path=/api/pending_closures6052worker1 # [ 166.250829] nix-grpc-daemon[1452]: time=2026-09-20T13:30:47.853Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6053worker1 # [ 166.252774] nix-grpc-daemon[1452]: time=2026-09-20T13:30:47.854Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"6054lb # [ 166.247197] niks3-server[1030]: 2026/09/20 13:30:47 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst6055worker1 # [ 166.291446] nix-grpc-daemon[1452]: time=2026-09-20T13:30:47.894Z level=INFO msg="Uploading 1 narinfos"6056lb # [ 166.263460] niks3-server[1030]: 2026/09/20 13:30:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6057lb # [ 166.274500] niks3-server[1030]: 2026/09/20 13:30:47 INFO Signed narinfos id=58 count=16058lb # [ 166.280997] niks3-server[1030]: 2026/09/20 13:30:47 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls6059lb # [ 166.292226] niks3-server[1030]: 2026/09/20 13:30:47 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6060lb # [ 166.300975] niks3-server[1030]: 2026/09/20 13:30:47 INFO Completed upload id=586061worker1 # [ 166.330981] nix-grpc-daemon[1452]: time=2026-09-20T13:30:47.934Z level=INFO msg="Upload complete. (531ms)"6062lb # [ 166.304215] niks3-server[1030]: 2026/09/20 13:30:47 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo6063worker1 # [ 166.340519] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39808 duration_s=0 paths=1 nar_bytes_in=7526064worker1 # [ 166.356708] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398086065worker1 # [ 166.364712] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)6066worker1 # [ 166.371077] nix-daemon[832]: reaped child process 1856, status = succeeded6067worker1 # [ 166.387851] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)6068worker1 # [ 167.425562] nix-daemon[832]: reaped child process 1870, status = succeeded6069worker1 # [ 167.612423] nix-daemon[832]: accepted connection from pid 1885, user nix-grpc-daemon (trusted)6070worker1 # [ 167.638255] nix-daemon[832]: reaped child process 1888, status = succeeded6071lb # [ 167.623993] niks3-server[1030]: 2026/09/20 13:30:49 INFO Received uploads request method=POST path=/api/pending_closures6072worker1 # [ 167.665036] nix-grpc-daemon[1452]: time=2026-09-20T13:30:49.268Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6073worker1 # [ 167.668274] nix-grpc-daemon[1452]: time=2026-09-20T13:30:49.270Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"6074lb # [ 167.672441] niks3-server[1030]: 2026/09/20 13:30:49 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv6075lb # [ 167.686466] niks3-server[1030]: 2026/09/20 13:30:49 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst6076lb # [ 167.699611] niks3-server[1030]: 2026/09/20 13:30:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6077worker1 # [ 167.735906] nix-grpc-daemon[1452]: time=2026-09-20T13:30:49.339Z level=INFO msg="Uploading 1 narinfos"6078lb # [ 167.706761] niks3-server[1030]: 2026/09/20 13:30:49 INFO Signed narinfos id=59 count=16079lb # [ 167.713316] niks3-server[1030]: 2026/09/20 13:30:49 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls6080lb # [ 167.725741] niks3-server[1030]: 2026/09/20 13:30:49 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6081lb # [ 167.735660] niks3-server[1030]: 2026/09/20 13:30:49 INFO Completed upload id=596082worker1 # [ 167.765791] nix-grpc-daemon[1452]: time=2026-09-20T13:30:49.369Z level=INFO msg="Upload complete. (366ms)"6083lb # [ 167.739056] niks3-server[1030]: 2026/09/20 13:30:49 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo6084worker1 # [ 167.781214] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39808 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=12 outputs=16085worker1 # [ 167.796654] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:49Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=16086worker1 # [ 167.800673] nix-daemon[832]: reaped child process 1868, status = succeeded6087worker1 # [ 167.823288] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398086088worker1 # [ 167.841472] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:398086089worker1 # [ 167.858397] nix-grpc-daemon[1452]: time=2026-09-20T13:30:49.461Z level=INFO msg="All 2 paths already cached"6090worker1 # [ 167.869400] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:398086091worker1 # [ 167.883665] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)6092worker1 # [ 168.107122] nix-daemon[832]: accepted connection from pid 1892, user nix-grpc-daemon (trusted)6093worker1 # [ 168.130123] nix-daemon[832]: reaped child process 1895, status = succeeded6094worker1 # [ 168.329902] nix-daemon[832]: accepted connection from pid 1897, user nix-grpc-daemon (trusted)6095worker1 # [ 168.352859] nix-daemon[832]: reaped child process 1900, status = succeeded6096lb # [ 168.334305] niks3-server[1030]: 2026/09/20 13:30:49 INFO Received uploads request method=POST path=/api/pending_closures6097worker1 # [ 168.404411] nix-grpc-daemon[1452]: time=2026-09-20T13:30:50.007Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6098worker1 # [ 168.406258] nix-grpc-daemon[1452]: time=2026-09-20T13:30:50.007Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"6099lb # [ 168.398887] niks3-server[1030]: 2026/09/20 13:30:49 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst6100lb # [ 168.417241] niks3-server[1030]: 2026/09/20 13:30:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6101worker1 # [ 168.453457] nix-grpc-daemon[1452]: time=2026-09-20T13:30:50.056Z level=INFO msg="Uploading 1 narinfos"6102lb # [ 168.430676] niks3-server[1030]: 2026/09/20 13:30:50 INFO Signed narinfos id=60 count=16103lb # [ 168.438116] niks3-server[1030]: 2026/09/20 13:30:50 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls6104lb # [ 168.447983] niks3-server[1030]: 2026/09/20 13:30:50 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6105worker1 # [ 168.486126] nix-grpc-daemon[1452]: time=2026-09-20T13:30:50.089Z level=INFO msg="Upload complete. (584ms)"6106lb # [ 168.456529] niks3-server[1030]: 2026/09/20 13:30:50 INFO Completed upload id=606107worker1 # [ 168.492202] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39808 duration_s=0 paths=1 nar_bytes_in=7526108lb # [ 168.460992] niks3-server[1030]: 2026/09/20 13:30:50 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo6109worker1 # [ 168.502549] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398086110worker1 # [ 168.509232] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)6111worker1 # [ 168.513402] nix-daemon[832]: reaped child process 1890, status = succeeded6112worker1 # [ 168.526592] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)6113worker1 # [ 169.772647] nix-daemon[832]: reaped child process 1904, status = succeeded6114worker1 # [ 169.971442] nix-daemon[832]: accepted connection from pid 1919, user nix-grpc-daemon (trusted)6115worker1 # [ 169.998197] nix-daemon[832]: reaped child process 1922, status = succeeded6116lb # [ 169.980672] niks3-server[1030]: 2026/09/20 13:30:51 INFO Received uploads request method=POST path=/api/pending_closures6117worker1 # [ 170.024685] nix-grpc-daemon[1452]: time=2026-09-20T13:30:51.626Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6118worker1 # [ 170.026461] nix-grpc-daemon[1452]: time=2026-09-20T13:30:51.626Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"6119lb # [ 170.036190] niks3-server[1030]: 2026/09/20 13:30:51 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst6120lb # [ 170.047063] niks3-server[1030]: 2026/09/20 13:30:51 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv6121worker1 # [ 170.082713] nix-grpc-daemon[1452]: time=2026-09-20T13:30:51.685Z level=INFO msg="Uploading 1 narinfos"6122lb # [ 170.057653] niks3-server[1030]: 2026/09/20 13:30:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6123lb # [ 170.066533] niks3-server[1030]: 2026/09/20 13:30:51 INFO Signed narinfos id=61 count=16124lb # [ 170.071414] niks3-server[1030]: 2026/09/20 13:30:51 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls6125lb # [ 170.078696] niks3-server[1030]: 2026/09/20 13:30:51 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6126lb # [ 170.085884] niks3-server[1030]: 2026/09/20 13:30:51 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo6127lb # [ 170.090465] niks3-server[1030]: 2026/09/20 13:30:51 INFO Completed upload id=616128worker1 # [ 170.120485] nix-grpc-daemon[1452]: time=2026-09-20T13:30:51.724Z level=INFO msg="Upload complete. (383ms)"6129worker1 # [ 170.133179] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39808 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=13 outputs=16130worker1 # [ 170.148608] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:51Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=16131worker1 # [ 170.154208] nix-daemon[832]: reaped child process 1902, status = succeeded6132worker1 # [ 170.174352] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398086133worker1 # [ 170.187623] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:398086134worker1 # [ 170.200303] nix-grpc-daemon[1452]: time=2026-09-20T13:30:51.803Z level=INFO msg="All 2 paths already cached"6135worker1 # [ 170.208773] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:398086136worker1 # [ 170.216133] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)6137worker1 # [ 170.423632] nix-daemon[832]: accepted connection from pid 1926, user nix-grpc-daemon (trusted)6138worker1 # [ 170.449653] nix-daemon[832]: reaped child process 1929, status = succeeded6139worker1 # [ 170.647663] nix-daemon[832]: accepted connection from pid 1931, user nix-grpc-daemon (trusted)6140worker1 # [ 170.673380] nix-daemon[832]: reaped child process 1934, status = succeeded6141lb # [ 170.657711] niks3-server[1030]: 2026/09/20 13:30:52 INFO Received uploads request method=POST path=/api/pending_closures6142worker1 # [ 170.701260] nix-grpc-daemon[1452]: time=2026-09-20T13:30:52.304Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6143worker1 # [ 170.702969] nix-grpc-daemon[1452]: time=2026-09-20T13:30:52.304Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"6144lb # [ 170.694960] niks3-server[1030]: 2026/09/20 13:30:52 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst6145lb # [ 170.708202] niks3-server[1030]: 2026/09/20 13:30:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6146worker1 # [ 170.745978] nix-grpc-daemon[1452]: time=2026-09-20T13:30:52.349Z level=INFO msg="Uploading 1 narinfos"6147lb # [ 170.715724] niks3-server[1030]: 2026/09/20 13:30:52 INFO Signed narinfos id=62 count=16148lb # [ 170.720386] niks3-server[1030]: 2026/09/20 13:30:52 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls6149lb # [ 170.734031] niks3-server[1030]: 2026/09/20 13:30:52 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6150worker1 # [ 170.772784] nix-grpc-daemon[1452]: time=2026-09-20T13:30:52.376Z level=INFO msg="Upload complete. (544ms)"6151lb # [ 170.742720] niks3-server[1030]: 2026/09/20 13:30:52 INFO Completed upload id=626152lb # [ 170.746918] niks3-server[1030]: 2026/09/20 13:30:52 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo6153worker1 # [ 170.780192] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39808 duration_s=0 paths=1 nar_bytes_in=7526154worker1 # [ 170.783623] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:398086155worker1 # [ 170.794118] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)6156worker1 # [ 170.798096] nix-daemon[832]: reaped child process 1924, status = succeeded6157worker1 # [ 170.810704] nix-daemon[832]: accepted connection from pid 1378, user nix-grpc-daemon (trusted)6158worker1 # [ 172.460327] nix-daemon[832]: reaped child process 1938, status = succeeded6159worker1 # [ 172.652509] nix-daemon[832]: accepted connection from pid 1953, user nix-grpc-daemon (trusted)6160worker1 # [ 172.674539] nix-daemon[832]: reaped child process 1956, status = succeeded6161lb # [ 172.658182] niks3-server[1030]: 2026/09/20 13:30:54 INFO Received uploads request method=POST path=/api/pending_closures6162worker1 # [ 172.700345] nix-grpc-daemon[1452]: time=2026-09-20T13:30:54.302Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6163worker1 # [ 172.702040] nix-grpc-daemon[1452]: time=2026-09-20T13:30:54.302Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"6164lb # [ 172.702801] niks3-server[1030]: 2026/09/20 13:30:54 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv6165lb # [ 172.715645] niks3-server[1030]: 2026/09/20 13:30:54 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst6166worker1 # [ 172.757245] nix-grpc-daemon[1452]: time=2026-09-20T13:30:54.360Z level=INFO msg="Uploading 1 narinfos"6167lb # [ 172.728266] niks3-server[1030]: 2026/09/20 13:30:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6168lb # [ 172.731745] niks3-server[1030]: 2026/09/20 13:30:54 INFO Signed narinfos id=63 count=16169lb # [ 172.742114] niks3-server[1030]: 2026/09/20 13:30:54 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls6170lb # [ 172.747891] niks3-server[1030]: 2026/09/20 13:30:54 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6171lb # [ 172.756402] niks3-server[1030]: 2026/09/20 13:30:54 INFO Completed upload id=636172worker1 # [ 172.786752] nix-grpc-daemon[1452]: time=2026-09-20T13:30:54.390Z level=INFO msg="Upload complete. (365ms)"6173lb # [ 172.759948] niks3-server[1030]: 2026/09/20 13:30:54 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo6174worker1 # [ 172.801395] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39808 duration_s=2 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=14 outputs=16175worker1 # [ 172.818297] nix-daemon[832]: reaped child process 1936, status = succeeded6176client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 21.70 seconds)6177worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6178worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)6179client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16180worker1 # [ 173.241779] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:398086181worker1 # [ 173.253113] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:398086182worker1 # [ 173.278756] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:54Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=06183client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 0.35 seconds)6184(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 22.13 seconds)6185subtest: low disk drains a worker and builds go to the other6186worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6187worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.14 seconds)6188worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6189worker1 # [ 174.529181] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:56Z level=info event=unhealthy reason=min_free6190worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.13 seconds)6191client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&26192worker2 # [ 175.889665] nix-grpc-daemon[1756]: ts=2026-09-20T13:30:56Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:578846193worker2 # [ 175.903403] nix-daemon[847]: accepted connection from pid 1756, user nix-grpc-daemon (trusted)6194client # don't know how to build these paths:6195client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6196worker2 # [ 175.928566] nix-grpc-daemon[1756]: ts=2026-09-20T13:30:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:578846197worker2 # [ 175.945793] nix-grpc-daemon[1756]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 79 ms (attempt 1/5)6198worker2 # [ 176.032870] nix-grpc-daemon[1756]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 142 ms (attempt 2/5)6199worker2 # [ 176.175442] nix-grpc-daemon[1756]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 368 ms (attempt 3/5)6200worker2 # [ 176.551684] nix-grpc-daemon[1756]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 603 ms (attempt 4/5)6201worker2 # [ 177.157050] nix-grpc-daemon[1756]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6202worker1 # [ 177.165903] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:58Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=06203worker1 # [ 177.173204] nix-grpc-daemon[1378]: ts=2026-09-20T13:30:58Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=16204worker2 # [ 177.253006] nix-grpc-daemon[1756]: ts=2026-09-20T13:30:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:578846205worker2 # [ 177.273381] nix-grpc-daemon[1756]: ts=2026-09-20T13:30:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:578846206client # copying 1 paths to 'lb:50051'...6207client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...6208worker2 # [ 177.291993] nix-grpc-daemon[1756]: ts=2026-09-20T13:30:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:578846209worker2 # [ 177.310067] nix-daemon[847]: accepted connection from pid 1756, user nix-grpc-daemon (trusted)6210worker2 # [ 177.343811] nix-grpc-daemon[1756]: ts=2026-09-20T13:30:57Z level=info event=niks3_push_started pid=18126211worker2 # [ 177.586652] nix-grpc-daemon[1812]: time=2026-09-20T13:30:58.182Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca=""6212worker2 # [ 177.820504] nix-daemon[847]: accepted connection from pid 1825, user nix-grpc-daemon (trusted)6213worker2 # [ 177.844135] nix-daemon[847]: reaped child process 1828, status = succeeded6214worker2 # [ 178.049153] nix-daemon[847]: accepted connection from pid 1830, user nix-grpc-daemon (trusted)6215worker2 # [ 178.073291] nix-daemon[847]: reaped child process 1833, status = succeeded6216lb # [ 178.025547] niks3-server[1030]: 2026/09/20 13:30:59 INFO Received uploads request method=POST path=/api/pending_closures6217worker2 # [ 178.107846] nix-grpc-daemon[1812]: time=2026-09-20T13:30:58.702Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6218worker2 # [ 178.109977] nix-grpc-daemon[1812]: time=2026-09-20T13:30:58.702Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6219lb # [ 178.077702] niks3-server[1030]: 2026/09/20 13:30:59 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6220lb # [ 178.092940] niks3-server[1030]: 2026/09/20 13:30:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6221worker2 # [ 178.161776] nix-grpc-daemon[1812]: time=2026-09-20T13:30:58.757Z level=INFO msg="Uploading 1 narinfos"6222lb # [ 178.102964] niks3-server[1030]: 2026/09/20 13:30:59 INFO Signed narinfos id=64 count=16223lb # [ 178.112497] niks3-server[1030]: 2026/09/20 13:30:59 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6224lb # [ 178.126206] niks3-server[1030]: 2026/09/20 13:30:59 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6225lb # [ 178.136474] niks3-server[1030]: 2026/09/20 13:30:59 INFO Completed upload id=646226worker2 # [ 178.199366] nix-grpc-daemon[1812]: time=2026-09-20T13:30:58.795Z level=INFO msg="Upload complete. (606ms)"6227lb # [ 178.139607] niks3-server[1030]: 2026/09/20 13:30:59 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6228worker2 # [ 178.213186] nix-grpc-daemon[1756]: ts=2026-09-20T13:30:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57884 duration_s=0 paths=1 nar_bytes_in=5126229worker2 # [ 178.228749] nix-grpc-daemon[1756]: ts=2026-09-20T13:30:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:578846230worker2 # [ 178.239073] nix-daemon[847]: accepted connection from pid 1756, user nix-grpc-daemon (trusted)6231worker2 # [ 178.243361] nix-daemon[847]: reaped child process 1810, status = succeeded6232client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6233worker2 # [ 178.256248] nix-daemon[847]: accepted connection from pid 1756, user nix-grpc-daemon (trusted)6234client # farm-a> worker2-next: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6235client # farm-a> LOG-farm-a-drain6236worker2 # [ 179.683986] nix-daemon[847]: reaped child process 1837, status = succeeded6237worker2 # [ 179.976772] nix-daemon[847]: accepted connection from pid 1852, user nix-grpc-daemon (trusted)6238worker2 # [ 180.002372] nix-daemon[847]: reaped child process 1855, status = succeeded6239lb # [ 179.951653] niks3-server[1030]: 2026/09/20 13:31:01 INFO Received uploads request method=POST path=/api/pending_closures6240worker2 # [ 180.036635] nix-grpc-daemon[1812]: time=2026-09-20T13:31:00.630Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6241worker2 # [ 180.039169] nix-grpc-daemon[1812]: time=2026-09-20T13:31:00.630Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"6242lb # [ 180.008489] niks3-server[1030]: 2026/09/20 13:31:01 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6243lb # [ 180.030186] niks3-server[1030]: 2026/09/20 13:31:01 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6244lb # [ 180.047053] niks3-server[1030]: 2026/09/20 13:31:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6245worker2 # [ 180.116152] nix-grpc-daemon[1812]: time=2026-09-20T13:31:00.710Z level=INFO msg="Uploading 1 narinfos"6246lb # [ 180.055492] niks3-server[1030]: 2026/09/20 13:31:01 INFO Signed narinfos id=65 count=16247lb # [ 180.062154] niks3-server[1030]: 2026/09/20 13:31:01 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls6248lb # [ 180.076318] niks3-server[1030]: 2026/09/20 13:31:01 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6249lb # [ 180.086952] niks3-server[1030]: 2026/09/20 13:31:01 INFO Completed upload id=656250worker2 # [ 180.149884] nix-grpc-daemon[1812]: time=2026-09-20T13:31:00.745Z level=INFO msg="Upload complete. (481ms)"6251lb # [ 180.090857] niks3-server[1030]: 2026/09/20 13:31:01 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo6252worker2 # [ 180.173227] nix-grpc-daemon[1756]: ts=2026-09-20T13:31:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57884 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=15 outputs=16253worker1 # [ 180.151342] nix-grpc-daemon[1378]: ts=2026-09-20T13:31:01Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=06254worker2 # [ 180.192833] nix-daemon[847]: reaped child process 1835, status = succeeded6255worker1 # [ 180.160679] nix-grpc-daemon[1378]: ts=2026-09-20T13:31:01Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=16256worker2 # [ 180.231623] nix-grpc-daemon[1756]: ts=2026-09-20T13:31:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:578846257worker2 # [ 180.244525] nix-grpc-daemon[1756]: ts=2026-09-20T13:31:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:578846258worker2 # [ 180.260409] nix-grpc-daemon[1812]: time=2026-09-20T13:31:00.856Z level=INFO msg="All 1 paths already cached"6259client # copying 1 paths to 'lb:50051'...6260client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...6261worker2 # [ 180.269343] nix-grpc-daemon[1756]: ts=2026-09-20T13:31:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:578846262worker2 # [ 180.277651] nix-daemon[847]: accepted connection from pid 1756, user nix-grpc-daemon (trusted)6263worker2 # [ 180.501135] nix-daemon[847]: accepted connection from pid 1859, user nix-grpc-daemon (trusted)6264worker2 # [ 180.526518] nix-daemon[847]: reaped child process 1862, status = succeeded6265worker2 # [ 180.708392] nix-daemon[847]: accepted connection from pid 1864, user nix-grpc-daemon (trusted)6266worker2 # [ 180.735545] nix-daemon[847]: reaped child process 1867, status = succeeded6267lb # [ 180.681408] niks3-server[1030]: 2026/09/20 13:31:02 INFO Received uploads request method=POST path=/api/pending_closures6268worker2 # [ 180.749372] nix-grpc-daemon[1812]: time=2026-09-20T13:31:01.345Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6269worker2 # [ 180.753095] nix-grpc-daemon[1812]: time=2026-09-20T13:31:01.347Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"6270lb # [ 180.714997] niks3-server[1030]: 2026/09/20 13:31:02 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst6271worker2 # [ 180.782490] nix-grpc-daemon[1812]: time=2026-09-20T13:31:01.378Z level=INFO msg="Uploading 1 narinfos"6272lb # [ 180.721348] niks3-server[1030]: 2026/09/20 13:31:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6273lb # [ 180.729014] niks3-server[1030]: 2026/09/20 13:31:02 INFO Signed narinfos id=66 count=16274lb # [ 180.733019] niks3-server[1030]: 2026/09/20 13:31:02 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls6275lb # [ 180.742016] niks3-server[1030]: 2026/09/20 13:31:02 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6276worker2 # [ 180.809080] nix-grpc-daemon[1812]: time=2026-09-20T13:31:01.405Z level=INFO msg="Upload complete. (519ms)"6277lb # [ 180.747636] niks3-server[1030]: 2026/09/20 13:31:02 INFO Completed upload id=666278lb # [ 180.750610] niks3-server[1030]: 2026/09/20 13:31:02 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo6279worker2 # [ 180.816184] nix-grpc-daemon[1756]: ts=2026-09-20T13:31:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57884 duration_s=0 paths=1 nar_bytes_in=6326280worker2 # [ 180.819743] nix-grpc-daemon[1756]: ts=2026-09-20T13:31:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:578846281worker2 # [ 180.831307] nix-daemon[847]: accepted connection from pid 1756, user nix-grpc-daemon (trusted)6282worker2 # [ 180.835844] nix-daemon[847]: reaped child process 1857, status = succeeded6283client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...6284worker2 # [ 180.848785] nix-daemon[847]: accepted connection from pid 1756, user nix-grpc-daemon (trusted)6285client # farm-b> worker2-next: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6286lb # [ 181.346076] envoy[915]: conn peer=[2001:db8:1::1]:34796 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27191 tx=10775 ms=213566287lb # [ 181.351826] envoy[915]: conn peer=[2001:db8:1::1]:40604 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=880 tx=482 ms=566288client # farm-b> LOG-farm-b-drain6289worker2 # [ 181.879973] nix-daemon[847]: reaped child process 1871, status = succeeded6290worker2 # [ 182.073825] nix-daemon[847]: accepted connection from pid 1886, user nix-grpc-daemon (trusted)6291worker2 # [ 182.098770] nix-daemon[847]: reaped child process 1889, status = succeeded6292lb # [ 182.048646] niks3-server[1030]: 2026/09/20 13:31:03 INFO Received uploads request method=POST path=/api/pending_closures6293worker2 # [ 182.120664] nix-grpc-daemon[1812]: time=2026-09-20T13:31:02.715Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6294worker2 # [ 182.122652] nix-grpc-daemon[1812]: time=2026-09-20T13:31:02.715Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"6295lb # [ 182.083175] niks3-server[1030]: 2026/09/20 13:31:03 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv6296lb # [ 182.096046] niks3-server[1030]: 2026/09/20 13:31:03 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst6297lb # [ 182.107616] niks3-server[1030]: 2026/09/20 13:31:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6298worker2 # [ 182.174975] nix-grpc-daemon[1812]: time=2026-09-20T13:31:02.770Z level=INFO msg="Uploading 1 narinfos"6299lb # [ 182.116606] niks3-server[1030]: 2026/09/20 13:31:03 INFO Signed narinfos id=67 count=16300lb # [ 182.118983] niks3-server[1030]: 2026/09/20 13:31:03 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls6301lb # [ 182.130143] niks3-server[1030]: 2026/09/20 13:31:03 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6302lb # [ 182.140618] niks3-server[1030]: 2026/09/20 13:31:03 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo6303lb # [ 182.144548] niks3-server[1030]: 2026/09/20 13:31:03 INFO Completed upload id=676304worker2 # [ 182.206982] nix-grpc-daemon[1812]: time=2026-09-20T13:31:02.802Z level=INFO msg="Upload complete. (348ms)"6305worker2 # [ 182.212788] nix-grpc-daemon[1756]: ts=2026-09-20T13:31:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57884 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=16 outputs=16306worker2 # [ 182.222857] nix-daemon[847]: reaped child process 1869, status = succeeded6307worker1 # [ 182.189724] nix-grpc-daemon[1378]: ts=2026-09-20T13:31:03Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=06308worker2 # [ 182.234276] nix-grpc-daemon[1756]: ts=2026-09-20T13:31:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:578846309worker1 # [ 182.197916] nix-grpc-daemon[1378]: ts=2026-09-20T13:31:03Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=16310worker2 # [ 182.248862] nix-grpc-daemon[1756]: ts=2026-09-20T13:31:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:578846311worker2 # [ 182.262015] nix-grpc-daemon[1812]: time=2026-09-20T13:31:02.857Z level=INFO msg="All 2 paths already cached"6312client # copying 1 paths to 'lb:50051'...6313worker2 # [ 182.271925] nix-grpc-daemon[1756]: ts=2026-09-20T13:31:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:578846314client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...6315worker2 # [ 182.285261] nix-daemon[847]: accepted connection from pid 1756, user nix-grpc-daemon (trusted)6316worker2 # [ 182.497603] nix-daemon[847]: accepted connection from pid 1893, user nix-grpc-daemon (trusted)6317worker2 # [ 182.524477] nix-daemon[847]: reaped child process 1896, status = succeeded6318worker2 # [ 182.718521] nix-daemon[847]: accepted connection from pid 1898, user nix-grpc-daemon (trusted)6319worker2 # [ 182.744724] nix-daemon[847]: reaped child process 1901, status = succeeded6320lb # [ 182.699148] niks3-server[1030]: 2026/09/20 13:31:04 INFO Received uploads request method=POST path=/api/pending_closures6321worker2 # [ 182.776095] nix-grpc-daemon[1812]: time=2026-09-20T13:31:03.371Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6322worker2 # [ 182.778006] nix-grpc-daemon[1812]: time=2026-09-20T13:31:03.371Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"6323lb # [ 182.751421] niks3-server[1030]: 2026/09/20 13:31:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6324worker2 # [ 182.818083] nix-grpc-daemon[1812]: time=2026-09-20T13:31:03.413Z level=INFO msg="Uploading 1 narinfos"6325lb # [ 182.760377] niks3-server[1030]: 2026/09/20 13:31:04 INFO Signed narinfos id=68 count=16326lb # [ 182.762704] niks3-server[1030]: 2026/09/20 13:31:04 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst6327lb # [ 182.773297] niks3-server[1030]: 2026/09/20 13:31:04 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls6328lb # [ 182.779461] niks3-server[1030]: 2026/09/20 13:31:04 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6329worker2 # [ 182.854859] nix-grpc-daemon[1812]: time=2026-09-20T13:31:03.450Z level=INFO msg="Upload complete. (554ms)"6330lb # [ 182.790983] niks3-server[1030]: 2026/09/20 13:31:04 INFO Completed upload id=686331worker2 # [ 182.860362] nix-grpc-daemon[1756]: ts=2026-09-20T13:31:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57884 duration_s=0 paths=1 nar_bytes_in=7606332worker2 # [ 182.868637] nix-grpc-daemon[1756]: ts=2026-09-20T13:31:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:578846333lb # [ 182.810950] niks3-server[1030]: 2026/09/20 13:31:04 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo6334worker2 # [ 182.880198] nix-daemon[847]: accepted connection from pid 1756, user nix-grpc-daemon (trusted)6335worker2 # [ 182.885572] nix-daemon[847]: reaped child process 1891, status = succeeded6336client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...6337client # farm-top> worker2-next: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6338worker2 # [ 182.895690] nix-daemon[847]: accepted connection from pid 1756, user nix-grpc-daemon (trusted)6339client # farm-top> LOG-farm-top-drain6340worker2 # [ 184.347077] nix-daemon[847]: reaped child process 1905, status = succeeded6341worker2 # [ 184.548870] nix-daemon[847]: accepted connection from pid 1920, user nix-grpc-daemon (trusted)6342worker2 # [ 184.573428] nix-daemon[847]: reaped child process 1923, status = succeeded6343lb # [ 184.524964] niks3-server[1030]: 2026/09/20 13:31:06 INFO Received uploads request method=POST path=/api/pending_closures6344worker2 # [ 184.608185] nix-grpc-daemon[1812]: time=2026-09-20T13:31:05.201Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6345worker2 # [ 184.610025] nix-grpc-daemon[1812]: time=2026-09-20T13:31:05.201Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"6346lb # [ 184.576521] niks3-server[1030]: 2026/09/20 13:31:06 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6347lb # [ 184.589750] niks3-server[1030]: 2026/09/20 13:31:06 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst6348lb # [ 184.602929] niks3-server[1030]: 2026/09/20 13:31:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6349worker2 # [ 184.671913] nix-grpc-daemon[1812]: time=2026-09-20T13:31:05.267Z level=INFO msg="Uploading 1 narinfos"6350lb # [ 184.610158] niks3-server[1030]: 2026/09/20 13:31:06 INFO Signed narinfos id=69 count=16351lb # [ 184.615413] niks3-server[1030]: 2026/09/20 13:31:06 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls6352lb # [ 184.628665] niks3-server[1030]: 2026/09/20 13:31:06 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6353lb # [ 184.642414] niks3-server[1030]: 2026/09/20 13:31:06 INFO Completed upload id=696354worker2 # [ 184.705214] nix-grpc-daemon[1812]: time=2026-09-20T13:31:05.301Z level=INFO msg="Upload complete. (395ms)"6355lb # [ 184.646619] niks3-server[1030]: 2026/09/20 13:31:06 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo6356worker2 # [ 184.717428] nix-grpc-daemon[1756]: ts=2026-09-20T13:31:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57884 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=17 outputs=16357worker2 # [ 184.741082] nix-daemon[847]: reaped child process 1903, status = succeeded6358client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 9.16 seconds)6359client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath6360client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.29 seconds)6361worker1: must succeed: rm /nix/.rw-store/fill6362worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.17 seconds)6363worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6364worker1 # [ 185.539981] nix-grpc-daemon[1378]: ts=2026-09-20T13:31:07Z level=info event=healthy reason=min_free6365worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.15 seconds)6366(finished: subtest: low disk drains a worker and builds go to the other, in 13.16 seconds)6367(finished: run the VM test script, in 187.36 seconds)6368test script finished in 187.69s6369cleanup6370kill QemuMachine (pid 49)6371client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6372kill QemuMachine (pid 50)6373lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6374kill QemuMachine (pid 51)6375worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6376kill QemuMachine (pid 52)6377worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14)6378(finished: cleanup, in 1.37 seconds)6379additionally exposed symbols:6380 client, lb, worker1, worker2,6381 vlan1,6382 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh