vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #502
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker1 # Disk image does not exist, creating the virtualisation disk image...13worker2 # Disk image does not exist, creating the virtualisation disk image...14client # Disk image does not exist, creating the virtualisation disk image...15worker2: QEMU running (pid 51)16lb: QEMU running (pid 50)17lb # Disk image does not exist, creating the virtualisation disk image...18worker1: QEMU running (pid 52)19worker1 # Formatting '/build/vm-state-worker1/tmp.tYbdm0g7Bn', fmt=raw size=107374182420worker2 # Formatting '/build/vm-state-worker2/tmp.POc6IIJF3L', fmt=raw size=107374182421client # Formatting '/build/vm-state-client/tmp.6X4JjVsQtt', fmt=raw size=107374182422worker1 # mke2fs 1.47.4 (6-Mar-2025)23worker2 # mke2fs 1.47.4 (6-Mar-2025)24client # mke2fs 1.47.4 (6-Mar-2025)25worker1 # Discarding device blocks: 0/262144 done26worker2 # Discarding device blocks: 0/262144 done27client # Discarding device blocks: 0/262144 done28worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes29worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes30client # Creating filesystem with 262144 4k blocks and 65536 inodes31worker1 # Filesystem UUID: 69af6843-d400-4508-8e52-ae8b11c7712632worker2 # Filesystem UUID: e0d9bf4d-739a-47eb-8932-643e98c0d22033client # Filesystem UUID: b05d3265-e406-49ad-ac8b-ff13de13135834worker1 # Superblock backups stored on blocks:35worker2 # Superblock backups stored on blocks:36client # Superblock backups stored on blocks:37worker1 # 32768, 98304, 163840, 22937638worker2 # 32768, 98304, 163840, 22937639client # 32768, 98304, 163840, 22937640worker1 # 41worker2 # 42client # 43worker1 # Allocating group tables: 0/8 done44worker2 # Allocating group tables: 0/8 done45client # Allocating group tables: 0/8 done46worker1 # Writing inode tables: 0/8 done47worker2 # Writing inode tables: 0/8 done48client # Writing inode tables: 0/8 done49worker1 # Creating journal (8192 blocks): done50worker2 # Creating journal (8192 blocks): done51client # Creating journal (8192 blocks): done52worker1 # Writing superblocks and filesystem accounting information: 0/8 done53worker2 # Writing superblocks and filesystem accounting information: 0/8 done54client # Writing superblocks and filesystem accounting information: 0/8 done55worker1 # 56worker2 # 57client # 58worker1 # Virtualisation disk image created.59worker2 # Virtualisation disk image created.60client # Virtualisation disk image created.61worker1 # Starting virtiofs daemons...62worker2 # Starting virtiofs daemons...63client # Starting virtiofs daemons...64worker1 # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)65worker2 # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)66client # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)67worker1 # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)68worker2 # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether69client # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether70worker1 # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether71worker2 # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)72client # [2026-09-22T15:04:31Z INFO virtiofsd] Waiting for vhost-user socket connection...73worker1 # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether74worker2 # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether75client # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)76worker1 # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)77worker2 # [2026-09-22T15:04:31Z INFO virtiofsd] Waiting for vhost-user socket connection...78client # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether79worker1 # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether80worker2 # [2026-09-22T15:04:31Z INFO virtiofsd] Waiting for vhost-user socket connection...81client # [2026-09-22T15:04:31Z INFO virtiofsd] Waiting for vhost-user socket connection...82worker1 # [2026-09-22T15:04:31Z INFO virtiofsd] Waiting for vhost-user socket connection...83worker2 # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)84client # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)85worker1 # [2026-09-22T15:04:31Z INFO virtiofsd] Waiting for vhost-user socket connection...86worker2 # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether87client # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether88worker1 # [2026-09-22T15:04:31Z INFO virtiofsd] Waiting for vhost-user socket connection...89worker2 # [2026-09-22T15:04:31Z INFO virtiofsd] Waiting for vhost-user socket connection...90client # [2026-09-22T15:04:31Z INFO virtiofsd] Waiting for vhost-user socket connection...91worker1 # [2026-09-22T15:04:31Z INFO virtiofsd] Client connected, servicing requests92worker2 # [2026-09-22T15:04:31Z INFO virtiofsd] Client connected, servicing requests93client # [2026-09-22T15:04:31Z INFO virtiofsd] Client connected, servicing requests94worker1 # [2026-09-22T15:04:31Z INFO virtiofsd] Client connected, servicing requests95worker2 # [2026-09-22T15:04:31Z INFO virtiofsd] Client connected, servicing requests96client # [2026-09-22T15:04:31Z INFO virtiofsd] Client connected, servicing requests97worker1 # [2026-09-22T15:04:31Z INFO virtiofsd] Client connected, servicing requests98worker2 # [2026-09-22T15:04:31Z INFO virtiofsd] Client connected, servicing requests99client # [2026-09-22T15:04:31Z INFO virtiofsd] Client connected, servicing requests100lb # Formatting '/build/vm-state-lb/tmp.pc3kU4mbJh', fmt=raw size=1073741824101client: QEMU running (pid 49)102lb # mke2fs 1.47.4 (6-Mar-2025)103lb # Discarding device blocks: 0/262144 done104lb # Creating filesystem with 262144 4k blocks and 65536 inodes105lb # Filesystem UUID: 77424937-216a-4d64-b967-244caaea4afe106lb # Superblock backups stored on blocks:107lb # 32768, 98304, 163840, 229376108lb # 109lb # Allocating group tables: 0/8 done110(finished: start all VMs, in 0.54 seconds)111lb # Writing inode tables: 0/8 done112client: waiting for unit network-addresses-eth1.service113lb # Creating journal (8192 blocks): done114client: waiting for the VM to finish booting115lb # Writing superblocks and filesystem accounting information: 0/8 done116lb # 117lb # Virtualisation disk image created.118lb # Starting virtiofs daemons...119lb # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)120lb # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether121lb # [2026-09-22T15:04:31Z INFO virtiofsd] Waiting for vhost-user socket connection...122lb # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)123lb # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether124lb # [2026-09-22T15:04:31Z INFO virtiofsd] Waiting for vhost-user socket connection...125lb # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)126lb # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether127lb # [2026-09-22T15:04:31Z INFO virtiofsd] Waiting for vhost-user socket connection...128lb # [2026-09-22T15:04:31Z INFO virtiofsd] Client connected, servicing requests129lb # [2026-09-22T15:04:31Z INFO virtiofsd] Client connected, servicing requests130lb # [2026-09-22T15:04:31Z INFO virtiofsd] Client connected, servicing requests131worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]132worker2 # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026133worker2 # [ 0.000000] KASLR enabled134worker2 # [ 0.000000] random: crng init done135worker2 # [ 0.000000] Machine model: linux,dummy-virt136worker2 # [ 0.000000] efi: UEFI not found.137worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT138worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]139worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]140worker2 # [ 0.000000] Zone ranges:141worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]142worker2 # [ 0.000000] DMA32 empty143worker2 # [ 0.000000] Normal empty144worker2 # [ 0.000000] Device empty145worker2 # [ 0.000000] Movable zone start for each node146worker2 # [ 0.000000] Early memory node ranges147worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]148worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]149worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000150worker2 # [ 0.000000] psci: probing for conduit method from DT.151worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.152worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs153worker2 # [ 0.000000] psci: Trusted OS migration not required154worker2 # [ 0.000000] psci: SMC Calling Convention v1.1155worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)156worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296157worker2 # [ 0.000000] Detected PIPT I-cache on CPU0158worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)159worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface160worker2 # [ 0.000000] CPU features: detected: Spectre-v4161worker2 # [ 0.000000] CPU features: detected: Spectre-BHB162worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38163worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23164worker2 # [ 0.000000] alternatives: applying boot alternatives165worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/gmd7z4ny4bi55sv3a6k2fbz28d26w0pi-nixos-system-worker2-test/init regInfo=/nix/store/g2bsb9vyy4qcljqrysdp84ii6pzd3g5i-closure-info/registration console=ttyAMA0,115200n8 console=tty0166worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/g2bsb9vyy4qcljqrysdp84ii6pzd3g5i-closure-info/registration", will be passed to user space.167worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes168worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)169worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)170worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB171worker2 # [ 0.000000] software IO TLB: area num 1.172worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB173worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)174worker2 # [ 0.000000] Fallback order for Node 0: 0175worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216176worker2 # [ 0.000000] Policy zone: DMA177worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off178worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1179worker2 # [ 0.000000] allocated 3145728 bytes of page_ext180worker2 # [ 0.000000] ftrace: allocating 74950 entries in 294 pages181worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups182worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.183worker2 # [ 0.000000] rcu: RCU event tracing is enabled.184worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.185worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.186worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.187worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.188worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.189worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1190worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.191worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.192worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.193worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0194worker2 # [ 0.000000] GICv3: 256 SPIs implemented195worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented196worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq197worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI198worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0199worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000200worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]201worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)202worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)203worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000204worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000205worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.206worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns207worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).208worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns209worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns210worker2 # [ 0.000034] arm-pv: using stolen time PV211worker2 # [ 0.000664] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)212worker2 # [ 0.000851] Console: colour dummy device 80x25213worker2 # [ 0.000859] printk: legacy console [tty0] enabled214worker2 # [ 0.001052] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)215worker2 # [ 0.001059] pid_max: default: 32768 minimum: 301216worker2 # [ 0.001141] LSM: initializing lsm=capability,landlock,yama,bpf,ima217lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]218worker2 # [ 0.001304] landlock: Up and running.219worker2 # [ 0.001307] Yama: becoming mindful.220worker2 # [ 0.001953] LSM support for eBPF active221lb # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026222lb # [ 0.000000] KASLR enabled223worker2 # [ 0.002131] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)224lb # [ 0.000000] random: crng init done225lb # [ 0.000000] Machine model: linux,dummy-virt226worker2 # [ 0.002164] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)227lb # [ 0.000000] efi: UEFI not found.228worker2 # [ 0.004055] rcu: Hierarchical SRCU implementation.229lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT230worker2 # [ 0.004060] rcu: Max phase no-delay instances is 1000.231worker2 # [ 0.005333] fsl-mc MSI: its@8080000 domain created232lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]233worker2 # [ 0.005424] EFI services will not be available.234lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]235worker2 # [ 0.005544] smp: Bringing up secondary CPUs ...236lb # [ 0.000000] Zone ranges:237worker2 # [ 0.005553] smp: Brought up 1 node, 1 CPU238lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]239worker2 # [ 0.005556] SMP: Total of 1 processors activated.240lb # [ 0.000000] DMA32 empty241lb # [ 0.000000] Normal empty242worker2 # [ 0.005561] CPU: All CPU(s) started at EL1243lb # [ 0.000000] Device empty244worker2 # [ 0.005571] CPU features: detected: Branch Target Identification245lb # [ 0.000000] Movable zone start for each node246lb # [ 0.000000] Early memory node ranges247worker2 # [ 0.005576] CPU features: detected: ARMv8.4 Translation Table Level248lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]249worker2 # [ 0.005579] CPU features: detected: Instruction cache invalidation not required for I/D coherence250lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]251lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000252worker2 # [ 0.005582] CPU features: detected: Data cache clean to the PoU not required for I/D coherence253lb # [ 0.000000] psci: probing for conduit method from DT.254worker2 # [ 0.005586] CPU features: detected: Common not Private translations255lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.256worker2 # [ 0.005589] CPU features: detected: CRC32 instructions257lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs258worker2 # [ 0.005592] CPU features: detected: Data cache clean to Point of Deep Persistence259lb # [ 0.000000] psci: Trusted OS migration not required260lb # [ 0.000000] psci: SMC Calling Convention v1.1261worker2 # [ 0.005596] CPU features: detected: Data cache clean to Point of Persistence262lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)263worker2 # [ 0.005599] CPU features: detected: Data independent timing control (DIT)264worker2 # [ 0.005602] CPU features: detected: E0PD265lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296266worker2 # [ 0.005604] CPU features: detected: Enhanced Counter Virtualization267lb # [ 0.000000] Detected PIPT I-cache on CPU0268worker2 # [ 0.005607] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)269lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)270worker2 # [ 0.005611] CPU features: detected: Enhanced Virtualization Traps271lb # [ 0.000000] CPU features: detected: GICv3 CPU interface272lb # [ 0.000000] CPU features: detected: Spectre-v4273worker2 # [ 0.005614] CPU features: detected: Fine Grained Traps274lb # [ 0.000000] CPU features: detected: Spectre-BHB275worker2 # [ 0.005618] CPU features: detected: Generic authentication (architected QARMA5 algorithm)276lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38277worker2 # [ 0.005622] CPU features: detected: RCpc load-acquire (LDAPR)278lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23279worker2 # [ 0.005625] CPU features: detected: LSE atomic instructions280lb # [ 0.000000] alternatives: applying boot alternatives281worker2 # [ 0.005628] CPU features: detected: Privileged Access Never282worker2 # [ 0.005631] CPU features: detected: PMUv3283worker2 # [ 0.005634] CPU features: detected: RAS Extension Support284client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]285worker2 # [ 0.005637] CPU features: detected: RASv1p1 Extension Support286lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/rwj7rgrjnik4yfrdy5nxpi16ig7dj0yx-nixos-system-lb-test/init regInfo=/nix/store/y0b8gyps1r0yyzfhbdbfwqvj69pgkv2z-closure-info/registration console=ttyAMA0,115200n8 console=tty0287worker2 # [ 0.005639] CPU features: detected: Random Number Generator288client # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026289client # [ 0.000000] KASLR enabled290worker2 # [ 0.005642] CPU features: detected: Speculation barrier (SB)291client # [ 0.000000] random: crng init done292worker2 # [ 0.005645] CPU features: detected: Stage-2 Force Write-Back293client # [ 0.000000] Machine model: linux,dummy-virt294lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/y0b8gyps1r0yyzfhbdbfwqvj69pgkv2z-closure-info/registration", will be passed to user space.295client # [ 0.000000] efi: UEFI not found.296worker2 # [ 0.005647] CPU features: detected: TLB range maintenance instructions297lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes298client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT299worker2 # [ 0.005652] CPU features: detected: Speculative Store Bypassing Safe (SSBS)300lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)301client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]302worker2 # [ 0.005692] alternatives: applying system-wide alternatives303client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]304lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)305worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]306worker2 # [ 0.008741] CPU features: detected: BBM Level 2 without TLB conflict abort307client # [ 0.000000] Zone ranges:308lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB309client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]310lb # [ 0.000000] software IO TLB: area num 1.311client # [ 0.000000] DMA32 empty312client # [ 0.000000] Normal empty313worker1 # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026314worker2 # [ 0.008927] Memory: 1405668K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124632K reserved, 32768K cma-reserved)315worker1 # [ 0.000000] KASLR enabled316client # [ 0.000000] Device empty317lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB318worker1 # [ 0.000000] random: crng init done319worker2 # [ 0.009326] devtmpfs: initialized320client # [ 0.000000] Movable zone start for each node321worker1 # [ 0.000000] Machine model: linux,dummy-virt322lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)323client # [ 0.000000] Early memory node ranges324worker1 # [ 0.000000] efi: UEFI not found.325worker2 # [ 0.011140] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)326lb # [ 0.000000] Fallback order for Node 0: 0327client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]328worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT329lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216330worker2 # [ 0.011163] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).331lb # [ 0.000000] Policy zone: DMA332client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]333worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]334worker2 # [ 0.011341] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL335client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000336lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off337worker2 # [ 0.011345] 0 pages in range for non-PLT usage338worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]339client # [ 0.000000] psci: probing for conduit method from DT.340worker1 # [ 0.000000] Zone ranges:341worker2 # [ 0.011346] 508272 pages in range for PLT usage342lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1343client # [ 0.000000] psci: PSCIv1.3 detected in firmware.344lb # [ 0.000000] allocated 3145728 bytes of page_ext345worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]346worker2 # [ 0.011461] pinctrl core: initialized pinctrl subsystem347worker1 # [ 0.000000] DMA32 empty348client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs349worker2 # [ 0.012262] DMI not present or invalid.350lb # [ 0.000000] ftrace: allocating 74950 entries in 294 pages351worker1 # [ 0.000000] Normal empty352client # [ 0.000000] psci: Trusted OS migration not required353worker1 # [ 0.000000] Device empty354worker2 # [ 0.016014] NET: Registered PF_NETLINK/PF_ROUTE protocol family355lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups356client # [ 0.000000] psci: SMC Calling Convention v1.1357worker1 # [ 0.000000] Movable zone start for each node358lb # [ 0.000000] rcu: Hierarchical RCU implementation.359worker1 # [ 0.000000] Early memory node ranges360worker2 # [ 0.018260] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations361lb # [ 0.000000] rcu: RCU event tracing is enabled.362client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)363worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]364worker2 # [ 0.018450] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations365lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.366client # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296367worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]368lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.369client # [ 0.000000] Detected PIPT I-cache on CPU0370worker2 # [ 0.018652] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations371worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000372lb # [ 0.000000] Rude variant of Tasks RCU enabled.373worker2 # [ 0.018673] audit: initializing netlink subsys (disabled)374worker1 # [ 0.000000] psci: probing for conduit method from DT.375lb # [ 0.000000] Tracing variant of Tasks RCU enabled.376client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)377worker2 # [ 0.019244] thermal_sys: Registered thermal governor 'fair_share'378worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.379client # [ 0.000000] CPU features: detected: GICv3 CPU interface380lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.381worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs382client # [ 0.000000] CPU features: detected: Spectre-v4383worker2 # [ 0.019246] thermal_sys: Registered thermal governor 'bang_bang'384lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1385client # [ 0.000000] CPU features: detected: Spectre-BHB386worker2 # [ 0.019250] thermal_sys: Registered thermal governor 'step_wise'387worker1 # [ 0.000000] psci: Trusted OS migration not required388worker1 # [ 0.000000] psci: SMC Calling Convention v1.1389client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38390worker2 # [ 0.019253] thermal_sys: Registered thermal governor 'user_space'391lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.392client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23393worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)394worker2 # [ 0.019258] thermal_sys: Registered thermal governor 'power_allocator'395client # [ 0.000000] alternatives: applying boot alternatives396lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.397worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296398worker2 # [ 0.019291] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1399worker1 # [ 0.000000] Detected PIPT I-cache on CPU0400worker2 # [ 0.019300] cpuidle: using governor ladder401lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.402worker2 # [ 0.019306] cpuidle: using governor menu403worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)404lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0405lb # [ 0.000000] GICv3: 256 SPIs implemented406worker2 # [ 0.019496] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.407worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface408lb # [ 0.000000] GICv3: 0 Extended SPIs implemented409worker2 # [ 0.019513] ASID allocator initialised with 65536 entries410worker1 # [ 0.000000] CPU features: detected: Spectre-v4411lb # [ 0.000000] Root IRQ handler: gic_handle_irq412worker2 # [ 0.020824] Serial: AMBA PL011 UART driver413worker1 # [ 0.000000] CPU features: detected: Spectre-BHB414client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/9h1c64jjdkn9jsqs8mxdg12zr39npfq0-nixos-system-client-test/init regInfo=/nix/store/iv8yhgcj2jxz61bmrp8pqvaxgrzmp3gb-closure-info/registration console=ttyAMA0,115200n8 console=tty0415lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI416worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38417worker2 # [ 0.026291] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1418lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0419worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23420worker2 # [ 0.026453] printk: console [ttyAMA0] enabled421lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000422worker1 # [ 0.000000] alternatives: applying boot alternatives423client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/iv8yhgcj2jxz61bmrp8pqvaxgrzmp3gb-closure-info/registration", will be passed to user space.424lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]425lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)426client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes427client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)428lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)429lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000430client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)431worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/9c58wlr9mbayd5fmz9rxgypan2qjrx99-nixos-system-worker1-test/init regInfo=/nix/store/v7wavp8ypjzmz1nd1f1sfw94m1i49xja-closure-info/registration console=ttyAMA0,115200n8 console=tty0432lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000433client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB434client # [ 0.000000] software IO TLB: area num 1.435lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.436worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/v7wavp8ypjzmz1nd1f1sfw94m1i49xja-closure-info/registration", will be passed to user space.437client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB438lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns439client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)440lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).441client # [ 0.000000] Fallback order for Node 0: 0442worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes443client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216444worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)445client # [ 0.000000] Policy zone: DMA446lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns447worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)448client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off449worker2 # [ 0.149841] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages450lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns451worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB452lb # [ 0.000035] arm-pv: using stolen time PV453client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1454worker2 # [ 0.149860] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page455worker1 # [ 0.000000] software IO TLB: area num 1.456client # [ 0.000000] allocated 3145728 bytes of page_ext457worker2 # [ 0.149865] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages458lb # [ 0.000533] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)459client # [ 0.000000] ftrace: allocating 74950 entries in 294 pages460worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB461lb # [ 0.000728] Console: colour dummy device 80x25462worker2 # [ 0.149870] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page463client # [ 0.000000] ftrace: allocated 294 pages with 4 groups464worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)465lb # [ 0.000736] printk: legacy console [tty0] enabled466client # [ 0.000000] rcu: Hierarchical RCU implementation.467worker2 # [ 0.149874] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages468worker1 # [ 0.000000] Fallback order for Node 0: 0469client # [ 0.000000] rcu: RCU event tracing is enabled.470worker2 # [ 0.149879] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page471worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216472lb # [ 0.000931] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)473worker1 # [ 0.000000] Policy zone: DMA474client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.475lb # [ 0.000937] pid_max: default: 32768 minimum: 301476worker2 # [ 0.149883] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages477client # [ 0.000000] Trampoline variant of Tasks RCU enabled.478worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off479lb # [ 0.001019] LSM: initializing lsm=capability,landlock,yama,bpf,ima480worker2 # [ 0.149887] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page481client # [ 0.000000] Rude variant of Tasks RCU enabled.482lb # [ 0.001179] landlock: Up and running.483worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1484client # [ 0.000000] Tracing variant of Tasks RCU enabled.485lb # [ 0.001182] Yama: becoming mindful.486worker1 # [ 0.000000] allocated 3145728 bytes of page_ext487lb # [ 0.001755] LSM support for eBPF active488client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.489worker1 # [ 0.000000] ftrace: allocating 74950 entries in 294 pages490lb # [ 0.001903] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)491worker2 # [ 0.157072] fbcon: Taking over console492worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups493client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1494worker2 # [ 0.157088] ACPI: Interpreter disabled.495worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.496lb # [ 0.001936] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)497worker1 # [ 0.000000] rcu: RCU event tracing is enabled.498client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.499worker2 # [ 0.158940] iommu: Default domain type: Translated500lb # [ 0.003793] rcu: Hierarchical SRCU implementation.501lb # [ 0.003797] rcu: Max phase no-delay instances is 1000.502worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.503worker2 # [ 0.158950] iommu: DMA domain TLB invalidation policy: strict mode504client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.505lb # [ 0.005089] fsl-mc MSI: its@8080000 domain created506worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.507worker2 # [ 0.160602] SCSI subsystem initialized508lb # [ 0.005189] EFI services will not be available.509worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.510client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.511lb # [ 0.005292] smp: Bringing up secondary CPUs ...512worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.513client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0514lb # [ 0.005301] smp: Brought up 1 node, 1 CPU515client # [ 0.000000] GICv3: 256 SPIs implemented516worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.517lb # [ 0.005304] SMP: Total of 1 processors activated.518client # [ 0.000000] GICv3: 0 Extended SPIs implemented519lb # [ 0.005310] CPU: All CPU(s) started at EL1520worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1521client # [ 0.000000] Root IRQ handler: gic_handle_irq522lb # [ 0.005320] CPU features: detected: Branch Target Identification523client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI524worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.525lb # [ 0.005325] CPU features: detected: ARMv8.4 Translation Table Level526client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0527worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.528client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000529lb # [ 0.005328] CPU features: detected: Instruction cache invalidation not required for I/D coherence530client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]531worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.532lb # [ 0.005332] CPU features: detected: Data cache clean to the PoU not required for I/D coherence533client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)534worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0535worker2 # [ 0.166082] usbcore: registered new interface driver usbfs536lb # [ 0.005336] CPU features: detected: Common not Private translations537worker1 # [ 0.000000] GICv3: 256 SPIs implemented538worker2 # [ 0.166123] usbcore: registered new interface driver hub539lb # [ 0.005339] CPU features: detected: CRC32 instructions540worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented541client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)542worker2 # [ 0.166139] usbcore: registered new device driver usb543worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq544lb # [ 0.005341] CPU features: detected: Data cache clean to Point of Deep Persistence545client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000546worker2 # [ 0.166414] pps_core: LinuxPPS API ver. 1 registered547worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI548lb # [ 0.005345] CPU features: detected: Data cache clean to Point of Persistence549client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000550worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0551worker2 # [ 0.166421] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>552worker2 # [ 0.166431] PTP clock support registered553lb # [ 0.005348] CPU features: detected: Data independent timing control (DIT)554client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.555worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000556lb # [ 0.005351] CPU features: detected: E0PD557worker2 # [ 0.166479] EDAC MC: Ver: 3.0.0558worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]559lb # [ 0.005354] CPU features: detected: Enhanced Counter Virtualization560client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns561worker2 # [ 0.170948] scmi_core: SCMI protocol bus registered562worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)563lb # [ 0.005357] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)564client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).565worker2 # [ 0.171890] FPGA manager framework566lb # [ 0.005360] CPU features: detected: Enhanced Virtualization Traps567worker2 # [ 0.172821] vgaarb: loaded568worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)569client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns570lb # [ 0.005364] CPU features: detected: Fine Grained Traps571worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000572worker2 # [ 0.173450] clocksource: Switched to clocksource arch_sys_counter573client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns574lb # [ 0.005368] CPU features: detected: Generic authentication (architected QARMA5 algorithm)575worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000576client # [ 0.000030] arm-pv: using stolen time PV577lb # [ 0.005373] CPU features: detected: RCpc load-acquire (LDAPR)578worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.579lb # [ 0.005376] CPU features: detected: LSE atomic instructions580client # [ 0.000409] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)581lb # [ 0.005379] CPU features: detected: Privileged Access Never582worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns583client # [ 0.000591] Console: colour dummy device 80x25584lb # [ 0.005382] CPU features: detected: PMUv3585client # [ 0.000598] printk: legacy console [tty0] enabled586worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).587lb # [ 0.005385] CPU features: detected: RAS Extension Support588worker2 # [ 0.177282] VFS: Disk quotas dquot_6.6.0589lb # [ 0.005388] CPU features: detected: RASv1p1 Extension Support590client # [ 0.000794] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)591worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns592worker2 # [ 0.177318] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)593lb # [ 0.005390] CPU features: detected: Random Number Generator594client # [ 0.000801] pid_max: default: 32768 minimum: 301595worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns596client # [ 0.000873] LSM: initializing lsm=capability,landlock,yama,bpf,ima597worker1 # [ 0.000031] arm-pv: using stolen time PV598client # [ 0.001007] landlock: Up and running.599lb # [ 0.005393] CPU features: detected: Speculation barrier (SB)600client # [ 0.001010] Yama: becoming mindful.601lb # [ 0.005396] CPU features: detected: Stage-2 Force Write-Back602client # [ 0.001476] LSM support for eBPF active603worker1 # [ 0.000396] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)604worker2 # [ 0.180962] netfs: FS-Cache loaded605worker1 # [ 0.000544] Console: colour dummy device 80x25606lb # [ 0.005398] CPU features: detected: TLB range maintenance instructions607worker2 # [ 0.181088] pnp: PnP ACPI: disabled608client # [ 0.001602] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)609worker1 # [ 0.000553] printk: legacy console [tty0] enabled610lb # [ 0.005403] CPU features: detected: Speculative Store Bypassing Safe (SSBS)611client # [ 0.001634] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)612lb # [ 0.005443] alternatives: applying system-wide alternatives613client # [ 0.003571] rcu: Hierarchical SRCU implementation.614worker1 # [ 0.000746] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)615lb # [ 0.008452] CPU features: detected: BBM Level 2 without TLB conflict abort616worker1 # [ 0.000753] pid_max: default: 32768 minimum: 301617client # [ 0.003576] rcu: Max phase no-delay instances is 1000.618client # [ 0.004835] fsl-mc MSI: its@8080000 domain created619worker1 # [ 0.000826] LSM: initializing lsm=capability,landlock,yama,bpf,ima620worker1 # [ 0.000976] landlock: Up and running.621client # [ 0.004924] EFI services will not be available.622worker1 # [ 0.000979] Yama: becoming mindful.623lb # [ 0.008624] Memory: 1405636K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124636K reserved, 32768K cma-reserved)624client # [ 0.004993] smp: Bringing up secondary CPUs ...625lb # [ 0.009006] devtmpfs: initialized626worker1 # [ 0.001418] LSM support for eBPF active627worker2 # [ 0.184905] NET: Registered PF_INET protocol family628client # [ 0.005001] smp: Brought up 1 node, 1 CPU629client # [ 0.005004] SMP: Total of 1 processors activated.630lb # [ 0.010898] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)631worker1 # [ 0.001585] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)632worker2 # [ 0.185156] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)633client # [ 0.005009] CPU: All CPU(s) started at EL1634worker1 # [ 0.001622] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)635lb # [ 0.010920] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).636client # [ 0.005019] CPU features: detected: Branch Target Identification637worker1 # [ 0.003446] rcu: Hierarchical SRCU implementation.638lb # [ 0.011103] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL639client # [ 0.005023] CPU features: detected: ARMv8.4 Translation Table Level640worker1 # [ 0.003451] rcu: Max phase no-delay instances is 1000.641lb # [ 0.011107] 0 pages in range for non-PLT usage642worker1 # [ 0.004738] fsl-mc MSI: its@8080000 domain created643lb # [ 0.011108] 508272 pages in range for PLT usage644client # [ 0.005026] CPU features: detected: Instruction cache invalidation not required for I/D coherence645worker1 # [ 0.004828] EFI services will not be available.646lb # [ 0.011200] pinctrl core: initialized pinctrl subsystem647worker1 # [ 0.004899] smp: Bringing up secondary CPUs ...648lb # [ 0.012002] DMI not present or invalid.649client # [ 0.005030] CPU features: detected: Data cache clean to the PoU not required for I/D coherence650worker1 # [ 0.004907] smp: Brought up 1 node, 1 CPU651lb # [ 0.015506] NET: Registered PF_NETLINK/PF_ROUTE protocol family652client # [ 0.005034] CPU features: detected: Common not Private translations653worker1 # [ 0.004911] SMP: Total of 1 processors activated.654worker1 # [ 0.004916] CPU: All CPU(s) started at EL1655client # [ 0.005037] CPU features: detected: CRC32 instructions656lb # [ 0.017723] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations657worker1 # [ 0.004926] CPU features: detected: Branch Target Identification658client # [ 0.005040] CPU features: detected: Data cache clean to Point of Deep Persistence659lb # [ 0.017925] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations660worker1 # [ 0.004931] CPU features: detected: ARMv8.4 Translation Table Level661client # [ 0.005043] CPU features: detected: Data cache clean to Point of Persistence662lb # [ 0.018124] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations663worker1 # [ 0.004934] CPU features: detected: Instruction cache invalidation not required for I/D coherence664client # [ 0.005046] CPU features: detected: Data independent timing control (DIT)665lb # [ 0.018145] audit: initializing netlink subsys (disabled)666client # [ 0.005049] CPU features: detected: E0PD667lb # [ 0.018729] thermal_sys: Registered thermal governor 'fair_share'668worker1 # [ 0.004938] CPU features: detected: Data cache clean to the PoU not required for I/D coherence669client # [ 0.005052] CPU features: detected: Enhanced Counter Virtualization670lb # [ 0.018731] thermal_sys: Registered thermal governor 'bang_bang'671worker1 # [ 0.004942] CPU features: detected: Common not Private translations672client # [ 0.005055] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)673worker1 # [ 0.004945] CPU features: detected: CRC32 instructions674lb # [ 0.018734] thermal_sys: Registered thermal governor 'step_wise'675client # [ 0.005058] CPU features: detected: Enhanced Virtualization Traps676lb # [ 0.018737] thermal_sys: Registered thermal governor 'user_space'677worker1 # [ 0.004948] CPU features: detected: Data cache clean to Point of Deep Persistence678client # [ 0.005061] CPU features: detected: Fine Grained Traps679lb # [ 0.018742] thermal_sys: Registered thermal governor 'power_allocator'680worker1 # [ 0.004951] CPU features: detected: Data cache clean to Point of Persistence681client # [ 0.005065] CPU features: detected: Generic authentication (architected QARMA5 algorithm)682lb # [ 0.018768] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1683worker1 # [ 0.004955] CPU features: detected: Data independent timing control (DIT)684lb # [ 0.018777] cpuidle: using governor ladder685worker1 # [ 0.004958] CPU features: detected: E0PD686client # [ 0.005070] CPU features: detected: RCpc load-acquire (LDAPR)687lb # [ 0.018783] cpuidle: using governor menu688client # [ 0.005072] CPU features: detected: LSE atomic instructions689worker1 # [ 0.004960] CPU features: detected: Enhanced Counter Virtualization690lb # [ 0.018968] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.691client # [ 0.005075] CPU features: detected: Privileged Access Never692worker1 # [ 0.004963] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)693lb # [ 0.018984] ASID allocator initialised with 65536 entries694client # [ 0.005078] CPU features: detected: PMUv3695lb # [ 0.020229] Serial: AMBA PL011 UART driver696worker1 # [ 0.004967] CPU features: detected: Enhanced Virtualization Traps697client # [ 0.005081] CPU features: detected: RAS Extension Support698worker1 # [ 0.004970] CPU features: detected: Fine Grained Traps699client # [ 0.005084] CPU features: detected: RASv1p1 Extension Support700lb # [ 0.025581] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1701client # [ 0.005086] CPU features: detected: Random Number Generator702lb # [ 0.025745] printk: console [ttyAMA0] enabled703worker1 # [ 0.004974] CPU features: detected: Generic authentication (architected QARMA5 algorithm)704worker1 # [ 0.004979] CPU features: detected: RCpc load-acquire (LDAPR)705client # [ 0.005089] CPU features: detected: Speculation barrier (SB)706client # [ 0.005091] CPU features: detected: Stage-2 Force Write-Back707worker1 # [ 0.004982] CPU features: detected: LSE atomic instructions708worker1 # [ 0.004984] CPU features: detected: Privileged Access Never709client # [ 0.005094] CPU features: detected: TLB range maintenance instructions710worker1 # [ 0.004987] CPU features: detected: PMUv3711client # [ 0.005098] CPU features: detected: Speculative Store Bypassing Safe (SSBS)712worker1 # [ 0.004990] CPU features: detected: RAS Extension Support713client # [ 0.005135] alternatives: applying system-wide alternatives714worker1 # [ 0.004993] CPU features: detected: RASv1p1 Extension Support715client # [ 0.008085] CPU features: detected: BBM Level 2 without TLB conflict abort716worker1 # [ 0.004995] CPU features: detected: Random Number Generator717worker1 # [ 0.004998] CPU features: detected: Speculation barrier (SB)718worker1 # [ 0.005001] CPU features: detected: Stage-2 Force Write-Back719client # [ 0.008262] Memory: 1405636K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124660K reserved, 32768K cma-reserved)720client # [ 0.008664] devtmpfs: initialized721lb # [ 0.142758] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages722worker1 # [ 0.005004] CPU features: detected: TLB range maintenance instructions723lb # [ 0.142776] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page724client # [ 0.010526] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)725worker1 # [ 0.005008] CPU features: detected: Speculative Store Bypassing Safe (SSBS)726lb # [ 0.142782] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages727worker1 # [ 0.005045] alternatives: applying system-wide alternatives728client # [ 0.010548] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).729lb # [ 0.142787] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page730worker1 # [ 0.008019] CPU features: detected: BBM Level 2 without TLB conflict abort731client # [ 0.010730] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL732lb # [ 0.142791] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages733lb # [ 0.142795] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page734worker1 # [ 0.008227] Memory: 1405672K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124664K reserved, 32768K cma-reserved)735worker1 # [ 0.008610] devtmpfs: initialized736lb # [ 0.142800] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages737lb # [ 0.142804] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page738worker1 # [ 0.010460] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)739worker1 # [ 0.010482] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).740worker1 # [ 0.010657] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL741lb # [ 0.150203] fbcon: Taking over console742worker1 # [ 0.010661] 0 pages in range for non-PLT usage743lb # [ 0.150218] ACPI: Interpreter disabled.744worker1 # [ 0.010662] 508272 pages in range for PLT usage745client # [ 0.010734] 0 pages in range for non-PLT usage746client # [ 0.010736] 508272 pages in range for PLT usage747worker2 # [ 0.214546] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)748client # [ 0.010849] pinctrl core: initialized pinctrl subsystem749client # [ 0.011581] DMI not present or invalid.750worker2 # [ 0.214586] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)751client # [ 0.014811] NET: Registered PF_NETLINK/PF_ROUTE protocol family752worker2 # [ 0.214613] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)753client # [ 0.017002] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations754worker2 # [ 0.214684] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)755client # [ 0.017193] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations756worker2 # [ 0.214826] TCP: Hash tables configured (established 16384 bind 16384)757client # [ 0.017393] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations758lb # [ 0.159221] iommu: Default domain type: Translated759worker2 # [ 0.214902] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)760worker1 # [ 0.010781] pinctrl core: initialized pinctrl subsystem761client # [ 0.017415] audit: initializing netlink subsys (disabled)762lb # [ 0.159233] iommu: DMA domain TLB invalidation policy: strict mode763worker1 # [ 0.011539] DMI not present or invalid.764worker2 # [ 0.214937] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)765lb # [ 0.159602] SCSI subsystem initialized766client # [ 0.018006] thermal_sys: Registered thermal governor 'fair_share'767worker1 # [ 0.014574] NET: Registered PF_NETLINK/PF_ROUTE protocol family768worker2 # [ 0.214973] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)769client # [ 0.018008] thermal_sys: Registered thermal governor 'bang_bang'770worker1 # [ 0.016938] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations771lb # [ 0.161512] usbcore: registered new interface driver usbfs772worker2 # [ 0.215070] NET: Registered PF_UNIX/PF_LOCAL protocol family773client # [ 0.018011] thermal_sys: Registered thermal governor 'step_wise'774lb # [ 0.161543] usbcore: registered new interface driver hub775worker2 # [ 0.215089] NET: Registered PF_XDP protocol family776worker1 # [ 0.017131] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations777client # [ 0.018014] thermal_sys: Registered thermal governor 'user_space'778worker2 # [ 0.215105] PCI: CLS 0 bytes, default 64779lb # [ 0.161558] usbcore: registered new device driver usb780client # [ 0.018019] thermal_sys: Registered thermal governor 'power_allocator'781worker1 # [ 0.017330] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations782lb # [ 0.161844] pps_core: LinuxPPS API ver. 1 registered783worker2 # [ 0.215341] Trying to unpack rootfs image as initramfs...784worker1 # [ 0.017353] audit: initializing netlink subsys (disabled)785client # [ 0.018050] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1786lb # [ 0.161851] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>787client # [ 0.018058] cpuidle: using governor ladder788worker1 # [ 0.017904] thermal_sys: Registered thermal governor 'fair_share'789lb # [ 0.161861] PTP clock support registered790client # [ 0.018064] cpuidle: using governor menu791lb # [ 0.161911] EDAC MC: Ver: 3.0.0792worker1 # [ 0.017906] thermal_sys: Registered thermal governor 'bang_bang'793client # [ 0.018257] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.794worker1 # [ 0.017909] thermal_sys: Registered thermal governor 'step_wise'795lb # [ 0.166384] scmi_core: SCMI protocol bus registered796worker2 # [ 0.230985] kvm [1]: HYP mode not available797client # [ 0.018273] ASID allocator initialised with 65536 entries798worker1 # [ 0.017912] thermal_sys: Registered thermal governor 'user_space'799client # [ 0.019463] Serial: AMBA PL011 UART driver800lb # [ 0.167364] FPGA manager framework801worker1 # [ 0.017918] thermal_sys: Registered thermal governor 'power_allocator'802lb # [ 0.168280] vgaarb: loaded803client # [ 0.024605] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1804worker1 # [ 0.017949] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1805client # [ 0.024724] printk: console [ttyAMA0] enabled806lb # [ 0.168910] clocksource: Switched to clocksource arch_sys_counter807worker1 # [ 0.017957] cpuidle: using governor ladder808worker1 # [ 0.017963] cpuidle: using governor menu809client # [ 0.145654] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages810worker1 # [ 0.018150] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.811client # [ 0.145674] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page812worker1 # [ 0.018165] ASID allocator initialised with 65536 entries813worker1 # [ 0.019333] Serial: AMBA PL011 UART driver814client # [ 0.145678] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages815client # [ 0.145683] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page816worker1 # [ 0.024495] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1817worker1 # [ 0.024648] printk: console [ttyAMA0] enabled818client # [ 0.145687] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages819client # [ 0.145691] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page820worker1 # [ 0.144400] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages821client # [ 0.145695] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages822lb # [ 0.175117] VFS: Disk quotas dquot_6.6.0823worker1 # [ 0.144419] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page824client # [ 0.145699] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page825lb # [ 0.175161] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)826worker1 # [ 0.144425] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages827lb # [ 0.176778] netfs: FS-Cache loaded828worker1 # [ 0.144429] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page829lb # [ 0.176903] pnp: PnP ACPI: disabled830worker1 # [ 0.144433] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages831client # [ 0.153251] fbcon: Taking over console832worker1 # [ 0.144437] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page833client # [ 0.153266] ACPI: Interpreter disabled.834client # [ 0.155152] iommu: Default domain type: Translated835worker1 # [ 0.144441] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages836worker1 # [ 0.144446] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page837client # [ 0.155162] iommu: DMA domain TLB invalidation policy: strict mode838lb # [ 0.180760] NET: Registered PF_INET protocol family839client # [ 0.156909] SCSI subsystem initialized840worker1 # [ 0.151972] fbcon: Taking over console841worker1 # [ 0.151985] ACPI: Interpreter disabled.842worker1 # [ 0.153834] iommu: Default domain type: Translated843worker1 # [ 0.153843] iommu: DMA domain TLB invalidation policy: strict mode844lb # [ 0.181641] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)845worker1 # [ 0.155521] SCSI subsystem initialized846client # [ 0.164625] usbcore: registered new interface driver usbfs847client # [ 0.164650] usbcore: registered new interface driver hub848client # [ 0.164683] usbcore: registered new device driver usb849client # [ 0.164942] pps_core: LinuxPPS API ver. 1 registered850client # [ 0.164949] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>851client # [ 0.164959] PTP clock support registered852client # [ 0.164999] EDAC MC: Ver: 3.0.0853worker1 # [ 0.163355] usbcore: registered new interface driver usbfs854client # [ 0.169657] scmi_core: SCMI protocol bus registered855worker1 # [ 0.163388] usbcore: registered new interface driver hub856worker1 # [ 0.163403] usbcore: registered new device driver usb857client # [ 0.170625] FPGA manager framework858client # [ 0.171592] vgaarb: loaded859worker1 # [ 0.163684] pps_core: LinuxPPS API ver. 1 registered860worker1 # [ 0.163690] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>861client # [ 0.172221] clocksource: Switched to clocksource arch_sys_counter862worker1 # [ 0.163700] PTP clock support registered863worker1 # [ 0.163755] EDAC MC: Ver: 3.0.0864client # [ 0.173616] VFS: Disk quotas dquot_6.6.0865worker1 # [ 0.168379] scmi_core: SCMI protocol bus registered866client # [ 0.173647] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)867client # [ 0.175214] netfs: FS-Cache loaded868worker1 # [ 0.169342] FPGA manager framework869client # [ 0.175311] pnp: PnP ACPI: disabled870worker1 # [ 0.170285] vgaarb: loaded871worker1 # [ 0.170917] clocksource: Switched to clocksource arch_sys_counter872worker1 # [ 0.171525] VFS: Disk quotas dquot_6.6.0873worker1 # [ 0.171553] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)874worker1 # [ 0.173864] netfs: FS-Cache loaded875worker1 # [ 0.173987] pnp: PnP ACPI: disabled876client # [ 0.181178] NET: Registered PF_INET protocol family877client # [ 0.181466] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)878worker1 # [ 0.180011] NET: Registered PF_INET protocol family879worker1 # [ 0.180272] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)880lb # [ 0.211068] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)881lb # [ 0.211108] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)882lb # [ 0.211135] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)883lb # [ 0.211206] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)884lb # [ 0.211350] TCP: Hash tables configured (established 16384 bind 16384)885lb # [ 0.211431] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)886lb # [ 0.211465] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)887lb # [ 0.211501] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)888lb # [ 0.211590] NET: Registered PF_UNIX/PF_LOCAL protocol family889lb # [ 0.211615] NET: Registered PF_XDP protocol family890lb # [ 0.211631] PCI: CLS 0 bytes, default 64891lb # [ 0.211871] Trying to unpack rootfs image as initramfs...892lb # [ 0.226479] kvm [1]: HYP mode not available893client # [ 0.210654] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)894client # [ 0.210696] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)895client # [ 0.210722] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)896client # [ 0.210792] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)897client # [ 0.210935] TCP: Hash tables configured (established 16384 bind 16384)898client # [ 0.211019] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)899client # [ 0.211054] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)900client # [ 0.211090] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)901client # [ 0.211209] NET: Registered PF_UNIX/PF_LOCAL protocol family902client # [ 0.211236] NET: Registered PF_XDP protocol family903client # [ 0.211254] PCI: CLS 0 bytes, default 64904worker1 # [ 0.210190] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)905client # [ 0.211481] Trying to unpack rootfs image as initramfs...906worker1 # [ 0.210233] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)907worker1 # [ 0.210262] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)908worker1 # [ 0.210339] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)909worker1 # [ 0.210482] TCP: Hash tables configured (established 16384 bind 16384)910worker1 # [ 0.210567] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)911worker1 # [ 0.210602] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)912worker1 # [ 0.210637] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)913worker2 # [ 0.322065] Initialise system trusted keyrings914worker1 # [ 0.210732] NET: Registered PF_UNIX/PF_LOCAL protocol family915client # [ 0.226085] kvm [1]: HYP mode not available916worker2 # [ 0.322816] workingset: timestamp_bits=42 max_order=19 bucket_order=0917worker1 # [ 0.210785] NET: Registered PF_XDP protocol family918worker1 # [ 0.210804] PCI: CLS 0 bytes, default 64919worker2 # [ 0.324060] squashfs: version 4.0 (2009/01/31) Phillip Lougher920worker1 # [ 0.211029] Trying to unpack rootfs image as initramfs...921worker2 # [ 0.324844] 9p: Installing v9fs 9p2000 file system support922worker1 # [ 0.228738] kvm [1]: HYP mode not available923worker2 # [ 0.353667] Key type asymmetric registered924worker2 # [ 0.353696] Asymmetric key parser 'x509' registered925worker2 # [ 0.353775] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)926worker2 # [ 0.355896] io scheduler mq-deadline registered927worker2 # [ 0.355907] io scheduler kyber registered928worker2 # [ 0.365613] pl061_gpio 9030000.pl061: PL061 GPIO chip registered929worker2 # [ 0.367055] ledtrig-cpu: registered to indicate activity on CPUs930worker2 # [ 0.367479] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:931worker2 # [ 0.367497] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000932worker2 # [ 0.367510] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000933worker2 # [ 0.367518] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000934worker2 # [ 0.367538] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits935worker2 # [ 0.367567] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]936worker2 # [ 0.367737] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00937worker2 # [ 0.367747] pci_bus 0000:00: root bus resource [bus 00-ff]938worker2 # [ 0.367753] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]939worker2 # [ 0.367758] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]940worker2 # [ 0.367764] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]941worker2 # [ 0.368003] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint942worker2 # [ 0.368480] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint943worker2 # [ 0.368663] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]944worker2 # [ 0.368679] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]945lb # [ 0.317512] Initialise system trusted keyrings946worker2 # [ 0.368708] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]947worker2 # [ 0.368724] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]948lb # [ 0.318280] workingset: timestamp_bits=42 max_order=19 bucket_order=0949worker2 # [ 0.369169] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint950worker2 # [ 0.369348] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]951worker2 # [ 0.369363] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]952worker2 # [ 0.369391] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]953worker2 # [ 0.389128] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint954worker2 # [ 0.389311] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f]955worker2 # [ 0.389327] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]956worker2 # [ 0.389356] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]957lb # [ 0.325364] squashfs: version 4.0 (2009/01/31) Phillip Lougher958lb # [ 0.326217] 9p: Installing v9fs 9p2000 file system support959worker2 # [ 0.397905] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint960worker2 # [ 0.398102] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]961worker2 # [ 0.398118] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]962worker2 # [ 0.398148] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]963worker2 # [ 0.398167] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref]964worker2 # [ 0.398622] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint965worker2 # [ 0.398805] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]966worker2 # [ 0.398833] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]967client # [ 0.320990] Initialise system trusted keyrings968worker2 # [ 0.399275] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint969lb # [ 0.346234] Key type asymmetric registered970client # [ 0.321761] workingset: timestamp_bits=42 max_order=19 bucket_order=0971worker2 # [ 0.399460] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]972lb # [ 0.346256] Asymmetric key parser 'x509' registered973worker2 # [ 0.399489] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]974client # [ 0.323039] squashfs: version 4.0 (2009/01/31) Phillip Lougher975lb # [ 0.346332] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)976worker2 # [ 0.399892] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint977lb # [ 0.348415] io scheduler mq-deadline registered978client # [ 0.323785] 9p: Installing v9fs 9p2000 file system support979lb # [ 0.348426] io scheduler kyber registered980worker2 # [ 0.400072] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff]981worker2 # [ 0.400372] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint982worker2 # [ 0.400556] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]983worker2 # [ 0.400585] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]984worker2 # [ 0.401028] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint985worker2 # [ 0.401213] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]986worker1 # [ 0.323986] Initialise system trusted keyrings987worker2 # [ 0.401244] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]988worker1 # [ 0.324733] workingset: timestamp_bits=42 max_order=19 bucket_order=0989worker2 # [ 0.401707] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint990worker2 # [ 0.401889] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff]991worker1 # [ 0.325994] squashfs: version 4.0 (2009/01/31) Phillip Lougher992worker2 # [ 0.401918] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]993worker1 # [ 0.326774] 9p: Installing v9fs 9p2000 file system support994worker2 # [ 0.402377] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint995worker2 # [ 0.402669] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]996worker2 # [ 0.402685] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]997worker2 # [ 0.402714] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]998worker2 # [ 0.403161] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint999worker2 # [ 0.403338] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1000worker2 # [ 0.403354] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1001lb # [ 0.361627] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1002worker2 # [ 0.403383] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1003worker2 # [ 0.403943] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1004worker2 # [ 0.403954] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1005lb # [ 0.362953] ledtrig-cpu: registered to indicate activity on CPUs1006worker2 # [ 0.403960] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1007lb # [ 0.363340] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1008worker2 # [ 0.404003] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1009lb # [ 0.363357] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001010worker2 # [ 0.404053] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1011lb # [ 0.363370] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001012worker2 # [ 0.404098] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1013lb # [ 0.363378] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001014worker2 # [ 0.404143] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1015lb # [ 0.363402] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1016worker2 # [ 0.404188] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1017lb # [ 0.363424] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1018worker2 # [ 0.404233] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1019lb # [ 0.363499] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001020worker2 # [ 0.404278] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1021lb # [ 0.363509] pci_bus 0000:00: root bus resource [bus 00-ff]1022worker2 # [ 0.404344] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1023lb # [ 0.363515] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1024worker2 # [ 0.404390] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1025lb # [ 0.363520] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1026lb # [ 0.363525] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1027worker2 # [ 0.404461] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1028worker2 # [ 0.404508] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1029lb # [ 0.363824] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1030client # [ 0.352503] Key type asymmetric registered1031worker2 # [ 0.404529] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1032lb # [ 0.364258] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1033client # [ 0.352531] Asymmetric key parser 'x509' registered1034worker2 # [ 0.404550] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1035lb # [ 0.364441] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1036client # [ 0.352598] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)1037worker2 # [ 0.404571] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1038lb # [ 0.364457] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1039client # [ 0.354689] io scheduler mq-deadline registered1040worker2 # [ 0.404592] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1041lb # [ 0.364486] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1042client # [ 0.354701] io scheduler kyber registered1043lb # [ 0.364503] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1044worker2 # [ 0.404612] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1045worker2 # [ 0.404633] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned1046lb # [ 0.380827] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1047worker2 # [ 0.404658] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1048worker2 # [ 0.404679] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1049worker2 # [ 0.404700] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned1050worker2 # [ 0.404722] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1051worker2 # [ 0.404743] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1052worker1 # [ 0.355444] Key type asymmetric registered1053worker2 # [ 0.404764] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned1054worker1 # [ 0.355471] Asymmetric key parser 'x509' registered1055worker2 # [ 0.404784] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned1056worker1 # [ 0.355555] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)1057worker2 # [ 0.404805] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned1058worker1 # [ 0.357709] io scheduler mq-deadline registered1059worker2 # [ 0.404826] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned1060worker1 # [ 0.357721] io scheduler kyber registered1061worker2 # [ 0.404846] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned1062lb # [ 0.385063] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1063worker2 # [ 0.404867] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned1064client # [ 0.364369] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1065lb # [ 0.385095] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1066worker2 # [ 0.404892] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1067lb # [ 0.385125] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1068worker2 # [ 0.404901] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1069lb # [ 0.385616] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1070worker2 # [ 0.404905] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1071lb # [ 0.385825] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f]1072client # [ 0.365771] ledtrig-cpu: registered to indicate activity on CPUs1073lb # [ 0.385841] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1074client # [ 0.366175] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1075lb # [ 0.385871] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1076lb # [ 0.386322] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1077client # [ 0.366192] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001078lb # [ 0.386504] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1079client # [ 0.366205] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001080lb # [ 0.386520] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1081lb # [ 0.386549] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1082client # [ 0.366214] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001083lb # [ 0.386567] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref]1084worker1 # [ 0.367059] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1085client # [ 0.366241] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1086lb # [ 0.387026] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1087client # [ 0.366266] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1088lb # [ 0.387212] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1089client # [ 0.366340] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001090lb # [ 0.387242] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1091client # [ 0.366350] pci_bus 0000:00: root bus resource [bus 00-ff]1092worker1 # [ 0.368437] ledtrig-cpu: registered to indicate activity on CPUs1093lb # [ 0.387698] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1094client # [ 0.366356] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1095worker2 # [ 0.465794] pci 0000:00:07.0: enabling device (0000 -> 0002)1096worker1 # [ 0.368847] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1097lb # [ 0.387883] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1098client # [ 0.366361] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1099lb # [ 0.387913] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1100client # [ 0.366366] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1101worker1 # [ 0.368864] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001102lb # [ 0.388298] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1103client # [ 0.366421] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1104worker1 # [ 0.368889] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001105lb # [ 0.388479] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff]1106client # [ 0.366866] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1107worker1 # [ 0.368898] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001108lb # [ 0.388751] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1109client # [ 0.367054] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1110worker1 # [ 0.368925] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1111client # [ 0.367071] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1112worker1 # [ 0.368949] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1113client # [ 0.367102] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1114client # [ 0.367118] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1115worker1 # [ 0.369028] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001116worker1 # [ 0.369038] pci_bus 0000:00: root bus resource [bus 00-ff]1117client # [ 0.367588] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1118worker1 # [ 0.369043] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1119client # [ 0.367773] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1120worker1 # [ 0.369048] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1121client # [ 0.367789] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1122worker1 # [ 0.369053] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1123client # [ 0.367819] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1124worker1 # [ 0.369121] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1125client # [ 0.387496] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1126lb # [ 0.408986] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1127worker1 # [ 0.369563] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1128client # [ 0.387684] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f]1129worker1 # [ 0.369751] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1130lb # [ 0.409028] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1131client # [ 0.387700] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1132worker1 # [ 0.369767] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1133lb # [ 0.409505] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1134client # [ 0.387730] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1135worker1 # [ 0.369798] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1136lb # [ 0.409693] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1137worker1 # [ 0.369816] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1138client # [ 0.388193] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1139lb # [ 0.409723] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1140worker1 # [ 0.370290] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1141lb # [ 0.410188] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1142worker1 # [ 0.370475] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1143lb # [ 0.410373] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff]1144worker1 # [ 0.370492] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1145lb # [ 0.410403] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1146worker1 # [ 0.370522] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1147lb # [ 0.410868] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1148lb # [ 0.411170] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1149lb # [ 0.411189] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1150worker1 # [ 0.389724] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1151worker1 # [ 0.389911] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f]1152lb # [ 0.411218] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1153worker1 # [ 0.389927] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1154lb # [ 0.411672] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1155worker1 # [ 0.389957] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1156lb # [ 0.411855] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1157worker2 # [ 0.487024] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1158lb # [ 0.411871] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1159worker1 # [ 0.390423] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1160worker2 # [ 0.489294] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1161worker1 # [ 0.390607] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1162lb # [ 0.411901] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1163worker1 # [ 0.390623] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1164lb # [ 0.412467] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1165worker1 # [ 0.390652] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1166lb # [ 0.412479] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1167worker1 # [ 0.390671] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref]1168lb # [ 0.412484] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1169client # [ 0.396454] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1170lb # [ 0.412529] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1171client # [ 0.396485] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1172lb # [ 0.412578] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1173client # [ 0.396515] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1174lb # [ 0.412625] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1175client # [ 0.396535] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref]1176lb # [ 0.412674] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1177client # [ 0.397048] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1178client # [ 0.397237] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1179lb # [ 0.412721] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1180client # [ 0.397267] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1181lb # [ 0.412768] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1182client # [ 0.397743] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1183lb # [ 0.412815] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1184client # [ 0.397937] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1185lb # [ 0.412863] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1186worker2 # [ 0.499247] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1187client # [ 0.397967] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1188worker2 # [ 0.501215] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1189lb # [ 0.412909] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1190client # [ 0.398399] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1191client # [ 0.398583] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff]1192client # [ 0.398836] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1193client # [ 0.399027] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1194client # [ 0.399057] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1195worker1 # [ 0.403240] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1196client # [ 0.399516] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1197worker1 # [ 0.403451] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1198client # [ 0.399705] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1199worker1 # [ 0.403483] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1200client # [ 0.399735] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1201worker1 # [ 0.403964] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1202client # [ 0.400194] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1203worker1 # [ 0.404154] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1204client # [ 0.400399] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff]1205lb # [ 0.441159] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1206worker1 # [ 0.404184] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1207client # [ 0.400430] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1208lb # [ 0.441225] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1209worker1 # [ 0.404592] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1210lb # [ 0.441248] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1211client # [ 0.400889] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1212worker2 # [ 0.511429] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002)1213worker1 # [ 0.404775] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff]1214client # [ 0.401171] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1215lb # [ 0.441270] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1216client # [ 0.401189] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1217worker1 # [ 0.405038] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1218lb # [ 0.441293] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1219worker1 # [ 0.405226] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1220client # [ 0.401219] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1221lb # [ 0.441316] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1222worker1 # [ 0.405256] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1223lb # [ 0.441338] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1224client # [ 0.401702] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1225client # [ 0.401888] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1226worker1 # [ 0.405707] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1227lb # [ 0.441361] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned1228client # [ 0.401904] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1229worker1 # [ 0.405894] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1230lb # [ 0.441389] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1231client # [ 0.401934] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1232worker1 # [ 0.405924] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1233lb # [ 0.441411] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1234client # [ 0.402513] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1235lb # [ 0.441437] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned1236worker1 # [ 0.406378] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1237client # [ 0.402525] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1238worker1 # [ 0.406566] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff]1239lb # [ 0.441461] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1240worker1 # [ 0.406596] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1241client # [ 0.402530] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1242lb # [ 0.441483] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1243lb # [ 0.441504] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned1244worker1 # [ 0.407076] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1245client # [ 0.402575] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1246worker2 # [ 0.517551] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002)1247lb # [ 0.441525] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned1248worker1 # [ 0.407367] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1249worker2 # [ 0.519336] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1250client # [ 0.402622] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1251lb # [ 0.441547] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned1252worker1 # [ 0.407385] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1253lb # [ 0.441568] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned1254client # [ 0.402670] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1255worker1 # [ 0.407416] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1256lb # [ 0.441591] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned1257client # [ 0.402717] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1258worker1 # [ 0.407889] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1259lb # [ 0.441613] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned1260worker1 # [ 0.408082] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1261client # [ 0.402763] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1262lb # [ 0.441643] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1263worker1 # [ 0.408098] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1264lb # [ 0.441653] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1265client # [ 0.402810] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1266worker1 # [ 0.408128] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1267lb # [ 0.441658] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1268client # [ 0.402857] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1269worker1 # [ 0.408704] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1270lb # [ 0.442512] pci 0000:00:07.0: enabling device (0000 -> 0002)1271client # [ 0.402903] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1272worker1 # [ 0.408716] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1273client # [ 0.402950] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1274worker1 # [ 0.408722] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1275worker1 # [ 0.408767] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1276client # [ 0.403026] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1277client # [ 0.403072] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1278worker1 # [ 0.408815] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1279client # [ 0.403094] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1280worker1 # [ 0.408862] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1281client # [ 0.403115] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1282worker1 # [ 0.408910] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1283client # [ 0.403138] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1284worker2 # [ 0.529597] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1285worker1 # [ 0.408957] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1286client # [ 0.403159] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1287worker2 # [ 0.531465] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002)1288worker1 # [ 0.409003] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1289client # [ 0.403180] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1290worker2 # [ 0.533280] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1291worker1 # [ 0.409050] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1292client # [ 0.403201] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned1293worker1 # [ 0.409096] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1294client # [ 0.403226] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1295client # [ 0.403248] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1296worker1 # [ 0.409143] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1297client # [ 0.403270] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned1298worker1 # [ 0.409218] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1299client # [ 0.403292] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1300worker1 # [ 0.409264] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1301client # [ 0.403315] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1302worker1 # [ 0.409285] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1303client # [ 0.403337] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned1304worker1 # [ 0.409309] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1305client # [ 0.403360] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned1306worker1 # [ 0.409331] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1307client # [ 0.403381] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned1308worker1 # [ 0.409352] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1309client # [ 0.403403] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned1310worker1 # [ 0.409374] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1311client # [ 0.403424] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned1312worker1 # [ 0.409395] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned1313client # [ 0.403445] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned1314worker2 # [ 0.543827] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1315worker1 # [ 0.409422] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1316client # [ 0.403471] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1317worker1 # [ 0.409444] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1318client # [ 0.403480] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1319worker1 # [ 0.409468] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned1320client # [ 0.403485] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1321worker1 # [ 0.409490] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1322worker1 # [ 0.409512] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1323worker1 # [ 0.409534] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned1324worker1 # [ 0.409554] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned1325worker1 # [ 0.409575] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned1326lb # [ 0.483210] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1327worker1 # [ 0.409596] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned1328worker1 # [ 0.409618] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned1329worker1 # [ 0.409639] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned1330worker1 # [ 0.409664] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1331worker1 # [ 0.409674] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1332worker1 # [ 0.409679] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1333worker1 # [ 0.410519] pci 0000:00:07.0: enabling device (0000 -> 0002)1334client # [ 0.464409] pci 0000:00:07.0: enabling device (0000 -> 0002)1335worker2 # [ 0.557032] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1336worker2 # [ 0.559566] msm_serial: driver initialized1337worker2 # [ 0.559702] SuperH (H)SCI(F) driver initialized1338worker2 # [ 0.559756] STM32 USART driver initialized1339worker1 # [ 0.467072] pci 0000:00:07.0: quirk_usb_early_handoff+0x0/0xa60 took 55232 usecs1340lb # [ 0.493328] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1341lb # [ 0.496906] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1342lb # [ 0.498852] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1343lb # [ 0.500816] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002)1344client # [ 0.485520] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1345client # [ 0.487649] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1346worker1 # [ 0.487694] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1347lb # [ 0.518745] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002)1348worker1 # [ 0.489894] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1349lb # [ 0.520696] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1350client # [ 0.498355] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1351lb # [ 0.524130] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1352worker2 # [ 0.592168] loop: module loaded1353worker2 # [ 0.592363] virtio_blk virtio2: 1/0/0 default/read/poll queues1354worker2 # [ 0.593119] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1355lb # [ 0.526728] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002)1356lb # [ 0.528654] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1357worker1 # [ 0.500901] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1358client # [ 0.504345] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1359client # [ 0.506496] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002)1360worker2 # [ 0.598029] megasas: 07.734.00.00-rc11361worker2 # [ 0.598729] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1362lb # [ 0.538435] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1363worker1 # [ 0.506954] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1364worker1 # [ 0.509039] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002)1365client # [ 0.516387] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002)1366client # [ 0.518259] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1367worker2 # [ 0.609490] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001368worker2 # [ 0.609513] Intel/Sharp Extended Query Table at 0x00311369worker2 # [ 0.611308] Using buffer write method1370worker2 # [ 0.611370] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1371worker2 # [ 0.613157] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001372worker2 # [ 0.613182] Intel/Sharp Extended Query Table at 0x00311373worker1 # [ 0.519119] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002)1374worker1 # [ 0.520985] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1375lb # [ 0.554205] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1376worker1 # [ 0.522846] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1377client # [ 0.528367] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1378lb # [ 0.556796] msm_serial: driver initialized1379client # [ 0.530863] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002)1380worker2 # [ 0.626542] Using buffer write method1381worker2 # [ 0.626578] Concatenating MTD devices:1382worker2 # [ 0.626582] (0): "0.flash"1383lb # [ 0.557496] SuperH (H)SCI(F) driver initialized1384worker2 # [ 0.626586] (1): "0.flash"1385lb # [ 0.557560] STM32 USART driver initialized1386worker2 # [ 0.626594] into device "0.flash"1387worker1 # [ 0.533291] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002)1388client # [ 0.540852] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1389client # [ 0.543696] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1390worker1 # [ 0.543091] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1391worker1 # [ 0.546538] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1392client # [ 0.557472] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1393client # [ 0.560094] msm_serial: driver initialized1394client # [ 0.560767] SuperH (H)SCI(F) driver initialized1395client # [ 0.560828] STM32 USART driver initialized1396lb # [ 0.589517] loop: module loaded1397worker1 # [ 0.560371] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1398lb # [ 0.589729] virtio_blk virtio2: 1/0/0 default/read/poll queues1399lb # [ 0.590594] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1400worker1 # [ 0.562986] msm_serial: driver initialized1401worker1 # [ 0.563133] SuperH (H)SCI(F) driver initialized1402worker1 # [ 0.563186] STM32 USART driver initialized1403lb # [ 0.601524] megasas: 07.734.00.00-rc11404lb # [ 0.602270] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1405lb # [ 0.604677] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001406lb # [ 0.604701] Intel/Sharp Extended Query Table at 0x00311407lb # [ 0.606253] Using buffer write method1408lb # [ 0.606316] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1409lb # [ 0.608085] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001410lb # [ 0.608107] Intel/Sharp Extended Query Table at 0x00311411client # [ 0.593435] loop: module loaded1412client # [ 0.593786] virtio_blk virtio2: 1/0/0 default/read/poll queues1413client # [ 0.594637] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1414lb # [ 0.625507] Using buffer write method1415lb # [ 0.625543] Concatenating MTD devices:1416lb # [ 0.625547] (0): "0.flash"1417lb # [ 0.625551] (1): "0.flash"1418lb # [ 0.625560] into device "0.flash"1419worker1 # [ 0.596796] loop: module loaded1420client # [ 0.600836] megasas: 07.734.00.00-rc11421worker1 # [ 0.596989] virtio_blk virtio2: 1/0/0 default/read/poll queues1422client # [ 0.601618] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1423worker1 # [ 0.597720] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1424client # [ 0.603838] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001425client # [ 0.603862] Intel/Sharp Extended Query Table at 0x00311426worker1 # [ 0.603522] megasas: 07.734.00.00-rc11427worker1 # [ 0.604273] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1428worker1 # [ 0.606138] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001429worker1 # [ 0.606188] Intel/Sharp Extended Query Table at 0x00311430client # [ 0.613279] Using buffer write method1431client # [ 0.613357] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1432worker1 # [ 0.616052] Using buffer write method1433worker1 # [ 0.616122] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1434worker1 # [ 0.617841] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001435client # [ 0.624260] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001436worker1 # [ 0.617863] Intel/Sharp Extended Query Table at 0x00311437client # [ 0.624284] Intel/Sharp Extended Query Table at 0x00311438client # [ 0.625830] Using buffer write method1439client # [ 0.625858] Concatenating MTD devices:1440client # [ 0.625862] (0): "0.flash"1441client # [ 0.625866] (1): "0.flash"1442client # [ 0.625875] into device "0.flash"1443worker1 # [ 0.629617] Using buffer write method1444worker1 # [ 0.629646] Concatenating MTD devices:1445worker1 # [ 0.629650] (0): "0.flash"1446worker1 # [ 0.629659] (1): "0.flash"1447worker1 # [ 0.629663] into device "0.flash"1448worker2 # [ 0.870426] Freeing initrd memory: 26944K1449worker2 # [ 0.876497] tun: Universal TUN/TAP device driver, 1.61450worker2 # [ 0.880268] thunder_xcv, ver 1.01451worker2 # [ 0.880342] thunder_bgx, ver 1.01452worker2 # [ 0.880365] nicpf, ver 1.01453worker2 # [ 0.880943] e1000: Intel(R) PRO/1000 Network Driver1454worker2 # [ 0.880950] e1000: Copyright (c) 1999-2006 Intel Corporation.1455worker2 # [ 0.880974] e1000e: Intel(R) PRO/1000 Network Driver1456worker2 # [ 0.880981] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1457worker2 # [ 0.881013] igb: Intel(R) Gigabit Ethernet Network Driver1458worker2 # [ 0.881019] igb: Copyright (c) 2007-2014 Intel Corporation.1459worker2 # [ 0.881043] igbvf: Intel(R) Gigabit Virtual Function Network Driver1460worker2 # [ 0.881049] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1461worker2 # [ 0.881182] sky2: driver version 1.301462worker2 # [ 0.890172] ehci-pci 0000:00:07.0: EHCI Host Controller1463worker2 # [ 0.890203] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 11464worker2 # [ 0.890441] ehci-pci 0000:00:07.0: irq 16, io mem 0x100860001465worker2 # [ 0.893096] usbcore: registered new interface driver usb-storage1466worker2 # [ 0.893195] usbcore: registered new interface driver usbserial_generic1467worker2 # [ 0.893209] usbserial: USB Serial support registered for generic1468worker2 # [ 0.896032] hv_vmbus: registering driver hyperv_keyboard1469worker2 # [ 0.897612] rtc-pl031 9010000.pl031: registered as rtc01470worker2 # [ 0.897635] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T15:04:32 UTC (1790089472)1471worker2 # [ 0.897934] i2c_dev: i2c /dev entries driver1472worker2 # [ 0.903192] sdhci: Secure Digital Host Controller Interface driver1473worker2 # [ 0.903203] sdhci: Copyright(c) Pierre Ossman1474worker2 # [ 0.903472] Synopsys Designware Multimedia Card Interface Driver1475worker2 # [ 0.903838] sdhci-pltfm: SDHCI platform and OF driver helper1476worker2 # [ 0.905349] hid: raw HID events driver (C) Jiri Kosina1477worker2 # [ 0.908720] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.001478worker2 # [ 0.909018] hub 1-0:1.0: USB hub found1479worker2 # [ 0.909039] hub 1-0:1.0: 6 ports detected1480worker2 # [ 0.911207] usbcore: registered new interface driver usbhid1481worker2 # [ 0.911216] usbhid: USB HID core driver1482worker2 # [ 0.913490] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1483worker2 # [ 0.914992] drop_monitor: Initializing network drop monitor service1484worker2 # [ 0.915129] NET: Registered PF_INET6 protocol family1485worker2 # [ 0.918060] Segment Routing with IPv61486worker2 # [ 0.918077] In-situ OAM (IOAM) with IPv61487worker2 # [ 0.918103] NET: Registered PF_PACKET protocol family1488worker2 # [ 0.919735] 9pnet: Installing 9P2000 support1489worker2 # [ 0.919783] Key type dns_resolver registered1490worker2 # [ 0.926292] registered taskstats version 11491worker2 # [ 0.926437] Loading compiled-in X.509 certificates1492worker2 # [ 0.935315] Demotion targets for Node 0: null1493worker2 # [ 0.935428] Key type .fscrypt registered1494worker2 # [ 0.935435] Key type fscrypt-provisioning registered1495worker2 # [ 0.935534] ima: No TPM chip found, activating TPM-bypass!1496lb # [ 0.871096] Freeing initrd memory: 26948K1497worker2 # [ 0.935554] ima: Allocated hash algorithm: sha11498worker2 # [ 0.935577] ima: No architecture policies found1499worker2 # [ 0.939617] input: gpio-keys as /devices/platform/gpio-keys/input/input01500lb # [ 0.877195] tun: Universal TUN/TAP device driver, 1.61501lb # [ 0.881021] thunder_xcv, ver 1.01502lb # [ 0.881062] thunder_bgx, ver 1.01503lb # [ 0.881084] nicpf, ver 1.01504lb # [ 0.881660] e1000: Intel(R) PRO/1000 Network Driver1505lb # [ 0.881668] e1000: Copyright (c) 1999-2006 Intel Corporation.1506lb # [ 0.881695] e1000e: Intel(R) PRO/1000 Network Driver1507lb # [ 0.881704] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1508lb # [ 0.881736] igb: Intel(R) Gigabit Ethernet Network Driver1509lb # [ 0.881742] igb: Copyright (c) 2007-2014 Intel Corporation.1510worker2 # [ 0.957044] clk: Disabling unused clocks1511lb # [ 0.881766] igbvf: Intel(R) Gigabit Virtual Function Network Driver1512worker2 # [ 0.957069] PM: genpd: Disabling unused power domains1513lb # [ 0.881780] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1514lb # [ 0.881917] sky2: driver version 1.301515lb # [ 0.883522] usbcore: registered new interface driver usb-storage1516lb # [ 0.883608] usbcore: registered new interface driver usbserial_generic1517lb # [ 0.883621] usbserial: USB Serial support registered for generic1518worker2 # [ 0.961156] Freeing unused kernel memory: 4736K1519lb # [ 0.884220] hv_vmbus: registering driver hyperv_keyboard1520worker2 # [ 0.961332] Run /init as init process1521lb # [ 0.885688] ehci-pci 0000:00:07.0: EHCI Host Controller1522lb # [ 0.885719] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 11523lb # [ 0.886021] ehci-pci 0000:00:07.0: irq 16, io mem 0x100860001524lb # [ 0.898195] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.001525lb # [ 0.898521] hub 1-0:1.0: USB hub found1526lb # [ 0.898543] hub 1-0:1.0: 6 ports detected1527client # [ 0.876261] Freeing initrd memory: 26972K1528lb # [ 0.900783] rtc-pl031 9010000.pl031: registered as rtc01529lb # [ 0.900819] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T15:04:32 UTC (1790089472)1530lb # [ 0.903005] i2c_dev: i2c /dev entries driver1531client # [ 0.882293] tun: Universal TUN/TAP device driver, 1.61532lb # [ 0.906630] sdhci: Secure Digital Host Controller Interface driver1533worker2 # [ 0.975696] systemd[1]: Successfully made /usr/ read-only.1534lb # [ 0.906642] sdhci: Copyright(c) Pierre Ossman1535lb # [ 0.906902] Synopsys Designware Multimedia Card Interface Driver1536lb # [ 0.907271] sdhci-pltfm: SDHCI platform and OF driver helper1537lb # [ 0.908780] hid: raw HID events driver (C) Jiri Kosina1538lb # [ 0.912380] usbcore: registered new interface driver usbhid1539lb # [ 0.912391] usbhid: USB HID core driver1540client # [ 0.886017] thunder_xcv, ver 1.01541client # [ 0.886060] thunder_bgx, ver 1.01542client # [ 0.886102] nicpf, ver 1.01543client # [ 0.886652] e1000: Intel(R) PRO/1000 Network Driver1544worker1 # [ 0.884996] Freeing initrd memory: 26976K1545client # [ 0.886660] e1000: Copyright (c) 1999-2006 Intel Corporation.1546client # [ 0.886685] e1000e: Intel(R) PRO/1000 Network Driver1547client # [ 0.886693] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1548lb # [ 0.914726] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1549client # [ 0.886722] igb: Intel(R) Gigabit Ethernet Network Driver1550lb # [ 0.916247] drop_monitor: Initializing network drop monitor service1551client # [ 0.886728] igb: Copyright (c) 2007-2014 Intel Corporation.1552lb # [ 0.916439] NET: Registered PF_INET6 protocol family1553client # [ 0.886764] igbvf: Intel(R) Gigabit Virtual Function Network Driver1554lb # [ 0.919599] Segment Routing with IPv61555client # [ 0.886770] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1556lb # [ 0.919619] In-situ OAM (IOAM) with IPv61557client # [ 0.886905] sky2: driver version 1.301558lb # [ 0.919659] NET: Registered PF_PACKET protocol family1559client # [ 0.888922] ehci-pci 0000:00:07.0: EHCI Host Controller1560worker1 # [ 0.891003] tun: Universal TUN/TAP device driver, 1.61561client # [ 0.888952] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 11562client # [ 0.889308] ehci-pci 0000:00:07.0: irq 16, io mem 0x100860001563client # [ 0.899083] usbcore: registered new interface driver usb-storage1564worker1 # [ 0.894604] thunder_xcv, ver 1.01565lb # [ 0.921507] 9pnet: Installing 9P2000 support1566worker1 # [ 0.894648] thunder_bgx, ver 1.01567lb # [ 0.921554] Key type dns_resolver registered1568worker1 # [ 0.894670] nicpf, ver 1.01569client # [ 0.899136] usbcore: registered new interface driver usbserial_generic1570client # [ 0.899150] usbserial: USB Serial support registered for generic1571client # [ 0.899737] hv_vmbus: registering driver hyperv_keyboard1572client # [ 0.900266] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.001573client # [ 0.904286] hub 1-0:1.0: USB hub found1574lb # [ 0.928390] registered taskstats version 11575client # [ 0.904775] hub 1-0:1.0: 6 ports detected1576lb # [ 0.928536] Loading compiled-in X.509 certificates1577worker1 # [ 0.896407] e1000: Intel(R) PRO/1000 Network Driver1578worker1 # [ 0.896418] e1000: Copyright (c) 1999-2006 Intel Corporation.1579worker1 # [ 0.896442] e1000e: Intel(R) PRO/1000 Network Driver1580client # [ 0.905862] rtc-pl031 9010000.pl031: registered as rtc01581worker1 # [ 0.896452] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1582client # [ 0.905888] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T15:04:32 UTC (1790089472)1583worker1 # [ 0.896480] igb: Intel(R) Gigabit Ethernet Network Driver1584client # [ 0.906208] i2c_dev: i2c /dev entries driver1585worker1 # [ 0.896485] igb: Copyright (c) 2007-2014 Intel Corporation.1586worker1 # [ 0.896507] igbvf: Intel(R) Gigabit Virtual Function Network Driver1587worker1 # [ 0.896513] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1588worker1 # [ 0.896648] sky2: driver version 1.301589worker1 # [ 0.898197] usbcore: registered new interface driver usb-storage1590client # [ 0.911700] sdhci: Secure Digital Host Controller Interface driver1591worker1 # [ 0.898343] usbcore: registered new interface driver usbserial_generic1592client # [ 0.911713] sdhci: Copyright(c) Pierre Ossman1593worker1 # [ 0.898358] usbserial: USB Serial support registered for generic1594lb # [ 0.937152] Demotion targets for Node 0: null1595client # [ 0.911974] Synopsys Designware Multimedia Card Interface Driver1596lb # [ 0.937256] Key type .fscrypt registered1597worker1 # [ 0.899667] ehci-pci 0000:00:07.0: EHCI Host Controller1598lb # [ 0.937262] Key type fscrypt-provisioning registered1599worker1 # [ 0.899692] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 11600lb # [ 0.937358] ima: No TPM chip found, activating TPM-bypass!1601worker1 # [ 0.899957] ehci-pci 0000:00:07.0: irq 16, io mem 0x100860001602lb # [ 0.937377] ima: Allocated hash algorithm: sha11603lb # [ 0.937397] ima: No architecture policies found1604client # [ 0.914393] sdhci-pltfm: SDHCI platform and OF driver helper1605worker1 # [ 0.910458] hv_vmbus: registering driver hyperv_keyboard1606client # [ 0.915903] hid: raw HID events driver (C) Jiri Kosina1607worker1 # [ 0.911616] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.001608lb # [ 0.941555] input: gpio-keys as /devices/platform/gpio-keys/input/input01609client # [ 0.916160] usbcore: registered new interface driver usbhid1610worker1 # [ 0.912602] hub 1-0:1.0: USB hub found1611client # [ 0.916167] usbhid: USB HID core driver1612worker1 # [ 0.913088] hub 1-0:1.0: 6 ports detected1613worker1 # [ 0.914398] rtc-pl031 9010000.pl031: registered as rtc01614client # [ 0.919794] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1615worker1 # [ 0.914426] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T15:04:32 UTC (1790089472)1616worker1 # [ 0.914731] i2c_dev: i2c /dev entries driver1617client # [ 0.922446] drop_monitor: Initializing network drop monitor service1618client # [ 0.922627] NET: Registered PF_INET6 protocol family1619client # [ 0.924548] Segment Routing with IPv61620client # [ 0.924565] In-situ OAM (IOAM) with IPv61621client # [ 0.924605] NET: Registered PF_PACKET protocol family1622client # [ 0.926241] 9pnet: Installing 9P2000 support1623worker1 # [ 0.920067] sdhci: Secure Digital Host Controller Interface driver1624client # [ 0.926287] Key type dns_resolver registered1625worker1 # [ 0.920079] sdhci: Copyright(c) Pierre Ossman1626worker1 # [ 0.920336] Synopsys Designware Multimedia Card Interface Driver1627worker1 # [ 0.920710] sdhci-pltfm: SDHCI platform and OF driver helper1628worker1 # [ 0.922185] hid: raw HID events driver (C) Jiri Kosina1629worker1 # [ 0.922464] usbcore: registered new interface driver usbhid1630worker1 # [ 0.922471] usbhid: USB HID core driver1631worker1 # [ 0.927940] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1632client # [ 0.933276] registered taskstats version 11633lb # [ 0.959147] clk: Disabling unused clocks1634worker1 # [ 0.929432] drop_monitor: Initializing network drop monitor service1635client # [ 0.933431] Loading compiled-in X.509 certificates1636lb # [ 0.959173] PM: genpd: Disabling unused power domains1637worker1 # [ 0.929611] NET: Registered PF_INET6 protocol family1638worker1 # [ 0.932590] Segment Routing with IPv61639worker1 # [ 0.932609] In-situ OAM (IOAM) with IPv61640worker1 # [ 0.932652] NET: Registered PF_PACKET protocol family1641lb # [ 0.963337] Freeing unused kernel memory: 4736K1642lb # [ 0.963534] Run /init as init process1643worker1 # [ 0.934284] 9pnet: Installing 9P2000 support1644worker1 # [ 0.934361] Key type dns_resolver registered1645client # [ 0.942142] Demotion targets for Node 0: null1646client # [ 0.942246] Key type .fscrypt registered1647client # [ 0.942253] Key type fscrypt-provisioning registered1648client # [ 0.942350] ima: No TPM chip found, activating TPM-bypass!1649client # [ 0.942369] ima: Allocated hash algorithm: sha11650client # [ 0.942391] ima: No architecture policies found1651client # [ 0.946388] input: gpio-keys as /devices/platform/gpio-keys/input/input01652worker1 # [ 0.941109] registered taskstats version 11653worker1 # [ 0.941246] Loading compiled-in X.509 certificates1654lb # [ 0.979223] systemd[1]: Successfully made /usr/ read-only.1655worker1 # [ 0.949818] Demotion targets for Node 0: null1656worker1 # [ 0.949923] Key type .fscrypt registered1657worker1 # [ 0.949930] Key type fscrypt-provisioning registered1658worker1 # [ 0.950034] ima: No TPM chip found, activating TPM-bypass!1659worker1 # [ 0.950053] ima: Allocated hash algorithm: sha11660worker1 # [ 0.950075] ima: No architecture policies found1661worker1 # [ 0.954104] input: gpio-keys as /devices/platform/gpio-keys/input/input01662client # [ 0.964722] clk: Disabling unused clocks1663client # [ 0.964744] PM: genpd: Disabling unused power domains1664client # [ 0.968900] Freeing unused kernel memory: 4736K1665client # [ 0.969115] Run /init as init process1666worker1 # [ 0.972449] clk: Disabling unused clocks1667worker1 # [ 0.972475] PM: genpd: Disabling unused power domains1668worker1 # [ 0.976602] Freeing unused kernel memory: 4736K1669worker1 # [ 0.976814] Run /init as init process1670client # [ 0.986441] systemd[1]: Successfully made /usr/ read-only.1671worker1 # [ 0.993120] systemd[1]: Successfully made /usr/ read-only.1672worker2 # [ 1.157502] usb 1-1: new high-speed USB device number 2 using ehci-pci1673lb # [ 1.144967] usb 1-1: new high-speed USB device number 2 using ehci-pci1674client # [ 1.152255] usb 1-1: new high-speed USB device number 2 using ehci-pci1675worker1 # [ 1.159004] usb 1-1: new high-speed USB device number 2 using ehci-pci1676worker2 # [ 1.307126] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11677worker2 # [ 1.310188] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1678worker2 # [ 1.310223] systemd[1]: Detected virtualization qemu.1679worker2 # [ 1.310268] systemd[1]: Detected architecture arm64.1680worker2 # [ 1.310280] systemd[1]: Running in initrd.1681worker2 # [ 1.310802] systemd[1]: Initializing machine ID from random generator.1682worker2 # [ 1.310953] systemd[1]: Hostname set to <worker2>.1683lb # [ 1.297561] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11684worker2 # [ 1.389627] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input01685lb # [ 1.314074] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1686lb # [ 1.326117] systemd[1]: Detected virtualization qemu.1687lb # [ 1.328145] systemd[1]: Detected architecture arm64.1688lb # [ 1.330127] systemd[1]: Running in initrd.1689lb # [ 1.332748] systemd[1]: Initializing machine ID from random generator.1690client # [ 1.306866] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11691lb # [ 1.335857] systemd[1]: Hostname set to <lb>.1692worker1 # [ 1.311637] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11693client # [ 1.321299] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1694client # [ 1.333571] systemd[1]: Detected virtualization qemu.1695client # [ 1.335687] systemd[1]: Detected architecture arm64.1696client # [ 1.337750] systemd[1]: Running in initrd.1697client # [ 1.340408] systemd[1]: Initializing machine ID from random generator.1698client # [ 1.343335] systemd[1]: Hostname set to <client>.1699worker1 # [ 1.327997] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1700worker1 # [ 1.340222] systemd[1]: Detected virtualization qemu.1701worker1 # [ 1.342291] systemd[1]: Detected architecture arm64.1702worker1 # [ 1.344284] systemd[1]: Running in initrd.1703worker1 # [ 1.346922] systemd[1]: Initializing machine ID from random generator.1704worker1 # [ 1.349924] systemd[1]: Hostname set to <worker1>.1705lb # [ 1.393179] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input01706client # [ 1.388618] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input01707worker1 # [ 1.395272] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input01708worker2 # [ 1.509536] usb 1-2: new high-speed USB device number 3 using ehci-pci1709lb # [ 1.512968] usb 1-2: new high-speed USB device number 3 using ehci-pci1710client # [ 1.512311] usb 1-2: new high-speed USB device number 3 using ehci-pci1711worker1 # [ 1.519018] usb 1-2: new high-speed USB device number 3 using ehci-pci1712worker2 # [ 1.669388] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21713worker2 # [ 1.672813] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input01714lb # [ 1.621292] systemd[1]: bpf-restrict-fs: LSM BPF program attached1715worker2 # [ 1.689921] systemd[1]: bpf-restrict-fs: LSM BPF program attached1716lb # [ 1.671979] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21717lb # [ 1.674404] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input01718worker1 # [ 1.655125] systemd[1]: bpf-restrict-fs: LSM BPF program attached1719lb # [ 1.693948] systemd[1]: Queued start job for default target Initrd Default Target.1720worker2 # [ 1.760678] systemd[1]: Queued start job for default target Initrd Default Target.1721client # [ 1.671558] systemd[1]: bpf-restrict-fs: LSM BPF program attached1722lb # [ 1.703088] systemd[1]: Created slice Slice /system/modprobe.1723lb # [ 1.704140] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1724client # [ 1.675758] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21725worker2 # [ 1.771656] systemd[1]: Created slice Slice /system/modprobe.1726worker2 # [ 1.772734] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1727lb # [ 1.705327] systemd[1]: Expecting device /dev/disk/by-label/nixos...1728worker2 # [ 1.773955] systemd[1]: Expecting device /dev/disk/by-label/nixos...1729lb # [ 1.705359] systemd[1]: Reached target Path Units.1730worker2 # [ 1.774909] systemd[1]: Reached target Path Units.1731lb # [ 1.705377] systemd[1]: Reached target Slice Units.1732worker2 # [ 1.775644] systemd[1]: Reached target Slice Units.1733lb # [ 1.705394] systemd[1]: Reached target Swaps.1734client # [ 1.676090] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input01735worker2 # [ 1.776442] systemd[1]: Reached target Swaps.1736lb # [ 1.705410] systemd[1]: Reached target Timer Units.1737worker2 # [ 1.777176] systemd[1]: Reached target Timer Units.1738lb # [ 1.705585] systemd[1]: Listening on D-Bus System Message Bus Socket.1739lb # [ 1.705725] systemd[1]: Listening on Journal Socket (/dev/log).1740worker2 # [ 1.778135] systemd[1]: Listening on D-Bus System Message Bus Socket.1741lb # [ 1.705879] systemd[1]: Listening on Journal Sockets.1742worker2 # [ 1.779232] systemd[1]: Listening on Journal Socket (/dev/log).1743lb # [ 1.706000] systemd[1]: Listening on udev Control Socket.1744worker2 # [ 1.780255] systemd[1]: Listening on Journal Sockets.1745lb # [ 1.706105] systemd[1]: Listening on udev Kernel Socket.1746lb # [ 1.706124] systemd[1]: Reached target Socket Units.1747worker2 # [ 1.781156] systemd[1]: Listening on udev Control Socket.1748worker1 # [ 1.680969] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21749worker2 # [ 1.782162] systemd[1]: Listening on udev Kernel Socket.1750lb # [ 1.715690] systemd[1]: Starting Create List of Static Device Nodes...1751worker2 # [ 1.782187] systemd[1]: Reached target Socket Units.1752lb # [ 1.715766] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1753worker2 # [ 1.785079] systemd[1]: Starting Create List of Static Device Nodes...1754worker1 # [ 1.686755] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input01755worker2 # [ 1.786166] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1756lb # [ 1.725057] systemd[1]: Mounting Kernel Configuration File System...1757worker2 # [ 1.796552] systemd[1]: Mounting Kernel Configuration File System...1758lb # [ 1.733289] systemd[1]: Starting Journal Service...1759lb # [ 1.748523] systemd[1]: Starting Load Kernel Modules...1760lb # [ 1.749455] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1761worker2 # [ 1.821697] systemd[1]: Starting Journal Service...1762lb # [ 1.762234] systemd[1]: Starting Coldplug All udev Devices...1763worker2 # [ 1.832390] systemd[1]: Starting Load Kernel Modules...1764worker2 # [ 1.833357] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1765worker2 # [ 1.845902] systemd[1]: Starting Coldplug All udev Devices...1766lb # [ 1.785049] systemd[1]: Finished Create List of Static Device Nodes.1767lb # [ 1.786034] systemd[1]: Mounted Kernel Configuration File System.1768lb # [ 1.791019] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1769worker2 # [ 1.857573] systemd[1]: Finished Create List of Static Device Nodes.1770worker2 # [ 1.858350] systemd[1]: Mounted Kernel Configuration File System.1771worker1 # [ 1.770520] systemd[1]: Queued start job for default target Initrd Default Target.1772client # [ 1.777160] systemd[1]: Queued start job for default target Initrd Default Target.1773lb # [ 1.808841] systemd-journald[72]: Collecting audit messages is disabled.1774client # [ 1.786648] systemd[1]: Created slice Slice /system/modprobe.1775worker1 # [ 1.781342] systemd[1]: Created slice Slice /system/modprobe.1776client # [ 1.787839] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1777worker1 # [ 1.782573] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1778client # [ 1.789243] systemd[1]: Expecting device /dev/disk/by-label/nixos...1779worker1 # [ 1.784023] systemd[1]: Expecting device /dev/disk/by-label/nixos...1780client # [ 1.790304] systemd[1]: Reached target Path Units.1781worker1 # [ 1.785103] systemd[1]: Reached target Path Units.1782client # [ 1.791107] systemd[1]: Reached target Slice Units.1783worker1 # [ 1.785911] systemd[1]: Reached target Slice Units.1784lb # [ 1.815024] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1785client # [ 1.791910] systemd[1]: Reached target Swaps.1786worker1 # [ 1.786726] systemd[1]: Reached target Swaps.1787client # [ 1.792712] systemd[1]: Reached target Timer Units.1788worker1 # [ 1.787559] systemd[1]: Reached target Timer Units.1789client # [ 1.793759] systemd[1]: Listening on D-Bus System Message Bus Socket.1790worker1 # [ 1.788691] systemd[1]: Listening on D-Bus System Message Bus Socket.1791client # [ 1.794961] systemd[1]: Listening on Journal Socket (/dev/log).1792worker1 # [ 1.789931] systemd[1]: Listening on Journal Socket (/dev/log).1793client # [ 1.796178] systemd[1]: Listening on Journal Sockets.1794worker1 # [ 1.791107] systemd[1]: Listening on Journal Sockets.1795worker1 # [ 1.792159] systemd[1]: Listening on udev Control Socket.1796worker2 # [ 1.888389] systemd-journald[72]: Collecting audit messages is disabled.1797client # [ 1.797280] systemd[1]: Listening on udev Control Socket.1798worker1 # [ 1.793342] systemd[1]: Listening on udev Kernel Socket.1799worker2 # [ 1.888548] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1800client # [ 1.797396] systemd[1]: Listening on udev Kernel Socket.1801worker1 # [ 1.794358] systemd[1]: Reached target Socket Units.1802client # [ 1.797419] systemd[1]: Reached target Socket Units.1803client # [ 1.801494] systemd[1]: Starting Create List of Static Device Nodes...1804client # [ 1.802604] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1805worker1 # [ 1.797222] systemd[1]: Starting Create List of Static Device Nodes...1806lb # [ 1.829266] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1807worker1 # [ 1.797317] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1808worker2 # [ 1.899063] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1809client # [ 1.812425] systemd[1]: Mounting Kernel Configuration File System...1810worker1 # [ 1.811316] systemd[1]: Mounting Kernel Configuration File System...1811lb # [ 1.842148] [drm] pci: virtio-gpu-pci detected at 0000:00:05.01812lb # [ 1.842384] [drm] features: -virgl +edid -resource_blob -host_visible1813lb # [ 1.842394] [drm] features: -context_init1814client # [ 1.820562] systemd[1]: Starting Journal Service...1815lb # [ 1.843091] [drm] number of scanouts: 11816lb # [ 1.843108] [drm] number of cap sets: 01817worker2 # [ 1.914095] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1818worker2 # [ 1.916890] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1819lb # [ 1.857647] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1820lb # [ 1.860240] systemd[1]: Starting Create Static Device Nodes in /dev...1821worker2 # [ 1.926732] [drm] pci: virtio-gpu-pci detected at 0000:00:05.01822worker2 # [ 1.926966] [drm] features: -virgl +edid -resource_blob -host_visible1823worker2 # [ 1.926976] [drm] features: -context_init1824worker2 # [ 1.927706] [drm] number of scanouts: 11825worker2 # [ 1.927724] [drm] number of cap sets: 01826worker2 # [ 1.931499] systemd[1]: Starting Create Static Device Nodes in /dev...1827client # [ 1.844695] systemd[1]: Starting Load Kernel Modules...1828worker1 # [ 1.839711] systemd[1]: Starting Journal Service...1829client # [ 1.845699] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1830worker1 # [ 1.842490] systemd[1]: Starting Load Kernel Modules...1831worker1 # [ 1.843630] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1832lb # [ 1.873278] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic1833lb # [ 1.873295] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 01834worker1 # [ 1.854602] systemd[1]: Starting Coldplug All udev Devices...1835client # [ 1.864432] systemd[1]: Starting Coldplug All udev Devices...1836worker2 # [ 1.957863] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic1837worker2 # [ 1.957881] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 01838client # [ 1.874960] systemd-journald[72]: Collecting audit messages is disabled.1839lb # [ 1.893445] Console: switching to colour frame buffer device 160x501840worker1 # [ 1.868582] systemd[1]: Finished Create List of Static Device Nodes.1841worker1 # [ 1.869299] systemd[1]: Mounted Kernel Configuration File System.1842client # [ 1.884361] systemd[1]: Finished Create List of Static Device Nodes.1843client # [ 1.885056] systemd[1]: Mounted Kernel Configuration File System.1844lb # [ 1.913494] systemd[1]: Finished Create Static Device Nodes in /dev.1845lb # [ 1.913691] systemd[1]: Reached target Preparation for Local File Systems.1846lb # [ 1.913715] systemd[1]: Reached target Local File Systems.1847worker1 # [ 1.887106] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1848worker2 # [ 1.977743] Console: switching to colour frame buffer device 160x501849lb # [ 1.917701] systemd[1]: Starting Rule-based Manager for Device Events and Files...1850client # [ 1.900509] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1851worker2 # [ 1.994141] systemd[1]: Finished Create Static Device Nodes in /dev.1852worker2 # [ 1.994506] systemd[1]: Reached target Preparation for Local File Systems.1853worker2 # [ 1.994530] systemd[1]: Reached target Local File Systems.1854lb # [ 1.929567] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device1855worker2 # [ 1.998409] systemd[1]: Starting Rule-based Manager for Device Events and Files...1856lb # [ 1.939710] systemd[1]: Finished Load Kernel Modules.1857worker1 # [ 1.911888] systemd-journald[72]: Collecting audit messages is disabled.1858lb # [ 1.945509] systemd[1]: Starting Apply Kernel Variables...1859worker2 # [ 2.011900] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device1860worker1 # [ 1.919625] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1861worker1 # [ 1.926463] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1862client # [ 1.932584] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1863client # [ 1.934358] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1864client # [ 1.937123] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1865worker1 # [ 1.931482] systemd[1]: Starting Create Static Device Nodes in /dev...1866worker2 # [ 2.029722] systemd[1]: Finished Load Kernel Modules.1867worker2 # [ 2.032990] systemd[1]: Starting Apply Kernel Variables...1868client # [ 1.945453] [drm] pci: virtio-gpu-pci detected at 0000:00:05.01869client # [ 1.945696] [drm] features: -virgl +edid -resource_blob -host_visible1870client # [ 1.945705] [drm] features: -context_init1871client # [ 1.946420] [drm] number of scanouts: 11872client # [ 1.946439] [drm] number of cap sets: 01873worker1 # [ 1.943377] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1874client # [ 1.950230] systemd[1]: Starting Create Static Device Nodes in /dev...1875worker1 # [ 1.952132] [drm] pci: virtio-gpu-pci detected at 0000:00:05.01876worker1 # [ 1.952370] [drm] features: -virgl +edid -resource_blob -host_visible1877worker1 # [ 1.952380] [drm] features: -context_init1878worker1 # [ 1.953089] [drm] number of scanouts: 11879worker1 # [ 1.953108] [drm] number of cap sets: 01880lb # [ 1.996815] systemd[1]: Finished Apply Kernel Variables.1881client # [ 1.972570] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic1882client # [ 1.972588] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 01883worker2 # [ 2.053618] systemd-modules-load[73]: Inserted module 'dm_mod'1884worker2 # [ 2.073677] systemd[1]: Started Journal Service.1885lb # [ 1.996351] systemd-modules-load[73]: Inserted module 'dm_mod'1886worker2 # [ 2.060391] systemd-modules-load[73]: Module 'virtio_balloon' is built in1887lb # [ 2.010414] systemd[1]: Started Journal Service.1888worker2 # [ 2.061571] systemd-modules-load[73]: Module 'virtio_console' is built in1889worker1 # [ 1.979348] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic1890worker2 # [ 2.062609] systemd-modules-load[73]: Inserted module 'virtio_gpu'1891worker1 # [ 1.979368] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 01892worker2 # [ 2.063637] systemd-modules-load[73]: Module 'virtio_rng' is built in1893lb # [ 2.004200] systemd-modules-load[73]: Module 'virtio_balloon' is built in1894lb # [ 2.008271] systemd-modules-load[73]: Module 'virtio_console' is built in1895client # [ 1.992603] Console: switching to colour frame buffer device 160x501896lb # [ 2.011657] systemd-modules-load[73]: Inserted module 'virtio_gpu'1897lb # [ 2.012803] systemd-modules-load[73]: Module 'virtio_rng' is built in1898worker1 # [ 1.995643] systemd[1]: Finished Create Static Device Nodes in /dev.1899worker1 # [ 1.996034] systemd[1]: Reached target Preparation for Local File Systems.1900worker1 # [ 1.996062] systemd[1]: Reached target Local File Systems.1901worker2 # [ 2.081667] systemd[1]: Starting Create System Files and Directories...1902worker1 # [ 2.002711] systemd[1]: Starting Rule-based Manager for Device Events and Files...1903lb # [ 2.020291] systemd[1]: Starting Create System Files and Directories...1904lb # [ 2.023075] systemd-udevd[79]: Using default interface naming scheme 'v261'.1905worker2 # [ 2.085243] systemd[1]: Finished Apply Kernel Variables.1906client # [ 2.016939] systemd[1]: Finished Create Static Device Nodes in /dev.1907worker2 # [ 2.092521] systemd-udevd[78]: Using default interface naming scheme 'v261'.1908client # [ 2.017303] systemd[1]: Reached target Preparation for Local File Systems.1909client # [ 2.017327] systemd[1]: Reached target Local File Systems.1910worker1 # [ 2.007446] Console: switching to colour frame buffer device 160x501911worker1 # [ 2.014422] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device1912client # [ 2.024595] systemd[1]: Starting Rule-based Manager for Device Events and Files...1913client # [ 2.029984] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device1914lb # [ 2.050008] systemd[1]: Finished Create System Files and Directories.1915client # [ 2.041548] systemd[1]: Finished Load Kernel Modules.1916worker1 # [ 2.043620] systemd[1]: Finished Load Kernel Modules.1917lb # [ 2.062231] systemd[1]: Started Rule-based Manager for Device Events and Files.1918client # [ 2.036663] systemd-modules-load[74]: Inserted module 'dm_mod'1919client # [ 2.037758] systemd-modules-load[74]: Module 'virtio_balloon' is built in1920client # [ 2.038891] systemd-modules-load[74]: Module 'virtio_console' is built in1921worker2 # [ 2.128898] systemd[1]: Finished Create System Files and Directories.1922client # [ 2.039962] systemd-modules-load[74]: Inserted module 'virtio_gpu'1923worker2 # [ 2.130951] systemd[1]: Started Rule-based Manager for Device Events and Files.1924worker1 # [ 2.051414] systemd[1]: Starting Apply Kernel Variables...1925client # [ 2.060798] systemd[1]: Starting Apply Kernel Variables...1926client # [ 2.060979] systemd[1]: Started Journal Service.1927client # [ 2.048585] systemd-modules-load[74]: Module 'virtio_rng' is built in1928client # [ 2.084827] systemd[1]: Starting Create System Files and Directories...1929worker1 # [ 2.095098] systemd[1]: Started Journal Service.1930worker1 # [ 2.079753] systemd-modules-load[73]: Inserted module 'dm_mod'1931worker1 # [ 2.084219] systemd-modules-load[73]: Module 'virtio_balloon' is built in1932worker2 # [ 2.185504] systemd[1]: Starting Virtual Console Setup...1933client # [ 2.097169] systemd[1]: Finished Apply Kernel Variables.1934lb # [ 2.126019] systemd[1]: Starting Virtual Console Setup...1935worker1 # [ 2.095445] systemd-modules-load[73]: Module 'virtio_console' is built in1936worker1 # [ 2.100119] systemd-modules-load[73]: Inserted module 'virtio_gpu'1937worker1 # [ 2.101188] systemd-modules-load[73]: Module 'virtio_rng' is built in1938worker1 # [ 2.102184] systemd[1]: Starting Create System Files and Directories...1939client # [ 2.112920] systemd[1]: Finished Create System Files and Directories.1940worker1 # [ 2.116418] systemd-udevd[79]: Using default interface naming scheme 'v261'.1941client # [ 2.122773] systemd-udevd[78]: Using default interface naming scheme 'v261'.1942worker1 # [ 2.124229] systemd[1]: Finished Apply Kernel Variables.1943worker1 # [ 2.140181] systemd[1]: Finished Create System Files and Directories.1944worker2 # [ 2.236513] systemd-vconsole-setup[101]: Configuration of first virtual console was skipped, ignoring remaining ones.1945lb # [ 2.177311] systemd-vconsole-setup[101]: Configuration of first virtual console was skipped, ignoring remaining ones.1946worker2 # [ 2.240125] systemd[1]: Finished Virtual Console Setup.1947client # [ 2.150410] systemd[1]: Started Rule-based Manager for Device Events and Files.1948lb # [ 2.179992] systemd[1]: Finished Virtual Console Setup.1949worker1 # [ 2.155112] systemd[1]: Started Rule-based Manager for Device Events and Files.1950client # [ 2.212124] systemd[1]: Starting Virtual Console Setup...1951worker1 # [ 2.220207] systemd[1]: Starting Virtual Console Setup...1952client # [ 2.260501] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones.1953client # [ 2.263869] systemd[1]: Finished Virtual Console Setup.1954worker1 # [ 2.269840] systemd-vconsole-setup[101]: Configuration of first virtual console was skipped, ignoring remaining ones.1955worker1 # [ 2.271972] systemd[1]: Finished Virtual Console Setup.1956lb # [ 2.782993] systemd[1]: Finished Coldplug All udev Devices.1957lb # [ 2.783937] systemd[1]: Reached target System Initialization.1958lb # [ 2.784834] systemd[1]: Reached target Basic System.1959worker2 # [ 2.849235] systemd[1]: Finished Coldplug All udev Devices.1960worker2 # [ 2.850195] systemd[1]: Reached target System Initialization.1961worker2 # [ 2.851037] systemd[1]: Reached target Basic System.1962client # [ 2.873451] systemd[1]: Finished Coldplug All udev Devices.1963client # [ 2.876140] systemd[1]: Reached target System Initialization.1964client # [ 2.876990] systemd[1]: Reached target Basic System.1965worker1 # [ 2.873990] systemd[1]: Finished Coldplug All udev Devices.1966worker1 # [ 2.874949] systemd[1]: Reached target System Initialization.1967worker1 # [ 2.880127] systemd[1]: Reached target Basic System.1968lb # [ 2.928230] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1969worker2 # [ 3.022840] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line.1970lb # [ 2.968265] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line.1971worker2 # [ 3.030418] (udev-worker)[92]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1972lb # [ 2.971504] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line.1973worker2 # [ 3.033929] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line.1974worker2 # [ 3.092095] systemd[1]: Found device /dev/disk/by-label/nixos.1975worker2 # [ 3.098018] systemd[1]: Reached target Initrd Root Device.1976worker2 # [ 3.103191] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1977lb # [ 3.041831] systemd[1]: Found device /dev/disk/by-label/nixos.1978lb # [ 3.052257] systemd[1]: Reached target Initrd Root Device.1979lb # [ 3.056467] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1980worker1 # [ 3.035662] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line.1981client # [ 3.039808] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1982client # [ 3.043864] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line.1983client # [ 3.052390] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line.1984worker2 # [ 3.155603] systemd-fsck[110]: nixos: clean, 12/65536 files, 13019/262144 blocks1985worker1 # [ 3.060780] (udev-worker)[97]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1986lb # [ 3.098821] systemd-fsck[110]: nixos: clean, 12/65536 files, 13019/262144 blocks1987worker1 # [ 3.068184] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line.1988worker2 # [ 3.162410] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1989worker2 # [ 3.166706] systemd[1]: Mounting /sysroot...1990lb # [ 3.107416] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1991lb # [ 3.112208] systemd[1]: Mounting /sysroot...1992worker2 # [ 3.213973] EXT4-fs (vda): mounted filesystem e0d9bf4d-739a-47eb-8932-643e98c0d220 r/w with ordered data mode. Quota mode: none.1993worker2 # [ 3.204998] systemd[1]: Mounted /sysroot.1994worker2 # [ 3.206924] systemd[1]: Reached target Initrd Root File System.1995worker2 # [ 3.208653] systemd[1]: Starting Mountpoints Configured in the Real Root...1996lb # [ 3.159956] EXT4-fs (vda): mounted filesystem 77424937-216a-4d64-b967-244caaea4afe r/w with ordered data mode. Quota mode: none.1997lb # [ 3.153196] systemd[1]: Mounted /sysroot.1998lb # [ 3.154682] systemd[1]: Reached target Initrd Root File System.1999lb # [ 3.159300] systemd[1]: Starting Mountpoints Configured in the Real Root...2000client # [ 3.140122] systemd[1]: Found device /dev/disk/by-label/nixos.
loading 2,351 hidden lines…
4352worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4353worker2 # deleting unused links...4354worker2 # note: hard linking is currently saving 0.0 KiB4355worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.22 seconds)4356client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 >&24357worker2 # [ 49.969075] nix-grpc-daemon[771]: ts=2026-09-22T15:05:21Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:447024358client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):4359client # /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4360worker2 # [ 49.985383] nix-grpc-daemon[771]: ts=2026-09-22T15:05:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:447024361worker2 # [ 49.996525] nix-grpc-daemon[872]: time=2026-09-22T15:05:21.615Z level=INFO msg="All 2 paths already cached"4362worker2 # [ 50.013432] nix-grpc-daemon[771]: ts=2026-09-22T15:05:21Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=14363client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 >&2, in 0.30 seconds)4364client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 outPath4365client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 outPath, in 0.14 seconds)4366lb: must succeed: curl -sf localhost:9901/clusters4367lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4368lb: must succeed: curl -sf localhost:9901/clusters4369lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4370worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4371worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)4372(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.17 seconds)4373subtest: inputs already in the cache are not sent to the scheduler4374lb: must succeed: curl -sf localhost:9901/clusters4375lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4376lb: must succeed: curl -sf localhost:9901/clusters4377lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4378worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4379worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds)4380client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 --argstr top t1b >&24381worker1 # [ 50.747691] nix-grpc-daemon[766]: ts=2026-09-22T15:05:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:536024382client # don't know how to build these paths:4383client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4384worker2 # [ 50.853428] nix-grpc-daemon[771]: ts=2026-09-22T15:05:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:447024385worker2 # [ 50.863933] nix-grpc-daemon[872]: time=2026-09-22T15:05:22.483Z level=INFO msg="All 2 paths already cached"4386worker2 # [ 50.880343] nix-grpc-daemon[771]: ts=2026-09-22T15:05:22Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=04387worker2 # [ 50.887045] nix-grpc-daemon[771]: ts=2026-09-22T15:05:22Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.4:50051 clients=14388worker2 # [ 50.926749] nix-grpc-daemon[771]: ts=2026-09-22T15:05:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:447024389worker2 # [ 50.941851] nix-grpc-daemon[771]: ts=2026-09-22T15:05:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:447024390worker2 # [ 50.956110] nix-grpc-daemon[872]: time=2026-09-22T15:05:22.575Z level=INFO msg="All 2 paths already cached"4391client # copying 1 paths to 'lb:50051'...4392client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'...4393worker2 # [ 50.966881] nix-grpc-daemon[771]: ts=2026-09-22T15:05:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:447024394worker2 # [ 50.982286] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4395worker2 # [ 51.144604] nix-daemon[857]: accepted connection from pid 1020, user nix-grpc-daemon (trusted)4396worker2 # [ 51.163777] nix-daemon[857]: reaped child process 1023, status = succeeded4397worker2 # [ 51.261173] nix-daemon[857]: accepted connection from pid 1025, user nix-grpc-daemon (trusted)4398worker2 # [ 51.278214] nix-daemon[857]: reaped child process 1028, status = succeeded4399lb # [ 51.221724] niks3-server[1010]: 2026/09/22 15:05:22 INFO Received uploads request method=POST path=/api/pending_closures4400worker2 # [ 51.294739] nix-grpc-daemon[872]: time=2026-09-22T15:05:22.913Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4401worker2 # [ 51.296297] nix-grpc-daemon[872]: time=2026-09-22T15:05:22.913Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)"4402lb # [ 51.259168] niks3-server[1010]: 2026/09/22 15:05:22 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst4403lb # [ 51.272997] niks3-server[1010]: 2026/09/22 15:05:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4404worker2 # [ 51.340330] nix-grpc-daemon[872]: time=2026-09-22T15:05:22.959Z level=INFO msg="Uploading 1 narinfos"4405lb # [ 51.281494] niks3-server[1010]: 2026/09/22 15:05:22 INFO Signed narinfos id=7 count=14406lb # [ 51.287736] niks3-server[1010]: 2026/09/22 15:05:22 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls4407lb # [ 51.297859] niks3-server[1010]: 2026/09/22 15:05:22 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4408lb # [ 51.307607] niks3-server[1010]: 2026/09/22 15:05:22 INFO Completed upload id=74409worker2 # [ 51.369970] nix-grpc-daemon[872]: time=2026-09-22T15:05:22.989Z level=INFO msg="Upload complete. (370ms)"4410lb # [ 51.311683] niks3-server[1010]: 2026/09/22 15:05:22 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo4411worker2 # [ 51.382070] nix-grpc-daemon[771]: ts=2026-09-22T15:05:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=0 paths=1 nar_bytes_in=7524412worker2 # [ 51.396829] nix-grpc-daemon[771]: ts=2026-09-22T15:05:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:447024413worker2 # [ 51.405758] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4414worker2 # [ 51.408802] nix-daemon[857]: reaped child process 1018, status = succeeded4415client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051...4416client # farm-top> worker2: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4417worker2 # [ 51.423323] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4418client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds4419client # farm-top> LOG-farm-top-t1b4420worker2 # [ 52.931063] nix-daemon[857]: reaped child process 1032, status = succeeded4421worker2 # [ 53.003776] nix-daemon[857]: accepted connection from pid 1048, user nix-grpc-daemon (trusted)4422worker2 # [ 53.027058] nix-daemon[857]: reaped child process 1051, status = succeeded4423lb # [ 52.963784] niks3-server[1010]: 2026/09/22 15:05:24 INFO Received uploads request method=POST path=/api/pending_closures4424worker2 # [ 53.036612] nix-grpc-daemon[872]: time=2026-09-22T15:05:24.655Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4425worker2 # [ 53.038628] nix-grpc-daemon[872]: time=2026-09-22T15:05:24.655Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)"4426lb # [ 53.012944] niks3-server[1010]: 2026/09/22 15:05:24 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst4427worker2 # [ 53.087420] nix-grpc-daemon[872]: time=2026-09-22T15:05:24.706Z level=INFO msg="Uploading 1 narinfos"4428lb # [ 53.033394] niks3-server[1010]: 2026/09/22 15:05:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4429lb # [ 53.050338] niks3-server[1010]: 2026/09/22 15:05:24 INFO Signed narinfos id=8 count=14430lb # [ 53.060677] niks3-server[1010]: 2026/09/22 15:05:24 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4431worker2 # [ 53.127106] nix-grpc-daemon[872]: time=2026-09-22T15:05:24.746Z level=INFO msg="Upload complete. (292ms)"4432lb # [ 53.073035] niks3-server[1010]: 2026/09/22 15:05:24 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4433lb # [ 53.079009] niks3-server[1010]: 2026/09/22 15:05:24 INFO Completed upload id=84434lb # [ 53.082151] niks3-server[1010]: 2026/09/22 15:05:24 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo4435worker2 # [ 53.141799] nix-grpc-daemon[771]: ts=2026-09-22T15:05:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=14436worker2 # [ 53.162111] nix-daemon[857]: reaped child process 1030, status = succeeded4437client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.55 seconds)4438client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 --argstr top t1b outPath4439client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.19 seconds)4440lb: must succeed: curl -sf localhost:9901/clusters4441lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4442lb: must succeed: curl -sf localhost:9901/clusters4443lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4444worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4445worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds)4446(finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.10 seconds)4447subtest: outputs read back through any worker carry the cache signature4448client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag sig >&24449worker2 # [ 53.783069] nix-grpc-daemon[771]: ts=2026-09-22T15:05:25Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:447024450client # don't know how to build these paths:4451client # /nix/store/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv4452worker2 # [ 53.794644] nix-grpc-daemon[771]: ts=2026-09-22T15:05:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:447024453worker2 # [ 53.820259] nix-grpc-daemon[771]: ts=2026-09-22T15:05:25Z level=debug event=want client=4 drv=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv cached=04454worker2 # [ 53.826272] nix-grpc-daemon[771]: ts=2026-09-22T15:05:25Z level=debug event=assigned drv=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv worker=192.168.1.3:50051 clients=14455worker1 # [ 53.739090] nix-grpc-daemon[766]: ts=2026-09-22T15:05:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:536024456worker1 # [ 53.753555] nix-grpc-daemon[766]: ts=2026-09-22T15:05:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:536024457client # copying 1 paths to 'lb:50051'...4458client # copying path '/nix/store/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv' to 'lb:50051'...4459worker1 # [ 53.769538] nix-grpc-daemon[766]: ts=2026-09-22T15:05:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:536024460worker1 # [ 53.785673] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted)4461worker1 # [ 53.817874] nix-grpc-daemon[766]: ts=2026-09-22T15:05:25Z level=info event=niks3_push_started pid=8594462worker1 # [ 53.992357] nix-grpc-daemon[859]: time=2026-09-22T15:05:25.590Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.key ca=""4463worker1 # [ 54.102991] nix-daemon[833]: accepted connection from pid 872, user nix-grpc-daemon (trusted)4464worker1 # [ 54.122433] nix-daemon[833]: reaped child process 875, status = succeeded4465worker1 # [ 54.224362] nix-daemon[833]: accepted connection from pid 877, user nix-grpc-daemon (trusted)4466worker1 # [ 54.241916] nix-daemon[833]: reaped child process 880, status = succeeded4467lb # [ 54.279049] niks3-server[1010]: 2026/09/22 15:05:25 INFO Received uploads request method=POST path=/api/pending_closures4468worker1 # [ 54.262691] nix-grpc-daemon[859]: time=2026-09-22T15:05:25.861Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4469worker1 # [ 54.264544] nix-grpc-daemon[859]: time=2026-09-22T15:05:25.861Z level=INFO msg="Uploading 3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv (512B)"4470lb # [ 54.334351] niks3-server[1010]: 2026/09/22 15:05:25 INFO Registered completed upload object_key=nar/13mhmmy2qay13imbbdi287vhryz1hwnyg0w6agd9s0ph37wnsqll.nar.zst4471worker1 # [ 54.312804] nix-grpc-daemon[859]: time=2026-09-22T15:05:25.912Z level=INFO msg="Uploading 1 narinfos"4472lb # [ 54.349486] niks3-server[1010]: 2026/09/22 15:05:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4473lb # [ 54.356961] niks3-server[1010]: 2026/09/22 15:05:25 INFO Signed narinfos id=9 count=14474lb # [ 54.361889] niks3-server[1010]: 2026/09/22 15:05:25 INFO Registered completed upload object_key=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y.ls4475lb # [ 54.371746] niks3-server[1010]: 2026/09/22 15:05:25 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4476lb # [ 54.378258] niks3-server[1010]: 2026/09/22 15:05:25 INFO Completed upload id=94477worker1 # [ 54.346360] nix-grpc-daemon[859]: time=2026-09-22T15:05:25.946Z level=INFO msg="Upload complete. (354ms)"4478lb # [ 54.380854] niks3-server[1010]: 2026/09/22 15:05:25 INFO Registered completed upload object_key=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y.narinfo4479worker1 # [ 54.356904] nix-grpc-daemon[766]: ts=2026-09-22T15:05:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=0 paths=1 nar_bytes_in=5124480worker1 # [ 54.372556] nix-grpc-daemon[766]: ts=2026-09-22T15:05:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:536024481worker1 # [ 54.380682] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted)4482worker1 # [ 54.387522] nix-daemon[833]: reaped child process 857, status = succeeded4483client # building '/nix/store/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv' on lb:50051...4484worker1 # [ 54.398402] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted)4485client # farm-a> node-a: building 3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv4486client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds4487client # farm-a> LOG-farm-a-sig4488worker1 # [ 55.843599] nix-daemon[833]: reaped child process 884, status = succeeded4489worker1 # [ 55.944290] nix-daemon[833]: accepted connection from pid 900, user nix-grpc-daemon (trusted)4490worker1 # [ 55.964931] nix-daemon[833]: reaped child process 903, status = succeeded4491lb # [ 56.000971] niks3-server[1010]: 2026/09/22 15:05:27 INFO Received uploads request method=POST path=/api/pending_closures4492worker1 # [ 55.980387] nix-grpc-daemon[859]: time=2026-09-22T15:05:27.578Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4493worker1 # [ 55.981854] nix-grpc-daemon[859]: time=2026-09-22T15:05:27.578Z level=INFO msg="Uploading 2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a (128B)"4494lb # [ 56.037135] niks3-server[1010]: 2026/09/22 15:05:27 INFO Registered completed upload object_key=log/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv4495lb # [ 56.051830] niks3-server[1010]: 2026/09/22 15:05:27 INFO Registered completed upload object_key=nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst4496lb # [ 56.067308] niks3-server[1010]: 2026/09/22 15:05:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4497worker1 # [ 56.042775] nix-grpc-daemon[859]: time=2026-09-22T15:05:27.641Z level=INFO msg="Uploading 1 narinfos"4498lb # [ 56.076337] niks3-server[1010]: 2026/09/22 15:05:27 INFO Signed narinfos id=10 count=14499lb # [ 56.082849] niks3-server[1010]: 2026/09/22 15:05:27 INFO Registered completed upload object_key=2ykckkv44ccpw95ad66fm21ggp6krwj9.ls4500lb # [ 56.093615] niks3-server[1010]: 2026/09/22 15:05:27 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4501worker1 # [ 56.066935] nix-grpc-daemon[859]: time=2026-09-22T15:05:27.667Z level=INFO msg="Upload complete. (256ms)"4502lb # [ 56.103420] niks3-server[1010]: 2026/09/22 15:05:27 INFO Completed upload id=104503lb # [ 56.107873] niks3-server[1010]: 2026/09/22 15:05:27 INFO Registered completed upload object_key=2ykckkv44ccpw95ad66fm21ggp6krwj9.narinfo4504worker1 # [ 56.081158] nix-grpc-daemon[766]: ts=2026-09-22T15:05:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=1 drv=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv assign_id=5 outputs=14505worker2 # [ 56.181704] nix-grpc-daemon[771]: ts=2026-09-22T15:05:27Z level=debug event=want client=4 drv=z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv cached=04506worker2 # [ 56.187444] nix-grpc-daemon[771]: ts=2026-09-22T15:05:27Z level=debug event=assigned drv=z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv worker=192.168.1.3:50051 clients=14507worker1 # [ 56.098837] nix-daemon[833]: reaped child process 882, status = succeeded4508worker1 # [ 56.134375] nix-grpc-daemon[766]: ts=2026-09-22T15:05:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:536024509worker1 # [ 56.151399] nix-grpc-daemon[766]: ts=2026-09-22T15:05:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:536024510worker1 # [ 56.167656] nix-grpc-daemon[859]: time=2026-09-22T15:05:27.767Z level=INFO msg="All 1 paths already cached"4511client # copying 1 paths to 'lb:50051'...4512client # copying path '/nix/store/z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv' to 'lb:50051'...4513worker1 # [ 56.179080] nix-grpc-daemon[766]: ts=2026-09-22T15:05:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:536024514worker1 # [ 56.193085] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted)4515worker1 # [ 56.356738] nix-daemon[833]: accepted connection from pid 907, user nix-grpc-daemon (trusted)4516worker1 # [ 56.379500] nix-daemon[833]: reaped child process 910, status = succeeded4517worker1 # [ 56.481188] nix-daemon[833]: accepted connection from pid 912, user nix-grpc-daemon (trusted)4518worker1 # [ 56.498120] nix-daemon[833]: reaped child process 915, status = succeeded4519lb # [ 56.536340] niks3-server[1010]: 2026/09/22 15:05:28 INFO Received uploads request method=POST path=/api/pending_closures4520worker1 # [ 56.515038] nix-grpc-daemon[859]: time=2026-09-22T15:05:28.115Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4521worker1 # [ 56.516703] nix-grpc-daemon[859]: time=2026-09-22T15:05:28.115Z level=INFO msg="Uploading z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv (624B)"4522lb # [ 56.568658] niks3-server[1010]: 2026/09/22 15:05:28 INFO Registered completed upload object_key=nar/0cnhkgsbmxv5hj7zw3fa59qfxikw6251mlhz2gz1v6pgn8c8shwp.nar.zst4523worker1 # [ 56.561027] nix-grpc-daemon[859]: time=2026-09-22T15:05:28.161Z level=INFO msg="Uploading 1 narinfos"4524lb # [ 56.592891] niks3-server[1010]: 2026/09/22 15:05:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4525lb # [ 56.601861] niks3-server[1010]: 2026/09/22 15:05:28 INFO Signed narinfos id=11 count=14526lb # [ 56.608294] niks3-server[1010]: 2026/09/22 15:05:28 INFO Registered completed upload object_key=z8kadp39h0myij9ln0hpxb61ldn71h4i.ls4527lb # [ 56.621024] niks3-server[1010]: 2026/09/22 15:05:28 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4528worker1 # [ 56.644061] nix-grpc-daemon[859]: time=2026-09-22T15:05:28.244Z level=INFO msg="Upload complete. (434ms)"4529lb # [ 56.675362] niks3-server[1010]: 2026/09/22 15:05:28 INFO Completed upload id=114530lb # [ 56.681386] niks3-server[1010]: 2026/09/22 15:05:28 INFO Registered completed upload object_key=z8kadp39h0myij9ln0hpxb61ldn71h4i.narinfo4531worker1 # [ 56.656428] nix-grpc-daemon[766]: ts=2026-09-22T15:05:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=0 paths=1 nar_bytes_in=6244532worker1 # [ 56.672692] nix-grpc-daemon[766]: ts=2026-09-22T15:05:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:536024533worker1 # [ 56.688516] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted)4534worker1 # [ 56.692733] nix-daemon[833]: reaped child process 905, status = succeeded4535client # building '/nix/store/z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv' on lb:50051...4536client # farm-b> node-a: building z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv4537worker1 # [ 56.712886] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted)4538client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds4539client # farm-b> LOG-farm-b-sig4540worker1 # [ 57.620685] nix-daemon[833]: reaped child process 919, status = succeeded4541worker1 # [ 57.694571] nix-daemon[833]: accepted connection from pid 935, user nix-grpc-daemon (trusted)4542worker1 # [ 57.714752] nix-daemon[833]: reaped child process 938, status = succeeded4543lb # [ 57.751760] niks3-server[1010]: 2026/09/22 15:05:29 INFO Received uploads request method=POST path=/api/pending_closures4544worker1 # [ 57.730462] nix-grpc-daemon[859]: time=2026-09-22T15:05:29.329Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4545worker1 # [ 57.732272] nix-grpc-daemon[859]: time=2026-09-22T15:05:29.329Z level=INFO msg="Uploading h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b (176B)"4546lb # [ 57.790898] niks3-server[1010]: 2026/09/22 15:05:29 INFO Registered completed upload object_key=nar/0f75gpfkjj0g9xi2113yvvpdw0l16spc2f1xik1ifnzfbrvx4pfk.nar.zst4547lb # [ 57.804121] niks3-server[1010]: 2026/09/22 15:05:29 INFO Registered completed upload object_key=log/z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv4548worker1 # [ 57.780608] nix-grpc-daemon[859]: time=2026-09-22T15:05:29.380Z level=INFO msg="Uploading 1 narinfos"4549lb # [ 57.816286] niks3-server[1010]: 2026/09/22 15:05:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4550lb # [ 57.826178] niks3-server[1010]: 2026/09/22 15:05:29 INFO Signed narinfos id=12 count=14551lb # [ 57.832488] niks3-server[1010]: 2026/09/22 15:05:29 INFO Registered completed upload object_key=h1r17djqpb9gp4y7v8nzx65ns9vdr50c.ls4552lb # [ 57.842755] niks3-server[1010]: 2026/09/22 15:05:29 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4553lb # [ 57.851739] niks3-server[1010]: 2026/09/22 15:05:29 INFO Completed upload id=124554worker1 # [ 57.819315] nix-grpc-daemon[859]: time=2026-09-22T15:05:29.419Z level=INFO msg="Upload complete. (293ms)"4555lb # [ 57.856696] niks3-server[1010]: 2026/09/22 15:05:29 INFO Registered completed upload object_key=h1r17djqpb9gp4y7v8nzx65ns9vdr50c.narinfo4556worker2 # [ 57.930660] nix-grpc-daemon[771]: ts=2026-09-22T15:05:29Z level=debug event=want client=4 drv=knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv cached=04557worker1 # [ 57.833162] nix-grpc-daemon[766]: ts=2026-09-22T15:05:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=1 drv=z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv assign_id=6 outputs=14558worker2 # [ 57.933572] nix-grpc-daemon[771]: ts=2026-09-22T15:05:29Z level=debug event=assigned drv=knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv worker=192.168.1.3:50051 clients=14559worker1 # [ 57.852282] nix-daemon[833]: reaped child process 917, status = succeeded4560worker1 # [ 57.884433] nix-grpc-daemon[766]: ts=2026-09-22T15:05:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:536024561worker1 # [ 57.901332] nix-grpc-daemon[766]: ts=2026-09-22T15:05:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:536024562worker1 # [ 57.914930] nix-grpc-daemon[859]: time=2026-09-22T15:05:29.515Z level=INFO msg="All 2 paths already cached"4563client # copying 1 paths to 'lb:50051'...4564client # copying path '/nix/store/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv' to 'lb:50051'...4565worker1 # [ 57.925883] nix-grpc-daemon[766]: ts=2026-09-22T15:05:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:536024566worker1 # [ 57.939617] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted)4567lb # [ 58.053113] envoy[895]: conn peer=[2001:db8:1::1]:34806 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9506 tx=4375 ms=56794568lb # [ 58.057912] envoy[895]: conn peer=[2001:db8:1::1]:34810 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=664569lb # [ 58.062578] envoy[895]: conn peer=[2001:db8:1::1]:34822 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4215 tx=1914 ms=23194570worker1 # [ 58.099024] nix-daemon[833]: accepted connection from pid 942, user nix-grpc-daemon (trusted)4571worker1 # [ 58.117435] nix-daemon[833]: reaped child process 945, status = succeeded4572worker1 # [ 58.222565] nix-daemon[833]: accepted connection from pid 947, user nix-grpc-daemon (trusted)4573worker1 # [ 58.239883] nix-daemon[833]: reaped child process 950, status = succeeded4574lb # [ 58.276354] niks3-server[1010]: 2026/09/22 15:05:29 INFO Received uploads request method=POST path=/api/pending_closures4575worker1 # [ 58.253716] nix-grpc-daemon[859]: time=2026-09-22T15:05:29.853Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4576worker1 # [ 58.255186] nix-grpc-daemon[859]: time=2026-09-22T15:05:29.853Z level=INFO msg="Uploading knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv (752B)"4577worker1 # [ 58.286456] nix-grpc-daemon[859]: time=2026-09-22T15:05:29.886Z level=INFO msg="Uploading 1 narinfos"4578lb # [ 58.307954] niks3-server[1010]: 2026/09/22 15:05:29 INFO Registered completed upload object_key=nar/0lpagyrngav67x80d1hq0njjlkmqdkvqawraz8dsp36ag50v6iwf.nar.zst4579lb # [ 58.323000] niks3-server[1010]: 2026/09/22 15:05:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4580lb # [ 58.335175] niks3-server[1010]: 2026/09/22 15:05:29 INFO Signed narinfos id=13 count=14581lb # [ 58.344909] niks3-server[1010]: 2026/09/22 15:05:29 INFO Registered completed upload object_key=knvx2sz45j0sdqm3fnbdrv7m887k7a6x.ls4582worker1 # [ 58.320306] nix-grpc-daemon[859]: time=2026-09-22T15:05:29.920Z level=INFO msg="Upload complete. (363ms)"4583lb # [ 58.354494] niks3-server[1010]: 2026/09/22 15:05:29 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4584lb # [ 58.360810] niks3-server[1010]: 2026/09/22 15:05:29 INFO Completed upload id=134585worker1 # [ 58.328325] nix-grpc-daemon[766]: ts=2026-09-22T15:05:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=0 paths=1 nar_bytes_in=7524586lb # [ 58.365322] niks3-server[1010]: 2026/09/22 15:05:29 INFO Registered completed upload object_key=knvx2sz45j0sdqm3fnbdrv7m887k7a6x.narinfo4587worker1 # [ 58.343625] nix-grpc-daemon[766]: ts=2026-09-22T15:05:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:536024588worker1 # [ 58.350092] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted)4589worker1 # [ 58.354560] nix-daemon[833]: reaped child process 940, status = succeeded4590worker1 # [ 58.365100] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted)4591client # building '/nix/store/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv' on lb:50051...4592client # farm-top> node-a: building knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv4593client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds4594client # farm-top> LOG-farm-top-sig4595worker1 # [ 59.644216] nix-daemon[833]: reaped child process 954, status = succeeded4596worker1 # [ 59.757343] nix-daemon[833]: accepted connection from pid 970, user nix-grpc-daemon (trusted)4597worker1 # [ 59.777226] nix-daemon[833]: reaped child process 973, status = succeeded4598lb # [ 59.815271] niks3-server[1010]: 2026/09/22 15:05:31 INFO Received uploads request method=POST path=/api/pending_closures4599worker1 # [ 59.795505] nix-grpc-daemon[859]: time=2026-09-22T15:05:31.393Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4600worker1 # [ 59.797469] nix-grpc-daemon[859]: time=2026-09-22T15:05:31.393Z level=INFO msg="Uploading 4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top (232B)"4601lb # [ 59.853695] niks3-server[1010]: 2026/09/22 15:05:31 INFO Registered completed upload object_key=log/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv4602lb # [ 59.873673] niks3-server[1010]: 2026/09/22 15:05:31 INFO Registered completed upload object_key=nar/07ar364rwqqniwi2nkdpqlgv7ws7702n5lqz703ackfmssrh40v8.nar.zst4603lb # [ 59.887547] niks3-server[1010]: 2026/09/22 15:05:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4604worker1 # [ 59.856564] nix-grpc-daemon[859]: time=2026-09-22T15:05:31.456Z level=INFO msg="Uploading 1 narinfos"4605lb # [ 59.895791] niks3-server[1010]: 2026/09/22 15:05:31 INFO Signed narinfos id=14 count=14606lb # [ 59.901412] niks3-server[1010]: 2026/09/22 15:05:31 INFO Registered completed upload object_key=4s2wbz2hg55lpb7s5vn3ynd342bs09lw.ls4607lb # [ 59.913029] niks3-server[1010]: 2026/09/22 15:05:31 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4608worker1 # [ 59.887996] nix-grpc-daemon[859]: time=2026-09-22T15:05:31.488Z level=INFO msg="Upload complete. (310ms)"4609lb # [ 59.922692] niks3-server[1010]: 2026/09/22 15:05:31 INFO Completed upload id=144610lb # [ 59.928663] niks3-server[1010]: 2026/09/22 15:05:31 INFO Registered completed upload object_key=4s2wbz2hg55lpb7s5vn3ynd342bs09lw.narinfo4611worker1 # [ 59.901422] nix-grpc-daemon[766]: ts=2026-09-22T15:05:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=1 drv=knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv assign_id=7 outputs=14612worker1 # [ 59.922100] nix-daemon[833]: reaped child process 952, status = succeeded4613client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag sig >&2, in 6.50 seconds)4614client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag sig outPath4615client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag sig outPath, in 0.19 seconds)4616client: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top4617worker1 # [ 60.287809] nix-grpc-daemon[766]: ts=2026-09-22T15:05:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:568144618worker1 # [ 60.330306] nix-grpc-daemon[766]: ts=2026-09-22T15:05:31Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:568144619client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top, in 0.25 seconds)4620client: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top4621worker2 # [ 60.677796] nix-grpc-daemon[771]: ts=2026-09-22T15:05:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:414044622client # these 3 paths will be fetched (0.0 KiB download, 0.5 KiB unpacked):4623client # /nix/store/2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a4624client # /nix/store/h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b4625client # /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top4626worker2 # [ 60.719587] nix-grpc-daemon[771]: ts=2026-09-22T15:05:32Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:414044627worker2 # [ 60.729655] nix-grpc-daemon[771]: copying path '/nix/store/2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a' from 'http://lb:5751'...4628worker2 # [ 60.753824] nix-grpc-daemon[771]: copying path '/nix/store/h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b' from 'http://lb:5751'...4629worker2 # [ 60.772136] nix-grpc-daemon[771]: copying path '/nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top' from 'http://lb:5751'...4630client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top, in 0.32 seconds)4631client: must succeed: nix-store --delete /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top4632client # finding garbage collector roots...4633client # removing stale temporary roots file "/nix/var/nix/temproots/900"4634client # removing stale temporary roots file "/nix/var/nix/temproots/944"4635client # removing stale temporary roots file "/nix/var/nix/temproots/929"4636client # removing stale temporary roots file "/nix/var/nix/temproots/921"4637client # removing stale temporary roots file "/nix/var/nix/temproots/851"4638client # removing stale temporary roots file "/nix/var/nix/temproots/867"4639client # removing stale temporary roots file "/nix/var/nix/temproots/908"4640client # removing stale temporary roots file "/nix/var/nix/temproots/888"4641client # deleting specified paths...4642client # deleting '/nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top'4643client # deleting unused links...4644client # note: hard linking is currently saving 0.0 KiB4645worker1 # [ 61.149438] nix-grpc-daemon[766]: ts=2026-09-22T15:05:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:536024646worker1 # [ 61.156393] nix-grpc-daemon[766]: ts=2026-09-22T15:05:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:536024647worker1 # [ 61.170023] nix-grpc-daemon[859]: time=2026-09-22T15:05:32.769Z level=INFO msg="All 1 paths already cached"4648worker1 # [ 61.183544] nix-grpc-daemon[766]: ts=2026-09-22T15:05:32Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:536024649worker1 # [ 61.198448] nix-grpc-daemon[766]: ts=2026-09-22T15:05:32Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:536024650client # copying 3 paths...4651worker1 # [ 61.222337] nix-grpc-daemon[766]: ts=2026-09-22T15:05:32Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:536024652client # copying path '/nix/store/2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a' from 'grpc://lb:50051'...4653worker1 # [ 61.259810] nix-grpc-daemon[766]: ts=2026-09-22T15:05:32Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:536024654worker1 # [ 61.267854] nix-grpc-daemon[766]: ts=2026-09-22T15:05:32Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=0 paths=1 nar_bytes_out=2324655worker1 # [ 61.277918] nix-grpc-daemon[766]: ts=2026-09-22T15:05:32Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:536024656worker1 # [ 61.285162] nix-grpc-daemon[766]: ts=2026-09-22T15:05:32Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=0 paths=1 nar_bytes_out=1764657worker2 # [ 61.388786] nix-grpc-daemon[771]: ts=2026-09-22T15:05:33Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:447024658worker2 # [ 61.396965] nix-grpc-daemon[771]: ts=2026-09-22T15:05:33Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=0 paths=1 nar_bytes_out=1284659client # copying path '/nix/store/h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b' from 'grpc://lb:50051'...4660client # copying path '/nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top' from 'grpc://lb:50051'...4661client: (finished: must succeed: nix-store --delete /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top, in 0.69 seconds)4662(finished: subtest: outputs read back through any worker carry the cache signature, in 7.95 seconds)4663subtest: two clients wanting the same drv build it once4664client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup4665client # [ 61.470626] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup.4666client # Running as unit: dedup1.service; invocation ID: 692dddb3ac07415ab487437902429f064667client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup, in 0.08 seconds)4668client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup4669worker1 # [ 61.655738] nix-grpc-daemon[766]: ts=2026-09-22T15:05:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:536024670client # [ 61.667550] nix[996]: don't know how to build these paths:4671client # [ 61.671310] nix[996]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4672worker2 # [ 61.774876] nix-grpc-daemon[771]: ts=2026-09-22T15:05:33Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04673worker2 # [ 61.780505] nix-grpc-daemon[771]: ts=2026-09-22T15:05:33Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=14674worker2 # [ 61.818497] nix-grpc-daemon[771]: ts=2026-09-22T15:05:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:447024675worker2 # [ 61.835886] nix-grpc-daemon[771]: ts=2026-09-22T15:05:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:447024676client # [ 61.759433] nix[996]: copying 1 paths to 'lb:50051'...4677client # [ 61.764388] nix[996]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4678worker2 # [ 61.854689] nix-grpc-daemon[771]: ts=2026-09-22T15:05:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:447024679worker2 # [ 61.870106] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4680worker2 # [ 62.036570] nix-daemon[857]: accepted connection from pid 1071, user nix-grpc-daemon (trusted)4681worker2 # [ 62.064238] nix-daemon[857]: reaped child process 1074, status = succeeded4682worker2 # [ 62.168995] nix-daemon[857]: accepted connection from pid 1076, user nix-grpc-daemon (trusted)4683worker2 # [ 62.189465] nix-daemon[857]: reaped child process 1079, status = succeeded4684lb # [ 62.127285] niks3-server[1010]: 2026/09/22 15:05:33 INFO Received uploads request method=POST path=/api/pending_closures4685worker2 # [ 62.200405] nix-grpc-daemon[872]: time=2026-09-22T15:05:33.819Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4686worker2 # [ 62.201851] nix-grpc-daemon[872]: time=2026-09-22T15:05:33.819Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4687lb # [ 62.159780] niks3-server[1010]: 2026/09/22 15:05:33 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4688lb # [ 62.179438] niks3-server[1010]: 2026/09/22 15:05:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4689worker2 # [ 62.251995] nix-grpc-daemon[872]: time=2026-09-22T15:05:33.871Z level=INFO msg="Uploading 1 narinfos"4690lb # [ 62.194296] niks3-server[1010]: 2026/09/22 15:05:33 INFO Signed narinfos id=15 count=14691lb # [ 62.201234] niks3-server[1010]: 2026/09/22 15:05:33 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4692lb # [ 62.212882] niks3-server[1010]: 2026/09/22 15:05:33 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4693worker2 # [ 62.279667] nix-grpc-daemon[872]: time=2026-09-22T15:05:33.899Z level=INFO msg="Upload complete. (391ms)"4694lb # [ 62.219432] niks3-server[1010]: 2026/09/22 15:05:33 INFO Completed upload id=154695lb # [ 62.222129] niks3-server[1010]: 2026/09/22 15:05:33 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4696worker2 # [ 62.292130] nix-grpc-daemon[771]: ts=2026-09-22T15:05:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=0 paths=1 nar_bytes_in=4324697worker2 # [ 62.306513] nix-grpc-daemon[771]: ts=2026-09-22T15:05:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:447024698worker2 # [ 62.312550] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4699worker2 # [ 62.317583] nix-daemon[857]: reaped child process 1069, status = succeeded4700client # [ 62.237644] nix[996]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4701worker2 # [ 62.330122] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4702client # [ 62.567595] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup.4703client # Running as unit: dedup2.service; invocation ID: ce9fc397e1154f9587d94017dc7485934704client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup, in 1.11 seconds)4705worker1 # [ 62.790590] nix-grpc-daemon[766]: ts=2026-09-22T15:05:34Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:536024706client # [ 62.802656] nix[1012]: don't know how to build these paths:4707client # [ 62.804775] nix[1012]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4708worker2 # [ 62.904282] nix-grpc-daemon[771]: ts=2026-09-22T15:05:34Z level=debug event=want client=6 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04709client # [ 62.822575] nix[1012]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4710worker2 # [ 62.911414] nix-grpc-daemon[771]: ts=2026-09-22T15:05:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:447024711client: must succeed: sleep 24712client: (finished: must succeed: sleep 2, in 2.05 seconds)4713client: waiting for success: ! systemctl is-active dedup1 dedup24714worker2 # [ 66.395446] nix-daemon[857]: reaped child process 1083, status = succeeded4715worker2 # [ 66.523381] nix-daemon[857]: accepted connection from pid 1115, user nix-grpc-daemon (trusted)4716worker2 # [ 66.547221] nix-daemon[857]: reaped child process 1118, status = succeeded4717lb # [ 66.484854] niks3-server[1010]: 2026/09/22 15:05:38 INFO Received uploads request method=POST path=/api/pending_closures4718worker2 # [ 66.608756] nix-grpc-daemon[872]: time=2026-09-22T15:05:38.224Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4719worker2 # [ 66.617770] nix-grpc-daemon[872]: time=2026-09-22T15:05:38.224Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4720lb # [ 66.589013] niks3-server[1010]: 2026/09/22 15:05:38 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4721worker2 # [ 66.666201] nix-grpc-daemon[872]: time=2026-09-22T15:05:38.285Z level=INFO msg="Uploading 1 narinfos"4722lb # [ 66.605536] niks3-server[1010]: 2026/09/22 15:05:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4723lb # [ 66.614337] niks3-server[1010]: 2026/09/22 15:05:38 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4724lb # [ 66.623433] niks3-server[1010]: 2026/09/22 15:05:38 INFO Signed narinfos id=16 count=14725lb # [ 66.627429] niks3-server[1010]: 2026/09/22 15:05:38 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4726lb # [ 66.636372] niks3-server[1010]: 2026/09/22 15:05:38 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4727lb # [ 66.640485] niks3-server[1010]: 2026/09/22 15:05:38 INFO Completed upload id=164728worker2 # [ 66.702869] nix-grpc-daemon[872]: time=2026-09-22T15:05:38.322Z level=INFO msg="Upload complete. (358ms)"4729lb # [ 66.645351] niks3-server[1010]: 2026/09/22 15:05:38 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4730worker2 # [ 66.716992] nix-grpc-daemon[771]: ts=2026-09-22T15:05:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=8 outputs=14731worker2 # [ 66.736333] nix-grpc-daemon[771]: ts=2026-09-22T15:05:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=8 outputs=14732worker2 # [ 66.745902] nix-daemon[857]: reaped child process 1081, status = succeeded4733client # [ 66.662144] systemd[1]: dedup2.service: Deactivated successfully.4734client # [ 66.666380] systemd[1]: dedup2.service: Consumed 206ms CPU time over 4.094s wall clock time, 35.2M memory peak, 5.9K incoming IP traffic, 5.5K outgoing IP traffic.4735client # [ 66.699554] systemd[1]: dedup1.service: Deactivated successfully.4736client # [ 66.707310] systemd[1]: dedup1.service: Consumed 175ms CPU time over 5.235s wall clock time, 41.4M memory peak, 7.4K incoming IP traffic, 8.6K outgoing IP traffic.4737client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.13 seconds)4738client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4739client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds)4740worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4741worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4742worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4743worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4744worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4745worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)4746worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4747worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)4748(finished: subtest: two clients wanting the same drv build it once, in 6.13 seconds)4749subtest: --timeout and --max-silent-time reach the builder4750worker2 # [ 67.860870] nix-grpc-daemon[771]: ts=2026-09-22T15:05:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:447024751worker2 # [ 67.870353] nix-grpc-daemon[771]: ts=2026-09-22T15:05:39Z level=debug event=want client=7 drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv cached=04752worker2 # [ 67.872760] nix-grpc-daemon[771]: ts=2026-09-22T15:05:39Z level=debug event=assigned drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv worker=192.168.1.3:50051 clients=14753worker1 # [ 67.783911] nix-grpc-daemon[766]: ts=2026-09-22T15:05:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:536024754worker1 # [ 67.799010] nix-grpc-daemon[766]: ts=2026-09-22T15:05:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:536024755worker1 # [ 67.814268] nix-grpc-daemon[766]: ts=2026-09-22T15:05:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:536024756worker1 # [ 67.828563] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted)4757worker1 # [ 67.997431] nix-daemon[833]: accepted connection from pid 998, user nix-grpc-daemon (trusted)4758worker1 # [ 68.014780] nix-daemon[833]: reaped child process 1001, status = succeeded4759lb # [ 68.049779] envoy[895]: conn peer=[2001:db8:1::1]:36742 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9528 tx=4369 ms=62274760lb # [ 68.054884] envoy[895]: conn peer=[2001:db8:1::1]:45940 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=409 ms=1284761lb # [ 68.060569] envoy[895]: conn peer=[2001:db8:1::1]:45926 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1051 tx=2893 ms=2384762lb # [ 68.065583] envoy[895]: conn peer=[2001:db8:1::1]:45946 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=376 ms=1104763lb # [ 68.070740] envoy[895]: conn peer=[2001:db8:1::1]:45956 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=408 tx=329 ms=924764lb # [ 68.076205] envoy[895]: conn peer=[2001:db8:1::1]:45982 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1443 tx=1197 ms=38524765lb # [ 68.080982] envoy[895]: conn peer=[2001:db8:1::1]:45966 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3035 tx=1558 ms=50284766worker1 # [ 68.118320] nix-daemon[833]: accepted connection from pid 1003, user nix-grpc-daemon (trusted)4767worker1 # [ 68.133509] nix-daemon[833]: reaped child process 1006, status = succeeded4768lb # [ 68.173092] niks3-server[1010]: 2026/09/22 15:05:39 INFO Received uploads request method=POST path=/api/pending_closures4769worker1 # [ 68.150983] nix-grpc-daemon[859]: time=2026-09-22T15:05:39.750Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4770worker1 # [ 68.152589] nix-grpc-daemon[859]: time=2026-09-22T15:05:39.750Z level=INFO msg="Uploading sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv (424B)"4771lb # [ 68.207098] niks3-server[1010]: 2026/09/22 15:05:39 INFO Registered completed upload object_key=nar/1m12xmj6yzmb9y2j8ly0yvh5fyzy1nqk7ajhqwr4wn3b5h0bsch5.nar.zst4772lb # [ 68.225332] niks3-server[1010]: 2026/09/22 15:05:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4773worker1 # [ 68.198950] nix-grpc-daemon[859]: time=2026-09-22T15:05:39.799Z level=INFO msg="Uploading 1 narinfos"4774lb # [ 68.231573] niks3-server[1010]: 2026/09/22 15:05:39 INFO Signed narinfos id=17 count=14775lb # [ 68.238938] niks3-server[1010]: 2026/09/22 15:05:39 INFO Registered completed upload object_key=sfkglm39i7dsf4k91pn9ij8xz5mkgirx.ls4776lb # [ 68.250970] niks3-server[1010]: 2026/09/22 15:05:39 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4777worker1 # [ 68.225087] nix-grpc-daemon[859]: time=2026-09-22T15:05:39.825Z level=INFO msg="Upload complete. (378ms)"4778lb # [ 68.257668] niks3-server[1010]: 2026/09/22 15:05:39 INFO Completed upload id=174779lb # [ 68.263815] niks3-server[1010]: 2026/09/22 15:05:39 INFO Registered completed upload object_key=sfkglm39i7dsf4k91pn9ij8xz5mkgirx.narinfo4780worker1 # [ 68.236399] nix-grpc-daemon[766]: ts=2026-09-22T15:05:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=0 paths=1 nar_bytes_in=4244781worker1 # [ 68.251575] nix-grpc-daemon[766]: ts=2026-09-22T15:05:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:536024782worker1 # [ 68.259716] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted)4783worker1 # [ 68.265136] nix-daemon[833]: reaped child process 996, status = succeeded4784worker1 # [ 68.277796] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted)4785worker1 # [ 74.494419] nix-grpc-daemon[766]: ts=2026-09-22T15:05:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=6 drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv assign_id=9 outputs=04786worker1 # [ 74.535454] nix-daemon[833]: reaped child process 1008, status = succeeded4787worker1 # [ 74.539066] nix-daemon[833]: reaped child process 1010, status = succeeded4788worker2 # [ 74.824495] nix-grpc-daemon[771]: ts=2026-09-22T15:05:46Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:447024789worker2 # [ 74.837932] nix-grpc-daemon[771]: ts=2026-09-22T15:05:46Z level=debug event=want client=8 drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv cached=04790worker2 # [ 74.847473] nix-grpc-daemon[771]: ts=2026-09-22T15:05:46Z level=debug event=assigned drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv worker=192.168.1.4:50051 clients=14791worker2 # [ 74.856355] nix-grpc-daemon[771]: ts=2026-09-22T15:05:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:447024792worker2 # [ 74.863320] nix-grpc-daemon[771]: ts=2026-09-22T15:05:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:447024793worker2 # [ 74.875077] nix-grpc-daemon[771]: ts=2026-09-22T15:05:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:447024794worker2 # [ 74.891983] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4795worker2 # [ 75.038682] nix-daemon[857]: accepted connection from pid 1135, user nix-grpc-daemon (trusted)4796worker2 # [ 75.058179] nix-daemon[857]: reaped child process 1138, status = succeeded4797worker2 # [ 75.158422] nix-daemon[857]: accepted connection from pid 1140, user nix-grpc-daemon (trusted)4798worker2 # [ 75.176384] nix-daemon[857]: reaped child process 1143, status = succeeded4799lb # [ 75.121210] niks3-server[1010]: 2026/09/22 15:05:46 INFO Received uploads request method=POST path=/api/pending_closures4800worker2 # [ 75.194000] nix-grpc-daemon[872]: time=2026-09-22T15:05:46.813Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4801worker2 # [ 75.195476] nix-grpc-daemon[872]: time=2026-09-22T15:05:46.813Z level=INFO msg="Uploading pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv (424B)"4802lb # [ 75.153563] niks3-server[1010]: 2026/09/22 15:05:46 INFO Registered completed upload object_key=nar/14f5yrnllfav3svmw4v4svw15r4zlf5yv1p972jy14mmq6gdw943.nar.zst4803lb # [ 75.169696] niks3-server[1010]: 2026/09/22 15:05:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4804worker2 # [ 75.237463] nix-grpc-daemon[872]: time=2026-09-22T15:05:46.857Z level=INFO msg="Uploading 1 narinfos"4805lb # [ 75.180400] niks3-server[1010]: 2026/09/22 15:05:46 INFO Signed narinfos id=18 count=14806lb # [ 75.182815] niks3-server[1010]: 2026/09/22 15:05:46 INFO Registered completed upload object_key=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s.ls4807lb # [ 75.195632] niks3-server[1010]: 2026/09/22 15:05:46 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4808worker2 # [ 75.262317] nix-grpc-daemon[872]: time=2026-09-22T15:05:46.882Z level=INFO msg="Upload complete. (359ms)"4809lb # [ 75.201392] niks3-server[1010]: 2026/09/22 15:05:46 INFO Completed upload id=184810lb # [ 75.206603] niks3-server[1010]: 2026/09/22 15:05:46 INFO Registered completed upload object_key=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s.narinfo4811worker2 # [ 75.268972] nix-grpc-daemon[771]: ts=2026-09-22T15:05:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=0 paths=1 nar_bytes_in=4244812worker2 # [ 75.283001] nix-grpc-daemon[771]: ts=2026-09-22T15:05:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:447024813worker2 # [ 75.289884] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4814worker2 # [ 75.294767] nix-daemon[857]: reaped child process 1133, status = succeeded4815worker2 # [ 75.306217] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4816lb # [ 78.050057] envoy[895]: conn peer=[2001:db8:1::1]:45996 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2975 tx=952 ms=67454817worker2 # [ 81.523203] nix-grpc-daemon[771]: ts=2026-09-22T15:05:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=6 drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv assign_id=10 outputs=04818worker2 # [ 81.541170] nix-daemon[857]: reaped child process 1145, status = succeeded4819worker2 # [ 81.542371] nix-daemon[857]: reaped child process 1147, status = succeeded4820(finished: subtest: --timeout and --max-silent-time reach the builder, in 14.12 seconds)4821subtest: the first client leaving does not fail the second4822client: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share4823client # [ 81.729410] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share.4824client # Running as unit: share1.service; invocation ID: a2e9a40d52994887bd9bb528d6c799624825client: (finished: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share, in 0.09 seconds)4826client: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share4827worker2 # [ 82.038020] nix-grpc-daemon[771]: ts=2026-09-22T15:05:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:447024828client # [ 81.955989] nix[1085]: don't know how to build these paths:4829client # [ 81.957174] nix[1085]: /nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv4830worker2 # [ 82.057849] nix-grpc-daemon[771]: ts=2026-09-22T15:05:53Z level=debug event=want client=9 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv cached=04831worker1 # [ 81.969075] nix-grpc-daemon[766]: ts=2026-09-22T15:05:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:536024832worker2 # [ 82.064318] nix-grpc-daemon[771]: ts=2026-09-22T15:05:53Z level=debug event=assigned drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv worker=192.168.1.3:50051 clients=14833worker1 # [ 81.987788] nix-grpc-daemon[766]: ts=2026-09-22T15:05:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:536024834client # [ 82.005151] nix[1085]: copying 1 paths to 'lb:50051'...4835client # [ 82.007946] nix[1085]: copying path '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' to 'lb:50051'...4836worker1 # [ 82.005259] nix-grpc-daemon[766]: ts=2026-09-22T15:05:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:536024837worker1 # [ 82.021541] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted)4838worker1 # [ 82.187675] nix-daemon[833]: accepted connection from pid 1033, user nix-grpc-daemon (trusted)4839worker1 # [ 82.205941] nix-daemon[833]: reaped child process 1036, status = succeeded4840worker1 # [ 82.311467] nix-daemon[833]: accepted connection from pid 1038, user nix-grpc-daemon (trusted)4841worker1 # [ 82.329535] nix-daemon[833]: reaped child process 1041, status = succeeded4842lb # [ 82.366874] niks3-server[1010]: 2026/09/22 15:05:53 INFO Received uploads request method=POST path=/api/pending_closures4843worker1 # [ 82.346412] nix-grpc-daemon[859]: time=2026-09-22T15:05:53.946Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4844worker1 # [ 82.347879] nix-grpc-daemon[859]: time=2026-09-22T15:05:53.946Z level=INFO msg="Uploading rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv (432B)"4845lb # [ 82.402274] niks3-server[1010]: 2026/09/22 15:05:54 INFO Registered completed upload object_key=nar/0chdjpc9an2ckdblh08lnyrmzvw3h8qs76cn5ydwjwvgwkrm731l.nar.zst4846worker1 # [ 82.383733] nix-grpc-daemon[859]: time=2026-09-22T15:05:53.983Z level=INFO msg="Uploading 1 narinfos"4847lb # [ 82.415588] niks3-server[1010]: 2026/09/22 15:05:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4848lb # [ 82.427942] niks3-server[1010]: 2026/09/22 15:05:54 INFO Signed narinfos id=19 count=14849lb # [ 82.434305] niks3-server[1010]: 2026/09/22 15:05:54 INFO Registered completed upload object_key=rxafkggp1xca5h7p0r6gwpq3qqp2kn63.ls4850worker1 # [ 82.415028] nix-grpc-daemon[859]: time=2026-09-22T15:05:54.015Z level=INFO msg="Upload complete. (374ms)"4851lb # [ 82.446983] niks3-server[1010]: 2026/09/22 15:05:54 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4852lb # [ 82.456470] niks3-server[1010]: 2026/09/22 15:05:54 INFO Completed upload id=194853worker1 # [ 82.425239] nix-grpc-daemon[766]: ts=2026-09-22T15:05:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=0 paths=1 nar_bytes_in=4324854lb # [ 82.459960] niks3-server[1010]: 2026/09/22 15:05:54 INFO Registered completed upload object_key=rxafkggp1xca5h7p0r6gwpq3qqp2kn63.narinfo4855worker1 # [ 82.442092] nix-grpc-daemon[766]: ts=2026-09-22T15:05:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:536024856worker1 # [ 82.447887] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted)4857worker1 # [ 82.455651] nix-daemon[833]: reaped child process 1031, status = succeeded4858worker1 # [ 82.464238] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted)4859client # [ 82.467802] nix[1085]: building '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' on lb:50051...4860client # [ 82.837601] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share.4861client # Running as unit: share2.service; invocation ID: 8ea066ff29994b2c80d3dd43aff357514862client: (finished: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share, in 1.12 seconds)4863worker1 # [ 83.032984] nix-grpc-daemon[766]: ts=2026-09-22T15:05:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:536024864client # [ 83.051364] nix[1101]: this derivation will be built:4865worker2 # [ 83.146310] nix-grpc-daemon[771]: ts=2026-09-22T15:05:54Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:447024866worker2 # [ 83.159271] nix-grpc-daemon[771]: copying path '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' from 'http://lb:5751'...4867client # [ 83.089212] nix[1101]: /nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv4868worker2 # [ 83.190062] nix-grpc-daemon[771]: ts=2026-09-22T15:05:54Z level=debug event=want client=10 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv cached=04869worker1 # [ 83.100120] nix-grpc-daemon[766]: ts=2026-09-22T15:05:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:536024870client # [ 83.111845] nix[1101]: building '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' on lb:50051...4871client: must succeed: sleep 2; systemctl kill -s INT share14872client # [ 86.217214] systemd[1]: share1.service: Sent signal SIGINT to main process 1085 (nix) on client request.4873client # [ 86.226435] nix[1085]: shutting downrxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)4874client # [ 86.235021] nix[1085]: [mutex.cc : 451] RAW: Unlock 0xe5933f5fc788 @ 0xe59743d759a4 0xe59744e4d40c 0xe597642c57bc 0xe597642c7414 0xe597642be1d4 0xe59763304f7c 0xe59763092d804875client: (finished: must succeed: sleep 2; systemctl kill -s INT share1, in 2.09 seconds)4876client: waiting for success: ! systemctl is-active share14877client # [ 86.264805] systemd-coredump[1116]: Process 1085 (nix) of user 0 terminated abnormally with signal 11/SEGV, processing...4878client # [ 86.283783] systemd[1]: Created slice Slice /system/systemd-coredump.4879client # [ 86.294638] systemd[1]: Started Process Core Dump (PID 1116/UID 0).4880lb # [ 88.052507] envoy[895]: conn peer=[2001:db8:1::1]:38052 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2989 tx=954 ms=67604881client # [ 88.565719] systemd-coredump[1120]: Cannot store coredump of 1085 (nix): No space left on device4882client # [ 88.686166] systemd-coredump[1120]: Process 1085 (nix) of user 0 terminated abnormally without generating a coredump.4883client # [ 88.703532] systemd[1]: systemd-coredump@0-1-1116_1117-0.service: Deactivated successfully.4884client # [ 88.709760] systemd[1]: systemd-coredump@0-1-1116_1117-0.service: Consumed 1.932s CPU time over 2.402s wall clock time, 968.8M memory peak, 926.3M written to disk.4885client # [ 88.713923] systemd[1]: share1.service: Main process exited, code=dumped, status=11/SEGV4886client # [ 88.716843] systemd[1]: share1.service: Failed with result 'core-dump'.4887client # [ 88.718059] systemd[1]: share1.service: Consumed 371ms CPU time over 6.987s wall clock time, 39.5M memory peak, 4K written to disk, 6.2K incoming IP traffic, 8.1K outgoing IP traffic.4888client: (finished: waiting for success: ! systemctl is-active share1, in 3.25 seconds)4889worker1 # [ 89.699248] nix-daemon[833]: reaped child process 1045, status = succeeded4890client: waiting for success: ! systemctl is-active share24891worker1 # [ 89.787822] nix-daemon[833]: accepted connection from pid 1079, user nix-grpc-daemon (trusted)4892worker1 # [ 89.805938] nix-daemon[833]: reaped child process 1082, status = succeeded4893lb # [ 89.846048] niks3-server[1010]: 2026/09/22 15:06:01 INFO Received uploads request method=POST path=/api/pending_closures4894worker1 # [ 89.824454] nix-grpc-daemon[859]: time=2026-09-22T15:06:01.424Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4895worker1 # [ 89.825930] nix-grpc-daemon[859]: time=2026-09-22T15:06:01.424Z level=INFO msg="Uploading fjww0fd4rwk1s35jav3cyal62l24n356-slow-share (120B)"4896lb # [ 89.893426] niks3-server[1010]: 2026/09/22 15:06:01 INFO Registered completed upload object_key=log/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv4897lb # [ 89.907256] niks3-server[1010]: 2026/09/22 15:06:01 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst4898worker1 # [ 89.888449] nix-grpc-daemon[859]: time=2026-09-22T15:06:01.488Z level=INFO msg="Uploading 1 narinfos"4899lb # [ 89.921474] niks3-server[1010]: 2026/09/22 15:06:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4900lb # [ 89.928296] niks3-server[1010]: 2026/09/22 15:06:01 INFO Signed narinfos id=20 count=14901lb # [ 89.933014] niks3-server[1010]: 2026/09/22 15:06:01 INFO Registered completed upload object_key=fjww0fd4rwk1s35jav3cyal62l24n356.ls4902lb # [ 89.939375] niks3-server[1010]: 2026/09/22 15:06:01 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4903lb # [ 89.947796] niks3-server[1010]: 2026/09/22 15:06:01 INFO Completed upload id=204904worker1 # [ 89.916247] nix-grpc-daemon[859]: time=2026-09-22T15:06:01.516Z level=INFO msg="Upload complete. (234ms)"4905lb # [ 89.950582] niks3-server[1010]: 2026/09/22 15:06:01 INFO Registered completed upload object_key=fjww0fd4rwk1s35jav3cyal62l24n356.narinfo4906worker1 # [ 89.929321] nix-grpc-daemon[766]: ts=2026-09-22T15:06:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=7 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv assign_id=11 outputs=14907worker1 # [ 89.946824] nix-grpc-daemon[766]: ts=2026-09-22T15:06:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=6 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv assign_id=11 outputs=14908worker1 # [ 89.953416] nix-daemon[833]: reaped child process 1043, status = succeeded4909client # [ 90.008579] systemd[1]: share2.service: Deactivated successfully.4910client # [ 90.012924] systemd[1]: share2.service: Consumed 182ms CPU time over 7.175s wall clock time, 35.3M memory peak, 4K written to disk, 6.5K incoming IP traffic, 5.9K outgoing IP traffic.4911client: (finished: waiting for success: ! systemctl is-active share2, in 1.12 seconds)4912client: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }4913client: (finished: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }, in 0.05 seconds)4914(finished: subtest: the first client leaving does not fail the second, in 9.25 seconds)4915subtest: build hook: nix-daemon with builders = grpc://lb4916client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag hook 2>/tmp/hook.log4917client # [ 91.048921] systemd[1]: Started Nix Daemon.4918client # [ 91.162728] nix-daemon[1167]: accepted connection from pid 1164, user root (trusted)4919worker1 # [ 91.303698] nix-grpc-daemon[766]: ts=2026-09-22T15:06:02Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:536024920worker1 # [ 91.310561] nix-grpc-daemon[766]: ts=2026-09-22T15:06:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:536024921worker2 # [ 91.417203] nix-grpc-daemon[771]: ts=2026-09-22T15:06:03Z level=debug event=want client=11 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04922worker2 # [ 91.423799] nix-grpc-daemon[771]: ts=2026-09-22T15:06:03Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.4:50051 clients=14923worker2 # [ 91.432604] nix-grpc-daemon[771]: ts=2026-09-22T15:06:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:447024924worker2 # [ 91.446696] nix-grpc-daemon[771]: ts=2026-09-22T15:06:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:447024925worker2 # [ 91.461426] nix-grpc-daemon[771]: ts=2026-09-22T15:06:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:447024926worker2 # [ 91.475902] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4927worker2 # [ 91.638451] nix-daemon[857]: accepted connection from pid 1193, user nix-grpc-daemon (trusted)4928worker2 # [ 91.657796] nix-daemon[857]: reaped child process 1196, status = succeeded4929worker2 # [ 91.757040] nix-daemon[857]: accepted connection from pid 1198, user nix-grpc-daemon (trusted)4930worker2 # [ 91.773059] nix-daemon[857]: reaped child process 1201, status = succeeded4931lb # [ 91.717197] niks3-server[1010]: 2026/09/22 15:06:03 INFO Received uploads request method=POST path=/api/pending_closures4932worker2 # [ 91.788990] nix-grpc-daemon[872]: time=2026-09-22T15:06:03.408Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4933worker2 # [ 91.790618] nix-grpc-daemon[872]: time=2026-09-22T15:06:03.408Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4934lb # [ 91.744886] niks3-server[1010]: 2026/09/22 15:06:03 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4935lb # [ 91.760462] niks3-server[1010]: 2026/09/22 15:06:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4936worker2 # [ 91.829074] nix-grpc-daemon[872]: time=2026-09-22T15:06:03.448Z level=INFO msg="Uploading 1 narinfos"4937lb # [ 91.773277] niks3-server[1010]: 2026/09/22 15:06:03 INFO Signed narinfos id=21 count=14938lb # [ 91.780993] niks3-server[1010]: 2026/09/22 15:06:03 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4939lb # [ 91.794479] niks3-server[1010]: 2026/09/22 15:06:03 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4940worker2 # [ 91.863037] nix-grpc-daemon[872]: time=2026-09-22T15:06:03.482Z level=INFO msg="Upload complete. (370ms)"4941lb # [ 91.802335] niks3-server[1010]: 2026/09/22 15:06:03 INFO Completed upload id=214942lb # [ 91.805528] niks3-server[1010]: 2026/09/22 15:06:03 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4943worker2 # [ 91.872314] nix-grpc-daemon[771]: ts=2026-09-22T15:06:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=0 paths=1 nar_bytes_in=5124944worker2 # [ 91.887936] nix-grpc-daemon[771]: ts=2026-09-22T15:06:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:447024945worker2 # [ 91.896121] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4946worker2 # [ 91.899743] nix-daemon[857]: reaped child process 1191, status = succeeded4947worker2 # [ 91.910459] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4948worker2 # [ 92.988421] nix-daemon[857]: reaped child process 1205, status = succeeded4949worker2 # [ 93.088913] nix-daemon[857]: accepted connection from pid 1221, user nix-grpc-daemon (trusted)4950worker2 # [ 93.109709] nix-daemon[857]: reaped child process 1224, status = succeeded4951lb # [ 93.049907] niks3-server[1010]: 2026/09/22 15:06:04 INFO Received uploads request method=POST path=/api/pending_closures4952worker2 # [ 93.123693] nix-grpc-daemon[872]: time=2026-09-22T15:06:04.740Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4953worker2 # [ 93.125619] nix-grpc-daemon[872]: time=2026-09-22T15:06:04.740Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4954lb # [ 93.081711] niks3-server[1010]: 2026/09/22 15:06:04 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4955worker2 # [ 93.173616] nix-grpc-daemon[872]: time=2026-09-22T15:06:04.793Z level=INFO msg="Uploading 1 narinfos"4956lb # [ 93.103346] niks3-server[1010]: 2026/09/22 15:06:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4957lb # [ 93.118293] niks3-server[1010]: 2026/09/22 15:06:04 INFO Signed narinfos id=22 count=14958lb # [ 93.123793] niks3-server[1010]: 2026/09/22 15:06:04 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4959lb # [ 93.133729] niks3-server[1010]: 2026/09/22 15:06:04 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4960worker2 # [ 93.205604] nix-grpc-daemon[872]: time=2026-09-22T15:06:04.825Z level=INFO msg="Upload complete. (283ms)"4961lb # [ 93.145037] niks3-server[1010]: 2026/09/22 15:06:04 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4962lb # [ 93.149415] niks3-server[1010]: 2026/09/22 15:06:04 INFO Completed upload id=224963lb # [ 93.153508] niks3-server[1010]: 2026/09/22 15:06:04 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4964worker2 # [ 93.221931] nix-grpc-daemon[771]: ts=2026-09-22T15:06:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=12 outputs=14965worker2 # [ 93.240377] nix-grpc-daemon[771]: ts=2026-09-22T15:06:04Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:447024966worker2 # [ 93.246552] nix-daemon[857]: reaped child process 1203, status = succeeded4967worker2 # [ 93.267640] nix-grpc-daemon[771]: ts=2026-09-22T15:06:04Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:447024968worker2 # [ 93.274392] nix-grpc-daemon[771]: ts=2026-09-22T15:06:04Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=0 paths=1 nar_bytes_out=1284969worker2 # [ 93.559756] nix-grpc-daemon[771]: ts=2026-09-22T15:06:05Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:447024970worker1 # [ 93.470854] nix-grpc-daemon[766]: ts=2026-09-22T15:06:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:536024971worker2 # [ 93.589253] nix-grpc-daemon[771]: ts=2026-09-22T15:06:05Z level=debug event=want client=12 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04972worker2 # [ 93.596748] nix-grpc-daemon[771]: ts=2026-09-22T15:06:05Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.4:50051 clients=14973worker2 # [ 93.605684] nix-grpc-daemon[771]: ts=2026-09-22T15:06:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:447024974worker2 # [ 93.616150] nix-grpc-daemon[771]: ts=2026-09-22T15:06:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:447024975worker2 # [ 93.629192] nix-grpc-daemon[872]: time=2026-09-22T15:06:05.248Z level=INFO msg="All 1 paths already cached"4976worker2 # [ 93.639289] nix-grpc-daemon[771]: ts=2026-09-22T15:06:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:447024977worker2 # [ 93.653548] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4978worker2 # [ 93.813275] nix-daemon[857]: accepted connection from pid 1230, user nix-grpc-daemon (trusted)4979worker2 # [ 93.835244] nix-daemon[857]: reaped child process 1233, status = succeeded4980worker2 # [ 93.942106] nix-daemon[857]: accepted connection from pid 1235, user nix-grpc-daemon (trusted)4981worker2 # [ 93.962140] nix-daemon[857]: reaped child process 1238, status = succeeded4982lb # [ 93.897528] niks3-server[1010]: 2026/09/22 15:06:05 INFO Received uploads request method=POST path=/api/pending_closures4983worker2 # [ 93.970448] nix-grpc-daemon[872]: time=2026-09-22T15:06:05.589Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4984worker2 # [ 93.971924] nix-grpc-daemon[872]: time=2026-09-22T15:06:05.589Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4985lb # [ 93.931856] niks3-server[1010]: 2026/09/22 15:06:05 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4986worker2 # [ 94.006807] nix-grpc-daemon[872]: time=2026-09-22T15:06:05.626Z level=INFO msg="Uploading 1 narinfos"4987lb # [ 93.947455] niks3-server[1010]: 2026/09/22 15:06:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4988lb # [ 93.958933] niks3-server[1010]: 2026/09/22 15:06:05 INFO Signed narinfos id=23 count=14989worker2 # [ 94.032501] nix-grpc-daemon[872]: time=2026-09-22T15:06:05.652Z level=INFO msg="Upload complete. (361ms)"4990lb # [ 93.970929] niks3-server[1010]: 2026/09/22 15:06:05 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4991worker2 # [ 94.040126] nix-grpc-daemon[771]: ts=2026-09-22T15:06:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=0 paths=1 nar_bytes_in=6244992lb # [ 93.983103] niks3-server[1010]: 2026/09/22 15:06:05 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4993worker2 # [ 94.048572] nix-grpc-daemon[771]: ts=2026-09-22T15:06:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:447024994lb # [ 93.987853] niks3-server[1010]: 2026/09/22 15:06:05 INFO Completed upload id=234995lb # [ 93.991047] niks3-server[1010]: 2026/09/22 15:06:05 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4996worker2 # [ 94.062610] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4997worker2 # [ 94.065121] nix-daemon[857]: reaped child process 1228, status = succeeded4998worker2 # [ 94.077513] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4999worker2 # [ 94.717351] nix-daemon[857]: reaped child process 1242, status = succeeded5000worker2 # [ 94.843194] nix-daemon[857]: accepted connection from pid 1258, user nix-grpc-daemon (trusted)5001worker2 # [ 94.865851] nix-daemon[857]: reaped child process 1261, status = succeeded5002lb # [ 94.803335] niks3-server[1010]: 2026/09/22 15:06:06 INFO Received uploads request method=POST path=/api/pending_closures5003worker2 # [ 94.878718] nix-grpc-daemon[872]: time=2026-09-22T15:06:06.496Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5004worker2 # [ 94.880865] nix-grpc-daemon[872]: time=2026-09-22T15:06:06.496Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"5005lb # [ 94.868166] niks3-server[1010]: 2026/09/22 15:06:06 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst5006lb # [ 94.881012] niks3-server[1010]: 2026/09/22 15:06:06 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv5007worker2 # [ 94.951631] nix-grpc-daemon[872]: time=2026-09-22T15:06:06.570Z level=INFO msg="Uploading 1 narinfos"5008lb # [ 94.894269] niks3-server[1010]: 2026/09/22 15:06:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign5009lb # [ 94.904357] niks3-server[1010]: 2026/09/22 15:06:06 INFO Signed narinfos id=24 count=15010lb # [ 94.906475] niks3-server[1010]: 2026/09/22 15:06:06 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls5011lb # [ 94.921521] niks3-server[1010]: 2026/09/22 15:06:06 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete5012lb # [ 94.931148] niks3-server[1010]: 2026/09/22 15:06:06 INFO Completed upload id=245013worker2 # [ 94.993771] nix-grpc-daemon[872]: time=2026-09-22T15:06:06.613Z level=INFO msg="Upload complete. (307ms)"5014lb # [ 94.933982] niks3-server[1010]: 2026/09/22 15:06:06 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo5015worker2 # [ 95.009221] nix-grpc-daemon[771]: ts=2026-09-22T15:06:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=0 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=13 outputs=15016worker2 # [ 95.032452] nix-grpc-daemon[771]: ts=2026-09-22T15:06:06Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:447025017worker2 # [ 95.039045] nix-daemon[857]: reaped child process 1240, status = succeeded5018worker1 # [ 94.964779] nix-grpc-daemon[766]: ts=2026-09-22T15:06:06Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:536025019worker1 # [ 94.978475] nix-grpc-daemon[766]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...5020worker1 # [ 94.994097] nix-grpc-daemon[766]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...5021worker1 # [ 95.009298] nix-grpc-daemon[766]: ts=2026-09-22T15:06:06Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=0 paths=1 nar_bytes_out=1765022worker1 # [ 95.350701] nix-grpc-daemon[766]: ts=2026-09-22T15:06:06Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:536025023worker2 # [ 95.450035] nix-grpc-daemon[771]: ts=2026-09-22T15:06:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:447025024worker2 # [ 95.462198] nix-grpc-daemon[872]: time=2026-09-22T15:06:07.081Z level=INFO msg="All 2 paths already cached"5025worker2 # [ 95.483300] nix-grpc-daemon[771]: ts=2026-09-22T15:06:07Z level=debug event=want client=13 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=05026worker2 # [ 95.490914] nix-grpc-daemon[771]: ts=2026-09-22T15:06:07Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.4:50051 clients=15027worker2 # [ 95.500954] nix-grpc-daemon[771]: ts=2026-09-22T15:06:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:447025028worker2 # [ 95.514965] nix-grpc-daemon[771]: ts=2026-09-22T15:06:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:447025029worker2 # [ 95.531254] nix-grpc-daemon[872]: time=2026-09-22T15:06:07.150Z level=INFO msg="All 2 paths already cached"5030worker2 # [ 95.544683] nix-grpc-daemon[771]: ts=2026-09-22T15:06:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:447025031worker2 # [ 95.562995] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted)5032worker2 # [ 95.753977] nix-daemon[857]: accepted connection from pid 1267, user nix-grpc-daemon (trusted)5033worker2 # [ 95.787613] nix-daemon[857]: reaped child process 1270, status = succeeded5034worker2 # [ 95.936161] nix-daemon[857]: accepted connection from pid 1272, user nix-grpc-daemon (trusted)5035worker2 # [ 95.958270] nix-daemon[857]: reaped child process 1275, status = succeeded5036lb # [ 95.907779] niks3-server[1010]: 2026/09/22 15:06:07 INFO Received uploads request method=POST path=/api/pending_closures5037worker2 # [ 95.990932] nix-grpc-daemon[872]: time=2026-09-22T15:06:07.609Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5038worker2 # [ 95.992753] nix-grpc-daemon[872]: time=2026-09-22T15:06:07.609Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"5039lb # [ 95.982305] niks3-server[1010]: 2026/09/22 15:06:07 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst5040worker2 # [ 96.070729] nix-grpc-daemon[872]: time=2026-09-22T15:06:07.689Z level=INFO msg="Uploading 1 narinfos"5041lb # [ 96.009386] niks3-server[1010]: 2026/09/22 15:06:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5042lb # [ 96.021657] niks3-server[1010]: 2026/09/22 15:06:07 INFO Signed narinfos id=25 count=15043lb # [ 96.042317] niks3-server[1010]: 2026/09/22 15:06:07 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls5044lb # [ 96.068445] niks3-server[1010]: 2026/09/22 15:06:07 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5045lb # [ 96.083114] niks3-server[1010]: 2026/09/22 15:06:07 INFO Completed upload id=255046worker2 # [ 96.144747] nix-grpc-daemon[872]: time=2026-09-22T15:06:07.764Z level=INFO msg="Upload complete. (562ms)"5047lb # [ 96.089437] niks3-server[1010]: 2026/09/22 15:06:07 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo5048worker2 # [ 96.158058] nix-grpc-daemon[771]: ts=2026-09-22T15:06:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=0 paths=1 nar_bytes_in=7525049worker2 # [ 96.177735] nix-grpc-daemon[771]: ts=2026-09-22T15:06:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:447025050worker2 # [ 96.197988] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted)5051worker2 # [ 96.208309] nix-daemon[857]: reaped child process 1265, status = succeeded5052worker2 # [ 96.233665] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted)5053worker2 # [ 97.325099] nix-daemon[857]: reaped child process 1279, status = succeeded5054worker2 # [ 97.430313] nix-daemon[857]: accepted connection from pid 1295, user nix-grpc-daemon (trusted)5055worker2 # [ 97.449731] nix-daemon[857]: reaped child process 1298, status = succeeded5056lb # [ 97.394743] niks3-server[1010]: 2026/09/22 15:06:09 INFO Received uploads request method=POST path=/api/pending_closures5057worker2 # [ 97.467015] nix-grpc-daemon[872]: time=2026-09-22T15:06:09.085Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5058worker2 # [ 97.468915] nix-grpc-daemon[872]: time=2026-09-22T15:06:09.085Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"5059lb # [ 97.434599] niks3-server[1010]: 2026/09/22 15:06:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5060worker2 # [ 97.507411] nix-grpc-daemon[872]: time=2026-09-22T15:06:09.126Z level=INFO msg="Uploading 1 narinfos"5061lb # [ 97.450364] niks3-server[1010]: 2026/09/22 15:06:09 INFO Signed narinfos id=26 count=15062lb # [ 97.458560] niks3-server[1010]: 2026/09/22 15:06:09 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv5063lb # [ 97.468085] niks3-server[1010]: 2026/09/22 15:06:09 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls5064lb # [ 97.476848] niks3-server[1010]: 2026/09/22 15:06:09 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst5065lb # [ 97.483605] niks3-server[1010]: 2026/09/22 15:06:09 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5066worker2 # [ 97.538816] nix-grpc-daemon[872]: time=2026-09-22T15:06:09.158Z level=INFO msg="Upload complete. (283ms)"5067lb # [ 97.489322] niks3-server[1010]: 2026/09/22 15:06:09 INFO Completed upload id=265068lb # [ 97.491743] niks3-server[1010]: 2026/09/22 15:06:09 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo5069worker2 # [ 97.553271] nix-grpc-daemon[771]: ts=2026-09-22T15:06:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=14 outputs=15070worker1 # [ 97.467630] nix-grpc-daemon[766]: ts=2026-09-22T15:06:09Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:536025071worker2 # [ 97.572962] nix-daemon[857]: reaped child process 1277, status = succeeded5072worker1 # [ 97.481581] nix-grpc-daemon[766]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...5073worker2 # [ 97.616574] nix-grpc-daemon[771]: ts=2026-09-22T15:06:09Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:447025074worker2 # [ 97.624277] nix-grpc-daemon[771]: ts=2026-09-22T15:06:09Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=0 paths=1 nar_bytes_out=2325075client # [ 97.625443] nix-daemon[1167]: reaped child process 1169, status = succeeded5076client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag hook 2>/tmp/hook.log, in 6.74 seconds)5077client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top5078client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds)5079client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }5080client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds)5081client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }5082client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)5083(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 6.85 seconds)5084subtest: an input only one worker has still reaches the builder5085client: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag w1only5086client # this derivation will be built:5087client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv5088lb # [ 98.050574] envoy[895]: conn peer=[2001:db8:1::1]:48804 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2990 tx=788 ms=67585089lb # [ 98.055679] envoy[895]: conn peer=[2001:db8:1::1]:48818 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1605 tx=1599 ms=69505090lb # [ 98.060667] envoy[895]: conn peer=[2001:db8:1::1]:41650 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3427 tx=1967 ms=19345091client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...5092lb # [ 98.065440] envoy[895]: conn peer=[2001:db8:1::1]:41662 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=333 ms=665093lb # [ 98.070420] envoy[895]: conn peer=[2001:db8:1::1]:41672 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3875 tx=2179 ms=15625094lb # [ 98.075271] envoy[895]: conn peer=[2001:db8:1::1]:41682 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=376 ms=775095lb # [ 98.080917] envoy[895]: conn peer=[2001:db8:1::1]:41702 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=406 ms=285096lb # [ 98.085561] envoy[895]: conn peer=[2001:db8:1::1]:41694 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4339 tx=2416 ms=22005097client: (finished: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag w1only, in 0.30 seconds)5098client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure5099client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.12 seconds)5100worker1: must succeed: nix-store --import < /tmp/shared/inp.closure5101worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.20 seconds)5102worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only5103worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.03 seconds)5104client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt a >&25105client # [ 98.589206] nix-daemon[1167]: accepted connection from pid 1249, user root (trusted)5106client # this derivation will be built:5107client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv5108worker2 # [ 98.826492] nix-grpc-daemon[771]: ts=2026-09-22T15:06:10Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:447025109client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux'...5110worker1 # [ 98.735951] nix-grpc-daemon[766]: ts=2026-09-22T15:06:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:536025111worker1 # [ 98.901633] nix-daemon[833]: accepted connection from pid 1092, user nix-grpc-daemon (trusted)5112worker1 # [ 98.922232] nix-daemon[833]: reaped child process 1095, status = succeeded5113lb # [ 98.953501] niks3-server[1010]: 2026/09/22 15:06:10 INFO Received uploads request method=POST path=/api/pending_closures5114worker1 # [ 98.931514] nix-grpc-daemon[859]: time=2026-09-22T15:06:10.531Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5115worker1 # [ 98.933209] nix-grpc-daemon[859]: time=2026-09-22T15:06:10.531Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"5116lb # [ 98.980837] niks3-server[1010]: 2026/09/22 15:06:10 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst5117worker1 # [ 98.962534] nix-grpc-daemon[859]: time=2026-09-22T15:06:10.562Z level=INFO msg="Uploading 1 narinfos"5118lb # [ 98.994280] niks3-server[1010]: 2026/09/22 15:06:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5119lb # [ 99.006682] niks3-server[1010]: 2026/09/22 15:06:10 INFO Signed narinfos id=27 count=15120lb # [ 99.015296] niks3-server[1010]: 2026/09/22 15:06:10 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls5121worker1 # [ 98.994797] nix-grpc-daemon[859]: time=2026-09-22T15:06:10.595Z level=INFO msg="Upload complete. (257ms)"5122lb # [ 99.029713] niks3-server[1010]: 2026/09/22 15:06:10 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5123lb # [ 99.036358] niks3-server[1010]: 2026/09/22 15:06:10 INFO Completed upload id=275124lb # [ 99.038843] niks3-server[1010]: 2026/09/22 15:06:10 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo5125worker2 # [ 99.115050] nix-grpc-daemon[771]: ts=2026-09-22T15:06:10Z level=debug event=want client=14 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=05126worker2 # [ 99.121595] nix-grpc-daemon[771]: ts=2026-09-22T15:06:10Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=15127worker1 # [ 99.068949] nix-grpc-daemon[766]: ts=2026-09-22T15:06:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:536025128worker1 # [ 99.084265] nix-grpc-daemon[766]: ts=2026-09-22T15:06:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:536025129client # copying 2 paths to 'lb:50051'...5130client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...5131worker1 # [ 99.102813] nix-grpc-daemon[766]: ts=2026-09-22T15:06:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:536025132client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...5133worker1 # [ 99.117370] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted)5134worker1 # [ 99.276891] nix-daemon[833]: accepted connection from pid 1099, user nix-grpc-daemon (trusted)5135worker1 # [ 99.296869] nix-daemon[833]: reaped child process 1102, status = succeeded5136worker1 # [ 99.401013] nix-daemon[833]: accepted connection from pid 1104, user nix-grpc-daemon (trusted)5137worker1 # [ 99.418671] nix-daemon[833]: reaped child process 1107, status = succeeded5138lb # [ 99.454355] niks3-server[1010]: 2026/09/22 15:06:11 INFO Received uploads request method=POST path=/api/pending_closures5139lb # [ 99.463843] niks3-server[1010]: 2026/09/22 15:06:11 INFO Received uploads request method=POST path=/api/pending_closures5140worker1 # [ 99.440930] nix-grpc-daemon[859]: time=2026-09-22T15:06:11.040Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5141worker1 # [ 99.442379] nix-grpc-daemon[859]: time=2026-09-22T15:06:11.040Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"5142worker1 # [ 99.444163] nix-grpc-daemon[859]: time=2026-09-22T15:06:11.040Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"5143lb # [ 99.496947] niks3-server[1010]: 2026/09/22 15:06:11 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst5144lb # [ 99.516106] niks3-server[1010]: 2026/09/22 15:06:11 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst5145lb # [ 99.526829] niks3-server[1010]: 2026/09/22 15:06:11 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls5146lb # [ 99.539047] niks3-server[1010]: 2026/09/22 15:06:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5147worker1 # [ 99.514064] nix-grpc-daemon[859]: time=2026-09-22T15:06:11.113Z level=INFO msg="Uploading 3 narinfos"5148lb # [ 99.548851] niks3-server[1010]: 2026/09/22 15:06:11 INFO Signed narinfos id=28 count=15149lb # [ 99.551652] niks3-server[1010]: 2026/09/22 15:06:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5150lb # [ 99.565555] niks3-server[1010]: 2026/09/22 15:06:11 INFO Signed narinfos id=29 count=25151lb # [ 99.571822] niks3-server[1010]: 2026/09/22 15:06:11 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls5152lb # [ 99.579827] niks3-server[1010]: 2026/09/22 15:06:11 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo5153lb # [ 99.587902] niks3-server[1010]: 2026/09/22 15:06:11 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo5154lb # [ 99.594532] niks3-server[1010]: 2026/09/22 15:06:11 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5155lb # [ 99.601405] niks3-server[1010]: 2026/09/22 15:06:11 INFO Completed upload id=285156worker1 # [ 99.570909] nix-grpc-daemon[859]: time=2026-09-22T15:06:11.171Z level=INFO msg="Upload complete. (433ms)"5157lb # [ 99.603964] niks3-server[1010]: 2026/09/22 15:06:11 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5158lb # [ 99.610152] niks3-server[1010]: 2026/09/22 15:06:11 INFO Completed upload id=295159lb # [ 99.612241] niks3-server[1010]: 2026/09/22 15:06:11 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo5160worker1 # [ 99.584885] nix-grpc-daemon[766]: ts=2026-09-22T15:06:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=0 paths=2 nar_bytes_in=9845161worker1 # [ 99.600410] nix-grpc-daemon[766]: ts=2026-09-22T15:06:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:536025162worker1 # [ 99.615330] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted)5163worker1 # [ 99.619058] nix-daemon[833]: reaped child process 1097, status = succeeded5164client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...5165client # uses-input-w1onlya> node-a: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv5166worker1 # [ 99.634195] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted)5167client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds5168worker1 # [ 101.067462] nix-daemon[833]: reaped child process 1111, status = succeeded5169worker1 # [ 101.177714] nix-daemon[833]: accepted connection from pid 1127, user nix-grpc-daemon (trusted)5170worker1 # [ 101.199913] nix-daemon[833]: reaped child process 1130, status = succeeded5171lb # [ 101.233224] niks3-server[1010]: 2026/09/22 15:06:12 INFO Received uploads request method=POST path=/api/pending_closures5172worker1 # [ 101.208495] nix-grpc-daemon[859]: time=2026-09-22T15:06:12.807Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5173lb # [ 101.253079] niks3-server[1010]: 2026/09/22 15:06:12 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls5174worker1 # [ 101.227611] nix-grpc-daemon[859]: time=2026-09-22T15:06:12.827Z level=INFO msg="Uploading 1 narinfos"5175lb # [ 101.259847] niks3-server[1010]: 2026/09/22 15:06:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5176lb # [ 101.266971] niks3-server[1010]: 2026/09/22 15:06:12 INFO Signed narinfos id=30 count=15177lb # [ 101.270776] niks3-server[1010]: 2026/09/22 15:06:12 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv5178worker1 # [ 101.247327] nix-grpc-daemon[859]: time=2026-09-22T15:06:12.847Z level=INFO msg="Upload complete. (197ms)"5179lb # [ 101.279187] niks3-server[1010]: 2026/09/22 15:06:12 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5180lb # [ 101.285252] niks3-server[1010]: 2026/09/22 15:06:12 INFO Completed upload id=305181worker1 # [ 101.252652] nix-grpc-daemon[766]: ts=2026-09-22T15:06:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=15 outputs=15182lb # [ 101.286834] niks3-server[1010]: 2026/09/22 15:06:12 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo5183worker1 # [ 101.264464] nix-daemon[833]: reaped child process 1109, status = succeeded5184client # copying 1 paths...5185worker2 # [ 101.397729] nix-grpc-daemon[771]: ts=2026-09-22T15:06:13Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:447025186worker2 # [ 101.405887] nix-grpc-daemon[771]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'...5187client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...5188worker1 # [ 101.357104] nix-grpc-daemon[766]: ts=2026-09-22T15:06:12Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:536025189worker1 # [ 101.364731] nix-grpc-daemon[766]: ts=2026-09-22T15:06:12Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=0 paths=1 nar_bytes_out=1205190client # [ 101.459952] nix-daemon[1167]: reaped child process 1252, status = succeeded5191client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.06 seconds)5192client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt b >&25193client # [ 101.624850] nix-daemon[1167]: accepted connection from pid 1271, user root (trusted)5194client # this derivation will be built:5195client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv5196worker2 # [ 101.870391] nix-grpc-daemon[771]: ts=2026-09-22T15:06:13Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:447025197client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux'...5198worker1 # [ 101.780980] nix-grpc-daemon[766]: ts=2026-09-22T15:06:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:536025199worker1 # [ 101.791096] nix-grpc-daemon[859]: time=2026-09-22T15:06:13.391Z level=INFO msg="All 1 paths already cached"5200worker2 # [ 101.902345] nix-grpc-daemon[771]: ts=2026-09-22T15:06:13Z level=debug event=want client=15 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=05201worker2 # [ 101.909922] nix-grpc-daemon[771]: ts=2026-09-22T15:06:13Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=15202worker2 # [ 101.919327] nix-grpc-daemon[771]: ts=2026-09-22T15:06:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:447025203worker2 # [ 101.930838] nix-grpc-daemon[771]: ts=2026-09-22T15:06:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:447025204client # copying 1 paths to 'lb:50051'...5205client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...5206worker2 # [ 101.952192] nix-grpc-daemon[771]: ts=2026-09-22T15:06:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:447025207worker2 # [ 101.967626] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted)5208worker2 # [ 101.988740] nix-grpc-daemon[771]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 57 ms (attempt 1/5)5209worker2 # [ 102.053261] nix-grpc-daemon[771]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 22 ms (attempt 2/5)5210worker2 # [ 102.076900] nix-grpc-daemon[771]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 266 ms (attempt 3/5)5211worker2 # [ 102.344795] nix-grpc-daemon[771]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 557 ms (attempt 4/5)5212worker2 # [ 102.905631] nix-grpc-daemon[771]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5213worker2 # [ 102.914064] nix-grpc-daemon[771]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5214worker2 # [ 102.921062] nix-grpc-daemon[771]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...5215worker2 # [ 103.096329] nix-daemon[857]: accepted connection from pid 1315, user nix-grpc-daemon (trusted)5216worker2 # [ 103.115012] nix-daemon[857]: reaped child process 1318, status = succeeded5217worker2 # [ 103.220235] nix-daemon[857]: accepted connection from pid 1320, user nix-grpc-daemon (trusted)5218worker2 # [ 103.236996] nix-daemon[857]: reaped child process 1323, status = succeeded5219lb # [ 103.181756] niks3-server[1010]: 2026/09/22 15:06:14 INFO Received uploads request method=POST path=/api/pending_closures5220worker2 # [ 103.253713] nix-grpc-daemon[872]: time=2026-09-22T15:06:14.872Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5221worker2 # [ 103.255212] nix-grpc-daemon[872]: time=2026-09-22T15:06:14.872Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"5222lb # [ 103.219230] niks3-server[1010]: 2026/09/22 15:06:14 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst5223lb # [ 103.234686] niks3-server[1010]: 2026/09/22 15:06:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5224worker2 # [ 103.302276] nix-grpc-daemon[872]: time=2026-09-22T15:06:14.921Z level=INFO msg="Uploading 1 narinfos"5225lb # [ 103.243192] niks3-server[1010]: 2026/09/22 15:06:14 INFO Signed narinfos id=31 count=15226lb # [ 103.248446] niks3-server[1010]: 2026/09/22 15:06:14 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls5227lb # [ 103.259865] niks3-server[1010]: 2026/09/22 15:06:14 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5228lb # [ 103.266772] niks3-server[1010]: 2026/09/22 15:06:14 INFO Completed upload id=315229worker2 # [ 103.327349] nix-grpc-daemon[872]: time=2026-09-22T15:06:14.947Z level=INFO msg="Upload complete. (387ms)"5230lb # [ 103.270570] niks3-server[1010]: 2026/09/22 15:06:14 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo5231worker2 # [ 103.336288] nix-grpc-daemon[771]: ts=2026-09-22T15:06:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=1 paths=1 nar_bytes_in=5685232worker2 # [ 103.347235] nix-grpc-daemon[771]: ts=2026-09-22T15:06:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:447025233worker2 # [ 103.360554] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted)5234worker2 # [ 103.366754] nix-daemon[857]: reaped child process 1308, status = succeeded5235worker2 # [ 103.383006] nix-grpc-daemon[771]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...5236client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...5237worker2 # [ 103.401804] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted)5238client # uses-input-w1onlyb> worker2: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv5239client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds5240worker2 # [ 105.080351] nix-daemon[857]: reaped child process 1328, status = succeeded5241worker2 # [ 105.199181] nix-daemon[857]: accepted connection from pid 1344, user nix-grpc-daemon (trusted)5242worker2 # [ 105.215365] nix-daemon[857]: reaped child process 1347, status = succeeded5243lb # [ 105.162403] niks3-server[1010]: 2026/09/22 15:06:16 INFO Received uploads request method=POST path=/api/pending_closures5244worker2 # [ 105.236481] nix-grpc-daemon[872]: time=2026-09-22T15:06:16.853Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5245lb # [ 105.194532] niks3-server[1010]: 2026/09/22 15:06:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5246worker2 # [ 105.265427] nix-grpc-daemon[872]: time=2026-09-22T15:06:16.884Z level=INFO msg="Uploading 1 narinfos"5247lb # [ 105.210031] niks3-server[1010]: 2026/09/22 15:06:16 INFO Signed narinfos id=32 count=15248lb # [ 105.218409] niks3-server[1010]: 2026/09/22 15:06:16 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv5249lb # [ 105.226711] niks3-server[1010]: 2026/09/22 15:06:16 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls5250lb # [ 105.236285] niks3-server[1010]: 2026/09/22 15:06:16 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5251lb # [ 105.240268] niks3-server[1010]: 2026/09/22 15:06:16 INFO Completed upload id=325252worker2 # [ 105.302584] nix-grpc-daemon[872]: time=2026-09-22T15:06:16.922Z level=INFO msg="Upload complete. (288ms)"5253lb # [ 105.243042] niks3-server[1010]: 2026/09/22 15:06:16 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo5254worker2 # [ 105.317258] nix-grpc-daemon[771]: ts=2026-09-22T15:06:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=16 outputs=15255worker2 # [ 105.335208] nix-daemon[857]: reaped child process 1325, status = succeeded5256client # copying 1 paths...5257worker2 # [ 105.359955] nix-grpc-daemon[771]: ts=2026-09-22T15:06:16Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:447025258client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...5259worker2 # [ 105.393635] nix-grpc-daemon[771]: ts=2026-09-22T15:06:17Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:447025260worker2 # [ 105.400405] nix-grpc-daemon[771]: ts=2026-09-22T15:06:17Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=0 paths=1 nar_bytes_out=1205261client # [ 105.437993] nix-daemon[1167]: reaped child process 1274, status = succeeded5262client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.98 seconds)5263client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt c >&25264client # [ 105.601952] nix-daemon[1167]: accepted connection from pid 1293, user root (trusted)5265client # this derivation will be built:5266client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv5267client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux'...5268worker1 # [ 105.743267] nix-grpc-daemon[766]: ts=2026-09-22T15:06:17Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:536025269worker2 # [ 105.839397] nix-grpc-daemon[771]: ts=2026-09-22T15:06:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:447025270worker2 # [ 105.848874] nix-grpc-daemon[872]: time=2026-09-22T15:06:17.468Z level=INFO msg="All 1 paths already cached"5271worker2 # [ 105.864815] nix-grpc-daemon[771]: ts=2026-09-22T15:06:17Z level=debug event=want client=16 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=05272worker1 # [ 105.780086] nix-grpc-daemon[766]: ts=2026-09-22T15:06:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:536025273worker2 # [ 105.871343] nix-grpc-daemon[771]: ts=2026-09-22T15:06:17Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=15274worker1 # [ 105.791848] nix-grpc-daemon[766]: ts=2026-09-22T15:06:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:536025275client # copying 1 paths to 'lb:50051'...5276worker1 # [ 105.805636] nix-grpc-daemon[859]: time=2026-09-22T15:06:17.403Z level=INFO msg="All 1 paths already cached"5277client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...5278worker1 # [ 105.811104] nix-grpc-daemon[766]: ts=2026-09-22T15:06:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:536025279worker1 # [ 105.826312] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted)5280worker1 # [ 105.987422] nix-daemon[833]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)5281worker1 # [ 106.006734] nix-daemon[833]: reaped child process 1137, status = succeeded5282worker1 # [ 106.107334] nix-daemon[833]: accepted connection from pid 1139, user nix-grpc-daemon (trusted)5283worker1 # [ 106.122120] nix-daemon[833]: reaped child process 1142, status = succeeded5284lb # [ 106.162816] niks3-server[1010]: 2026/09/22 15:06:17 INFO Received uploads request method=POST path=/api/pending_closures5285worker1 # [ 106.143242] nix-grpc-daemon[859]: time=2026-09-22T15:06:17.743Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5286worker1 # [ 106.144829] nix-grpc-daemon[859]: time=2026-09-22T15:06:17.743Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"5287lb # [ 106.192290] niks3-server[1010]: 2026/09/22 15:06:17 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst5288lb # [ 106.206825] niks3-server[1010]: 2026/09/22 15:06:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5289worker1 # [ 106.181173] nix-grpc-daemon[859]: time=2026-09-22T15:06:17.781Z level=INFO msg="Uploading 1 narinfos"5290lb # [ 106.217891] niks3-server[1010]: 2026/09/22 15:06:17 INFO Signed narinfos id=33 count=15291lb # [ 106.224635] niks3-server[1010]: 2026/09/22 15:06:17 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls5292lb # [ 106.234358] niks3-server[1010]: 2026/09/22 15:06:17 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5293lb # [ 106.242510] niks3-server[1010]: 2026/09/22 15:06:17 INFO Completed upload id=335294lb # [ 106.244620] niks3-server[1010]: 2026/09/22 15:06:17 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo5295worker1 # [ 106.209389] nix-grpc-daemon[859]: time=2026-09-22T15:06:17.809Z level=INFO msg="Upload complete. (366ms)"5296worker1 # [ 106.221140] nix-grpc-daemon[766]: ts=2026-09-22T15:06:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=0 paths=1 nar_bytes_in=5685297worker1 # [ 106.234242] nix-grpc-daemon[766]: ts=2026-09-22T15:06:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:536025298worker1 # [ 106.242585] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted)5299worker1 # [ 106.244895] nix-daemon[833]: reaped child process 1132, status = succeeded5300client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...5301worker1 # [ 106.257678] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted)5302client # uses-input-w1onlyc> node-a: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv5303client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds5304worker1 # [ 107.735621] nix-daemon[833]: reaped child process 1146, status = succeeded5305worker1 # [ 107.846357] nix-daemon[833]: accepted connection from pid 1162, user nix-grpc-daemon (trusted)5306worker1 # [ 107.865641] nix-daemon[833]: reaped child process 1165, status = succeeded5307lb # [ 107.896609] niks3-server[1010]: 2026/09/22 15:06:19 INFO Received uploads request method=POST path=/api/pending_closures5308worker1 # [ 107.875778] nix-grpc-daemon[859]: time=2026-09-22T15:06:19.475Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5309lb # [ 107.924493] niks3-server[1010]: 2026/09/22 15:06:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5310worker1 # [ 107.901588] nix-grpc-daemon[859]: time=2026-09-22T15:06:19.501Z level=INFO msg="Uploading 1 narinfos"5311lb # [ 107.937993] niks3-server[1010]: 2026/09/22 15:06:19 INFO Signed narinfos id=34 count=15312lb # [ 107.948381] niks3-server[1010]: 2026/09/22 15:06:19 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls5313lb # [ 107.959994] niks3-server[1010]: 2026/09/22 15:06:19 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv5314lb # [ 107.973233] niks3-server[1010]: 2026/09/22 15:06:19 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5315worker1 # [ 107.947616] nix-grpc-daemon[859]: time=2026-09-22T15:06:19.547Z level=INFO msg="Upload complete. (277ms)"5316lb # [ 107.982100] niks3-server[1010]: 2026/09/22 15:06:19 INFO Completed upload id=345317lb # [ 107.988545] niks3-server[1010]: 2026/09/22 15:06:19 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo5318client # copying 1 paths...5319worker1 # [ 107.961205] nix-grpc-daemon[766]: ts=2026-09-22T15:06:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=17 outputs=15320worker1 # [ 107.979677] nix-grpc-daemon[766]: ts=2026-09-22T15:06:19Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:536025321worker1 # [ 107.985767] nix-daemon[833]: reaped child process 1144, status = succeeded5322client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...5323worker2 # [ 108.106080] nix-grpc-daemon[771]: ts=2026-09-22T15:06:19Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:447025324lb # [ 108.053920] envoy[895]: conn peer=[2001:db8:1::1]:41714 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3875 tx=2083 ms=26505325lb # [ 108.062009] envoy[895]: conn peer=[2001:db8:1::1]:51206 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=305326worker2 # [ 108.125956] nix-grpc-daemon[771]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'...5327lb # [ 108.066775] envoy[895]: conn peer=[2001:db8:1::1]:51208 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3765 tx=2123 ms=35895328lb # [ 108.076420] envoy[895]: conn peer=[2001:db8:1::1]:51222 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=705329worker2 # [ 108.144157] nix-grpc-daemon[771]: ts=2026-09-22T15:06:19Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=0 paths=1 nar_bytes_out=1205330client # [ 108.186879] nix-daemon[1167]: reaped child process 1296, status = succeeded5331client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.75 seconds)5332(finished: subtest: an input only one worker has still reaches the builder, in 10.44 seconds)5333subtest: upload whose reference the worker lacks is completed from the cache5334client: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag viacache5335client # this derivation will be built:5336client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv5337client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...5338client: (finished: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag viacache, in 0.33 seconds)5339client: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A referrer --argstr tag viacache5340client # this derivation will be built:5341client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv5342client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...5343client: (finished: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A referrer --argstr tag viacache, in 0.28 seconds)5344client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure5345client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.12 seconds)5346worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5347worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.19 seconds)5348worker2 # [ 109.281325] systemd[1]: Stopping Nix worker-protocol over gRPC...5349worker2 # [ 109.509345] nix-grpc-daemon[771]: ts=2026-09-22T15:06:21Z level=info event=signal_exit5350lb # [ 109.741216] niks3-server[1010]: 2026/09/22 15:06:21 INFO lead: released remote=192.168.1.4:371725351worker2 # [ 110.799392] nix-grpc-daemon[771]: ts=2026-09-22T15:06:22Z level=info event=scheduler_restarting5352worker1 # [ 110.707187] nix-grpc-daemon[766]: ts=2026-09-22T15:06:22Z level=info event=scheduler_restarting addr=lb:500515353worker2 # [ 110.810815] nix-grpc-daemon[771]: ts=2026-09-22T15:06:22Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:447005354worker2 # [ 110.816720] nix-grpc-daemon[771]: ts=2026-09-22T15:06:22Z level=info event=worker_gone addr=192.168.1.3:500515355worker2 # [ 110.821631] nix-grpc-daemon[771]: ts=2026-09-22T15:06:22Z level=info event=scheduler_restarting addr=lb:500515356worker2 # [ 110.826294] nix-grpc-daemon[771]: ts=2026-09-22T15:06:22Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:447005357worker2 # [ 110.831706] nix-grpc-daemon[771]: ts=2026-09-22T15:06:22Z level=info event=worker_gone addr=192.168.1.4:500515358worker2 # [ 110.859684] nix-daemon[857]: reaped child process 859, status = succeeded5359worker1 # [ 110.907221] nix-grpc-daemon[766]: ts=2026-09-22T15:06:22Z level=info event=scheduler_connected addr=lb:500515360worker1 # [ 110.912719] nix-grpc-daemon[766]: ts=2026-09-22T15:06:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5361worker2 # [ 111.034230] nix-grpc-daemon[771]: ts=2026-09-22T15:06:22Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5362worker1 # [ 111.113376] nix-grpc-daemon[766]: ts=2026-09-22T15:06:22Z level=info event=scheduler_connected addr=lb:500515363worker1 # [ 111.118452] nix-grpc-daemon[766]: ts=2026-09-22T15:06:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5364worker1 # [ 111.319244] nix-grpc-daemon[766]: ts=2026-09-22T15:06:22Z level=info event=scheduler_connected addr=lb:500515365worker1 # [ 111.324562] nix-grpc-daemon[766]: ts=2026-09-22T15:06:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5366worker1 # [ 111.525191] nix-grpc-daemon[766]: ts=2026-09-22T15:06:23Z level=info event=scheduler_connected addr=lb:500515367worker1 # [ 111.530350] nix-grpc-daemon[766]: ts=2026-09-22T15:06:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5368worker2 # [ 111.710382] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5369worker2 # [ 111.716295] systemd[1]: Stopped Nix worker-protocol over gRPC.5370worker2 # [ 111.724321] systemd[1]: nix-grpc-daemon.service: Consumed 4.858s CPU time over 1min 33.442s wall clock time, 69M memory peak, 115.9K incoming IP traffic, 301.2K outgoing IP traffic.5371worker2 # [ 111.740527] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5372worker2 # [ 111.747864] systemd[1]: Closed Nix worker-protocol over gRPC.5373worker2 # [ 111.750051] systemd[1]: nix-grpc-daemon.socket: Consumed 551us CPU time over 1min 41.541s wall clock time, 256K memory peak, 128.3K incoming IP traffic, 107.4K outgoing IP traffic.5374lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy5375lb: must succeed: curl -sf localhost:9901/clusters5376worker1 # [ 111.732992] nix-grpc-daemon[766]: ts=2026-09-22T15:06:23Z level=info event=scheduler_connected addr=lb:500515377lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5378worker1 # [ 111.737056] nix-grpc-daemon[766]: ts=2026-09-22T15:06:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5379lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.07 seconds)5380client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&25381worker1 # [ 111.933503] nix-grpc-daemon[766]: ts=2026-09-22T15:06:23Z level=info event=scheduler_connected addr=lb:500515382worker1 # [ 111.938333] nix-grpc-daemon[766]: ts=2026-09-22T15:06:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5383worker1 # [ 111.957809] nix-grpc-daemon[766]: ts=2026-09-22T15:06:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:536025384worker1 # [ 111.966820] nix-grpc-daemon[766]: ts=2026-09-22T15:06:23Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:536025385client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache5386client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.25 seconds)5387worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache5388worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.03 seconds)5389worker2 # [ 112.186104] systemd[1]: Listening on Nix worker-protocol over gRPC.5390worker1 # [ 112.139613] nix-grpc-daemon[766]: ts=2026-09-22T15:06:23Z level=info event=scheduler_connected addr=lb:500515391worker1 # [ 112.146547] nix-grpc-daemon[766]: ts=2026-09-22T15:06:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5392worker1 # [ 112.175130] systemd[1]: Stopping Nix worker-protocol over gRPC...5393worker1 # [ 112.330069] nix-grpc-daemon[766]: ts=2026-09-22T15:06:23Z level=info event=signal_exit5394worker1 # [ 112.346732] nix-grpc-daemon[766]: ts=2026-09-22T15:06:23Z level=info event=scheduler_connected addr=lb:500515395worker1 # [ 112.351848] nix-grpc-daemon[766]: ts=2026-09-22T15:06:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5396worker1 # [ 112.552541] nix-grpc-daemon[766]: ts=2026-09-22T15:06:24Z level=info event=scheduler_connected addr=lb:500515397worker1 # [ 112.557498] nix-grpc-daemon[766]: ts=2026-09-22T15:06:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5398worker2 # [ 112.749135] systemd[1]: Starting scheduler-token.service...5399worker2 # [ 112.833079] systemd[1]: scheduler-token.service: Deactivated successfully.5400worker2 # [ 112.838542] systemd[1]: Finished scheduler-token.service.5401worker2 # [ 112.845372] systemd[1]: scheduler-token.service: Consumed 58ms CPU time over 89ms wall clock time, 2.2M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5402worker2 # [ 112.853623] systemd[1]: Starting Nix worker-protocol over gRPC...5403worker1 # [ 112.759871] nix-grpc-daemon[766]: ts=2026-09-22T15:06:24Z level=info event=scheduler_connected addr=lb:500515404worker1 # [ 112.764159] nix-grpc-daemon[766]: ts=2026-09-22T15:06:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5405worker2 # [ 113.003490] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:24Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5406worker2 # [ 113.006609] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:24Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5407worker2 # [ 113.010433] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:24Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15408worker2 # [ 113.016044] nix-grpc-daemon[1374]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5409worker2 # [ 113.017514] nix-grpc-daemon[1374]: E0000 00:00:1790089584.635120 1374 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5410lb # [ 112.974405] niks3-server[1010]: 2026/09/22 15:06:24 INFO lead: acquired remote=192.168.1.4:453325411worker1 # [ 112.960385] nix-grpc-daemon[766]: ts=2026-09-22T15:06:24Z level=info event=scheduler_connected addr=lb:500515412worker2 # [ 113.060070] nix-grpc-daemon[1374]: E0000 00:00:1790089584.641259 1374 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5413worker2 # [ 113.062403] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:24Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5414worker2 # [ 113.072611] nix-grpc-daemon[1374]: E0000 00:00:1790089584.653761 1415 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5415worker2 # [ 113.075649] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:24Z level=info event=scheduler_take_over5416worker2 # [ 113.077057] nix-grpc-daemon[1374]: E0000 00:00:1790089584.671220 1415 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5417worker2 # [ 113.079310] nix-grpc-daemon[1374]: E0000 00:00:1790089584.671362 1415 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5418worker2 # [ 113.084601] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:24Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:413165419worker2 # [ 113.088715] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:24Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05420worker2 # [ 113.090779] systemd[1]: Started Nix worker-protocol over gRPC.5421worker2 # [ 113.092101] nix-grpc-daemon[1374]: E0000 00:00:1790089584.691551 1415 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5422worker2 # [ 113.094759] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:24Z level=info event=scheduler_connected addr=lb:500515423worker2 # [ 113.097882] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:24Z level=info event=oidc_jwks provider=mock keys=15424worker2 # [ 113.099161] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:24Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:413165425worker2 # [ 113.100951] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:24Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05426worker1 # [ 113.715187] nix-grpc-daemon[766]: ts=2026-09-22T15:06:25Z level=info event=scheduler_restarting5427worker2 # [ 113.820262] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:25Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:413165428worker2 # [ 113.820672] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:25Z level=info event=worker_gone addr=192.168.1.3:500515429worker1 # [ 113.756763] nix-grpc-daemon[766]: ts=2026-09-22T15:06:25Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5430worker1 # [ 113.774892] nix-daemon[833]: reaped child process 835, status = succeeded5431worker1 # [ 114.507462] nix-grpc-daemon[766]: E0000 00:00:1790089586.106439 811 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 18, started true, shutdown true5432worker1 # [ 114.513948] nix-grpc-daemon[766]: E0000 00:00:1790089586.106742 811 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5433worker1 # [ 115.556472] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5434worker1 # [ 115.561477] systemd[1]: Stopped Nix worker-protocol over gRPC.5435worker1 # [ 115.569114] systemd[1]: nix-grpc-daemon.service: Consumed 3.579s CPU time over 1min 37.525s wall clock time, 59.1M memory peak, 91.6K incoming IP traffic, 164.7K outgoing IP traffic.5436worker1 # [ 115.583492] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5437worker1 # [ 115.590315] systemd[1]: Closed Nix worker-protocol over gRPC.5438worker1 # [ 115.595350] systemd[1]: nix-grpc-daemon.socket: Consumed 550us CPU time over 1min 45.489s wall clock time, 256K memory peak, 98.6K incoming IP traffic, 87.2K outgoing IP traffic.5439lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy5440lb: must succeed: curl -sf localhost:9901/clusters5441lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5442lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.07 seconds)5443client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&25444worker2 # [ 116.003735] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:413245445worker2 # [ 116.019912] nix-daemon[857]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)5446worker2 # [ 116.045373] nix-grpc-daemon[1374]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 60 ms (attempt 1/5)5447worker2 # [ 116.115540] nix-grpc-daemon[1374]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 166 ms (attempt 2/5)5448worker2 # [ 116.283532] nix-grpc-daemon[1374]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 338 ms (attempt 3/5)5449worker2 # [ 116.623530] nix-grpc-daemon[1374]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 209 ms (attempt 4/5)5450worker2 # [ 116.836252] nix-grpc-daemon[1374]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5451worker2 # [ 116.839926] nix-grpc-daemon[1374]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5452client # copying 2 paths...5453client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...5454worker2 # [ 116.865955] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:413245455client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...5456worker2 # [ 116.883053] nix-daemon[857]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)5457worker2 # [ 116.914580] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:28Z level=info event=niks3_push_started pid=14345458worker2 # [ 117.066963] nix-grpc-daemon[1434]: time=2026-09-22T15:06:28.686Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca=""5459worker2 # [ 117.175956] nix-daemon[857]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)5460worker2 # [ 117.196944] nix-daemon[857]: reaped child process 1449, status = succeeded5461lb # [ 117.141102] niks3-server[1010]: 2026/09/22 15:06:28 INFO Received uploads request method=POST path=/api/pending_closures5462lb # [ 117.151720] niks3-server[1010]: 2026/09/22 15:06:28 INFO Received uploads request method=POST path=/api/pending_closures5463worker2 # [ 117.224075] nix-grpc-daemon[1434]: time=2026-09-22T15:06:28.842Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5464worker2 # [ 117.225688] nix-grpc-daemon[1434]: time=2026-09-22T15:06:28.842Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"5465worker2 # [ 117.227478] nix-grpc-daemon[1434]: time=2026-09-22T15:06:28.843Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"5466lb # [ 117.200256] niks3-server[1010]: 2026/09/22 15:06:28 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst5467lb # [ 117.224772] niks3-server[1010]: 2026/09/22 15:06:28 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls5468lb # [ 117.231933] niks3-server[1010]: 2026/09/22 15:06:28 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5469lb # [ 117.237210] niks3-server[1010]: 2026/09/22 15:06:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5470lb # [ 117.245032] niks3-server[1010]: 2026/09/22 15:06:28 INFO Signed narinfos id=36 count=25471worker2 # [ 117.306331] nix-grpc-daemon[1434]: time=2026-09-22T15:06:28.925Z level=INFO msg="Uploading 3 narinfos"5472lb # [ 117.246845] niks3-server[1010]: 2026/09/22 15:06:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5473lb # [ 117.255432] niks3-server[1010]: 2026/09/22 15:06:28 INFO Signed narinfos id=35 count=15474lb # [ 117.259513] niks3-server[1010]: 2026/09/22 15:06:28 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls5475lb # [ 117.274446] niks3-server[1010]: 2026/09/22 15:06:28 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo5476lb # [ 117.281773] niks3-server[1010]: 2026/09/22 15:06:28 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo5477lb # [ 117.288567] niks3-server[1010]: 2026/09/22 15:06:28 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5478lb # [ 117.293996] niks3-server[1010]: 2026/09/22 15:06:28 INFO Completed upload id=355479worker2 # [ 117.355790] nix-grpc-daemon[1434]: time=2026-09-22T15:06:28.975Z level=INFO msg="Upload complete. (285ms)"5480lb # [ 117.295439] niks3-server[1010]: 2026/09/22 15:06:28 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5481lb # [ 117.298601] niks3-server[1010]: 2026/09/22 15:06:28 INFO Completed upload id=365482lb # [ 117.300275] niks3-server[1010]: 2026/09/22 15:06:28 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo5483worker2 # [ 117.369458] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41324 duration_s=0 paths=2 nar_bytes_in=3125484worker2 # [ 117.386521] nix-daemon[857]: reaped child process 1432, status = succeeded5485client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.64 seconds)5486worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache5487worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.03 seconds)5488worker1 # [ 117.415342] systemd[1]: Listening on Nix worker-protocol over gRPC.5489worker1 # [ 117.424105] systemd[1]: Starting Nix worker-protocol over gRPC...5490worker1 # [ 117.578950] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:29Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5491worker1 # [ 117.581506] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:29Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5492worker1 # [ 117.585386] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:29Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15493worker1 # [ 117.591068] nix-grpc-daemon[1188]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5494worker1 # [ 117.612150] nix-grpc-daemon[1188]: E0000 00:00:1790089589.190930 1188 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5495lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5496lb: must succeed: curl -sf localhost:9901/clusters5497worker1 # [ 117.644195] nix-grpc-daemon[1188]: E0000 00:00:1790089589.194822 1188 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5498worker1 # [ 117.649898] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:29Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5499worker1 # [ 117.652130] nix-grpc-daemon[1188]: E0000 00:00:1790089589.210088 1230 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5500worker1 # [ 117.654683] nix-grpc-daemon[1188]: E0000 00:00:1790089589.230794 1230 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5501worker1 # [ 117.657034] nix-grpc-daemon[1188]: E0000 00:00:1790089589.230972 1230 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5502worker1 # [ 117.659387] systemd[1]: Started Nix worker-protocol over gRPC.5503worker1 # [ 117.660487] nix-grpc-daemon[1188]: E0000 00:00:1790089589.249165 1230 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5504worker1 # [ 117.668359] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:29Z level=info event=scheduler_connected addr=lb:500515505worker2 # [ 117.764350] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:29Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:413165506worker2 # [ 117.770200] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:29Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05507lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5508lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.08 seconds)5509(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 9.52 seconds)5510subtest: a niks3 restart does not cost the leader its role5511lb: must succeed: curl -sf localhost:9901/clusters5512lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5513lb: must succeed: curl -sf localhost:9901/clusters5514lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5515worker2 # [ 117.929086] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:29Z level=info event=scheduler_lock_lost status=2005516worker1 # [ 117.835085] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:29Z level=info event=scheduler_lock_lost status=2005517lb # [ 117.866503] niks3-server[1010]: 2026/09/22 15:06:29 INFO Shutdown signal received, draining in-flight requests timeout=10s5518lb # [ 117.884525] niks3-server[1010]: 2026/09/22 15:06:29 INFO lead: released remote=192.168.1.4:453325519lb # [ 117.890874] systemd[1]: Stopping niks3 server...5520lb # [ 117.892888] systemd[1]: niks3.service: Deactivated successfully.5521lb # [ 117.895662] systemd[1]: Stopped niks3 server.5522lb # [ 117.896500] systemd[1]: niks3.service: Consumed 651ms CPU time over 1min 29.450s wall clock time, 27.7M memory peak, 97.1K incoming IP traffic, 139.4K outgoing IP traffic.5523lb # [ 117.905704] systemd[1]: Starting niks3 server...5524lb # [ 117.969615] niks3-server[1145]: 2026/09/22 15:06:29 goose: no migrations to run. current version: 202609200000005525lb # [ 117.979362] niks3-server[1145]: 2026/09/22 15:06:29 OK 1_commit_pending_closure.sql (7.86ms)5526lb # [ 117.983099] niks3-server[1145]: 2026/09/22 15:06:29 OK 2_object_stats_trigger.sql (3.39ms)5527lb # [ 117.985592] niks3-server[1145]: 2026/09/22 15:06:29 goose: up to current file version: 25528lb # [ 117.987352] niks3-server[1145]: 2026/09/22 15:06:29 INFO Loaded signing key name=farm-test-1 path=/nix/store/3qiyvklx8qgcqqsb1swilx6drs1cdj8m-key5529lb # [ 117.998338] niks3-server[1145]: 2026/09/22 15:06:29 INFO Read proxy enabled — serving cache objects from S35530lb # [ 117.999704] niks3-server[1145]: 2026/09/22 15:06:29 INFO Using socket-activated listener address=0.0.0.0:57515531lb # [ 118.005067] niks3-server[1145]: 2026/09/22 15:06:29 INFO systemd watchdog enabled interval=15s5532lb # [ 118.007445] niks3-server[1145]: 2026/09/22 15:06:29 INFO Starting HTTP server address=0.0.0.0:57515533lb # [ 118.009803] systemd[1]: Started niks3 server.5534lb: waiting for unit niks3.service5535lb: (finished: waiting for unit niks3.service, in 0.03 seconds)5536lb: must succeed: curl -sf localhost:9901/clusters5537lb # [ 118.050052] envoy[895]: conn peer=[2001:db8:1::1]:51238 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3753 tx=2099 ms=23665538lb # [ 118.051633] envoy[895]: conn peer=[2001:db8:1::1]:51242 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=1015539lb # [ 118.053741] envoy[895]: conn peer=[2001:db8:1::4]:39914 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=80611 tx=4421 ms=924755540lb # [ 118.056439] envoy[895]: conn peer=[2001:db8:1::1]:41844 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=295541lb # [ 118.057963] envoy[895]: conn peer=[2001:db8:1::3]:33890 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=17209 tx=4560 ms=953755542lb # [ 118.059554] envoy[895]: conn peer=[2001:db8:1::1]:41858 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1005 tx=282 ms=13835543lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5544worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5545worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)5546lb: must succeed: curl -sf localhost:9901/clusters5547lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5548lb: must succeed: curl -sf localhost:9901/clusters5549lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5550worker2: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield5551worker2: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.07 seconds)5552client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart >&25553worker2 # [ 118.573114] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:413245554client # don't know how to build these paths:5555client # /nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv5556worker2 # [ 118.582995] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:413245557worker2 # [ 118.614444] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:30Z level=debug event=want client=1 drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv cached=05558worker2 # [ 118.622037] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:30Z level=debug event=assigned drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv worker=192.168.1.4:50051 clients=15559worker2 # [ 118.662468] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:413245560worker2 # [ 118.678317] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:413245561client # copying 1 paths to 'lb:50051'...5562client # copying path '/nix/store/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv' to 'lb:50051'...5563worker2 # [ 118.694303] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:413245564worker2 # [ 118.709338] nix-daemon[857]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)5565worker2 # [ 118.870570] nix-daemon[857]: accepted connection from pid 1466, user nix-grpc-daemon (trusted)5566worker2 # [ 118.890961] nix-daemon[857]: reaped child process 1469, status = succeeded5567lb # [ 118.872140] niks3-server[1145]: 2026/09/22 15:06:30 INFO lead: acquired remote=192.168.1.4:454005568worker2 # [ 118.990926] nix-daemon[857]: accepted connection from pid 1471, user nix-grpc-daemon (trusted)5569worker2 # [ 119.006091] nix-daemon[857]: reaped child process 1476, status = succeeded5570lb # [ 118.952126] niks3-server[1145]: 2026/09/22 15:06:30 INFO Received uploads request method=POST path=/api/pending_closures5571worker2 # [ 119.042795] nix-grpc-daemon[1434]: time=2026-09-22T15:06:30.661Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5572worker2 # [ 119.044625] nix-grpc-daemon[1434]: time=2026-09-22T15:06:30.661Z level=INFO msg="Uploading mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv (544B)"5573lb # [ 119.019923] niks3-server[1145]: 2026/09/22 15:06:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5574lb # [ 119.034871] niks3-server[1145]: 2026/09/22 15:06:30 INFO Registered completed upload object_key=nar/0hn539w6achi7azzyhpihsi61g85x9f535dxv438yq5y50ksrp1d.nar.zst5575lb # [ 119.056170] niks3-server[1145]: 2026/09/22 15:06:30 INFO Signed narinfos id=37 count=15576lb # [ 119.062155] niks3-server[1145]: 2026/09/22 15:06:30 INFO Registered completed upload object_key=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z.ls5577worker2 # [ 119.124821] nix-grpc-daemon[1434]: time=2026-09-22T15:06:30.743Z level=INFO msg="Uploading 1 narinfos"5578lb # [ 119.068816] niks3-server[1145]: 2026/09/22 15:06:30 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5579lb # [ 119.080425] niks3-server[1145]: 2026/09/22 15:06:30 INFO Completed upload id=375580worker2 # [ 119.142830] nix-grpc-daemon[1434]: time=2026-09-22T15:06:30.762Z level=INFO msg="Upload complete. (416ms)"5581lb # [ 119.085881] niks3-server[1145]: 2026/09/22 15:06:30 INFO Registered completed upload object_key=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z.narinfo5582worker2 # [ 119.152323] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41324 duration_s=0 paths=1 nar_bytes_in=5445583worker2 # [ 119.172384] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:413245584worker2 # [ 119.180729] nix-daemon[857]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)5585worker2 # [ 119.187030] nix-daemon[857]: reaped child process 1464, status = succeeded5586client # building '/nix/store/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv' on lb:50051...5587worker2 # [ 119.199459] nix-daemon[857]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)5588client # farm-a> worker2: building mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv5589client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds5590client # farm-a> LOG-farm-a-after-niks3-restart5591worker2 # [ 120.454148] nix-daemon[857]: reaped child process 1480, status = succeeded5592worker2 # [ 120.584454] nix-daemon[857]: accepted connection from pid 1496, user nix-grpc-daemon (trusted)5593worker2 # [ 120.601508] nix-daemon[857]: reaped child process 1499, status = succeeded5594lb # [ 120.547409] niks3-server[1145]: 2026/09/22 15:06:32 INFO Received uploads request method=POST path=/api/pending_closures5595worker2 # [ 120.624449] nix-grpc-daemon[1434]: time=2026-09-22T15:06:32.241Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5596worker2 # [ 120.626212] nix-grpc-daemon[1434]: time=2026-09-22T15:06:32.241Z level=INFO msg="Uploading j3iswx3ynilvcycpyw0z667966c9kpzx-farm-a (144B)"5597lb # [ 120.594787] niks3-server[1145]: 2026/09/22 15:06:32 INFO Registered completed upload object_key=log/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv5598lb # [ 120.605762] niks3-server[1145]: 2026/09/22 15:06:32 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst5599worker2 # [ 120.681716] nix-grpc-daemon[1434]: time=2026-09-22T15:06:32.300Z level=INFO msg="Uploading 1 narinfos"5600lb # [ 120.623052] niks3-server[1145]: 2026/09/22 15:06:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5601lb # [ 120.634262] niks3-server[1145]: 2026/09/22 15:06:32 INFO Signed narinfos id=38 count=15602lb # [ 120.639777] niks3-server[1145]: 2026/09/22 15:06:32 INFO Registered completed upload object_key=j3iswx3ynilvcycpyw0z667966c9kpzx.ls5603worker2 # [ 120.712946] nix-grpc-daemon[1434]: time=2026-09-22T15:06:32.332Z level=INFO msg="Upload complete. (300ms)"5604lb # [ 120.651419] niks3-server[1145]: 2026/09/22 15:06:32 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5605lb # [ 120.656881] niks3-server[1145]: 2026/09/22 15:06:32 INFO Completed upload id=385606lb # [ 120.661484] niks3-server[1145]: 2026/09/22 15:06:32 INFO Registered completed upload object_key=j3iswx3ynilvcycpyw0z667966c9kpzx.narinfo5607worker2 # [ 120.735023] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41324 duration_s=1 drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv assign_id=1 outputs=15608worker2 # [ 120.752289] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:32Z level=debug event=want client=1 drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv cached=05609worker2 # [ 120.757435] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:32Z level=debug event=assigned drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv worker=192.168.1.4:50051 clients=15610worker2 # [ 120.762026] nix-daemon[857]: reaped child process 1478, status = succeeded5611worker2 # [ 120.778506] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:413245612worker2 # [ 120.794091] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:413245613worker2 # [ 120.809204] nix-grpc-daemon[1434]: time=2026-09-22T15:06:32.428Z level=INFO msg="All 1 paths already cached"5614client # copying 1 paths to 'lb:50051'...5615client # copying path '/nix/store/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv' to 'lb:50051'...5616worker2 # [ 120.819702] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:413245617worker2 # [ 120.833291] nix-daemon[857]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)5618worker2 # [ 120.986043] nix-daemon[857]: accepted connection from pid 1505, user nix-grpc-daemon (trusted)5619worker2 # [ 121.003139] nix-daemon[857]: reaped child process 1508, status = succeeded5620worker2 # [ 121.105615] nix-daemon[857]: accepted connection from pid 1510, user nix-grpc-daemon (trusted)5621worker2 # [ 121.124212] nix-daemon[857]: reaped child process 1513, status = succeeded5622lb # [ 121.060569] niks3-server[1145]: 2026/09/22 15:06:32 INFO Received uploads request method=POST path=/api/pending_closures5623worker2 # [ 121.133810] nix-grpc-daemon[1434]: time=2026-09-22T15:06:32.753Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5624worker2 # [ 121.135298] nix-grpc-daemon[1434]: time=2026-09-22T15:06:32.753Z level=INFO msg="Uploading 5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv (656B)"5625lb # [ 121.090898] niks3-server[1145]: 2026/09/22 15:06:32 INFO Registered completed upload object_key=nar/1xpcisa10g5by3yknnrs1xwhxhf4s243h7gwzjii0799pwbhfjfa.nar.zst5626lb # [ 121.103122] niks3-server[1145]: 2026/09/22 15:06:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5627worker2 # [ 121.172586] nix-grpc-daemon[1434]: time=2026-09-22T15:06:32.792Z level=INFO msg="Uploading 1 narinfos"5628lb # [ 121.117177] niks3-server[1145]: 2026/09/22 15:06:32 INFO Signed narinfos id=39 count=15629lb # [ 121.124868] niks3-server[1145]: 2026/09/22 15:06:32 INFO Registered completed upload object_key=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.ls5630worker2 # [ 121.198983] nix-grpc-daemon[1434]: time=2026-09-22T15:06:32.818Z level=INFO msg="Upload complete. (350ms)"5631lb # [ 121.137397] niks3-server[1145]: 2026/09/22 15:06:32 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5632lb # [ 121.143824] niks3-server[1145]: 2026/09/22 15:06:32 INFO Completed upload id=395633lb # [ 121.147367] niks3-server[1145]: 2026/09/22 15:06:32 INFO Registered completed upload object_key=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.narinfo5634worker2 # [ 121.208247] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41324 duration_s=0 paths=1 nar_bytes_in=6565635worker2 # [ 121.221314] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:413245636worker2 # [ 121.227546] nix-daemon[857]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)5637worker2 # [ 121.232731] nix-daemon[857]: reaped child process 1503, status = succeeded5638client # building '/nix/store/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv' on lb:50051...5639worker2 # [ 121.244987] nix-daemon[857]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)5640client # farm-b> worker2: building 5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv5641client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds5642client # farm-b> LOG-farm-b-after-niks3-restart5643worker2 # [ 121.919989] nix-daemon[857]: reaped child process 1517, status = succeeded5644worker2 # [ 122.025013] nix-daemon[857]: accepted connection from pid 1534, user nix-grpc-daemon (trusted)5645worker2 # [ 122.042663] nix-daemon[857]: reaped child process 1537, status = succeeded5646lb # [ 121.988606] niks3-server[1145]: 2026/09/22 15:06:33 INFO Received uploads request method=POST path=/api/pending_closures5647worker2 # [ 122.060993] nix-grpc-daemon[1434]: time=2026-09-22T15:06:33.679Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5648worker2 # [ 122.062640] nix-grpc-daemon[1434]: time=2026-09-22T15:06:33.679Z level=INFO msg="Uploading myar0ljvsqm9h7fxyh6qrqkg0175r3xn-farm-b (192B)"5649lb # [ 122.023859] niks3-server[1145]: 2026/09/22 15:06:33 INFO Registered completed upload object_key=nar/0zvv5rxmyk9afay83j52m7ipyhrqivhg6h6a0ksjd658pxzwi78w.nar.zst5650worker2 # [ 122.106256] nix-grpc-daemon[1434]: time=2026-09-22T15:06:33.725Z level=INFO msg="Uploading 1 narinfos"5651lb # [ 122.043700] niks3-server[1145]: 2026/09/22 15:06:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5652lb # [ 122.054683] niks3-server[1145]: 2026/09/22 15:06:33 INFO Signed narinfos id=40 count=15653lb # [ 122.061935] niks3-server[1145]: 2026/09/22 15:06:33 INFO Registered completed upload object_key=log/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv5654lb # [ 122.071359] niks3-server[1145]: 2026/09/22 15:06:33 INFO Registered completed upload object_key=myar0ljvsqm9h7fxyh6qrqkg0175r3xn.ls5655lb # [ 122.082420] niks3-server[1145]: 2026/09/22 15:06:33 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5656lb # [ 122.088743] niks3-server[1145]: 2026/09/22 15:06:33 INFO Completed upload id=405657worker2 # [ 122.148657] nix-grpc-daemon[1434]: time=2026-09-22T15:06:33.768Z level=INFO msg="Upload complete. (294ms)"5658lb # [ 122.090692] niks3-server[1145]: 2026/09/22 15:06:33 INFO Registered completed upload object_key=myar0ljvsqm9h7fxyh6qrqkg0175r3xn.narinfo5659worker2 # [ 122.167207] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41324 duration_s=0 drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv assign_id=2 outputs=15660worker2 # [ 122.184396] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:33Z level=debug event=want client=1 drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv cached=05661worker2 # [ 122.190691] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:33Z level=debug event=assigned drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv worker=192.168.1.4:50051 clients=15662worker2 # [ 122.195285] nix-daemon[857]: reaped child process 1515, status = succeeded5663worker2 # [ 122.210733] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:413245664worker2 # [ 122.225744] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:413245665worker2 # [ 122.241054] nix-grpc-daemon[1434]: time=2026-09-22T15:06:33.860Z level=INFO msg="All 2 paths already cached"5666client # copying 1 paths to 'lb:50051'...5667client # copying path '/nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv' to 'lb:50051'...5668worker2 # [ 122.252525] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:413245669worker2 # [ 122.266064] nix-daemon[857]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)5670worker2 # [ 122.421202] nix-daemon[857]: accepted connection from pid 1543, user nix-grpc-daemon (trusted)5671worker2 # [ 122.448774] nix-daemon[857]: reaped child process 1546, status = succeeded5672worker2 # [ 122.537705] nix-daemon[857]: accepted connection from pid 1548, user nix-grpc-daemon (trusted)5673worker2 # [ 122.556434] nix-daemon[857]: reaped child process 1551, status = succeeded5674lb # [ 122.492406] niks3-server[1145]: 2026/09/22 15:06:34 INFO Received uploads request method=POST path=/api/pending_closures5675worker2 # [ 122.564175] nix-grpc-daemon[1434]: time=2026-09-22T15:06:34.183Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5676worker2 # [ 122.565607] nix-grpc-daemon[1434]: time=2026-09-22T15:06:34.183Z level=INFO msg="Uploading 6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv (784B)"5677lb # [ 122.519585] niks3-server[1145]: 2026/09/22 15:06:34 INFO Registered completed upload object_key=nar/1fnvw3c0v6n1j60nd5iagl3bggzcvixsw103w98mwhnpmnmgb248.nar.zst5678worker2 # [ 122.602094] nix-grpc-daemon[1434]: time=2026-09-22T15:06:34.221Z level=INFO msg="Uploading 1 narinfos"5679lb # [ 122.532967] niks3-server[1145]: 2026/09/22 15:06:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5680lb # [ 122.547081] niks3-server[1145]: 2026/09/22 15:06:34 INFO Signed narinfos id=41 count=15681lb # [ 122.552602] niks3-server[1145]: 2026/09/22 15:06:34 INFO Registered completed upload object_key=6j7gr603xfslr5lxcbh72430f5q1r4b0.ls5682worker2 # [ 122.627980] nix-grpc-daemon[1434]: time=2026-09-22T15:06:34.247Z level=INFO msg="Upload complete. (345ms)"5683lb # [ 122.566621] niks3-server[1145]: 2026/09/22 15:06:34 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5684worker2 # [ 122.636123] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41324 duration_s=0 paths=1 nar_bytes_in=7845685lb # [ 122.575468] niks3-server[1145]: 2026/09/22 15:06:34 INFO Completed upload id=415686lb # [ 122.579644] niks3-server[1145]: 2026/09/22 15:06:34 INFO Registered completed upload object_key=6j7gr603xfslr5lxcbh72430f5q1r4b0.narinfo5687worker2 # [ 122.644367] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:413245688worker2 # [ 122.657902] nix-daemon[857]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)5689worker2 # [ 122.660490] nix-daemon[857]: reaped child process 1541, status = succeeded5690client # building '/nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv' on lb:50051...5691client # farm-top> worker2: building 6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv5692worker2 # [ 122.674435] nix-daemon[857]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)5693client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds5694client # farm-top> LOG-farm-top-after-niks3-restart5695worker2 # [ 123.511379] nix-daemon[857]: reaped child process 1555, status = succeeded5696worker2 # [ 123.633932] nix-daemon[857]: accepted connection from pid 1571, user nix-grpc-daemon (trusted)5697worker2 # [ 123.653120] nix-daemon[857]: reaped child process 1574, status = succeeded5698lb # [ 123.599730] niks3-server[1145]: 2026/09/22 15:06:35 INFO Received uploads request method=POST path=/api/pending_closures5699worker2 # [ 123.671743] nix-grpc-daemon[1434]: time=2026-09-22T15:06:35.289Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5700worker2 # [ 123.673493] nix-grpc-daemon[1434]: time=2026-09-22T15:06:35.289Z level=INFO msg="Uploading z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc-farm-top (248B)"5701lb # [ 123.638651] niks3-server[1145]: 2026/09/22 15:06:35 INFO Registered completed upload object_key=nar/0cypkbh15calmx90jgh2waxpq661jalf4c99dgb7j606z61xh0ld.nar.zst5702lb # [ 123.650589] niks3-server[1145]: 2026/09/22 15:06:35 INFO Registered completed upload object_key=log/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv5703worker2 # [ 123.722795] nix-grpc-daemon[1434]: time=2026-09-22T15:06:35.342Z level=INFO msg="Uploading 1 narinfos"5704lb # [ 123.663302] niks3-server[1145]: 2026/09/22 15:06:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5705lb # [ 123.670891] niks3-server[1145]: 2026/09/22 15:06:35 INFO Signed narinfos id=42 count=15706lb # [ 123.675352] niks3-server[1145]: 2026/09/22 15:06:35 INFO Registered completed upload object_key=z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.ls5707lb # [ 123.682411] niks3-server[1145]: 2026/09/22 15:06:35 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5708worker2 # [ 123.748846] nix-grpc-daemon[1434]: time=2026-09-22T15:06:35.368Z level=INFO msg="Upload complete. (264ms)"5709lb # [ 123.689250] niks3-server[1145]: 2026/09/22 15:06:35 INFO Completed upload id=425710lb # [ 123.691883] niks3-server[1145]: 2026/09/22 15:06:35 INFO Registered completed upload object_key=z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.narinfo5711worker2 # [ 123.765283] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41324 duration_s=1 drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv assign_id=3 outputs=15712worker2 # [ 123.780846] nix-daemon[857]: reaped child process 1553, status = succeeded5713client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart >&2, in 5.45 seconds)5714client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart outPath5715client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart outPath, in 0.19 seconds)5716(finished: subtest: a niks3 restart does not cost the leader its role, in 6.18 seconds)5717subtest: scheduler down: the other node takes the lock and keeps it5718lb: must succeed: curl -sf localhost:9901/clusters5719lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5720lb: must succeed: curl -sf localhost:9901/clusters5721lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5722lb: must succeed: curl -sf localhost:9901/clusters5723lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5724lb: must succeed: curl -sf localhost:9901/clusters5725lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5726worker2 # [ 124.235949] systemd[1]: Stopping Nix worker-protocol over gRPC...5727worker2 # [ 125.035580] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:36Z level=info event=signal_exit5728lb # [ 125.884387] niks3-server[1145]: 2026/09/22 15:06:37 INFO lead: released remote=192.168.1.4:454005729worker1 # [ 126.847656] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:38Z level=info event=scheduler_restarting addr=lb:500515730worker2 # [ 126.945411] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:38Z level=info event=scheduler_restarting5731worker2 # [ 126.950192] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:38Z level=info event=scheduler_restarting addr=lb:500515732worker2 # [ 126.954637] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:38Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:413165733worker2 # [ 126.959930] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:38Z level=info event=worker_gone addr=192.168.1.4:500515734worker2 # [ 126.964259] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:38Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:413165735worker2 # [ 126.970043] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:38Z level=info event=worker_gone addr=192.168.1.3:500515736worker2 # [ 126.991785] nix-daemon[857]: reaped child process 1426, status = succeeded5737worker2 # [ 127.072827] nix-grpc-daemon[1374]: E0000 00:00:1790089598.692323 1419 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true5738worker2 # [ 127.079985] nix-grpc-daemon[1374]: E0000 00:00:1790089598.699528 1419 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5739worker1 # [ 127.047323] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:38Z level=info event=scheduler_connected addr=lb:500515740worker1 # [ 127.053136] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5741worker2 # [ 127.160573] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:38Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5742worker1 # [ 127.253812] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:38Z level=info event=scheduler_connected addr=lb:500515743worker1 # [ 127.259118] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5744worker1 # [ 127.460000] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:39Z level=info event=scheduler_connected addr=lb:500515745worker1 # [ 127.465295] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5746worker1 # [ 127.665919] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:39Z level=info event=scheduler_connected addr=lb:500515747worker1 # [ 127.671130] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5748worker1 # [ 127.873683] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:39Z level=info event=scheduler_connected addr=lb:500515749worker1 # [ 127.877831] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5750lb # [ 128.051887] envoy[895]: conn peer=[2001:db8:1::1]:41874 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9723 tx=4424 ms=52075751lb # [ 128.052205] envoy[895]: conn peer=[2001:db8:1::4]:59368 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=1691 tx=425 ms=140665752worker1 # [ 128.074543] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:39Z level=info event=scheduler_connected addr=lb:500515753worker1 # [ 128.079563] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5754worker2 # [ 128.260544] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5755worker2 # [ 128.265453] systemd[1]: Stopped Nix worker-protocol over gRPC.5756worker2 # [ 128.273421] systemd[1]: nix-grpc-daemon.service: Consumed 1.651s CPU time over 15.411s wall clock time, 38.4M memory peak, 44.5K incoming IP traffic, 75.9K outgoing IP traffic.5757worker2 # [ 128.288354] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5758worker2 # [ 128.297834] systemd[1]: Closed Nix worker-protocol over gRPC.5759worker2 # [ 128.303013] systemd[1]: nix-grpc-daemon.socket: Consumed 836us CPU time over 16.114s wall clock time, 256K memory peak, 38K incoming IP traffic, 28.1K outgoing IP traffic.5760worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5761worker1 # [ 128.281118] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:39Z level=info event=scheduler_connected addr=lb:500515762worker1 # [ 128.287602] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5763worker1 # [ 128.482734] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:40Z level=info event=scheduler_connected addr=lb:500515764worker1 # [ 128.488131] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5765worker1 # [ 128.688862] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:40Z level=info event=scheduler_connected addr=lb:500515766worker1 # [ 128.693846] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5767lb # [ 128.873926] niks3-server[1145]: 2026/09/22 15:06:40 INFO lead: acquired remote=192.168.1.3:534385768worker1 # [ 128.843092] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:40Z level=info event=scheduler_take_over5769worker1 # [ 128.896442] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:40Z level=info event=scheduler_connected addr=lb:500515770worker1 # [ 128.900298] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5771worker1 # [ 129.097376] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:40Z level=info event=scheduler_connected addr=lb:500515772worker1 # [ 129.102189] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5773worker1 # [ 129.303268] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:40Z level=info event=scheduler_connected addr=lb:500515774worker1 # [ 129.314179] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5775worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 1.17 seconds)5776worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5777worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)5778worker1 # [ 129.511701] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:41Z level=info event=scheduler_connected addr=lb:500515779worker1 # [ 129.517976] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5780worker1 # [ 129.717832] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:41Z level=info event=scheduler_connected addr=lb:500515781worker1 # [ 129.728202] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:41Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:338565782worker1 # [ 129.733201] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:41Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05783worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5784worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)5785client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby >&25786worker1 # [ 130.725282] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:42Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:338705787worker1 # [ 130.740882] nix-daemon[833]: accepted connection from pid 1188, user nix-grpc-daemon (trusted)5788client # don't know how to build these paths:5789client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5790worker1 # [ 130.765292] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:338705791worker1 # [ 130.781521] nix-grpc-daemon[1188]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 31 ms (attempt 1/5)5792worker1 # [ 130.821664] nix-grpc-daemon[1188]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 186 ms (attempt 2/5)5793worker1 # [ 131.009892] nix-grpc-daemon[1188]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 99 ms (attempt 3/5)5794worker1 # [ 131.110673] nix-grpc-daemon[1188]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 496 ms (attempt 4/5)5795worker1 # [ 131.609373] nix-grpc-daemon[1188]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5796worker1 # [ 131.616758] nix-grpc-daemon[1188]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5797worker1 # [ 131.647274] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:43Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=05798worker1 # [ 131.655154] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:43Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=15799worker1 # [ 131.693815] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338705800worker1 # [ 131.710057] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:338705801client # copying 1 paths to 'lb:50051'...5802client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...5803worker1 # [ 131.726702] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:338705804worker1 # [ 131.742303] nix-daemon[833]: accepted connection from pid 1188, user nix-grpc-daemon (trusted)5805worker1 # [ 131.773310] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:43Z level=info event=niks3_push_started pid=12705806worker1 # [ 131.964281] nix-grpc-daemon[1270]: time=2026-09-22T15:06:43.564Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.key ca=""5807worker1 # [ 132.071402] nix-daemon[833]: accepted connection from pid 1283, user nix-grpc-daemon (trusted)5808worker1 # [ 132.090313] nix-daemon[833]: reaped child process 1286, status = succeeded5809worker1 # [ 132.191603] nix-daemon[833]: accepted connection from pid 1288, user nix-grpc-daemon (trusted)5810worker1 # [ 132.206976] nix-daemon[833]: reaped child process 1291, status = succeeded5811lb # [ 132.247137] niks3-server[1145]: 2026/09/22 15:06:43 INFO Received uploads request method=POST path=/api/pending_closures5812worker1 # [ 132.229464] nix-grpc-daemon[1270]: time=2026-09-22T15:06:43.828Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5813worker1 # [ 132.230942] nix-grpc-daemon[1270]: time=2026-09-22T15:06:43.828Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"5814lb # [ 132.284792] niks3-server[1145]: 2026/09/22 15:06:43 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst5815lb # [ 132.297909] niks3-server[1145]: 2026/09/22 15:06:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5816worker1 # [ 132.273650] nix-grpc-daemon[1270]: time=2026-09-22T15:06:43.873Z level=INFO msg="Uploading 1 narinfos"5817lb # [ 132.313654] niks3-server[1145]: 2026/09/22 15:06:43 INFO Signed narinfos id=43 count=15818lb # [ 132.320801] niks3-server[1145]: 2026/09/22 15:06:43 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls5819lb # [ 132.336307] niks3-server[1145]: 2026/09/22 15:06:43 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5820lb # [ 132.346331] niks3-server[1145]: 2026/09/22 15:06:43 INFO Completed upload id=435821worker1 # [ 132.313653] nix-grpc-daemon[1270]: time=2026-09-22T15:06:43.913Z level=INFO msg="Upload complete. (345ms)"5822lb # [ 132.348932] niks3-server[1145]: 2026/09/22 15:06:43 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo5823worker1 # [ 132.325073] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33870 duration_s=0 paths=1 nar_bytes_in=5205824worker1 # [ 132.341937] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338705825worker1 # [ 132.348746] nix-daemon[833]: accepted connection from pid 1188, user nix-grpc-daemon (trusted)5826worker1 # [ 132.354051] nix-daemon[833]: reaped child process 1268, status = succeeded5827client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...5828client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5829worker1 # [ 132.367943] nix-daemon[833]: accepted connection from pid 1188, user nix-grpc-daemon (trusted)5830client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds5831client # farm-a> LOG-farm-a-on-standby5832worker1 # [ 133.645005] nix-daemon[833]: reaped child process 1295, status = succeeded5833worker1 # [ 133.755222] nix-daemon[833]: accepted connection from pid 1311, user nix-grpc-daemon (trusted)5834worker1 # [ 133.774439] nix-daemon[833]: reaped child process 1314, status = succeeded5835lb # [ 133.815161] niks3-server[1145]: 2026/09/22 15:06:45 INFO Received uploads request method=POST path=/api/pending_closures5836worker1 # [ 133.796407] nix-grpc-daemon[1270]: time=2026-09-22T15:06:45.394Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5837worker1 # [ 133.797879] nix-grpc-daemon[1270]: time=2026-09-22T15:06:45.394Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"5838lb # [ 133.849433] niks3-server[1145]: 2026/09/22 15:06:45 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5839lb # [ 133.870991] niks3-server[1145]: 2026/09/22 15:06:45 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5840lb # [ 133.883743] niks3-server[1145]: 2026/09/22 15:06:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5841worker1 # [ 133.858308] nix-grpc-daemon[1270]: time=2026-09-22T15:06:45.457Z level=INFO msg="Uploading 1 narinfos"5842lb # [ 133.892289] niks3-server[1145]: 2026/09/22 15:06:45 INFO Signed narinfos id=44 count=15843lb # [ 133.897314] niks3-server[1145]: 2026/09/22 15:06:45 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls5844lb # [ 133.907451] niks3-server[1145]: 2026/09/22 15:06:45 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5845lb # [ 133.915326] niks3-server[1145]: 2026/09/22 15:06:45 INFO Completed upload id=445846lb # [ 133.918820] niks3-server[1145]: 2026/09/22 15:06:45 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo5847worker1 # [ 133.881909] nix-grpc-daemon[1270]: time=2026-09-22T15:06:45.482Z level=INFO msg="Upload complete. (302ms)"5848worker1 # [ 133.904466] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33870 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=15849worker1 # [ 133.919151] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:45Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=05850worker1 # [ 133.922663] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:45Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=15851worker1 # [ 133.926318] nix-daemon[833]: reaped child process 1293, status = succeeded5852worker1 # [ 133.948496] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338705853worker1 # [ 133.962943] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:338705854worker1 # [ 133.979124] nix-grpc-daemon[1270]: time=2026-09-22T15:06:45.579Z level=INFO msg="All 1 paths already cached"5855client # copying 1 paths to 'lb:50051'...5856client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...5857worker1 # [ 133.989370] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:338705858worker1 # [ 134.002092] nix-daemon[833]: accepted connection from pid 1188, user nix-grpc-daemon (trusted)5859worker1 # [ 134.151780] nix-daemon[833]: accepted connection from pid 1320, user nix-grpc-daemon (trusted)5860worker1 # [ 134.167244] nix-daemon[833]: reaped child process 1323, status = succeeded5861worker1 # [ 134.271577] nix-daemon[833]: accepted connection from pid 1325, user nix-grpc-daemon (trusted)5862worker1 # [ 134.285794] nix-daemon[833]: reaped child process 1328, status = succeeded5863lb # [ 134.325197] niks3-server[1145]: 2026/09/22 15:06:45 INFO Received uploads request method=POST path=/api/pending_closures5864worker1 # [ 134.303481] nix-grpc-daemon[1270]: time=2026-09-22T15:06:45.903Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5865worker1 # [ 134.305099] nix-grpc-daemon[1270]: time=2026-09-22T15:06:45.903Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"5866lb # [ 134.355669] niks3-server[1145]: 2026/09/22 15:06:45 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst5867lb # [ 134.367976] niks3-server[1145]: 2026/09/22 15:06:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5868worker1 # [ 134.342452] nix-grpc-daemon[1270]: time=2026-09-22T15:06:45.942Z level=INFO msg="Uploading 1 narinfos"5869lb # [ 134.380260] niks3-server[1145]: 2026/09/22 15:06:45 INFO Signed narinfos id=45 count=15870lb # [ 134.382634] niks3-server[1145]: 2026/09/22 15:06:45 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls5871lb # [ 134.396369] niks3-server[1145]: 2026/09/22 15:06:46 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5872lb # [ 134.405726] niks3-server[1145]: 2026/09/22 15:06:46 INFO Completed upload id=455873worker1 # [ 134.374181] nix-grpc-daemon[1270]: time=2026-09-22T15:06:45.974Z level=INFO msg="Upload complete. (356ms)"5874lb # [ 134.408987] niks3-server[1145]: 2026/09/22 15:06:46 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo5875worker1 # [ 134.384522] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33870 duration_s=0 paths=1 nar_bytes_in=6405876worker1 # [ 134.395685] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338705877worker1 # [ 134.405699] nix-daemon[833]: accepted connection from pid 1188, user nix-grpc-daemon (trusted)5878worker1 # [ 134.408928] nix-daemon[833]: reaped child process 1318, status = succeeded5879client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...5880worker1 # [ 134.421013] nix-daemon[833]: accepted connection from pid 1188, user nix-grpc-daemon (trusted)5881client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5882client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds5883client # farm-b> LOG-farm-b-on-standby5884worker1 # [ 135.288790] nix-daemon[833]: reaped child process 1332, status = succeeded5885worker1 # [ 135.395616] nix-daemon[833]: accepted connection from pid 1348, user nix-grpc-daemon (trusted)5886worker1 # [ 135.416378] nix-daemon[833]: reaped child process 1351, status = succeeded5887lb # [ 135.447599] niks3-server[1145]: 2026/09/22 15:06:47 INFO Received uploads request method=POST path=/api/pending_closures5888worker1 # [ 135.426463] nix-grpc-daemon[1270]: time=2026-09-22T15:06:47.025Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5889worker1 # [ 135.428685] nix-grpc-daemon[1270]: time=2026-09-22T15:06:47.025Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"5890lb # [ 135.485450] niks3-server[1145]: 2026/09/22 15:06:47 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst5891worker1 # [ 135.475475] nix-grpc-daemon[1270]: time=2026-09-22T15:06:47.075Z level=INFO msg="Uploading 1 narinfos"5892lb # [ 135.497724] niks3-server[1145]: 2026/09/22 15:06:47 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5893lb # [ 135.511504] niks3-server[1145]: 2026/09/22 15:06:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5894lb # [ 135.519188] niks3-server[1145]: 2026/09/22 15:06:47 INFO Signed narinfos id=46 count=15895lb # [ 135.524672] niks3-server[1145]: 2026/09/22 15:06:47 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls5896lb # [ 135.533328] niks3-server[1145]: 2026/09/22 15:06:47 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5897lb # [ 135.539911] niks3-server[1145]: 2026/09/22 15:06:47 INFO Completed upload id=465898worker1 # [ 135.507229] nix-grpc-daemon[1270]: time=2026-09-22T15:06:47.107Z level=INFO msg="Upload complete. (274ms)"5899lb # [ 135.542407] niks3-server[1145]: 2026/09/22 15:06:47 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo5900worker1 # [ 135.525193] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33870 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=15901worker1 # [ 135.543255] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:47Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=05902worker1 # [ 135.547614] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:47Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=15903worker1 # [ 135.552003] nix-daemon[833]: reaped child process 1330, status = succeeded5904worker1 # [ 135.568392] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338705905worker1 # [ 135.582515] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:338705906worker1 # [ 135.596625] nix-grpc-daemon[1270]: time=2026-09-22T15:06:47.196Z level=INFO msg="All 2 paths already cached"5907client # copying 1 paths to 'lb:50051'...5908client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...5909worker1 # [ 135.608124] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:338705910worker1 # [ 135.621718] nix-daemon[833]: accepted connection from pid 1188, user nix-grpc-daemon (trusted)5911worker1 # [ 135.776287] nix-daemon[833]: accepted connection from pid 1357, user nix-grpc-daemon (trusted)5912worker1 # [ 135.794148] nix-daemon[833]: reaped child process 1360, status = succeeded5913worker1 # [ 135.894388] nix-daemon[833]: accepted connection from pid 1362, user nix-grpc-daemon (trusted)5914worker1 # [ 135.910379] nix-daemon[833]: reaped child process 1365, status = succeeded5915lb # [ 135.948714] niks3-server[1145]: 2026/09/22 15:06:47 INFO Received uploads request method=POST path=/api/pending_closures5916worker1 # [ 135.925813] nix-grpc-daemon[1270]: time=2026-09-22T15:06:47.525Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5917worker1 # [ 135.927319] nix-grpc-daemon[1270]: time=2026-09-22T15:06:47.525Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"5918lb # [ 135.975939] niks3-server[1145]: 2026/09/22 15:06:47 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst5919worker1 # [ 135.957931] nix-grpc-daemon[1270]: time=2026-09-22T15:06:47.558Z level=INFO msg="Uploading 1 narinfos"5920lb # [ 135.991031] niks3-server[1145]: 2026/09/22 15:06:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5921lb # [ 136.001367] niks3-server[1145]: 2026/09/22 15:06:47 INFO Signed narinfos id=47 count=15922lb # [ 136.008192] niks3-server[1145]: 2026/09/22 15:06:47 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls5923lb # [ 136.016681] niks3-server[1145]: 2026/09/22 15:06:47 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5924worker1 # [ 135.991660] nix-grpc-daemon[1270]: time=2026-09-22T15:06:47.592Z level=INFO msg="Upload complete. (352ms)"5925lb # [ 136.023487] niks3-server[1145]: 2026/09/22 15:06:47 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo5926lb # [ 136.028801] niks3-server[1145]: 2026/09/22 15:06:47 INFO Completed upload id=475927worker1 # [ 135.998594] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33870 duration_s=0 paths=1 nar_bytes_in=7685928worker1 # [ 136.011559] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338705929worker1 # [ 136.020156] nix-daemon[833]: accepted connection from pid 1188, user nix-grpc-daemon (trusted)5930worker1 # [ 136.022906] nix-daemon[833]: reaped child process 1355, status = succeeded5931client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...5932worker1 # [ 136.033804] nix-daemon[833]: accepted connection from pid 1188, user nix-grpc-daemon (trusted)5933client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5934client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds5935client # farm-top> LOG-farm-top-on-standby5936worker1 # [ 136.880841] nix-daemon[833]: reaped child process 1369, status = succeeded5937worker1 # [ 136.999918] nix-daemon[833]: accepted connection from pid 1385, user nix-grpc-daemon (trusted)5938worker1 # [ 137.016646] nix-daemon[833]: reaped child process 1388, status = succeeded5939lb # [ 137.055702] niks3-server[1145]: 2026/09/22 15:06:48 INFO Received uploads request method=POST path=/api/pending_closures5940worker1 # [ 137.036402] nix-grpc-daemon[1270]: time=2026-09-22T15:06:48.635Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5941worker1 # [ 137.038075] nix-grpc-daemon[1270]: time=2026-09-22T15:06:48.635Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"5942lb # [ 137.089351] niks3-server[1145]: 2026/09/22 15:06:48 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5943lb # [ 137.107418] niks3-server[1145]: 2026/09/22 15:06:48 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst5944lb # [ 137.122345] niks3-server[1145]: 2026/09/22 15:06:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5945worker1 # [ 137.099552] nix-grpc-daemon[1270]: time=2026-09-22T15:06:48.699Z level=INFO msg="Uploading 1 narinfos"5946lb # [ 137.133880] niks3-server[1145]: 2026/09/22 15:06:48 INFO Signed narinfos id=48 count=15947lb # [ 137.142721] niks3-server[1145]: 2026/09/22 15:06:48 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls5948lb # [ 137.153368] niks3-server[1145]: 2026/09/22 15:06:48 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5949lb # [ 137.160957] niks3-server[1145]: 2026/09/22 15:06:48 INFO Completed upload id=485950worker1 # [ 137.128576] nix-grpc-daemon[1270]: time=2026-09-22T15:06:48.728Z level=INFO msg="Upload complete. (283ms)"5951lb # [ 137.165118] niks3-server[1145]: 2026/09/22 15:06:48 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo5952worker1 # [ 137.141936] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33870 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=15953worker1 # [ 137.162433] nix-daemon[833]: reaped child process 1367, status = succeeded5954client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby >&2, in 6.70 seconds)5955client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby outPath5956client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby outPath, in 0.18 seconds)5957worker2 # [ 137.542918] systemd[1]: Listening on Nix worker-protocol over gRPC.5958worker2 # [ 137.552730] systemd[1]: Starting scheduler-token.service...5959worker2 # [ 137.626890] systemd[1]: scheduler-token.service: Deactivated successfully.5960worker2 # [ 137.631345] systemd[1]: Finished scheduler-token.service.5961worker2 # [ 137.636590] systemd[1]: scheduler-token.service: Consumed 43ms CPU time over 77ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5962worker2 # [ 137.642289] systemd[1]: Starting Nix worker-protocol over gRPC...5963worker2 # [ 137.762403] nix-grpc-daemon[1595]: ts=2026-09-22T15:06:49Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5964worker2 # [ 137.764686] nix-grpc-daemon[1595]: ts=2026-09-22T15:06:49Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5965worker2 # [ 137.768459] nix-grpc-daemon[1595]: ts=2026-09-22T15:06:49Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15966worker2 # [ 137.773713] nix-grpc-daemon[1595]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5967worker2 # [ 137.775159] nix-grpc-daemon[1595]: E0000 00:00:1790089609.392632 1595 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5968lb: must succeed: curl -sf localhost:9901/clusters5969worker2 # [ 137.800218] nix-grpc-daemon[1595]: E0000 00:00:1790089609.398719 1595 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5970worker2 # [ 137.802607] nix-grpc-daemon[1595]: ts=2026-09-22T15:06:49Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5971worker2 # [ 137.823488] nix-grpc-daemon[1595]: E0000 00:00:1790089609.408454 1635 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5972worker2 # [ 137.826585] systemd[1]: Started Nix worker-protocol over gRPC.5973worker2 # [ 137.827414] nix-grpc-daemon[1595]: E0000 00:00:1790089609.427927 1635 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5974worker2 # [ 137.829958] nix-grpc-daemon[1595]: E0000 00:00:1790089609.428068 1635 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5975worker2 # [ 137.835201] nix-grpc-daemon[1595]: E0000 00:00:1790089609.442331 1635 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5976worker2 # [ 137.839567] nix-grpc-daemon[1595]: ts=2026-09-22T15:06:49Z level=info event=scheduler_connected addr=lb:500515977worker1 # [ 137.754352] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:49Z level=info event=oidc_jwks provider=mock keys=15978worker1 # [ 137.758959] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:49Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:338565979worker1 # [ 137.764232] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:49Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05980lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5981worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5982worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)5983lb: must succeed: curl -sf localhost:9901/clusters5984lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5985lb: must succeed: curl -sf localhost:9901/clusters5986lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5987worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5988worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)5989(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 14.11 seconds)5990subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5991client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag rs5992lb # [ 138.051043] envoy[895]: conn peer=[2001:db8:1::1]:48502 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9593 tx=4413 ms=64365993client # [ 138.080325] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag rs.5994client # Running as unit: rs.service; invocation ID: dfdf0a2041ca4d3f96d903dbbb27208c5995client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag rs, in 0.09 seconds)5996client # [ 138.279454] nix[1420]: don't know how to build these paths:5997client # [ 138.280884] nix[1420]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5998worker1 # [ 138.274205] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:49Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:338705999worker1 # [ 138.287128] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:49Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=06000worker1 # [ 138.294196] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:49Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=16001worker1 # [ 138.331886] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338706002worker1 # [ 138.347712] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:338706003client # [ 138.367073] nix[1420]: copying 1 paths to 'lb:50051'...6004worker1 # [ 138.362512] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:338706005client # [ 138.369458] nix[1420]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...6006worker1 # [ 138.377575] nix-daemon[833]: accepted connection from pid 1188, user nix-grpc-daemon (trusted)6007worker1 # [ 138.542632] nix-daemon[833]: accepted connection from pid 1401, user nix-grpc-daemon (trusted)6008worker1 # [ 138.560957] nix-daemon[833]: reaped child process 1404, status = succeeded6009worker1 # [ 138.662676] nix-daemon[833]: accepted connection from pid 1406, user nix-grpc-daemon (trusted)6010worker1 # [ 138.682795] nix-daemon[833]: reaped child process 1409, status = succeeded6011lb # [ 138.716954] niks3-server[1145]: 2026/09/22 15:06:50 INFO Received uploads request method=POST path=/api/pending_closures6012worker1 # [ 138.696946] nix-grpc-daemon[1270]: time=2026-09-22T15:06:50.296Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6013worker1 # [ 138.698445] nix-grpc-daemon[1270]: time=2026-09-22T15:06:50.296Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"6014lb # [ 138.745294] niks3-server[1145]: 2026/09/22 15:06:50 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst6015lb # [ 138.759089] niks3-server[1145]: 2026/09/22 15:06:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6016worker1 # [ 138.734314] nix-grpc-daemon[1270]: time=2026-09-22T15:06:50.334Z level=INFO msg="Uploading 1 narinfos"6017lb # [ 138.772560] niks3-server[1145]: 2026/09/22 15:06:50 INFO Signed narinfos id=49 count=16018lb # [ 138.775808] niks3-server[1145]: 2026/09/22 15:06:50 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls6019lb # [ 138.789032] niks3-server[1145]: 2026/09/22 15:06:50 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6020worker1 # [ 138.763118] nix-grpc-daemon[1270]: time=2026-09-22T15:06:50.363Z level=INFO msg="Upload complete. (368ms)"6021lb # [ 138.797250] niks3-server[1145]: 2026/09/22 15:06:50 INFO Completed upload id=496022worker1 # [ 138.772002] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33870 duration_s=0 paths=1 nar_bytes_in=4166023lb # [ 138.805718] niks3-server[1145]: 2026/09/22 15:06:50 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo6024worker1 # [ 138.785430] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:338706025worker1 # [ 138.791573] nix-daemon[833]: accepted connection from pid 1188, user nix-grpc-daemon (trusted)6026worker1 # [ 138.796765] nix-daemon[833]: reaped child process 1399, status = succeeded6027worker1 # [ 138.808152] nix-daemon[833]: accepted connection from pid 1188, user nix-grpc-daemon (trusted)6028client # [ 138.810891] nix[1420]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...6029lb: must succeed: curl -sf localhost:9901/clusters6030lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6031lb: must succeed: curl -sf localhost:9901/clusters6032lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6033lb: must succeed: curl -sf localhost:9901/clusters6034lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6035lb: must succeed: curl -sf localhost:9901/clusters6036lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)6037worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true6038worker2 # [ 140.978186] systemd-journald[269]: Received client request to rotate journal, rotating.6039worker2 # [ 140.999622] systemd-journald[269]: Vacuuming done, freed 0B of archived journals from /var/log/journal/13d2a3aa7d2141f3b9e914591afa70a2.6040worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.09 seconds)6041worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service6042worker1 # [ 140.953434] systemd[1]: Stopping Nix worker-protocol over gRPC...6043worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.05 seconds)6044client: must succeed: sleep 5.06045worker1 # [ 141.611051] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:53Z level=info event=draining6046client: (finished: must succeed: sleep 5.0, in 5.05 seconds)6047worker1 # [ 146.242472] nix-daemon[833]: reaped child process 1413, status = succeeded6048worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='6049worker1 # [ 146.332426] nix-daemon[833]: accepted connection from pid 1454, user nix-grpc-daemon (trusted)6050worker1 # [ 146.353239] nix-daemon[833]: reaped child process 1457, status = succeeded6051lb # [ 146.385257] niks3-server[1145]: 2026/09/22 15:06:57 INFO Received uploads request method=POST path=/api/pending_closures6052worker1 # [ 146.364386] nix-grpc-daemon[1270]: time=2026-09-22T15:06:57.962Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6053worker1 # [ 146.365853] nix-grpc-daemon[1270]: time=2026-09-22T15:06:57.962Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"6054lb # [ 146.425156] niks3-server[1145]: 2026/09/22 15:06:58 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv6055lb # [ 146.436739] niks3-server[1145]: 2026/09/22 15:06:58 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst6056worker1 # [ 146.422400] nix-grpc-daemon[1270]: time=2026-09-22T15:06:58.022Z level=INFO msg="Uploading 1 narinfos"6057lb # [ 146.449002] niks3-server[1145]: 2026/09/22 15:06:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6058lb # [ 146.458422] niks3-server[1145]: 2026/09/22 15:06:58 INFO Signed narinfos id=50 count=16059lb # [ 146.464069] niks3-server[1145]: 2026/09/22 15:06:58 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls6060lb # [ 146.474821] niks3-server[1145]: 2026/09/22 15:06:58 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6061worker1 # [ 146.449845] nix-grpc-daemon[1270]: time=2026-09-22T15:06:58.050Z level=INFO msg="Upload complete. (225ms)"6062lb # [ 146.482806] niks3-server[1145]: 2026/09/22 15:06:58 INFO Completed upload id=506063lb # [ 146.486096] niks3-server[1145]: 2026/09/22 15:06:58 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo6064worker1 # [ 146.465023] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33870 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=16065worker1 # [ 146.478889] nix-daemon[833]: reaped child process 1411, status = succeeded6066client # [ 146.501399] systemd[1]: rs.service: Deactivated successfully.6067client # [ 146.507029] systemd[1]: rs.service: Consumed 190ms CPU time over 8.422s wall clock time, 41.2M memory peak, 7.3K incoming IP traffic, 8.4K outgoing IP traffic.6068worker1 # [ 146.612874] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:58Z level=info event=signal_exit6069lb # [ 146.884208] niks3-server[1145]: 2026/09/22 15:06:58 INFO lead: released remote=192.168.1.3:534386070lb # [ 147.724585] niks3-server[1145]: 2026/09/22 15:06:59 INFO lead: acquired remote=192.168.1.4:532626071worker2 # [ 147.787187] nix-grpc-daemon[1595]: ts=2026-09-22T15:06:59Z level=info event=scheduler_take_over6072worker2 # [ 147.941442] nix-grpc-daemon[1595]: ts=2026-09-22T15:06:59Z level=info event=scheduler_restarting addr=lb:500516073worker1 # [ 147.852581] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:59Z level=info event=scheduler_restarting6074worker1 # [ 147.857323] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:59Z level=info event=scheduler_restarting addr=lb:500516075worker1 # [ 147.861733] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:59Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:338566076worker1 # [ 147.866735] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:59Z level=info event=worker_gone addr=192.168.1.4:500516077worker1 # [ 147.871286] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:59Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:338566078worker1 # [ 147.876566] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:59Z level=info event=worker_gone addr=192.168.1.3:500516079worker1 # [ 147.902464] nix-daemon[833]: reaped child process 1260, status = succeeded6080lb # [ 148.050704] envoy[895]: conn peer=[2001:db8:1::1]:40828 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2979 tx=1540 ms=82026081worker2 # [ 148.142976] nix-grpc-daemon[1595]: ts=2026-09-22T15:06:59Z level=info event=scheduler_connected addr=lb:500516082worker2 # [ 148.148687] nix-grpc-daemon[1595]: ts=2026-09-22T15:06:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6083worker1 # [ 148.070686] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:59Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6084worker2 # [ 148.349620] nix-grpc-daemon[1595]: ts=2026-09-22T15:06:59Z level=info event=scheduler_connected addr=lb:500516085worker2 # [ 148.366242] nix-grpc-daemon[1595]: ts=2026-09-22T15:06:59Z level=info event=oidc_jwks provider=mock keys=16086worker2 # [ 148.370437] nix-grpc-daemon[1595]: ts=2026-09-22T15:06:59Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:452886087worker2 # [ 148.375844] nix-grpc-daemon[1595]: ts=2026-09-22T15:06:59Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=06088worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.17 seconds)6089client: waiting for success: ! systemctl is-active rs6090client: (finished: waiting for success: ! systemctl is-active rs, in 0.06 seconds)6091client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }6092client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds)6093client: must fail: journalctl -u rs | grep -q 'reconnecting'6094client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)6095lb: must succeed: curl -sf localhost:9901/clusters6096lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6097worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6098worker1 # [ 148.688745] nix-grpc-daemon[1188]: E0000 00:00:1790089620.288763 1233 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true6099worker1 # [ 148.695512] nix-grpc-daemon[1188]: E0000 00:00:1790089620.289060 1233 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true6100worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)6101lb: must succeed: curl -sf localhost:9901/clusters6102lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6103worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6104worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)6105worker1 # [ 149.879709] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6106worker1 # [ 149.886229] systemd[1]: Stopped Nix worker-protocol over gRPC.6107worker1 # [ 149.889072] systemd[1]: nix-grpc-daemon.service: Consumed 1.957s CPU time over 32.459s wall clock time, 38.9M memory peak, 47.5K incoming IP traffic, 89.3K outgoing IP traffic.6108worker1 # [ 149.909371] systemd[1]: Starting Nix worker-protocol over gRPC...6109worker1 # [ 150.064473] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:01Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6110worker1 # [ 150.066999] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:01Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6111worker1 # [ 150.070842] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:01Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=16112worker1 # [ 150.076058] nix-grpc-daemon[1464]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6113worker1 # [ 150.096151] nix-grpc-daemon[1464]: E0000 00:00:1790089621.676001 1464 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6114worker1 # [ 150.098487] nix-grpc-daemon[1464]: E0000 00:00:1790089621.679615 1464 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6115worker1 # [ 150.120692] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:01Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6116worker1 # [ 150.122843] nix-grpc-daemon[1464]: E0000 00:00:1790089621.685741 1504 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6117worker1 # [ 150.125507] systemd[1]: Started Nix worker-protocol over gRPC.6118worker1 # [ 150.126311] nix-grpc-daemon[1464]: E0000 00:00:1790089621.705900 1504 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6119worker1 # [ 150.131822] nix-grpc-daemon[1464]: E0000 00:00:1790089621.706042 1504 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6120worker1 # [ 150.136180] nix-grpc-daemon[1464]: E0000 00:00:1790089621.720336 1504 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6121worker1 # [ 150.138657] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:01Z level=info event=scheduler_connected addr=lb:500516122worker2 # [ 150.233069] nix-grpc-daemon[1595]: ts=2026-09-22T15:07:01Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:452886123worker2 # [ 150.238311] nix-grpc-daemon[1595]: ts=2026-09-22T15:07:01Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=06124lb: must succeed: curl -sf localhost:9901/clusters6125lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)6126worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics6127worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)6128(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.98 seconds)6129subtest: scheduler restart mid-build: build finishes, no double build6130client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag mid6131client # [ 151.065308] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag mid.6132client # Running as unit: mid.service; invocation ID: 18fc8e704a794ea7a769d14519fd29886133client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag mid, in 0.09 seconds)6134worker1 # [ 151.271665] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:520366135worker1 # [ 151.286305] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6136client # [ 151.308263] nix[1456]: don't know how to build these paths:6137client # [ 151.309868] nix[1456]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv6138worker2 # [ 151.413346] nix-grpc-daemon[1595]: ts=2026-09-22T15:07:03Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=06139worker2 # [ 151.419424] nix-grpc-daemon[1595]: ts=2026-09-22T15:07:03Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=16140worker2 # [ 151.481942] nix-grpc-daemon[1595]: ts=2026-09-22T15:07:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:342286141worker2 # [ 151.495742] nix-daemon[857]: accepted connection from pid 1595, user nix-grpc-daemon (trusted)6142worker2 # [ 151.519728] nix-grpc-daemon[1595]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 26 ms (attempt 1/5)6143worker2 # [ 151.554028] nix-grpc-daemon[1595]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 29 ms (attempt 2/5)6144worker2 # [ 151.584680] nix-grpc-daemon[1595]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 22 ms (attempt 3/5)6145worker2 # [ 151.608541] nix-grpc-daemon[1595]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 434 ms (attempt 4/5)6146worker2 # [ 152.052198] nix-grpc-daemon[1595]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6147worker2 # [ 152.058397] nix-grpc-daemon[1595]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6148worker2 # [ 152.077593] nix-grpc-daemon[1595]: ts=2026-09-22T15:07:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:342286149client # [ 152.003589] nix[1456]: copying 1 paths to 'lb:50051'...6150worker2 # [ 152.093037] nix-grpc-daemon[1595]: ts=2026-09-22T15:07:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:342286151client # [ 152.004082] nix[1456]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...6152worker2 # [ 152.106990] nix-daemon[857]: accepted connection from pid 1595, user nix-grpc-daemon (trusted)6153worker2 # [ 152.144085] nix-grpc-daemon[1595]: ts=2026-09-22T15:07:03Z level=info event=niks3_push_started pid=17206154worker2 # [ 152.286364] nix-grpc-daemon[1720]: time=2026-09-22T15:07:03.905Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca=""6155worker2 # [ 152.393461] nix-daemon[857]: accepted connection from pid 1732, user nix-grpc-daemon (trusted)6156worker2 # [ 152.452516] nix-daemon[857]: reaped child process 1737, status = succeeded6157worker2 # [ 152.545835] nix-daemon[857]: accepted connection from pid 1740, user nix-grpc-daemon (trusted)6158worker2 # [ 152.565046] nix-daemon[857]: reaped child process 1744, status = succeeded6159lb # [ 152.501847] niks3-server[1145]: 2026/09/22 15:07:04 INFO Received uploads request method=POST path=/api/pending_closures6160worker2 # [ 152.574471] nix-grpc-daemon[1720]: time=2026-09-22T15:07:04.193Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6161worker2 # [ 152.575929] nix-grpc-daemon[1720]: time=2026-09-22T15:07:04.193Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"6162lb # [ 152.536235] niks3-server[1145]: 2026/09/22 15:07:04 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst6163worker2 # [ 152.613411] nix-grpc-daemon[1720]: time=2026-09-22T15:07:04.232Z level=INFO msg="Uploading 1 narinfos"6164lb # [ 152.550648] niks3-server[1145]: 2026/09/22 15:07:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6165lb # [ 152.563805] niks3-server[1145]: 2026/09/22 15:07:04 INFO Signed narinfos id=51 count=16166lb # [ 152.571580] niks3-server[1145]: 2026/09/22 15:07:04 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls6167lb # [ 152.586597] niks3-server[1145]: 2026/09/22 15:07:04 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6168lb # [ 152.599545] niks3-server[1145]: 2026/09/22 15:07:04 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo6169lb # [ 152.615585] niks3-server[1145]: 2026/09/22 15:07:04 INFO Completed upload id=516170worker2 # [ 152.678216] nix-grpc-daemon[1720]: time=2026-09-22T15:07:04.297Z level=INFO msg="Upload complete. (388ms)"6171worker2 # [ 152.690441] nix-grpc-daemon[1595]: ts=2026-09-22T15:07:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34228 duration_s=0 paths=1 nar_bytes_in=4246172worker2 # [ 152.704530] nix-grpc-daemon[1595]: ts=2026-09-22T15:07:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:342286173worker2 # [ 152.717596] nix-daemon[857]: accepted connection from pid 1595, user nix-grpc-daemon (trusted)6174worker2 # [ 152.720592] nix-daemon[857]: reaped child process 1718, status = succeeded6175client # [ 152.642125] nix[1456]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...6176worker2 # [ 152.733724] nix-daemon[857]: accepted connection from pid 1595, user nix-grpc-daemon (trusted)6177lb: must succeed: curl -sf localhost:9901/clusters6178lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)6179lb: must succeed: curl -sf localhost:9901/clusters6180lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6181worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service6182worker2 # [ 155.072704] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1595 (nix-grpc-daemon) on client request.6183worker2 # [ 155.074290] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.6184lb # [ 155.029385] niks3-server[1145]: 2026/09/22 15:07:06 INFO lead: released remote=192.168.1.4:532626185worker2 # [ 155.099823] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL6186client # [ 155.006198] nix[1456]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again6187worker1 # [ 155.001855] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:06Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"6188worker2 # [ 155.104978] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.6189client # [ 155.012669] nix[1456]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting6190worker2 # [ 155.106308] systemd[1]: nix-grpc-daemon.service: Consumed 590ms CPU time over 17.452s wall clock time, 34.5M memory peak, 15K incoming IP traffic, 27.7K outgoing IP traffic.6191worker2 # [ 155.120470] systemd[1]: Starting scheduler-token.service...6192worker2 # [ 155.153265] nix-daemon[857]: reaped child process 1746, status = succeeded6193worker2 # [ 155.155189] nix-daemon[857]: reaped child process 1712, status = succeeded6194worker2 # [ 155.161668] nix-daemon[1748]: unexpected Nix daemon error: error: interrupted by the user6195worker2 # [ 155.176821] nix-daemon[857]: reaped child process 1748, status = failed with exit code 16196worker1 # [ 155.091137] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:06Z level=info event=scheduler_take_over6197lb # [ 155.122660] niks3-server[1145]: 2026/09/22 15:07:06 INFO lead: acquired remote=192.168.1.3:520526198worker2 # [ 155.199225] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.6199worker2 # [ 155.201285] systemd[1]: scheduler-token.service: Deactivated successfully.6200worker2 # [ 155.204492] systemd[1]: Finished scheduler-token.service.6201worker2 # [ 155.205289] systemd[1]: scheduler-token.service: Consumed 24ms CPU time over 88ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.6202worker2 # [ 155.208766] systemd[1]: Starting Nix worker-protocol over gRPC...6203worker1 # [ 155.201957] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:06Z level=info event=scheduler_connected addr=lb:500516204worker2 # [ 155.310960] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:06Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6205worker2 # [ 155.313253] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:06Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6206worker2 # [ 155.316914] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:06Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16207worker2 # [ 155.322568] nix-grpc-daemon[1788]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6208worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.31 seconds)6209worker2 # [ 155.338403] nix-grpc-daemon[1788]: E0000 00:00:1790089626.941487 1788 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6210client: must succeed: sleep 5.06211worker2 # [ 155.356171] nix-grpc-daemon[1788]: E0000 00:00:1790089626.945103 1788 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6212worker2 # [ 155.358444] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:06Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6213worker1 # [ 155.262569] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6214worker2 # [ 155.381454] nix-grpc-daemon[1788]: E0000 00:00:1790089626.963779 1830 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6215worker2 # [ 155.384416] systemd[1]: Started Nix worker-protocol over gRPC.6216worker2 # [ 155.385362] nix-grpc-daemon[1788]: E0000 00:00:1790089626.986103 1830 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6217worker2 # [ 155.387606] nix-grpc-daemon[1788]: E0000 00:00:1790089626.986231 1830 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6218worker2 # [ 155.392896] nix-grpc-daemon[1788]: E0000 00:00:1790089627.000535 1830 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6219worker2 # [ 155.398196] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:07Z level=info event=scheduler_connected addr=lb:500516220worker2 # [ 155.399748] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6221worker1 # [ 155.463432] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:07Z level=info event=scheduler_connected addr=lb:500516222worker1 # [ 155.468536] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6223worker2 # [ 155.601629] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:07Z level=info event=scheduler_connected addr=lb:500516224client # [ 155.515144] nix[1456]: scheduler at lb:50051: no healthy upstream, reconnecting6225worker2 # [ 155.606897] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6226worker1 # [ 155.669196] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:07Z level=info event=scheduler_connected addr=lb:500516227worker1 # [ 155.674344] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6228worker2 # [ 155.807825] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:07Z level=info event=scheduler_connected addr=lb:500516229worker2 # [ 155.813130] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6230worker1 # [ 155.875130] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:07Z level=info event=scheduler_connected addr=lb:500516231worker1 # [ 155.880387] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6232worker2 # [ 156.014074] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:07Z level=info event=scheduler_connected addr=lb:500516233worker2 # [ 156.019355] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6234worker1 # [ 156.082982] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:07Z level=info event=scheduler_connected addr=lb:500516235worker1 # [ 156.087960] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6236worker2 # [ 156.220504] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:07Z level=info event=scheduler_connected addr=lb:500516237worker2 # [ 156.225670] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6238worker1 # [ 156.283289] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:07Z level=info event=scheduler_connected addr=lb:500516239worker1 # [ 156.288393] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6240worker2 # [ 156.428493] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:08Z level=info event=scheduler_connected addr=lb:500516241worker2 # [ 156.432523] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6242worker1 # [ 156.489151] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:08Z level=info event=scheduler_connected addr=lb:500516243worker1 # [ 156.494109] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6244client # [ 156.521714] nix[1456]: scheduler at lb:50051: no healthy upstream, reconnecting6245worker2 # [ 156.629087] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:08Z level=info event=scheduler_connected addr=lb:500516246worker2 # [ 156.634198] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6247worker1 # [ 156.694938] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:08Z level=info event=scheduler_connected addr=lb:500516248worker1 # [ 156.700123] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6249worker2 # [ 156.835394] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:08Z level=info event=scheduler_connected addr=lb:500516250worker2 # [ 156.840703] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6251worker1 # [ 156.900857] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:08Z level=info event=scheduler_connected addr=lb:500516252worker1 # [ 156.905746] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"6253worker2 # [ 157.041897] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:08Z level=info event=scheduler_connected addr=lb:500516254worker1 # [ 156.969954] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:08Z level=info event=oidc_jwks provider=mock keys=16255worker1 # [ 156.974500] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:08Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:520466256worker1 # [ 156.980046] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:08Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=06257worker1 # [ 157.109396] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:08Z level=info event=scheduler_connected addr=lb:500516258worker1 # [ 157.113531] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:08Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:520466259worker1 # [ 157.118332] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:08Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=06260lb # [ 158.052757] envoy[895]: conn peer=[2001:db8:1::3]:37342 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3223 tx=1027 ms=303976261lb # [ 158.057770] envoy[895]: conn peer=[2001:db8:1::4]:42544 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=2679 tx=376 ms=172656262worker1 # [ 158.529258] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:10Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=06263worker1 # [ 158.535255] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:10Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=16264worker2 # [ 158.675834] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:342546265worker2 # [ 158.690177] nix-daemon[857]: accepted connection from pid 1788, user nix-grpc-daemon (trusted)6266worker2 # [ 158.708368] nix-daemon[857]: accepted connection from pid 1788, user nix-grpc-daemon (trusted)6267client # [ 158.638536] nix[1456]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...6268worker2 # [ 158.732962] nix-daemon[857]: accepted connection from pid 1788, user nix-grpc-daemon (trusted)6269client: (finished: must succeed: sleep 5.0, in 5.05 seconds)6270client: waiting for success: ! systemctl is-active mid6271worker2 # [ 160.761109] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:12Z level=info event=niks3_push_started pid=18696272worker2 # [ 160.803162] nix-daemon[857]: reaped child process 1844, status = succeeded6273worker2 # [ 160.923912] nix-grpc-daemon[1869]: time=2026-09-22T15:07:12.542Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca=""6274worker2 # [ 161.028129] nix-daemon[857]: accepted connection from pid 1881, user nix-grpc-daemon (trusted)6275worker2 # [ 161.045873] nix-daemon[857]: reaped child process 1884, status = succeeded6276lb # [ 160.990354] niks3-server[1145]: 2026/09/22 15:07:12 INFO Received uploads request method=POST path=/api/pending_closures6277worker2 # [ 161.066427] nix-grpc-daemon[1869]: time=2026-09-22T15:07:12.684Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6278worker2 # [ 161.067890] nix-grpc-daemon[1869]: time=2026-09-22T15:07:12.684Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"6279lb # [ 161.042288] niks3-server[1145]: 2026/09/22 15:07:12 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst6280lb # [ 161.064587] niks3-server[1145]: 2026/09/22 15:07:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6281worker2 # [ 161.128109] nix-grpc-daemon[1869]: time=2026-09-22T15:07:12.746Z level=INFO msg="Uploading 1 narinfos"6282lb # [ 161.067914] niks3-server[1145]: 2026/09/22 15:07:12 INFO Signed narinfos id=52 count=16283lb # [ 161.083370] niks3-server[1145]: 2026/09/22 15:07:12 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls6284lb # [ 161.094885] niks3-server[1145]: 2026/09/22 15:07:12 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv6285lb # [ 161.108695] niks3-server[1145]: 2026/09/22 15:07:12 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6286lb # [ 161.114193] niks3-server[1145]: 2026/09/22 15:07:12 INFO Completed upload id=526287worker2 # [ 161.176652] nix-grpc-daemon[1869]: time=2026-09-22T15:07:12.796Z level=INFO msg="Upload complete. (249ms)"6288lb # [ 161.118950] niks3-server[1145]: 2026/09/22 15:07:12 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo6289worker2 # [ 161.188343] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34254 duration_s=2 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=16290worker2 # [ 161.207877] nix-daemon[857]: reaped child process 1842, status = succeeded6291client # [ 161.136621] systemd[1]: mid.service: Deactivated successfully.6292client # [ 161.141551] systemd[1]: mid.service: Consumed 209ms CPU time over 10.072s wall clock time, 41.5M memory peak, 8.9K incoming IP traffic, 11.3K outgoing IP traffic.6293client: (finished: waiting for success: ! systemctl is-active mid, in 1.12 seconds)6294client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }6295client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.05 seconds)6296(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.74 seconds)6297subtest: interrupting the client stops the build on the worker6298client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag intr6299client # [ 161.773146] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag intr.6300client # Running as unit: intr.service; invocation ID: 636215684f5c4b578981114829407e9d6301client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag intr, in 0.05 seconds)6302worker2 # [ 162.031304] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:342546303client # [ 161.950120] nix[1492]: don't know how to build these paths:6304client # [ 161.951126] nix[1492]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv6305worker1 # [ 161.957295] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:13Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=06306worker1 # [ 161.963254] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:13Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.3:50051 clients=16307worker1 # [ 162.008878] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520366308worker1 # [ 162.025331] nix-grpc-daemon[1464]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 90 ms (attempt 1/5)6309worker1 # [ 162.124349] nix-grpc-daemon[1464]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 39 ms (attempt 2/5)6310worker1 # [ 162.165209] nix-grpc-daemon[1464]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 256 ms (attempt 3/5)6311worker1 # [ 162.430756] nix-grpc-daemon[1464]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 68 ms (attempt 4/5)6312worker1 # [ 162.500991] nix-grpc-daemon[1464]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6313worker1 # [ 162.507509] nix-grpc-daemon[1464]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6314worker1 # [ 162.525265] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:520366315client # [ 162.544155] nix[1492]: copying 1 paths to 'lb:50051'...6316client # [ 162.546466] nix[1492]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...6317worker1 # [ 162.541005] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:520366318worker1 # [ 162.558726] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6319worker1 # [ 162.585927] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:14Z level=info event=niks3_push_started pid=15606320worker1 # [ 162.734670] nix-grpc-daemon[1560]: time=2026-09-22T15:07:14.334Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.key ca=""6321worker1 # [ 162.843487] nix-daemon[833]: accepted connection from pid 1572, user nix-grpc-daemon (trusted)6322worker1 # [ 162.860544] nix-daemon[833]: reaped child process 1575, status = succeeded6323worker1 # [ 162.972344] nix-daemon[833]: accepted connection from pid 1577, user nix-grpc-daemon (trusted)6324lb # [ 163.031783] niks3-server[1145]: 2026/09/22 15:07:14 INFO Received uploads request method=POST path=/api/pending_closures6325worker1 # [ 163.008186] nix-daemon[833]: reaped child process 1583, status = succeeded6326worker1 # [ 163.011427] nix-grpc-daemon[1560]: time=2026-09-22T15:07:14.611Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6327worker1 # [ 163.016741] nix-grpc-daemon[1560]: time=2026-09-22T15:07:14.613Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"6328lb # [ 163.084991] niks3-server[1145]: 2026/09/22 15:07:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6329worker1 # [ 163.062172] nix-grpc-daemon[1560]: time=2026-09-22T15:07:14.662Z level=INFO msg="Uploading 1 narinfos"6330lb # [ 163.100366] niks3-server[1145]: 2026/09/22 15:07:14 INFO Signed narinfos id=53 count=16331lb # [ 163.107273] niks3-server[1145]: 2026/09/22 15:07:14 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst6332lb # [ 163.123820] niks3-server[1145]: 2026/09/22 15:07:14 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6333lb # [ 163.133486] niks3-server[1145]: 2026/09/22 15:07:14 INFO Completed upload id=536334worker1 # [ 163.095475] nix-grpc-daemon[1560]: time=2026-09-22T15:07:14.695Z level=INFO msg="Upload complete. (357ms)"6335lb # [ 163.135047] niks3-server[1145]: 2026/09/22 15:07:14 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo6336worker1 # [ 163.105194] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=0 paths=1 nar_bytes_in=4246337lb # [ 163.139857] niks3-server[1145]: 2026/09/22 15:07:14 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls6338worker1 # [ 163.119287] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520366339worker1 # [ 163.127404] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6340worker1 # [ 163.130908] nix-daemon[833]: reaped child process 1558, status = succeeded6341worker1 # [ 163.141383] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6342client # [ 163.145717] nix[1492]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...6343client: must succeed: systemctl kill -s INT intr6344worker1 # [ 164.279731] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:15Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv6345client # [ 164.283584] systemd[1]: intr.service: Sent signal SIGINT to main process 1492 (nix) on client request.6346client # [ 164.290330] nix[1492]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)6347client # [ 164.305148] nix[1492]: error: interrupted by the user6348client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds)6349client # [ 164.329793] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE6350client # [ 164.334600] systemd[1]: intr.service: Failed with result 'exit-code'.6351client # [ 164.336821] systemd[1]: intr.service: Consumed 163ms CPU time over 2.559s wall clock time, 41.5M memory peak, 6.5K incoming IP traffic, 8.3K outgoing IP traffic.6352worker1 # [ 164.371166] nix-daemon[833]: reaped child process 1586, status = succeeded6353worker1 # [ 164.375549] nix-daemon[1588]: unexpected Nix daemon error: error: interrupted by the user6354worker1 # [ 164.381411] nix-daemon[833]: reaped child process 1588, status = failed with exit code 16355(finished: subtest: interrupting the client stops the build on the worker, in 3.85 seconds)6356subtest: a deploy mid-build drains: the build finishes, the new generation takes over6357client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag sw6358client # [ 165.650744] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag sw.6359client # Running as unit: sw.service; invocation ID: 2ae46600dbcf432cbe646ccc896d624b6360client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag sw, in 0.09 seconds)6361client # [ 165.833839] nix[1513]: don't know how to build these paths:6362client # [ 165.834819] nix[1513]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv6363worker2 # [ 165.922612] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:342546364worker1 # [ 165.845420] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:17Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=06365worker1 # [ 165.845710] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:17Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.4:50051 clients=16366worker2 # [ 165.998712] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:342546367worker2 # [ 166.014207] nix-grpc-daemon[1788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 84 ms (attempt 1/5)6368worker2 # [ 166.107400] nix-grpc-daemon[1788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 165 ms (attempt 2/5)6369worker2 # [ 166.274570] nix-grpc-daemon[1788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 359 ms (attempt 3/5)6370worker2 # [ 166.635605] nix-grpc-daemon[1788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 133 ms (attempt 4/5)6371worker2 # [ 166.770933] nix-grpc-daemon[1788]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6372worker2 # [ 166.777072] nix-grpc-daemon[1788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6373worker2 # [ 166.795591] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:342546374client # [ 166.720402] nix[1513]: copying 1 paths to 'lb:50051'...6375worker2 # [ 166.811413] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:342546376client # [ 166.724191] nix[1513]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...6377worker2 # [ 166.828938] nix-daemon[857]: accepted connection from pid 1788, user nix-grpc-daemon (trusted)6378worker2 # [ 166.988402] nix-daemon[857]: accepted connection from pid 1916, user nix-grpc-daemon (trusted)6379worker2 # [ 167.054576] nix-daemon[857]: reaped child process 1921, status = succeeded6380worker2 # [ 167.136598] nix-daemon[857]: accepted connection from pid 1925, user nix-grpc-daemon (trusted)6381worker2 # [ 167.156281] nix-daemon[857]: reaped child process 1928, status = succeeded6382lb # [ 167.093695] niks3-server[1145]: 2026/09/22 15:07:18 INFO Received uploads request method=POST path=/api/pending_closures6383worker2 # [ 167.169863] nix-grpc-daemon[1869]: time=2026-09-22T15:07:18.788Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6384worker2 # [ 167.171326] nix-grpc-daemon[1869]: time=2026-09-22T15:07:18.788Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"6385lb # [ 167.149039] niks3-server[1145]: 2026/09/22 15:07:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6386worker2 # [ 167.217947] nix-grpc-daemon[1869]: time=2026-09-22T15:07:18.837Z level=INFO msg="Uploading 1 narinfos"6387lb # [ 167.161452] niks3-server[1145]: 2026/09/22 15:07:18 INFO Signed narinfos id=54 count=16388lb # [ 167.167072] niks3-server[1145]: 2026/09/22 15:07:18 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst6389lb # [ 167.176436] niks3-server[1145]: 2026/09/22 15:07:18 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls6390lb # [ 167.185388] niks3-server[1145]: 2026/09/22 15:07:18 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6391lb # [ 167.190969] niks3-server[1145]: 2026/09/22 15:07:18 INFO Completed upload id=546392worker2 # [ 167.253453] nix-grpc-daemon[1869]: time=2026-09-22T15:07:18.873Z level=INFO msg="Upload complete. (407ms)"6393lb # [ 167.194407] niks3-server[1145]: 2026/09/22 15:07:18 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo6394worker2 # [ 167.265036] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34254 duration_s=0 paths=1 nar_bytes_in=4166395worker2 # [ 167.280917] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:342546396worker2 # [ 167.287637] nix-daemon[857]: accepted connection from pid 1788, user nix-grpc-daemon (trusted)6397worker2 # [ 167.293304] nix-daemon[857]: reaped child process 1914, status = succeeded6398client # [ 167.214743] nix[1513]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...6399worker2 # [ 167.306326] nix-daemon[857]: accepted connection from pid 1788, user nix-grpc-daemon (trusted)6400lb # [ 168.049707] envoy[895]: conn peer=[2001:db8:1::1]:41388 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4288 tx=2110 ms=98466401lb # [ 168.055129] envoy[895]: conn peer=[2001:db8:1::1]:34584 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2987 tx=826 ms=23706402worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&26403worker2 # Checking switch inhibitors... done6404worker2 # activating the configuration...6405worker2 # [ 170.000569] nixos[1964]: switching to system configuration /nix/store/yvvqkjafn76srxj10bdx106rab59v1hp-nixos-system-worker2-test6406worker2 # [ 170.005303] systemd[1]: Stopped target Local File Systems.6407worker2 # [ 170.006184] systemd[1]: Stopped target Remote File Systems.6408worker2 # setting up /etc...6409worker2 # [ 170.565328] systemd[1]: Reload requested from client PID 1964 ('.switch-to-conf') (unit backdoor.service)...6410worker2 # [ 170.566853] systemd[1]: Reloading...6411worker2 # [ 175.422694] systemd[1]: Reloading finished in 4850 ms.6412worker2 # restarting sysinit-reactivation.target6413worker2 # [ 175.544728] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....6414worker2 # [ 175.664449] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..6415worker2 # [ 175.665654] systemd[1]: Reached target Reactivate sysinit units.6416worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service6417worker2 # [ 175.677028] systemd[1]: Reloading D-Bus System Message Bus...6418worker2 # [ 175.678215] dbus-broker-launch[494]: Caught SIGHUP, trigger reload.6419worker2 # [ 175.679140] systemd[1]: Reloading Nix worker-protocol over gRPC...6420worker2 # [ 175.691338] dbus-broker-launch[494]: Looking up NSS user entry for 'systemd-timesync'...6421worker2 # [ 175.710213] dbus-broker-launch[494]: NSS returned no entry for 'systemd-timesync'6422worker2 # [ 175.715586] dbus-broker-launch[494]: Invalid user-name in /nix/store/ng2ydfkv03gvmdws4f4mjf9wj6qj3kq6-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"6423worker2 # [ 175.726327] systemd[1]: Reloaded Nix worker-protocol over gRPC.6424worker2 # [ 175.730184] systemd[1]: Reloaded D-Bus System Message Bus.6425worker2 # [ 175.734373] systemd[1]: Reached target Remote File Systems.6426worker2 # [ 175.739111] systemd[1]: Reached target Local File Systems.6427worker2 # [ 175.741997] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore6428worker2 # [ 175.743401] systemd[1]: Starting Create SUID/SGID Wrappers...6429worker2 # [ 175.752504] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.6430worker2 # [ 175.753762] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc676431worker2 # [ 175.755834] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore6432worker2 # [ 175.772485] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os6433worker2 # [ 175.774340] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os6434worker2 # [ 175.780407] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os6435worker2 # [ 175.781693] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki6436worker2 # [ 176.082561] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.6437worker2 # [ 176.083651] systemd[1]: Finished Create SUID/SGID Wrappers.6438worker2 # [ 176.092157] systemd[1]: Starting linger-users.service...6439worker2 # [ 176.128762] systemd[1]: linger-users.service: Deactivated successfully.6440worker2 # [ 176.129975] systemd[1]: Finished linger-users.service.6441worker2 # [ 176.337050] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:27Z level=info event=draining6442worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service6443worker2 # [ 176.390908] nixos[1964]: finished switching to system configuration /nix/store/yvvqkjafn76srxj10bdx106rab59v1hp-nixos-system-worker2-test6444worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 6.84 seconds)6445worker2: must succeed: pgrep -f 'read -t [9]0 x'6446worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds)6447client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain >&26448client # don't know how to build these paths:6449client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv6450worker1 # [ 176.573302] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:520366451worker1 # [ 176.581647] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:520366452worker1 # [ 176.605075] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:28Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=06453worker1 # [ 176.611720] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:28Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.3:50051 clients=16454worker1 # [ 176.652727] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520366455worker1 # [ 176.668310] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:520366456client # copying 1 paths to 'lb:50051'...6457client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...6458worker1 # [ 176.683930] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:520366459worker1 # [ 176.698882] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6460worker1 # [ 176.858089] nix-daemon[833]: accepted connection from pid 1643, user nix-grpc-daemon (trusted)6461worker1 # [ 176.883974] nix-daemon[833]: reaped child process 1646, status = succeeded6462worker1 # [ 176.980907] nix-daemon[833]: accepted connection from pid 1648, user nix-grpc-daemon (trusted)6463worker1 # [ 176.997650] nix-daemon[833]: reaped child process 1651, status = succeeded6464lb # [ 177.035225] niks3-server[1145]: 2026/09/22 15:07:28 INFO Received uploads request method=POST path=/api/pending_closures6465worker1 # [ 177.014176] nix-grpc-daemon[1560]: time=2026-09-22T15:07:28.613Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6466worker1 # [ 177.015667] nix-grpc-daemon[1560]: time=2026-09-22T15:07:28.614Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"6467lb # [ 177.067727] niks3-server[1145]: 2026/09/22 15:07:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6468worker1 # [ 177.045866] nix-grpc-daemon[1560]: time=2026-09-22T15:07:28.646Z level=INFO msg="Uploading 1 narinfos"6469lb # [ 177.082514] niks3-server[1145]: 2026/09/22 15:07:28 INFO Signed narinfos id=55 count=16470lb # [ 177.090868] niks3-server[1145]: 2026/09/22 15:07:28 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst6471worker1 # [ 177.076490] nix-grpc-daemon[1560]: time=2026-09-22T15:07:28.676Z level=INFO msg="Upload complete. (360ms)"6472lb # [ 177.109290] niks3-server[1145]: 2026/09/22 15:07:28 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls6473lb # [ 177.117131] niks3-server[1145]: 2026/09/22 15:07:28 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6474worker1 # [ 177.085317] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=0 paths=1 nar_bytes_in=5286475lb # [ 177.121082] niks3-server[1145]: 2026/09/22 15:07:28 INFO Completed upload id=556476lb # [ 177.123806] niks3-server[1145]: 2026/09/22 15:07:28 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo6477worker1 # [ 177.100615] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520366478worker1 # [ 177.105644] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6479worker1 # [ 177.110270] nix-daemon[833]: reaped child process 1641, status = succeeded6480worker1 # [ 177.120160] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6481client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...6482client # farm-a> node-a: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv6483client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds6484client # farm-a> LOG-farm-a-during-drain6485worker1 # [ 178.188379] nix-daemon[833]: reaped child process 1655, status = succeeded6486worker1 # [ 178.293627] nix-daemon[833]: accepted connection from pid 1671, user nix-grpc-daemon (trusted)6487worker1 # [ 178.312735] nix-daemon[833]: reaped child process 1674, status = succeeded6488lb # [ 178.346624] niks3-server[1145]: 2026/09/22 15:07:29 INFO Received uploads request method=POST path=/api/pending_closures6489worker1 # [ 178.328414] nix-grpc-daemon[1560]: time=2026-09-22T15:07:29.925Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6490worker1 # [ 178.330079] nix-grpc-daemon[1560]: time=2026-09-22T15:07:29.925Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"6491lb # [ 178.390028] niks3-server[1145]: 2026/09/22 15:07:30 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv6492lb # [ 178.401224] niks3-server[1145]: 2026/09/22 15:07:30 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst6493lb # [ 178.412104] niks3-server[1145]: 2026/09/22 15:07:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6494worker1 # [ 178.386265] nix-grpc-daemon[1560]: time=2026-09-22T15:07:29.985Z level=INFO msg="Uploading 1 narinfos"6495lb # [ 178.419565] niks3-server[1145]: 2026/09/22 15:07:30 INFO Signed narinfos id=56 count=16496lb # [ 178.423846] niks3-server[1145]: 2026/09/22 15:07:30 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls6497lb # [ 178.432624] niks3-server[1145]: 2026/09/22 15:07:30 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6498lb # [ 178.437387] niks3-server[1145]: 2026/09/22 15:07:30 INFO Completed upload id=566499worker1 # [ 178.405136] nix-grpc-daemon[1560]: time=2026-09-22T15:07:30.005Z level=INFO msg="Upload complete. (274ms)"6500lb # [ 178.440278] niks3-server[1145]: 2026/09/22 15:07:30 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo6501worker1 # [ 178.424890] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=16502worker1 # [ 178.439167] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:30Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=06503worker1 # [ 178.443141] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:30Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.3:50051 clients=16504worker1 # [ 178.447489] nix-daemon[833]: reaped child process 1653, status = succeeded6505worker1 # [ 178.470026] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520366506worker1 # [ 178.481267] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:520366507worker1 # [ 178.501262] nix-grpc-daemon[1560]: time=2026-09-22T15:07:30.101Z level=INFO msg="All 1 paths already cached"6508client # copying 1 paths to 'lb:50051'...6509client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...6510worker1 # [ 178.512116] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:520366511worker1 # [ 178.525554] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6512worker1 # [ 178.676099] nix-daemon[833]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6513worker1 # [ 178.692407] nix-daemon[833]: reaped child process 1683, status = succeeded6514worker1 # [ 178.794560] nix-daemon[833]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)6515worker1 # [ 178.809813] nix-daemon[833]: reaped child process 1688, status = succeeded6516lb # [ 178.849132] niks3-server[1145]: 2026/09/22 15:07:30 INFO Received uploads request method=POST path=/api/pending_closures6517worker1 # [ 178.827167] nix-grpc-daemon[1560]: time=2026-09-22T15:07:30.427Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6518worker1 # [ 178.828852] nix-grpc-daemon[1560]: time=2026-09-22T15:07:30.427Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"6519lb # [ 178.879810] niks3-server[1145]: 2026/09/22 15:07:30 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst6520worker1 # [ 178.860533] nix-grpc-daemon[1560]: time=2026-09-22T15:07:30.460Z level=INFO msg="Uploading 1 narinfos"6521lb # [ 178.894305] niks3-server[1145]: 2026/09/22 15:07:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6522lb # [ 178.905364] niks3-server[1145]: 2026/09/22 15:07:30 INFO Signed narinfos id=57 count=16523lb # [ 178.907739] niks3-server[1145]: 2026/09/22 15:07:30 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls6524lb # [ 178.918891] niks3-server[1145]: 2026/09/22 15:07:30 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6525lb # [ 178.925272] niks3-server[1145]: 2026/09/22 15:07:30 INFO Completed upload id=576526worker1 # [ 178.892072] nix-grpc-daemon[1560]: time=2026-09-22T15:07:30.492Z level=INFO msg="Upload complete. (350ms)"6527lb # [ 178.927377] niks3-server[1145]: 2026/09/22 15:07:30 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo6528worker1 # [ 178.900338] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=0 paths=1 nar_bytes_in=6406529worker1 # [ 178.915131] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520366530worker1 # [ 178.921038] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6531worker1 # [ 178.925863] nix-daemon[833]: reaped child process 1678, status = succeeded6532worker1 # [ 178.935936] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6533client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...6534client # farm-b> node-a: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv6535client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds6536client # farm-b> LOG-farm-b-during-drain6537worker1 # [ 179.798974] nix-daemon[833]: reaped child process 1692, status = succeeded6538worker1 # [ 179.918828] nix-daemon[833]: accepted connection from pid 1708, user nix-grpc-daemon (trusted)6539worker1 # [ 179.939079] nix-daemon[833]: reaped child process 1711, status = succeeded6540lb # [ 179.975673] niks3-server[1145]: 2026/09/22 15:07:31 INFO Received uploads request method=POST path=/api/pending_closures6541worker1 # [ 179.954374] nix-grpc-daemon[1560]: time=2026-09-22T15:07:31.553Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6542worker1 # [ 179.956106] nix-grpc-daemon[1560]: time=2026-09-22T15:07:31.553Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"6543lb # [ 180.016187] niks3-server[1145]: 2026/09/22 15:07:31 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst6544lb # [ 180.027512] niks3-server[1145]: 2026/09/22 15:07:31 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv6545worker1 # [ 180.003636] nix-grpc-daemon[1560]: time=2026-09-22T15:07:31.603Z level=INFO msg="Uploading 1 narinfos"6546lb # [ 180.038660] niks3-server[1145]: 2026/09/22 15:07:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6547lb # [ 180.048000] niks3-server[1145]: 2026/09/22 15:07:31 INFO Signed narinfos id=58 count=16548lb # [ 180.056793] niks3-server[1145]: 2026/09/22 15:07:31 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls6549lb # [ 180.066294] niks3-server[1145]: 2026/09/22 15:07:31 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6550lb # [ 180.071590] niks3-server[1145]: 2026/09/22 15:07:31 INFO Completed upload id=586551worker1 # [ 180.031718] nix-grpc-daemon[1560]: time=2026-09-22T15:07:31.632Z level=INFO msg="Upload complete. (284ms)"6552lb # [ 180.074804] niks3-server[1145]: 2026/09/22 15:07:31 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo6553worker1 # [ 180.051063] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=16554worker1 # [ 180.068487] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:31Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=06555worker1 # [ 180.075486] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:31Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.3:50051 clients=16556worker1 # [ 180.081549] nix-daemon[833]: reaped child process 1690, status = succeeded6557worker1 # [ 180.097103] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520366558worker1 # [ 180.112445] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:520366559worker1 # [ 180.125848] nix-grpc-daemon[1560]: time=2026-09-22T15:07:31.726Z level=INFO msg="All 2 paths already cached"6560client # copying 1 paths to 'lb:50051'...6561client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...6562worker1 # [ 180.137327] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:520366563worker1 # [ 180.150744] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6564worker1 # [ 180.299478] nix-daemon[833]: accepted connection from pid 1717, user nix-grpc-daemon (trusted)6565worker1 # [ 180.317440] nix-daemon[833]: reaped child process 1720, status = succeeded6566worker1 # [ 180.416129] nix-daemon[833]: accepted connection from pid 1722, user nix-grpc-daemon (trusted)6567worker1 # [ 180.431793] nix-daemon[833]: reaped child process 1725, status = succeeded6568lb # [ 180.470197] niks3-server[1145]: 2026/09/22 15:07:32 INFO Received uploads request method=POST path=/api/pending_closures6569worker1 # [ 180.447149] nix-grpc-daemon[1560]: time=2026-09-22T15:07:32.047Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6570worker1 # [ 180.448779] nix-grpc-daemon[1560]: time=2026-09-22T15:07:32.047Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"6571lb # [ 180.496751] niks3-server[1145]: 2026/09/22 15:07:32 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst6572worker1 # [ 180.478954] nix-grpc-daemon[1560]: time=2026-09-22T15:07:32.079Z level=INFO msg="Uploading 1 narinfos"6573lb # [ 180.511883] niks3-server[1145]: 2026/09/22 15:07:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6574lb # [ 180.523725] niks3-server[1145]: 2026/09/22 15:07:32 INFO Signed narinfos id=59 count=16575lb # [ 180.529625] niks3-server[1145]: 2026/09/22 15:07:32 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls6576lb # [ 180.538289] niks3-server[1145]: 2026/09/22 15:07:32 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6577lb # [ 180.545943] niks3-server[1145]: 2026/09/22 15:07:32 INFO Completed upload id=596578worker1 # [ 180.513125] nix-grpc-daemon[1560]: time=2026-09-22T15:07:32.113Z level=INFO msg="Upload complete. (347ms)"6579lb # [ 180.548117] niks3-server[1145]: 2026/09/22 15:07:32 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo6580worker1 # [ 180.523428] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=0 paths=1 nar_bytes_in=7686581worker1 # [ 180.535158] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520366582worker1 # [ 180.545249] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6583worker1 # [ 180.548140] nix-daemon[833]: reaped child process 1715, status = succeeded6584client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...6585client # farm-top> node-a: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv6586worker1 # [ 180.561820] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6587client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds6588client # farm-top> LOG-farm-top-during-drain6589worker1 # [ 182.230535] nix-daemon[833]: reaped child process 1729, status = succeeded6590worker1 # [ 182.358239] nix-daemon[833]: accepted connection from pid 1745, user nix-grpc-daemon (trusted)6591worker1 # [ 182.379163] nix-daemon[833]: reaped child process 1748, status = succeeded6592lb # [ 182.409664] niks3-server[1145]: 2026/09/22 15:07:34 INFO Received uploads request method=POST path=/api/pending_closures6593worker1 # [ 182.388887] nix-grpc-daemon[1560]: time=2026-09-22T15:07:33.988Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6594worker1 # [ 182.391242] nix-grpc-daemon[1560]: time=2026-09-22T15:07:33.988Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"6595lb # [ 182.451558] niks3-server[1145]: 2026/09/22 15:07:34 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst6596lb # [ 182.463556] niks3-server[1145]: 2026/09/22 15:07:34 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv6597lb # [ 182.475183] niks3-server[1145]: 2026/09/22 15:07:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6598worker1 # [ 182.443972] nix-grpc-daemon[1560]: time=2026-09-22T15:07:34.043Z level=INFO msg="Uploading 1 narinfos"6599lb # [ 182.483148] niks3-server[1145]: 2026/09/22 15:07:34 INFO Signed narinfos id=60 count=16600lb # [ 182.487789] niks3-server[1145]: 2026/09/22 15:07:34 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls6601worker1 # [ 182.467238] nix-grpc-daemon[1560]: time=2026-09-22T15:07:34.067Z level=INFO msg="Upload complete. (293ms)"6602lb # [ 182.499352] niks3-server[1145]: 2026/09/22 15:07:34 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6603lb # [ 182.504371] niks3-server[1145]: 2026/09/22 15:07:34 INFO Completed upload id=606604lb # [ 182.510602] niks3-server[1145]: 2026/09/22 15:07:34 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo6605worker1 # [ 182.481200] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=16606worker1 # [ 182.501066] nix-daemon[833]: reaped child process 1727, status = succeeded6607client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain >&2, in 6.18 seconds)6608client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain outPath6609client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain outPath, in 0.19 seconds)6610worker2: must succeed: pkill -f 'read -t [9]0 x'6611worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)6612client: waiting for success: ! systemctl is-active sw6613worker2 # [ 182.963874] nix-daemon[857]: reaped child process 1932, status = succeeded6614worker2 # [ 183.074435] nix-daemon[857]: accepted connection from pid 2104, user nix-grpc-daemon (trusted)6615worker2 # [ 183.094315] nix-daemon[857]: reaped child process 2107, status = succeeded6616lb # [ 183.034974] niks3-server[1145]: 2026/09/22 15:07:34 INFO Received uploads request method=POST path=/api/pending_closures6617worker2 # [ 183.107667] nix-grpc-daemon[1869]: time=2026-09-22T15:07:34.726Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6618worker2 # [ 183.109711] nix-grpc-daemon[1869]: time=2026-09-22T15:07:34.726Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"6619lb # [ 183.069380] niks3-server[1145]: 2026/09/22 15:07:34 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6620lb # [ 183.084877] niks3-server[1145]: 2026/09/22 15:07:34 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv6621lb # [ 183.096946] niks3-server[1145]: 2026/09/22 15:07:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6622worker2 # [ 183.160083] nix-grpc-daemon[1869]: time=2026-09-22T15:07:34.778Z level=INFO msg="Uploading 1 narinfos"6623lb # [ 183.105710] niks3-server[1145]: 2026/09/22 15:07:34 INFO Signed narinfos id=61 count=16624lb # [ 183.110465] niks3-server[1145]: 2026/09/22 15:07:34 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls6625lb # [ 183.118965] niks3-server[1145]: 2026/09/22 15:07:34 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6626worker2 # [ 183.189356] nix-grpc-daemon[1869]: time=2026-09-22T15:07:34.809Z level=INFO msg="Upload complete. (254ms)"6627lb # [ 183.126982] niks3-server[1145]: 2026/09/22 15:07:34 INFO Completed upload id=616628lb # [ 183.131664] niks3-server[1145]: 2026/09/22 15:07:34 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo6629worker2 # [ 183.205128] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34254 duration_s=15 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=16630worker2 # [ 183.221340] nix-daemon[857]: reaped child process 1930, status = succeeded6631client # [ 183.147725] systemd[1]: sw.service: Deactivated successfully.6632client # [ 183.153276] systemd[1]: sw.service: Consumed 186ms CPU time over 17.498s wall clock time, 41.4M memory peak, 7.3K incoming IP traffic, 8.5K outgoing IP traffic.6633worker2 # [ 183.337901] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:34Z level=info event=signal_exit6634client: (finished: waiting for success: ! systemctl is-active sw, in 1.10 seconds)6635client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6636client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.05 seconds)6637worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6638worker2 # [ 184.097527] systemd[1]: Starting scheduler-token.service...6639worker2 # [ 184.168965] systemd[1]: scheduler-token.service: Deactivated successfully.6640worker2 # [ 184.174313] systemd[1]: Finished scheduler-token.service.6641worker2 # [ 184.175983] systemd[1]: scheduler-token.service: Consumed 40ms CPU time over 75ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.6642worker1 # [ 184.257727] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:35Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:520466643worker1 # [ 184.262698] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:35Z level=info event=worker_gone addr=192.168.1.4:500516644worker2 # [ 184.356759] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:35Z level=info event=scheduler_restarting6645worker2 # [ 184.377392] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:35Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6646worker2 # [ 184.400384] nix-grpc-daemon[1788]: E0000 00:00:1790089656.019964 1833 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true6647worker2 # [ 184.411572] nix-daemon[857]: reaped child process 1840, status = succeeded6648worker2 # [ 184.429296] nix-grpc-daemon[1788]: E0000 00:00:1790089656.048942 1833 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true6649worker2 # [ 185.384976] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6650worker2 # [ 185.390022] systemd[1]: nix-grpc-daemon.service: Consumed 894ms CPU time over 30.288s wall clock time, 35.3M memory peak, 22.2K incoming IP traffic, 35.7K outgoing IP traffic.6651worker2 # [ 185.411832] systemd[1]: Starting Nix worker-protocol over gRPC...6652worker2 # [ 185.560500] nix-grpc-daemon[2124]: ts=2026-09-22T15:07:37Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6653worker2 # [ 185.562994] nix-grpc-daemon[2124]: ts=2026-09-22T15:07:37Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6654worker2 # [ 185.566886] nix-grpc-daemon[2124]: ts=2026-09-22T15:07:37Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16655worker2 # [ 185.572054] nix-grpc-daemon[2124]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6656worker2 # [ 185.596139] nix-grpc-daemon[2124]: E0000 00:00:1790089657.191489 2124 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6657worker2 # [ 185.598545] nix-grpc-daemon[2124]: E0000 00:00:1790089657.195073 2124 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6658worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 1.61 seconds)6659worker2 # [ 185.623280] nix-grpc-daemon[2124]: ts=2026-09-22T15:07:37Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6660lb: waiting until exactly no endpoints of aarch64-linux are unhealthy6661lb: must succeed: curl -sf localhost:9901/clusters6662worker2 # [ 185.625240] nix-grpc-daemon[2124]: E0000 00:00:1790089657.201314 2164 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6663worker2 # [ 185.627549] systemd[1]: Started Nix worker-protocol over gRPC.6664worker2 # [ 185.628405] nix-grpc-daemon[2124]: E0000 00:00:1790089657.224459 2164 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6665worker2 # [ 185.633885] nix-grpc-daemon[2124]: E0000 00:00:1790089657.224643 2164 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6666worker2 # [ 185.638370] nix-grpc-daemon[2124]: E0000 00:00:1790089657.240941 2164 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6667worker2 # [ 185.640993] nix-grpc-daemon[2124]: ts=2026-09-22T15:07:37Z level=info event=scheduler_connected addr=lb:500516668worker1 # [ 185.546908] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:37Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:520466669worker1 # [ 185.550023] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:37Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=06670lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)6671lb: must succeed: curl -sf localhost:9901/clusters6672lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)6673lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.14 seconds)6674lb: must succeed: curl -sf localhost:9901/clusters6675lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6676worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6677worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)6678(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 21.21 seconds)6679subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6680client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16681worker2 # [ 187.106033] nix-grpc-daemon[2124]: ts=2026-09-22T15:07:38Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:521206682worker2 # [ 187.121284] nix-daemon[857]: accepted connection from pid 2124, user nix-grpc-daemon (trusted)6683worker2 # [ 187.141978] nix-grpc-daemon[2124]: ts=2026-09-22T15:07:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:521206684worker2 # [ 187.156821] nix-grpc-daemon[2124]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 18 ms (attempt 1/5)6685worker2 # [ 187.183752] nix-grpc-daemon[2124]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 64 ms (attempt 2/5)6686worker2 # [ 187.257170] nix-grpc-daemon[2124]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 273 ms (attempt 3/5)6687worker2 # [ 187.532659] nix-grpc-daemon[2124]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 177 ms (attempt 4/5)6688worker2 # [ 187.712296] nix-grpc-daemon[2124]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6689worker2 # [ 187.715998] nix-grpc-daemon[2124]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6690worker1 # [ 187.678027] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:39Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=06691worker1 # [ 187.678350] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:39Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=16692worker1 # [ 187.678483] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:39Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=06693worker1 # [ 187.678679] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:39Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=06694worker1 # [ 187.722170] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520366695worker1 # [ 187.738992] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:520366696worker1 # [ 187.754099] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:520366697worker1 # [ 187.769046] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6698worker1 # [ 187.930155] nix-daemon[833]: accepted connection from pid 1757, user nix-grpc-daemon (trusted)6699worker1 # [ 187.950251] nix-daemon[833]: reaped child process 1760, status = succeeded6700lb # [ 188.051099] envoy[895]: conn peer=[2001:db8:1::1]:42864 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9608 tx=4423 ms=59256701worker1 # [ 188.055050] nix-daemon[833]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)6702worker1 # [ 188.074585] nix-daemon[833]: reaped child process 1765, status = succeeded6703lb # [ 188.056915] envoy[895]: conn peer=[2001:db8:1::1]:34598 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2995 tx=1561 ms=172976704lb # [ 188.057081] envoy[895]: conn peer=[2001:db8:1::4]:40234 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=7565 tx=639 ms=289706705lb # [ 188.106355] niks3-server[1145]: 2026/09/22 15:07:39 INFO Received uploads request method=POST path=/api/pending_closures6706worker1 # [ 188.095845] nix-grpc-daemon[1560]: time=2026-09-22T15:07:39.695Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6707worker1 # [ 188.097665] nix-grpc-daemon[1560]: time=2026-09-22T15:07:39.695Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"6708lb # [ 188.148307] niks3-server[1145]: 2026/09/22 15:07:39 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst6709worker1 # [ 188.132642] nix-grpc-daemon[1560]: time=2026-09-22T15:07:39.732Z level=INFO msg="Uploading 1 narinfos"6710lb # [ 188.164754] niks3-server[1145]: 2026/09/22 15:07:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6711lb # [ 188.172387] niks3-server[1145]: 2026/09/22 15:07:39 INFO Signed narinfos id=62 count=16712lb # [ 188.180309] niks3-server[1145]: 2026/09/22 15:07:39 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls6713lb # [ 188.191332] niks3-server[1145]: 2026/09/22 15:07:39 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6714lb # [ 188.199949] niks3-server[1145]: 2026/09/22 15:07:39 INFO Completed upload id=626715worker1 # [ 188.166902] nix-grpc-daemon[1560]: time=2026-09-22T15:07:39.767Z level=INFO msg="Upload complete. (381ms)"6716lb # [ 188.202440] niks3-server[1145]: 2026/09/22 15:07:39 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo6717worker1 # [ 188.179614] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=0 paths=1 nar_bytes_in=5126718worker1 # [ 188.195841] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520366719worker1 # [ 188.202759] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6720worker1 # [ 188.207853] nix-daemon[833]: reaped child process 1755, status = succeeded6721worker1 # [ 188.223029] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6722worker1 # [ 189.472247] nix-daemon[833]: reaped child process 1769, status = succeeded6723worker1 # [ 189.586198] nix-daemon[833]: accepted connection from pid 1785, user nix-grpc-daemon (trusted)6724worker1 # [ 189.606727] nix-daemon[833]: reaped child process 1788, status = succeeded6725lb # [ 189.643250] niks3-server[1145]: 2026/09/22 15:07:41 INFO Received uploads request method=POST path=/api/pending_closures6726worker1 # [ 189.623758] nix-grpc-daemon[1560]: time=2026-09-22T15:07:41.221Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6727worker1 # [ 189.625620] nix-grpc-daemon[1560]: time=2026-09-22T15:07:41.221Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"6728lb # [ 189.683915] niks3-server[1145]: 2026/09/22 15:07:41 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6729lb # [ 189.697001] niks3-server[1145]: 2026/09/22 15:07:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6730worker1 # [ 189.671864] nix-grpc-daemon[1560]: time=2026-09-22T15:07:41.271Z level=INFO msg="Uploading 1 narinfos"6731lb # [ 189.710059] niks3-server[1145]: 2026/09/22 15:07:41 INFO Signed narinfos id=63 count=16732lb # [ 189.715608] niks3-server[1145]: 2026/09/22 15:07:41 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv6733lb # [ 189.722645] niks3-server[1145]: 2026/09/22 15:07:41 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls6734lb # [ 189.730102] niks3-server[1145]: 2026/09/22 15:07:41 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6735lb # [ 189.737035] niks3-server[1145]: 2026/09/22 15:07:41 INFO Completed upload id=636736worker1 # [ 189.705508] nix-grpc-daemon[1560]: time=2026-09-22T15:07:41.305Z level=INFO msg="Upload complete. (271ms)"6737lb # [ 189.740657] niks3-server[1145]: 2026/09/22 15:07:41 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo6738worker1 # [ 189.725305] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=7 outputs=16739worker1 # [ 189.741716] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:41Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=16740worker1 # [ 189.746341] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:41Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=06741worker1 # [ 189.750265] nix-daemon[833]: reaped child process 1767, status = succeeded6742worker1 # [ 189.761140] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520366743worker1 # [ 189.774924] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:520366744worker1 # [ 189.789978] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:520366745worker1 # [ 189.803900] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6746worker1 # [ 189.954603] nix-daemon[833]: accepted connection from pid 1794, user nix-grpc-daemon (trusted)6747worker1 # [ 189.977371] nix-daemon[833]: reaped child process 1797, status = succeeded6748worker1 # [ 190.074795] nix-daemon[833]: accepted connection from pid 1799, user nix-grpc-daemon (trusted)6749worker1 # [ 190.095168] nix-daemon[833]: reaped child process 1802, status = succeeded6750lb # [ 190.125632] niks3-server[1145]: 2026/09/22 15:07:41 INFO Received uploads request method=POST path=/api/pending_closures6751worker1 # [ 190.103403] nix-grpc-daemon[1560]: time=2026-09-22T15:07:41.703Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6752worker1 # [ 190.105089] nix-grpc-daemon[1560]: time=2026-09-22T15:07:41.703Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"6753lb # [ 190.154856] niks3-server[1145]: 2026/09/22 15:07:41 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst6754worker1 # [ 190.137696] nix-grpc-daemon[1560]: time=2026-09-22T15:07:41.737Z level=INFO msg="Uploading 1 narinfos"6755lb # [ 190.170112] niks3-server[1145]: 2026/09/22 15:07:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6756lb # [ 190.180885] niks3-server[1145]: 2026/09/22 15:07:41 INFO Signed narinfos id=64 count=16757lb # [ 190.186630] niks3-server[1145]: 2026/09/22 15:07:41 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls6758lb # [ 190.196425] niks3-server[1145]: 2026/09/22 15:07:41 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6759lb # [ 190.202166] niks3-server[1145]: 2026/09/22 15:07:41 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo6760lb # [ 190.207829] niks3-server[1145]: 2026/09/22 15:07:41 INFO Completed upload id=646761worker1 # [ 190.175362] nix-grpc-daemon[1560]: time=2026-09-22T15:07:41.775Z level=INFO msg="Upload complete. (356ms)"6762worker1 # [ 190.184596] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=0 paths=1 nar_bytes_in=5126763worker1 # [ 190.192607] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520366764worker1 # [ 190.203394] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6765worker1 # [ 190.208843] nix-daemon[833]: reaped child process 1792, status = succeeded6766worker1 # [ 190.220176] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6767worker1 # [ 191.496210] nix-daemon[833]: reaped child process 1806, status = succeeded6768worker1 # [ 191.608746] nix-daemon[833]: accepted connection from pid 1822, user nix-grpc-daemon (trusted)6769worker1 # [ 191.629593] nix-daemon[833]: reaped child process 1825, status = succeeded6770lb # [ 191.661330] niks3-server[1145]: 2026/09/22 15:07:43 INFO Received uploads request method=POST path=/api/pending_closures6771worker1 # [ 191.640510] nix-grpc-daemon[1560]: time=2026-09-22T15:07:43.239Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6772worker1 # [ 191.642086] nix-grpc-daemon[1560]: time=2026-09-22T15:07:43.239Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"6773lb # [ 191.700906] niks3-server[1145]: 2026/09/22 15:07:43 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6774lb # [ 191.719746] niks3-server[1145]: 2026/09/22 15:07:43 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv6775worker1 # [ 191.697862] nix-grpc-daemon[1560]: time=2026-09-22T15:07:43.297Z level=INFO msg="Uploading 1 narinfos"6776lb # [ 191.732109] niks3-server[1145]: 2026/09/22 15:07:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6777lb # [ 191.740661] niks3-server[1145]: 2026/09/22 15:07:43 INFO Signed narinfos id=65 count=16778lb # [ 191.746022] niks3-server[1145]: 2026/09/22 15:07:43 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls6779worker1 # [ 191.724841] nix-grpc-daemon[1560]: time=2026-09-22T15:07:43.325Z level=INFO msg="Upload complete. (294ms)"6780lb # [ 191.757337] niks3-server[1145]: 2026/09/22 15:07:43 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6781lb # [ 191.761788] niks3-server[1145]: 2026/09/22 15:07:43 INFO Completed upload id=656782lb # [ 191.765363] niks3-server[1145]: 2026/09/22 15:07:43 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo6783worker1 # [ 191.743638] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=8 outputs=16784worker1 # [ 191.768971] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:43Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=16785worker1 # [ 191.774275] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520366786worker1 # [ 191.780379] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:43Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=06787worker1 # [ 191.785790] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:520366788worker1 # [ 191.804224] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:520366789worker1 # [ 191.810240] nix-daemon[833]: reaped child process 1804, status = succeeded6790worker1 # [ 191.812964] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6791worker1 # [ 191.946356] nix-daemon[833]: accepted connection from pid 1831, user nix-grpc-daemon (trusted)6792worker1 # [ 191.966473] nix-daemon[833]: reaped child process 1834, status = succeeded6793worker1 # [ 192.071414] nix-daemon[833]: accepted connection from pid 1836, user nix-grpc-daemon (trusted)6794worker1 # [ 192.088101] nix-daemon[833]: reaped child process 1839, status = succeeded6795lb # [ 192.126975] niks3-server[1145]: 2026/09/22 15:07:43 INFO Received uploads request method=POST path=/api/pending_closures6796worker1 # [ 192.104279] nix-grpc-daemon[1560]: time=2026-09-22T15:07:43.704Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6797worker1 # [ 192.105768] nix-grpc-daemon[1560]: time=2026-09-22T15:07:43.704Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"6798lb # [ 192.153804] niks3-server[1145]: 2026/09/22 15:07:43 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst6799lb # [ 192.167536] niks3-server[1145]: 2026/09/22 15:07:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6800worker1 # [ 192.144292] nix-grpc-daemon[1560]: time=2026-09-22T15:07:43.744Z level=INFO msg="Uploading 1 narinfos"6801lb # [ 192.182043] niks3-server[1145]: 2026/09/22 15:07:43 INFO Signed narinfos id=66 count=16802lb # [ 192.189470] niks3-server[1145]: 2026/09/22 15:07:43 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls6803lb # [ 192.198645] niks3-server[1145]: 2026/09/22 15:07:43 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6804worker1 # [ 192.176257] nix-grpc-daemon[1560]: time=2026-09-22T15:07:43.776Z level=INFO msg="Upload complete. (364ms)"6805lb # [ 192.210021] niks3-server[1145]: 2026/09/22 15:07:43 INFO Completed upload id=666806lb # [ 192.214184] niks3-server[1145]: 2026/09/22 15:07:43 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo6807worker1 # [ 192.184333] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=0 paths=1 nar_bytes_in=5126808worker1 # [ 192.200669] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520366809worker1 # [ 192.206944] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6810worker1 # [ 192.211707] nix-daemon[833]: reaped child process 1829, status = succeeded6811worker1 # [ 192.222252] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6812worker1 # [ 193.133069] nix-daemon[833]: reaped child process 1843, status = succeeded6813worker1 # [ 193.205485] nix-daemon[833]: accepted connection from pid 1859, user nix-grpc-daemon (trusted)6814worker1 # [ 193.225571] nix-daemon[833]: reaped child process 1862, status = succeeded6815lb # [ 193.264734] niks3-server[1145]: 2026/09/22 15:07:44 INFO Received uploads request method=POST path=/api/pending_closures6816worker1 # [ 193.242891] nix-grpc-daemon[1560]: time=2026-09-22T15:07:44.841Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6817worker1 # [ 193.244776] nix-grpc-daemon[1560]: time=2026-09-22T15:07:44.842Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"6818lb # [ 193.300890] niks3-server[1145]: 2026/09/22 15:07:44 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv6819lb # [ 193.312138] niks3-server[1145]: 2026/09/22 15:07:44 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6820worker1 # [ 193.292553] nix-grpc-daemon[1560]: time=2026-09-22T15:07:44.892Z level=INFO msg="Uploading 1 narinfos"6821lb # [ 193.324972] niks3-server[1145]: 2026/09/22 15:07:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6822lb # [ 193.334417] niks3-server[1145]: 2026/09/22 15:07:44 INFO Signed narinfos id=67 count=16823lb # [ 193.341317] niks3-server[1145]: 2026/09/22 15:07:44 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls6824worker1 # [ 193.323044] nix-grpc-daemon[1560]: time=2026-09-22T15:07:44.923Z level=INFO msg="Upload complete. (288ms)"6825lb # [ 193.355307] niks3-server[1145]: 2026/09/22 15:07:44 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6826lb # [ 193.360376] niks3-server[1145]: 2026/09/22 15:07:44 INFO Completed upload id=676827lb # [ 193.364350] niks3-server[1145]: 2026/09/22 15:07:44 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo6828worker1 # [ 193.338595] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=9 outputs=16829worker1 # [ 193.361385] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:44Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=16830worker1 # [ 193.371037] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520366831worker1 # [ 193.376729] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:44Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=06832worker1 # [ 193.381020] nix-daemon[833]: reaped child process 1841, status = succeeded6833worker1 # [ 193.393132] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:520366834worker1 # [ 193.406562] nix-grpc-daemon[1560]: time=2026-09-22T15:07:45.006Z level=INFO msg="All 1 paths already cached"6835worker1 # [ 193.415732] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:520366836worker1 # [ 193.428996] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6837worker1 # [ 193.573558] nix-daemon[833]: accepted connection from pid 1868, user nix-grpc-daemon (trusted)6838worker1 # [ 193.594915] nix-daemon[833]: reaped child process 1871, status = succeeded6839worker1 # [ 193.696146] nix-daemon[833]: accepted connection from pid 1873, user nix-grpc-daemon (trusted)6840worker1 # [ 193.715913] nix-daemon[833]: reaped child process 1876, status = succeeded6841lb # [ 193.753106] niks3-server[1145]: 2026/09/22 15:07:45 INFO Received uploads request method=POST path=/api/pending_closures6842worker1 # [ 193.730835] nix-grpc-daemon[1560]: time=2026-09-22T15:07:45.330Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6843worker1 # [ 193.732450] nix-grpc-daemon[1560]: time=2026-09-22T15:07:45.331Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"6844lb # [ 193.780424] niks3-server[1145]: 2026/09/22 15:07:45 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst6845worker1 # [ 193.762126] nix-grpc-daemon[1560]: time=2026-09-22T15:07:45.362Z level=INFO msg="Uploading 1 narinfos"6846lb # [ 193.796501] niks3-server[1145]: 2026/09/22 15:07:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6847lb # [ 193.808480] niks3-server[1145]: 2026/09/22 15:07:45 INFO Signed narinfos id=68 count=16848lb # [ 193.815631] niks3-server[1145]: 2026/09/22 15:07:45 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls6849worker1 # [ 193.796647] nix-grpc-daemon[1560]: time=2026-09-22T15:07:45.397Z level=INFO msg="Upload complete. (354ms)"6850lb # [ 193.830409] niks3-server[1145]: 2026/09/22 15:07:45 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6851worker1 # [ 193.804139] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=0 paths=1 nar_bytes_in=6246852lb # [ 193.838431] niks3-server[1145]: 2026/09/22 15:07:45 INFO Completed upload id=686853lb # [ 193.841387] niks3-server[1145]: 2026/09/22 15:07:45 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo6854worker1 # [ 193.819511] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520366855worker1 # [ 193.826099] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6856worker1 # [ 193.830665] nix-daemon[833]: reaped child process 1866, status = succeeded6857worker1 # [ 193.841693] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6858worker1 # [ 195.328710] nix-daemon[833]: reaped child process 1880, status = succeeded6859worker1 # [ 195.431372] nix-daemon[833]: accepted connection from pid 1896, user nix-grpc-daemon (trusted)6860worker1 # [ 195.451958] nix-daemon[833]: reaped child process 1899, status = succeeded6861lb # [ 195.489770] niks3-server[1145]: 2026/09/22 15:07:47 INFO Received uploads request method=POST path=/api/pending_closures6862worker1 # [ 195.472394] nix-grpc-daemon[1560]: time=2026-09-22T15:07:47.069Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6863worker1 # [ 195.474100] nix-grpc-daemon[1560]: time=2026-09-22T15:07:47.069Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"6864lb # [ 195.528925] niks3-server[1145]: 2026/09/22 15:07:47 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv6865lb # [ 195.540777] niks3-server[1145]: 2026/09/22 15:07:47 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst6866worker1 # [ 195.522360] nix-grpc-daemon[1560]: time=2026-09-22T15:07:47.122Z level=INFO msg="Uploading 1 narinfos"6867lb # [ 195.555462] niks3-server[1145]: 2026/09/22 15:07:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6868lb # [ 195.563630] niks3-server[1145]: 2026/09/22 15:07:47 INFO Signed narinfos id=69 count=16869lb # [ 195.567483] niks3-server[1145]: 2026/09/22 15:07:47 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls6870worker1 # [ 195.543233] nix-grpc-daemon[1560]: time=2026-09-22T15:07:47.143Z level=INFO msg="Upload complete. (285ms)"6871lb # [ 195.576890] niks3-server[1145]: 2026/09/22 15:07:47 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6872lb # [ 195.579836] niks3-server[1145]: 2026/09/22 15:07:47 INFO Completed upload id=696873lb # [ 195.583450] niks3-server[1145]: 2026/09/22 15:07:47 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo6874worker1 # [ 195.561228] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=10 outputs=16875worker1 # [ 195.578232] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:47Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=16876worker1 # [ 195.591738] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520366877worker1 # [ 195.596588] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:47Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=06878worker1 # [ 195.601832] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:520366879worker1 # [ 195.606835] nix-daemon[833]: reaped child process 1878, status = succeeded6880worker1 # [ 195.608879] nix-grpc-daemon[1560]: time=2026-09-22T15:07:47.205Z level=INFO msg="All 1 paths already cached"6881worker1 # [ 195.621435] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:520366882worker1 # [ 195.627447] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6883worker1 # [ 195.752958] nix-daemon[833]: accepted connection from pid 1905, user nix-grpc-daemon (trusted)6884worker1 # [ 195.780230] nix-daemon[833]: reaped child process 1908, status = succeeded6885worker1 # [ 195.874927] nix-daemon[833]: accepted connection from pid 1910, user nix-grpc-daemon (trusted)6886worker1 # [ 195.894877] nix-daemon[833]: reaped child process 1913, status = succeeded6887lb # [ 195.932614] niks3-server[1145]: 2026/09/22 15:07:47 INFO Received uploads request method=POST path=/api/pending_closures6888worker1 # [ 195.909351] nix-grpc-daemon[1560]: time=2026-09-22T15:07:47.509Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6889worker1 # [ 195.910889] nix-grpc-daemon[1560]: time=2026-09-22T15:07:47.509Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"6890lb # [ 195.963290] niks3-server[1145]: 2026/09/22 15:07:47 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst6891worker1 # [ 195.944485] nix-grpc-daemon[1560]: time=2026-09-22T15:07:47.544Z level=INFO msg="Uploading 1 narinfos"6892lb # [ 195.979609] niks3-server[1145]: 2026/09/22 15:07:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/70/sign6893lb # [ 195.989939] niks3-server[1145]: 2026/09/22 15:07:47 INFO Signed narinfos id=70 count=16894worker1 # [ 195.965834] nix-grpc-daemon[1560]: time=2026-09-22T15:07:47.566Z level=INFO msg="Upload complete. (332ms)"6895lb # [ 195.997891] niks3-server[1145]: 2026/09/22 15:07:47 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls6896worker1 # [ 195.972264] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=0 paths=1 nar_bytes_in=6246897lb # [ 196.006516] niks3-server[1145]: 2026/09/22 15:07:47 INFO Received complete upload request method=POST path=/api/pending_closures/70/complete6898lb # [ 196.009987] niks3-server[1145]: 2026/09/22 15:07:47 INFO Completed upload id=706899lb # [ 196.011959] niks3-server[1145]: 2026/09/22 15:07:47 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo6900worker1 # [ 195.985959] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520366901worker1 # [ 195.991298] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6902worker1 # [ 195.996978] nix-daemon[833]: reaped child process 1903, status = succeeded6903worker1 # [ 196.005583] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6904worker1 # [ 197.242504] nix-daemon[833]: reaped child process 1917, status = succeeded6905worker1 # [ 197.351880] nix-daemon[833]: accepted connection from pid 1933, user nix-grpc-daemon (trusted)6906worker1 # [ 197.371912] nix-daemon[833]: reaped child process 1936, status = succeeded6907lb # [ 197.410758] niks3-server[1145]: 2026/09/22 15:07:49 INFO Received uploads request method=POST path=/api/pending_closures6908worker1 # [ 197.390127] nix-grpc-daemon[1560]: time=2026-09-22T15:07:48.989Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6909worker1 # [ 197.391795] nix-grpc-daemon[1560]: time=2026-09-22T15:07:48.989Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"6910lb # [ 197.445059] niks3-server[1145]: 2026/09/22 15:07:49 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv6911lb # [ 197.459459] niks3-server[1145]: 2026/09/22 15:07:49 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst6912lb # [ 197.475255] niks3-server[1145]: 2026/09/22 15:07:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/71/sign6913worker1 # [ 197.448464] nix-grpc-daemon[1560]: time=2026-09-22T15:07:49.048Z level=INFO msg="Uploading 1 narinfos"6914lb # [ 197.484924] niks3-server[1145]: 2026/09/22 15:07:49 INFO Signed narinfos id=71 count=16915lb # [ 197.487383] niks3-server[1145]: 2026/09/22 15:07:49 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls6916lb # [ 197.502754] niks3-server[1145]: 2026/09/22 15:07:49 INFO Received complete upload request method=POST path=/api/pending_closures/71/complete6917lb # [ 197.509419] niks3-server[1145]: 2026/09/22 15:07:49 INFO Completed upload id=716918worker1 # [ 197.476859] nix-grpc-daemon[1560]: time=2026-09-22T15:07:49.077Z level=INFO msg="Upload complete. (261ms)"6919lb # [ 197.512063] niks3-server[1145]: 2026/09/22 15:07:49 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo6920worker1 # [ 197.496889] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=11 outputs=16921worker1 # [ 197.512326] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:49Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=16922worker1 # [ 197.522608] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520366923worker1 # [ 197.527892] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:49Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=06924worker1 # [ 197.533695] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:520366925worker1 # [ 197.539219] nix-daemon[833]: reaped child process 1915, status = succeeded6926worker1 # [ 197.541571] nix-grpc-daemon[1560]: time=2026-09-22T15:07:49.138Z level=INFO msg="All 1 paths already cached"6927worker1 # [ 197.547277] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:520366928worker1 # [ 197.557813] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6929worker1 # [ 197.688227] nix-daemon[833]: accepted connection from pid 1942, user nix-grpc-daemon (trusted)6930worker1 # [ 197.713922] nix-daemon[833]: reaped child process 1945, status = succeeded6931worker1 # [ 197.813366] nix-daemon[833]: accepted connection from pid 1947, user nix-grpc-daemon (trusted)6932worker1 # [ 197.834200] nix-daemon[833]: reaped child process 1950, status = succeeded6933lb # [ 197.870948] niks3-server[1145]: 2026/09/22 15:07:49 INFO Received uploads request method=POST path=/api/pending_closures6934worker1 # [ 197.848065] nix-grpc-daemon[1560]: time=2026-09-22T15:07:49.448Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6935worker1 # [ 197.849616] nix-grpc-daemon[1560]: time=2026-09-22T15:07:49.448Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"6936lb # [ 197.898849] niks3-server[1145]: 2026/09/22 15:07:49 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst6937worker1 # [ 197.879329] nix-grpc-daemon[1560]: time=2026-09-22T15:07:49.479Z level=INFO msg="Uploading 1 narinfos"6938lb # [ 197.912369] niks3-server[1145]: 2026/09/22 15:07:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/72/sign6939lb # [ 197.924779] niks3-server[1145]: 2026/09/22 15:07:49 INFO Signed narinfos id=72 count=16940lb # [ 197.927595] niks3-server[1145]: 2026/09/22 15:07:49 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls6941lb # [ 197.939377] niks3-server[1145]: 2026/09/22 15:07:49 INFO Received complete upload request method=POST path=/api/pending_closures/72/complete6942lb # [ 197.944595] niks3-server[1145]: 2026/09/22 15:07:49 INFO Completed upload id=726943worker1 # [ 197.913796] nix-grpc-daemon[1560]: time=2026-09-22T15:07:49.514Z level=INFO msg="Upload complete. (347ms)"6944lb # [ 197.951284] niks3-server[1145]: 2026/09/22 15:07:49 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo6945worker1 # [ 197.920298] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=0 paths=1 nar_bytes_in=6246946worker1 # [ 197.934823] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520366947worker1 # [ 197.940914] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6948worker1 # [ 197.945749] nix-daemon[833]: reaped child process 1940, status = succeeded6949worker1 # [ 197.957711] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6950worker1 # [ 199.028475] nix-daemon[833]: reaped child process 1954, status = succeeded6951worker1 # [ 199.130890] nix-daemon[833]: accepted connection from pid 1970, user nix-grpc-daemon (trusted)6952worker1 # [ 199.149619] nix-daemon[833]: reaped child process 1973, status = succeeded6953lb # [ 199.187408] niks3-server[1145]: 2026/09/22 15:07:50 INFO Received uploads request method=POST path=/api/pending_closures6954worker1 # [ 199.171360] nix-grpc-daemon[1560]: time=2026-09-22T15:07:50.768Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6955worker1 # [ 199.173213] nix-grpc-daemon[1560]: time=2026-09-22T15:07:50.768Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"6956lb # [ 199.227885] niks3-server[1145]: 2026/09/22 15:07:50 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst6957lb # [ 199.240879] niks3-server[1145]: 2026/09/22 15:07:50 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv6958worker1 # [ 199.216622] nix-grpc-daemon[1560]: time=2026-09-22T15:07:50.816Z level=INFO msg="Uploading 1 narinfos"6959lb # [ 199.249894] niks3-server[1145]: 2026/09/22 15:07:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/73/sign6960lb # [ 199.257122] niks3-server[1145]: 2026/09/22 15:07:50 INFO Signed narinfos id=73 count=16961lb # [ 199.262073] niks3-server[1145]: 2026/09/22 15:07:50 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls6962lb # [ 199.268924] niks3-server[1145]: 2026/09/22 15:07:50 INFO Received complete upload request method=POST path=/api/pending_closures/73/complete6963lb # [ 199.274701] niks3-server[1145]: 2026/09/22 15:07:50 INFO Completed upload id=736964worker1 # [ 199.241462] nix-grpc-daemon[1560]: time=2026-09-22T15:07:50.841Z level=INFO msg="Upload complete. (274ms)"6965lb # [ 199.277390] niks3-server[1145]: 2026/09/22 15:07:50 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo6966worker1 # [ 199.261184] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=12 outputs=16967worker1 # [ 199.276358] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:50Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=16968worker1 # [ 199.286093] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520366969worker1 # [ 199.290525] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:50Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=06970worker1 # [ 199.295102] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:520366971worker1 # [ 199.298252] nix-daemon[833]: reaped child process 1952, status = succeeded6972worker1 # [ 199.301688] nix-grpc-daemon[1560]: time=2026-09-22T15:07:50.900Z level=INFO msg="All 2 paths already cached"6973worker1 # [ 199.305721] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:520366974worker1 # [ 199.319016] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6975worker1 # [ 199.445529] nix-daemon[833]: accepted connection from pid 1979, user nix-grpc-daemon (trusted)6976worker1 # [ 199.464429] nix-daemon[833]: reaped child process 1982, status = succeeded6977worker1 # [ 199.567500] nix-daemon[833]: accepted connection from pid 1984, user nix-grpc-daemon (trusted)6978worker1 # [ 199.583788] nix-daemon[833]: reaped child process 1987, status = succeeded6979lb # [ 199.622597] niks3-server[1145]: 2026/09/22 15:07:51 INFO Received uploads request method=POST path=/api/pending_closures6980worker1 # [ 199.600932] nix-grpc-daemon[1560]: time=2026-09-22T15:07:51.201Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6981worker1 # [ 199.602395] nix-grpc-daemon[1560]: time=2026-09-22T15:07:51.201Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"6982lb # [ 199.653403] niks3-server[1145]: 2026/09/22 15:07:51 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst6983lb # [ 199.668791] niks3-server[1145]: 2026/09/22 15:07:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/74/sign6984worker1 # [ 199.642783] nix-grpc-daemon[1560]: time=2026-09-22T15:07:51.243Z level=INFO msg="Uploading 1 narinfos"6985lb # [ 199.679475] niks3-server[1145]: 2026/09/22 15:07:51 INFO Signed narinfos id=74 count=16986lb # [ 199.684805] niks3-server[1145]: 2026/09/22 15:07:51 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls6987lb # [ 199.693409] niks3-server[1145]: 2026/09/22 15:07:51 INFO Received complete upload request method=POST path=/api/pending_closures/74/complete6988lb # [ 199.697019] niks3-server[1145]: 2026/09/22 15:07:51 INFO Completed upload id=746989worker1 # [ 199.665394] nix-grpc-daemon[1560]: time=2026-09-22T15:07:51.265Z level=INFO msg="Upload complete. (340ms)"6990lb # [ 199.702231] niks3-server[1145]: 2026/09/22 15:07:51 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo6991worker1 # [ 199.674559] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=0 paths=1 nar_bytes_in=7526992worker1 # [ 199.686982] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520366993worker1 # [ 199.692390] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6994worker1 # [ 199.696841] nix-daemon[833]: reaped child process 1977, status = succeeded6995worker1 # [ 199.707976] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)6996worker1 # [ 200.549543] nix-daemon[833]: reaped child process 1991, status = succeeded6997worker1 # [ 200.650076] nix-daemon[833]: accepted connection from pid 2007, user nix-grpc-daemon (trusted)6998worker1 # [ 200.671173] nix-daemon[833]: reaped child process 2010, status = succeeded6999lb # [ 200.709329] niks3-server[1145]: 2026/09/22 15:07:52 INFO Received uploads request method=POST path=/api/pending_closures7000worker1 # [ 200.687117] nix-grpc-daemon[1560]: time=2026-09-22T15:07:52.286Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7001worker1 # [ 200.688761] nix-grpc-daemon[1560]: time=2026-09-22T15:07:52.286Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"7002lb # [ 200.739621] niks3-server[1145]: 2026/09/22 15:07:52 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv7003lb # [ 200.759662] niks3-server[1145]: 2026/09/22 15:07:52 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst7004worker1 # [ 200.742977] nix-grpc-daemon[1560]: time=2026-09-22T15:07:52.343Z level=INFO msg="Uploading 1 narinfos"7005lb # [ 200.774383] niks3-server[1145]: 2026/09/22 15:07:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/75/sign7006lb # [ 200.784321] niks3-server[1145]: 2026/09/22 15:07:52 INFO Signed narinfos id=75 count=17007lb # [ 200.790290] niks3-server[1145]: 2026/09/22 15:07:52 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls7008lb # [ 200.799542] niks3-server[1145]: 2026/09/22 15:07:52 INFO Received complete upload request method=POST path=/api/pending_closures/75/complete7009lb # [ 200.810004] niks3-server[1145]: 2026/09/22 15:07:52 INFO Completed upload id=757010worker1 # [ 200.777231] nix-grpc-daemon[1560]: time=2026-09-22T15:07:52.377Z level=INFO msg="Upload complete. (259ms)"7011lb # [ 200.812564] niks3-server[1145]: 2026/09/22 15:07:52 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo7012worker1 # [ 200.793229] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=13 outputs=17013worker1 # [ 200.810986] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:52Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=17014worker1 # [ 200.816372] nix-daemon[833]: reaped child process 1989, status = succeeded7015worker1 # [ 200.833845] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520367016worker1 # [ 200.850749] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:520367017worker1 # [ 200.867586] nix-grpc-daemon[1560]: time=2026-09-22T15:07:52.467Z level=INFO msg="All 2 paths already cached"7018worker1 # [ 200.879200] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:520367019worker1 # [ 200.894287] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)7020worker1 # [ 201.056507] nix-daemon[833]: accepted connection from pid 2014, user nix-grpc-daemon (trusted)7021worker1 # [ 201.080373] nix-daemon[833]: reaped child process 2017, status = succeeded7022worker1 # [ 201.193566] nix-daemon[833]: accepted connection from pid 2019, user nix-grpc-daemon (trusted)7023worker1 # [ 201.216220] nix-daemon[833]: reaped child process 2022, status = succeeded7024lb # [ 201.251754] niks3-server[1145]: 2026/09/22 15:07:52 INFO Received uploads request method=POST path=/api/pending_closures7025worker1 # [ 201.229301] nix-grpc-daemon[1560]: time=2026-09-22T15:07:52.829Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7026worker1 # [ 201.230857] nix-grpc-daemon[1560]: time=2026-09-22T15:07:52.829Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"7027lb # [ 201.286287] niks3-server[1145]: 2026/09/22 15:07:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/76/sign7028worker1 # [ 201.261253] nix-grpc-daemon[1560]: time=2026-09-22T15:07:52.861Z level=INFO msg="Uploading 1 narinfos"7029lb # [ 201.300582] niks3-server[1145]: 2026/09/22 15:07:52 INFO Signed narinfos id=76 count=17030lb # [ 201.303608] niks3-server[1145]: 2026/09/22 15:07:52 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst7031lb # [ 201.322168] niks3-server[1145]: 2026/09/22 15:07:52 INFO Received complete upload request method=POST path=/api/pending_closures/76/complete7032lb # [ 201.329198] niks3-server[1145]: 2026/09/22 15:07:52 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls7033lb # [ 201.333252] niks3-server[1145]: 2026/09/22 15:07:52 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo7034worker1 # [ 201.301052] nix-grpc-daemon[1560]: time=2026-09-22T15:07:52.901Z level=INFO msg="Upload complete. (390ms)"7035lb # [ 201.336666] niks3-server[1145]: 2026/09/22 15:07:52 INFO Completed upload id=767036worker1 # [ 201.311439] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=0 paths=1 nar_bytes_in=7527037worker1 # [ 201.326853] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520367038worker1 # [ 201.333269] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)7039worker1 # [ 201.338618] nix-daemon[833]: reaped child process 2012, status = succeeded7040worker1 # [ 201.350176] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)7041worker1 # [ 202.195230] nix-daemon[833]: reaped child process 2026, status = succeeded7042worker1 # [ 202.285175] nix-daemon[833]: accepted connection from pid 2042, user nix-grpc-daemon (trusted)7043worker1 # [ 202.303247] nix-daemon[833]: reaped child process 2045, status = succeeded7044lb # [ 202.341672] niks3-server[1145]: 2026/09/22 15:07:53 INFO Received uploads request method=POST path=/api/pending_closures7045worker1 # [ 202.320376] nix-grpc-daemon[1560]: time=2026-09-22T15:07:53.919Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7046worker1 # [ 202.321842] nix-grpc-daemon[1560]: time=2026-09-22T15:07:53.919Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"7047lb # [ 202.382899] niks3-server[1145]: 2026/09/22 15:07:53 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv7048lb # [ 202.395531] niks3-server[1145]: 2026/09/22 15:07:54 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst7049worker1 # [ 202.379582] nix-grpc-daemon[1560]: time=2026-09-22T15:07:53.979Z level=INFO msg="Uploading 1 narinfos"7050lb # [ 202.411718] niks3-server[1145]: 2026/09/22 15:07:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/77/sign7051lb # [ 202.419462] niks3-server[1145]: 2026/09/22 15:07:54 INFO Signed narinfos id=77 count=17052lb # [ 202.423645] niks3-server[1145]: 2026/09/22 15:07:54 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls7053lb # [ 202.430549] niks3-server[1145]: 2026/09/22 15:07:54 INFO Received complete upload request method=POST path=/api/pending_closures/77/complete7054lb # [ 202.437302] niks3-server[1145]: 2026/09/22 15:07:54 INFO Completed upload id=777055worker1 # [ 202.405051] nix-grpc-daemon[1560]: time=2026-09-22T15:07:54.005Z level=INFO msg="Upload complete. (243ms)"7056lb # [ 202.441156] niks3-server[1145]: 2026/09/22 15:07:54 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo7057worker1 # [ 202.417983] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=14 outputs=17058worker1 # [ 202.437257] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:54Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=17059worker1 # [ 202.442076] nix-daemon[833]: reaped child process 2024, status = succeeded7060worker1 # [ 202.460620] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520367061worker1 # [ 202.475611] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:520367062worker1 # [ 202.490378] nix-grpc-daemon[1560]: time=2026-09-22T15:07:54.090Z level=INFO msg="All 2 paths already cached"7063worker1 # [ 202.500280] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:520367064worker1 # [ 202.513865] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)7065worker1 # [ 202.674075] nix-daemon[833]: accepted connection from pid 2049, user nix-grpc-daemon (trusted)7066worker1 # [ 202.691683] nix-daemon[833]: reaped child process 2052, status = succeeded7067worker1 # [ 202.793682] nix-daemon[833]: accepted connection from pid 2054, user nix-grpc-daemon (trusted)7068worker1 # [ 202.811530] nix-daemon[833]: reaped child process 2057, status = succeeded7069lb # [ 202.844397] niks3-server[1145]: 2026/09/22 15:07:54 INFO Received uploads request method=POST path=/api/pending_closures7070worker1 # [ 202.821919] nix-grpc-daemon[1560]: time=2026-09-22T15:07:54.422Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7071worker1 # [ 202.823371] nix-grpc-daemon[1560]: time=2026-09-22T15:07:54.422Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"7072lb # [ 202.871169] niks3-server[1145]: 2026/09/22 15:07:54 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst7073worker1 # [ 202.852094] nix-grpc-daemon[1560]: time=2026-09-22T15:07:54.452Z level=INFO msg="Uploading 1 narinfos"7074lb # [ 202.884947] niks3-server[1145]: 2026/09/22 15:07:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/78/sign7075lb # [ 202.897243] niks3-server[1145]: 2026/09/22 15:07:54 INFO Signed narinfos id=78 count=17076lb # [ 202.899975] niks3-server[1145]: 2026/09/22 15:07:54 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls7077worker1 # [ 202.883173] nix-grpc-daemon[1560]: time=2026-09-22T15:07:54.483Z level=INFO msg="Upload complete. (354ms)"7078lb # [ 202.915635] niks3-server[1145]: 2026/09/22 15:07:54 INFO Received complete upload request method=POST path=/api/pending_closures/78/complete7079worker1 # [ 202.890769] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=0 paths=1 nar_bytes_in=7527080lb # [ 202.924270] niks3-server[1145]: 2026/09/22 15:07:54 INFO Completed upload id=787081lb # [ 202.926920] niks3-server[1145]: 2026/09/22 15:07:54 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo7082worker1 # [ 202.902170] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:520367083worker1 # [ 202.907484] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)7084worker1 # [ 202.912401] nix-daemon[833]: reaped child process 2047, status = succeeded7085worker1 # [ 202.923863] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)7086worker1 # [ 204.197260] nix-daemon[833]: reaped child process 2061, status = succeeded7087worker1 # [ 204.314176] nix-daemon[833]: accepted connection from pid 2077, user nix-grpc-daemon (trusted)7088worker1 # [ 204.329438] nix-daemon[833]: reaped child process 2080, status = succeeded7089lb # [ 204.372201] niks3-server[1145]: 2026/09/22 15:07:55 INFO Received uploads request method=POST path=/api/pending_closures7090worker1 # [ 204.350209] nix-grpc-daemon[1560]: time=2026-09-22T15:07:55.948Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7091worker1 # [ 204.352544] nix-grpc-daemon[1560]: time=2026-09-22T15:07:55.948Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"7092lb # [ 204.409306] niks3-server[1145]: 2026/09/22 15:07:56 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst7093lb # [ 204.423369] niks3-server[1145]: 2026/09/22 15:07:56 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv7094worker1 # [ 204.404746] nix-grpc-daemon[1560]: time=2026-09-22T15:07:56.004Z level=INFO msg="Uploading 1 narinfos"7095lb # [ 204.436318] niks3-server[1145]: 2026/09/22 15:07:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/79/sign7096lb # [ 204.444187] niks3-server[1145]: 2026/09/22 15:07:56 INFO Signed narinfos id=79 count=17097lb # [ 204.447212] niks3-server[1145]: 2026/09/22 15:07:56 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls7098lb # [ 204.462784] niks3-server[1145]: 2026/09/22 15:07:56 INFO Received complete upload request method=POST path=/api/pending_closures/79/complete7099lb # [ 204.469799] niks3-server[1145]: 2026/09/22 15:07:56 INFO Completed upload id=797100worker1 # [ 204.437245] nix-grpc-daemon[1560]: time=2026-09-22T15:07:56.037Z level=INFO msg="Upload complete. (303ms)"7101lb # [ 204.473079] niks3-server[1145]: 2026/09/22 15:07:56 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo7102worker1 # [ 204.453216] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=15 outputs=17103worker1 # [ 204.470097] nix-daemon[833]: reaped child process 2059, status = succeeded7104client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 17.73 seconds)7105worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics7106worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)7107client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag f5 --arg features '["gpu"]'7108client # [ 204.648838] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag f5 --arg features "[\"gpu\"]".7109client # Running as unit: gpu.service; invocation ID: e34eb5c3047343ec8dca46b1ba77d9a77110client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.09 seconds)7111lb: must succeed: curl -sf localhost:9901/clusters7112lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)7113lb: must succeed: curl -sf localhost:9901/clusters7114lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)7115worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics7116client # [ 204.858862] nix[1592]: don't know how to build these paths:7117client # [ 204.859982] nix[1592]: /nix/store/3i1nziwpdqq19lzpqy4rywzxnm8dlps6-farm-top.drv7118worker2 # [ 204.948371] nix-grpc-daemon[2124]: ts=2026-09-22T15:07:56Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:521207119worker1 # [ 204.860184] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:520367120worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)7121worker1 # [ 204.880099] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:56Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=07122client # [ 204.890236] nix[1592]: warning: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,gccarch-armv8-a,kvm,nixos-test,vip}, waiting up to 30s for a worker7123lb: must succeed: curl -sf localhost:9901/clusters7124lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)7125lb: must succeed: curl -sf localhost:9901/clusters7126lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)7127worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics7128worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)7129client: waiting for success: systemctl show -p Result gpu | grep -q exit-code7130lb # [ 208.057416] envoy[895]: conn peer=[2001:db8:1::1]:58108 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27127 tx=12427 ms=174607131client # [ 234.895544] nix[1592]: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,gccarch-armv8-a,kvm,nixos-test,vip}7132client # [ 234.902175] nix[1592]: error: dependency '1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv' failed7133client # [ 234.925342] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE7134client # [ 234.927383] systemd[1]: gpu.service: Failed with result 'exit-code'.7135client # [ 234.930789] systemd[1]: gpu.service: Consumed 187ms CPU time over 30.276s wall clock time, 35.4M memory peak, 5.2K incoming IP traffic, 5K outgoing IP traffic.7136client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.09 seconds)7137client: must succeed: journalctl -u gpu -o cat7138client: (finished: must succeed: journalctl -u gpu -o cat, in 0.03 seconds)7139lb: must succeed: curl -sf localhost:9901/clusters7140lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)7141lb: must succeed: curl -sf localhost:9901/clusters7142lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)7143worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics7144worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)7145(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 48.57 seconds)7146subtest: low disk drains a worker and builds go to the other7147worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill7148worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.25 seconds)7149worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'7150worker1 # [ 237.159688] nix-grpc-daemon[1464]: ts=2026-09-22T15:08:28Z level=info event=unhealthy reason=min_free7151worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.11 seconds)7152client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain >&27153client # don't know how to build these paths:7154client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv7155worker1 # [ 237.934059] nix-grpc-daemon[1464]: ts=2026-09-22T15:08:29Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:520367156worker2 # [ 238.035116] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:521207157worker1 # [ 237.969192] nix-grpc-daemon[1464]: ts=2026-09-22T15:08:29Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=07158worker1 # [ 237.975025] nix-grpc-daemon[1464]: ts=2026-09-22T15:08:29Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=17159worker2 # [ 238.111159] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:521207160lb # [ 238.059340] envoy[895]: conn peer=[2001:db8:1::1]:33902 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=579 ms=300637161worker2 # [ 238.132477] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:521207162client # copying 1 paths to 'lb:50051'...7163client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...7164worker2 # [ 238.148440] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:521207165worker2 # [ 238.163867] nix-daemon[857]: accepted connection from pid 2124, user nix-grpc-daemon (trusted)7166worker2 # [ 238.193219] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:29Z level=info event=niks3_push_started pid=21847167worker2 # [ 238.345255] nix-grpc-daemon[2184]: time=2026-09-22T15:08:29.964Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca=""7168worker2 # [ 238.455628] nix-daemon[857]: accepted connection from pid 2197, user nix-grpc-daemon (trusted)7169worker2 # [ 238.474991] nix-daemon[857]: reaped child process 2200, status = succeeded7170worker2 # [ 238.582237] nix-daemon[857]: accepted connection from pid 2202, user nix-grpc-daemon (trusted)7171worker2 # [ 238.603219] nix-daemon[857]: reaped child process 2205, status = succeeded7172lb # [ 238.541907] niks3-server[1145]: 2026/09/22 15:08:30 INFO Received uploads request method=POST path=/api/pending_closures7173worker2 # [ 238.614572] nix-grpc-daemon[2184]: time=2026-09-22T15:08:30.234Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7174worker2 # [ 238.617808] nix-grpc-daemon[2184]: time=2026-09-22T15:08:30.234Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"7175lb # [ 238.579088] niks3-server[1145]: 2026/09/22 15:08:30 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst7176worker2 # [ 238.661995] nix-grpc-daemon[2184]: time=2026-09-22T15:08:30.281Z level=INFO msg="Uploading 1 narinfos"7177lb # [ 238.592979] niks3-server[1145]: 2026/09/22 15:08:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/80/sign7178lb # [ 238.606931] niks3-server[1145]: 2026/09/22 15:08:30 INFO Signed narinfos id=80 count=17179lb # [ 238.614531] niks3-server[1145]: 2026/09/22 15:08:30 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls7180lb # [ 238.628551] niks3-server[1145]: 2026/09/22 15:08:30 INFO Received complete upload request method=POST path=/api/pending_closures/80/complete7181worker2 # [ 238.700340] nix-grpc-daemon[2184]: time=2026-09-22T15:08:30.319Z level=INFO msg="Upload complete. (351ms)"7182lb # [ 238.638646] niks3-server[1145]: 2026/09/22 15:08:30 INFO Completed upload id=807183lb # [ 238.641915] niks3-server[1145]: 2026/09/22 15:08:30 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo7184worker2 # [ 238.708152] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52120 duration_s=0 paths=1 nar_bytes_in=5127185worker2 # [ 238.724367] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:521207186worker2 # [ 238.731448] nix-daemon[857]: accepted connection from pid 2124, user nix-grpc-daemon (trusted)7187worker2 # [ 238.736968] nix-daemon[857]: reaped child process 2182, status = succeeded7188client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...7189worker2 # [ 238.749649] nix-daemon[857]: accepted connection from pid 2124, user nix-grpc-daemon (trusted)7190client # farm-a> worker2-next: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv7191client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds7192client # farm-a> LOG-farm-a-drain7193worker2 # [ 239.439607] nix-daemon[857]: reaped child process 2209, status = succeeded7194worker2 # [ 239.519378] nix-daemon[857]: accepted connection from pid 2225, user nix-grpc-daemon (trusted)7195worker2 # [ 239.541247] nix-daemon[857]: reaped child process 2228, status = succeeded7196lb # [ 239.483652] niks3-server[1145]: 2026/09/22 15:08:31 INFO Received uploads request method=POST path=/api/pending_closures7197worker2 # [ 239.556426] nix-grpc-daemon[2184]: time=2026-09-22T15:08:31.174Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7198worker2 # [ 239.561445] nix-grpc-daemon[2184]: time=2026-09-22T15:08:31.175Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"7199lb # [ 239.528110] niks3-server[1145]: 2026/09/22 15:08:31 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv7200lb # [ 239.543874] niks3-server[1145]: 2026/09/22 15:08:31 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst7201worker2 # [ 239.622390] nix-grpc-daemon[2184]: time=2026-09-22T15:08:31.240Z level=INFO msg="Uploading 1 narinfos"7202lb # [ 239.559631] niks3-server[1145]: 2026/09/22 15:08:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/81/sign7203lb # [ 239.571511] niks3-server[1145]: 2026/09/22 15:08:31 INFO Signed narinfos id=81 count=17204lb # [ 239.578808] niks3-server[1145]: 2026/09/22 15:08:31 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls7205lb # [ 239.586559] niks3-server[1145]: 2026/09/22 15:08:31 INFO Received complete upload request method=POST path=/api/pending_closures/81/complete7206lb # [ 239.595371] niks3-server[1145]: 2026/09/22 15:08:31 INFO Completed upload id=817207lb # [ 239.599518] niks3-server[1145]: 2026/09/22 15:08:31 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo7208worker2 # [ 239.657072] nix-grpc-daemon[2184]: time=2026-09-22T15:08:31.275Z level=INFO msg="Upload complete. (296ms)"7209worker1 # [ 239.583275] nix-grpc-daemon[1464]: ts=2026-09-22T15:08:31Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=07210worker1 # [ 239.589501] nix-grpc-daemon[1464]: ts=2026-09-22T15:08:31Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=17211worker2 # [ 239.669615] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52120 duration_s=0 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=16 outputs=17212worker2 # [ 239.691721] nix-daemon[857]: reaped child process 2207, status = succeeded7213worker2 # [ 239.722803] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:521207214worker2 # [ 239.737931] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:521207215worker2 # [ 239.752147] nix-grpc-daemon[2184]: time=2026-09-22T15:08:31.371Z level=INFO msg="All 1 paths already cached"7216client # copying 1 paths to 'lb:50051'...7217client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...7218worker2 # [ 239.763227] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:521207219worker2 # [ 239.777419] nix-daemon[857]: accepted connection from pid 2124, user nix-grpc-daemon (trusted)7220worker2 # [ 239.928213] nix-daemon[857]: accepted connection from pid 2232, user nix-grpc-daemon (trusted)7221worker2 # [ 239.948894] nix-daemon[857]: reaped child process 2235, status = succeeded7222worker2 # [ 240.050734] nix-daemon[857]: accepted connection from pid 2237, user nix-grpc-daemon (trusted)7223worker2 # [ 240.069371] nix-daemon[857]: reaped child process 2240, status = succeeded7224lb # [ 240.016759] niks3-server[1145]: 2026/09/22 15:08:31 INFO Received uploads request method=POST path=/api/pending_closures7225worker2 # [ 240.088222] nix-grpc-daemon[2184]: time=2026-09-22T15:08:31.707Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7226worker2 # [ 240.089733] nix-grpc-daemon[2184]: time=2026-09-22T15:08:31.707Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"7227lb # [ 240.061773] niks3-server[1145]: 2026/09/22 15:08:31 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst7228worker2 # [ 240.133091] nix-grpc-daemon[2184]: time=2026-09-22T15:08:31.752Z level=INFO msg="Uploading 1 narinfos"7229lb # [ 240.074895] niks3-server[1145]: 2026/09/22 15:08:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/82/sign7230lb # [ 240.082059] niks3-server[1145]: 2026/09/22 15:08:31 INFO Signed narinfos id=82 count=17231lb # [ 240.086501] niks3-server[1145]: 2026/09/22 15:08:31 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls7232lb # [ 240.095998] niks3-server[1145]: 2026/09/22 15:08:31 INFO Received complete upload request method=POST path=/api/pending_closures/82/complete7233lb # [ 240.101974] niks3-server[1145]: 2026/09/22 15:08:31 INFO Completed upload id=827234worker2 # [ 240.163020] nix-grpc-daemon[2184]: time=2026-09-22T15:08:31.782Z level=INFO msg="Upload complete. (368ms)"7235lb # [ 240.104574] niks3-server[1145]: 2026/09/22 15:08:31 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo7236worker2 # [ 240.172341] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52120 duration_s=0 paths=1 nar_bytes_in=6327237worker2 # [ 240.191540] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:521207238worker2 # [ 240.198174] nix-daemon[857]: accepted connection from pid 2124, user nix-grpc-daemon (trusted)7239worker2 # [ 240.204180] nix-daemon[857]: reaped child process 2230, status = succeeded7240client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...7241worker2 # [ 240.216470] nix-daemon[857]: accepted connection from pid 2124, user nix-grpc-daemon (trusted)7242client # farm-b> worker2-next: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv7243client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds7244client # farm-b> LOG-farm-b-drain7245worker2 # [ 241.681142] nix-daemon[857]: reaped child process 2244, status = succeeded7246worker2 # [ 241.800055] nix-daemon[857]: accepted connection from pid 2260, user nix-grpc-daemon (trusted)7247worker2 # [ 241.822981] nix-daemon[857]: reaped child process 2263, status = succeeded7248lb # [ 241.759804] niks3-server[1145]: 2026/09/22 15:08:33 INFO Received uploads request method=POST path=/api/pending_closures7249worker2 # [ 241.836404] nix-grpc-daemon[2184]: time=2026-09-22T15:08:33.455Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7250worker2 # [ 241.838019] nix-grpc-daemon[2184]: time=2026-09-22T15:08:33.455Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"7251lb # [ 241.805244] niks3-server[1145]: 2026/09/22 15:08:33 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst7252lb # [ 241.816855] niks3-server[1145]: 2026/09/22 15:08:33 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv7253worker2 # [ 241.889051] nix-grpc-daemon[2184]: time=2026-09-22T15:08:33.508Z level=INFO msg="Uploading 1 narinfos"7254lb # [ 241.828956] niks3-server[1145]: 2026/09/22 15:08:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/83/sign7255lb # [ 241.836248] niks3-server[1145]: 2026/09/22 15:08:33 INFO Signed narinfos id=83 count=17256lb # [ 241.841518] niks3-server[1145]: 2026/09/22 15:08:33 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls7257lb # [ 241.855766] niks3-server[1145]: 2026/09/22 15:08:33 INFO Received complete upload request method=POST path=/api/pending_closures/83/complete7258lb # [ 241.865533] niks3-server[1145]: 2026/09/22 15:08:33 INFO Completed upload id=837259worker2 # [ 241.927262] nix-grpc-daemon[2184]: time=2026-09-22T15:08:33.546Z level=INFO msg="Upload complete. (300ms)"7260lb # [ 241.870674] niks3-server[1145]: 2026/09/22 15:08:33 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo7261worker2 # [ 241.941352] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52120 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=17 outputs=17262worker1 # [ 241.855917] nix-grpc-daemon[1464]: ts=2026-09-22T15:08:33Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=07263worker1 # [ 241.861984] nix-grpc-daemon[1464]: ts=2026-09-22T15:08:33Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=17264worker2 # [ 241.961443] nix-daemon[857]: reaped child process 2242, status = succeeded7265worker2 # [ 241.994564] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:521207266worker2 # [ 242.008158] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:521207267worker2 # [ 242.020853] nix-grpc-daemon[2184]: time=2026-09-22T15:08:33.640Z level=INFO msg="All 2 paths already cached"7268client # copying 1 paths to 'lb:50051'...7269client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...7270worker2 # [ 242.031439] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:521207271worker2 # [ 242.045569] nix-daemon[857]: accepted connection from pid 2124, user nix-grpc-daemon (trusted)7272worker2 # [ 242.201747] nix-daemon[857]: accepted connection from pid 2267, user nix-grpc-daemon (trusted)7273worker2 # [ 242.220145] nix-daemon[857]: reaped child process 2270, status = succeeded7274worker2 # [ 242.322628] nix-daemon[857]: accepted connection from pid 2272, user nix-grpc-daemon (trusted)7275worker2 # [ 242.340242] nix-daemon[857]: reaped child process 2275, status = succeeded7276lb # [ 242.282614] niks3-server[1145]: 2026/09/22 15:08:33 INFO Received uploads request method=POST path=/api/pending_closures7277worker2 # [ 242.353787] nix-grpc-daemon[2184]: time=2026-09-22T15:08:33.973Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7278worker2 # [ 242.355236] nix-grpc-daemon[2184]: time=2026-09-22T15:08:33.973Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"7279lb # [ 242.309897] niks3-server[1145]: 2026/09/22 15:08:33 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst7280lb # [ 242.326019] niks3-server[1145]: 2026/09/22 15:08:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/84/sign7281worker2 # [ 242.394060] nix-grpc-daemon[2184]: time=2026-09-22T15:08:34.013Z level=INFO msg="Uploading 1 narinfos"7282lb # [ 242.338006] niks3-server[1145]: 2026/09/22 15:08:33 INFO Signed narinfos id=84 count=17283lb # [ 242.345551] niks3-server[1145]: 2026/09/22 15:08:33 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls7284worker2 # [ 242.420301] nix-grpc-daemon[2184]: time=2026-09-22T15:08:34.040Z level=INFO msg="Upload complete. (358ms)"7285lb # [ 242.359390] niks3-server[1145]: 2026/09/22 15:08:33 INFO Received complete upload request method=POST path=/api/pending_closures/84/complete7286lb # [ 242.370241] niks3-server[1145]: 2026/09/22 15:08:33 INFO Completed upload id=847287worker2 # [ 242.428148] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52120 duration_s=0 paths=1 nar_bytes_in=7607288lb # [ 242.374073] niks3-server[1145]: 2026/09/22 15:08:33 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo7289worker2 # [ 242.441032] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:521207290worker2 # [ 242.446843] nix-daemon[857]: accepted connection from pid 2124, user nix-grpc-daemon (trusted)7291worker2 # [ 242.452496] nix-daemon[857]: reaped child process 2265, status = succeeded7292client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...7293worker2 # [ 242.464437] nix-daemon[857]: accepted connection from pid 2124, user nix-grpc-daemon (trusted)7294client # farm-top> worker2-next: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv7295client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds7296client # farm-top> LOG-farm-top-drain7297worker2 # [ 243.726612] nix-daemon[857]: reaped child process 2279, status = succeeded7298worker2 # [ 243.850030] nix-daemon[857]: accepted connection from pid 2295, user nix-grpc-daemon (trusted)7299worker2 # [ 243.870221] nix-daemon[857]: reaped child process 2298, status = succeeded7300lb # [ 243.815989] niks3-server[1145]: 2026/09/22 15:08:35 INFO Received uploads request method=POST path=/api/pending_closures7301worker2 # [ 243.887806] nix-grpc-daemon[2184]: time=2026-09-22T15:08:35.505Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7302worker2 # [ 243.889935] nix-grpc-daemon[2184]: time=2026-09-22T15:08:35.505Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"7303lb # [ 243.851090] niks3-server[1145]: 2026/09/22 15:08:35 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst7304worker2 # [ 243.937611] nix-grpc-daemon[2184]: time=2026-09-22T15:08:35.556Z level=INFO msg="Uploading 1 narinfos"7305lb # [ 243.868580] niks3-server[1145]: 2026/09/22 15:08:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/85/sign7306lb # [ 243.882346] niks3-server[1145]: 2026/09/22 15:08:35 INFO Signed narinfos id=85 count=17307lb # [ 243.889963] niks3-server[1145]: 2026/09/22 15:08:35 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv7308lb # [ 243.901918] niks3-server[1145]: 2026/09/22 15:08:35 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls7309worker2 # [ 243.969585] nix-grpc-daemon[2184]: time=2026-09-22T15:08:35.589Z level=INFO msg="Upload complete. (295ms)"7310lb # [ 243.908289] niks3-server[1145]: 2026/09/22 15:08:35 INFO Received complete upload request method=POST path=/api/pending_closures/85/complete7311lb # [ 243.912464] niks3-server[1145]: 2026/09/22 15:08:35 INFO Completed upload id=857312lb # [ 243.915806] niks3-server[1145]: 2026/09/22 15:08:35 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo7313worker2 # [ 243.981168] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52120 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=18 outputs=17314worker2 # [ 244.000301] nix-daemon[857]: reaped child process 2277, status = succeeded7315client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain >&2, in 6.22 seconds)7316client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain outPath7317client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain outPath, in 0.18 seconds)7318worker1: must succeed: rm /nix/.rw-store/fill7319worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.16 seconds)7320worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'7321worker1 # [ 245.163452] nix-grpc-daemon[1464]: ts=2026-09-22T15:08:36Z level=info event=healthy reason=min_free7322worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.10 seconds)7323(finished: subtest: low disk drains a worker and builds go to the other, in 10.10 seconds)7324(finished: run the VM test script, in 246.40 seconds)7325test script finished in 246.66s7326cleanup7327kill QemuMachine (pid 49)7328client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14)7329client # [2026-09-22T15:08:37Z INFO virtiofsd] Client disconnected, shutting down7330client # [2026-09-22T15:08:37Z INFO virtiofsd] Client disconnected, shutting down7331client # [2026-09-22T15:08:37Z INFO virtiofsd] Client disconnected, shutting down7332kill QemuMachine (pid 50)7333lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14)7334lb # [2026-09-22T15:08:38Z INFO virtiofsd] Client disconnected, shutting down7335lb # [2026-09-22T15:08:38Z INFO virtiofsd] Client disconnected, shutting down7336lb # [2026-09-22T15:08:38Z INFO virtiofsd] Client disconnected, shutting down7337kill QemuMachine (pid 52)7338worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14)7339worker1 # [2026-09-22T15:08:38Z INFO virtiofsd] Client disconnected, shutting down7340worker1 # [2026-09-22T15:08:38Z INFO virtiofsd] Client disconnected, shutting down7341worker1 # [2026-09-22T15:08:38Z INFO virtiofsd] Client disconnected, shutting down7342kill QemuMachine (pid 51)7343worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14)7344worker2 # [2026-09-22T15:08:38Z INFO virtiofsd] Client disconnected, shutting down7345worker2 # [2026-09-22T15:08:38Z INFO virtiofsd] Client disconnected, shutting down7346worker2 # [2026-09-22T15:08:38Z INFO virtiofsd] Client disconnected, shutting down7347(finished: cleanup, in 1.45 seconds)7348additionally exposed symbols:7349 client, lb, worker1, worker2,7350 vlan1,7351 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh