vm-test-run-nix-grpc-farm
checks.aarch64-linux.farm
· build #500
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker2 # Disk image does not exist, creating the virtualisation disk image...13worker2 # Formatting '/build/vm-state-worker2/tmp.EzLr4OJmUC', fmt=raw size=107374182414worker2 # mke2fs 1.47.4 (6-Mar-2025)15worker2: QEMU running (pid 52)16worker1 # Disk image does not exist, creating the virtualisation disk image...17worker2 # Discarding device blocks: 0/262144 done18lb # Disk image does not exist, creating the virtualisation disk image...19client: QEMU running (pid 49)20client # Disk image does not exist, creating the virtualisation disk image...21worker1: QEMU running (pid 50)22lb: QEMU running (pid 51)23worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes24lb # Formatting '/build/vm-state-lb/tmp.hhLYFHjuyK', fmt=raw size=107374182425client # Formatting '/build/vm-state-client/tmp.7wLKAHO3I5', fmt=raw size=107374182426worker1 # Formatting '/build/vm-state-worker1/tmp.h3ycF7eFuv', fmt=raw size=107374182427worker2 # Filesystem UUID: 5009ca46-ef03-4a4f-be7f-ab9ba76160e428lb # mke2fs 1.47.4 (6-Mar-2025)29worker1 # mke2fs 1.47.4 (6-Mar-2025)30worker2 # Superblock backups stored on blocks:31lb # Discarding device blocks: 0/262144 done32worker1 # Discarding device blocks: 0/262144 done33worker2 # 32768, 98304, 163840, 22937634lb # Creating filesystem with 262144 4k blocks and 65536 inodes35worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes36worker2 # 37lb # Filesystem UUID: 54a7df79-8ec8-4b88-95ec-e8f1c3e8196438worker1 # Filesystem UUID: 4da37615-95fd-4986-9ecb-1fab9abc373a39worker2 # Allocating group tables: 0/8 done40lb # Superblock backups stored on blocks:41worker1 # Superblock backups stored on blocks:42worker2 # Writing inode tables: 0/8 done43lb # 32768, 98304, 163840, 22937644worker1 # 32768, 98304, 163840, 22937645worker2 # Creating journal (8192 blocks): done46lb # 47worker1 # 48worker2 # Writing superblocks and filesystem accounting information: 0/8 done49lb # Allocating group tables: 0/8 done50worker1 # Allocating group tables: 0/8 done51worker2 # 52lb # Writing inode tables: 0/8 done53worker1 # Writing inode tables: 0/8 done54worker2 # Virtualisation disk image created.55lb # Creating journal (8192 blocks): done56worker1 # Creating journal (8192 blocks): done57worker2 # Starting virtiofs daemons...58lb # Writing superblocks and filesystem accounting information: 0/8 done59worker1 # Writing superblocks and filesystem accounting information: 0/8 done60worker2 # [2026-09-22T14:50:43Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)61lb # 62worker1 # 63worker2 # [2026-09-22T14:50:43Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether64lb # Virtualisation disk image created.65worker1 # Virtualisation disk image created.66worker2 # [2026-09-22T14:50:43Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)67lb # Starting virtiofs daemons...68worker1 # Starting virtiofs daemons...69worker2 # [2026-09-22T14:50:43Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether70lb # [2026-09-22T14:50:43Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)71worker1 # [2026-09-22T14:50:43Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)72worker2 # [2026-09-22T14:50:43Z INFO virtiofsd] Waiting for vhost-user socket connection...73lb # [2026-09-22T14:50:43Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether74worker1 # [2026-09-22T14:50:43Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether75worker2 # [2026-09-22T14:50:43Z INFO virtiofsd] Waiting for vhost-user socket connection...76lb # [2026-09-22T14:50:43Z INFO virtiofsd] Waiting for vhost-user socket connection...77worker1 # [2026-09-22T14:50:43Z INFO virtiofsd] Waiting for vhost-user socket connection...78worker2 # [2026-09-22T14:50:43Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)79lb # [2026-09-22T14:50:43Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)80worker1 # [2026-09-22T14:50:43Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)81worker2 # [2026-09-22T14:50:43Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether82lb # [2026-09-22T14:50:43Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether83worker1 # [2026-09-22T14:50:43Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether84worker2 # [2026-09-22T14:50:43Z INFO virtiofsd] Waiting for vhost-user socket connection...85lb # [2026-09-22T14:50:43Z INFO virtiofsd] Waiting for vhost-user socket connection...86worker1 # [2026-09-22T14:50:43Z INFO virtiofsd] Waiting for vhost-user socket connection...87worker2 # [2026-09-22T14:50:43Z INFO virtiofsd] Client connected, servicing requests88lb # [2026-09-22T14:50:43Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)89worker1 # [2026-09-22T14:50:43Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)90worker2 # [2026-09-22T14:50:43Z INFO virtiofsd] Client connected, servicing requests91lb # [2026-09-22T14:50:43Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether92worker1 # [2026-09-22T14:50:43Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether93worker2 # [2026-09-22T14:50:43Z INFO virtiofsd] Client connected, servicing requests94lb # [2026-09-22T14:50:43Z INFO virtiofsd] Waiting for vhost-user socket connection...95worker1 # [2026-09-22T14:50:43Z INFO virtiofsd] Waiting for vhost-user socket connection...96client # mke2fs 1.47.4 (6-Mar-2025)97lb # [2026-09-22T14:50:43Z INFO virtiofsd] Client connected, servicing requests98worker1 # [2026-09-22T14:50:43Z INFO virtiofsd] Client connected, servicing requests99(finished: start all VMs, in 0.60 seconds)100worker1 # [2026-09-22T14:50:43Z INFO virtiofsd] Client connected, servicing requests101client: waiting for unit network-addresses-eth1.service102lb # [2026-09-22T14:50:43Z INFO virtiofsd] Client connected, servicing requests103client # Discarding device blocks: 0/262144 done104worker1 # [2026-09-22T14:50:43Z INFO virtiofsd] Client connected, servicing requests105client: waiting for the VM to finish booting106lb # [2026-09-22T14:50:43Z INFO virtiofsd] Client connected, servicing requests107client # Creating filesystem with 262144 4k blocks and 65536 inodes108client # Filesystem UUID: 42475ddb-4856-4c13-88b2-a776ef152770109client # Superblock backups stored on blocks:110client # 32768, 98304, 163840, 229376111client # 112client # Allocating group tables: 0/8 done113client # Writing inode tables: 0/8 done114client # Creating journal (8192 blocks): done115client # Writing superblocks and filesystem accounting information: 0/8 done116client # 117client # Virtualisation disk image created.118client # Starting virtiofs daemons...119client # [2026-09-22T14:50:43Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)120client # [2026-09-22T14:50:43Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether121client # [2026-09-22T14:50:43Z INFO virtiofsd] Waiting for vhost-user socket connection...122client # [2026-09-22T14:50:43Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)123client # [2026-09-22T14:50:43Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether124client # [2026-09-22T14:50:43Z INFO virtiofsd] Waiting for vhost-user socket connection...125client # [2026-09-22T14:50:43Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1)126client # [2026-09-22T14:50:43Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether127client # [2026-09-22T14:50:43Z INFO virtiofsd] Waiting for vhost-user socket connection...128client # [2026-09-22T14:50:43Z INFO virtiofsd] Client connected, servicing requests129client # [2026-09-22T14:50:43Z INFO virtiofsd] Client connected, servicing requests130client # [2026-09-22T14:50:43Z INFO virtiofsd] Client connected, servicing requests131worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]132worker2 # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026133worker2 # [ 0.000000] KASLR enabled134worker2 # [ 0.000000] random: crng init done135worker2 # [ 0.000000] Machine model: linux,dummy-virt136worker2 # [ 0.000000] efi: UEFI not found.137worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT138worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]139worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]140worker2 # [ 0.000000] Zone ranges:141worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]142worker2 # [ 0.000000] DMA32 empty143worker2 # [ 0.000000] Normal empty144worker2 # [ 0.000000] Device empty145worker2 # [ 0.000000] Movable zone start for each node146worker2 # [ 0.000000] Early memory node ranges147worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]148worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]149worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000150worker2 # [ 0.000000] psci: probing for conduit method from DT.151worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware.152worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs153worker2 # [ 0.000000] psci: Trusted OS migration not required154worker2 # [ 0.000000] psci: SMC Calling Convention v1.1155worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)156worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296157worker2 # [ 0.000000] Detected PIPT I-cache on CPU0158worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)159worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface160worker2 # [ 0.000000] CPU features: detected: Spectre-v4161worker2 # [ 0.000000] CPU features: detected: Spectre-BHB162worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38163worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23164worker2 # [ 0.000000] alternatives: applying boot alternatives165worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/fq96yig7qx9b0kmamr046lw4i5yrkcml-nixos-system-worker2-test/init regInfo=/nix/store/q5z0fmg8ggm2cpxd0h10z7763nzl22kp-closure-info/registration console=ttyAMA0,115200n8 console=tty0166worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/q5z0fmg8ggm2cpxd0h10z7763nzl22kp-closure-info/registration", will be passed to user space.167worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes168worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)169worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)170worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB171worker2 # [ 0.000000] software IO TLB: area num 1.172worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB173worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)174worker2 # [ 0.000000] Fallback order for Node 0: 0175worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216176worker2 # [ 0.000000] Policy zone: DMA177worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off178worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1179worker2 # [ 0.000000] allocated 3145728 bytes of page_ext180worker2 # [ 0.000000] ftrace: allocating 74950 entries in 294 pages181worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups182worker2 # [ 0.000000] rcu: Hierarchical RCU implementation.183worker2 # [ 0.000000] rcu: RCU event tracing is enabled.184worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.185worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled.186worker2 # [ 0.000000] Rude variant of Tasks RCU enabled.187worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled.188worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.189worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1190worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.191worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.192worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.193worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0194worker2 # [ 0.000000] GICv3: 256 SPIs implemented195worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented196worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq197worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI198worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0199worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000200worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]201worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)202worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)203worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000204worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000205worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.206worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns207worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).208worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns209worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns210worker2 # [ 0.000036] arm-pv: using stolen time PV211worker2 # [ 0.000698] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)212worker2 # [ 0.000898] Console: colour dummy device 80x25213worker2 # [ 0.000906] printk: legacy console [tty0] enabled214worker2 # [ 0.001098] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)215worker2 # [ 0.001105] pid_max: default: 32768 minimum: 301216worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]217worker2 # [ 0.001189] LSM: initializing lsm=capability,landlock,yama,bpf,ima218worker2 # [ 0.001400] landlock: Up and running.219worker1 # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026220worker2 # [ 0.001403] Yama: becoming mindful.221worker1 # [ 0.000000] KASLR enabled222worker2 # [ 0.002063] LSM support for eBPF active223worker1 # [ 0.000000] random: crng init done224worker1 # [ 0.000000] Machine model: linux,dummy-virt225worker2 # [ 0.002239] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)226worker1 # [ 0.000000] efi: UEFI not found.227worker2 # [ 0.002274] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)228worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT229worker2 # [ 0.004233] rcu: Hierarchical SRCU implementation.230worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]231worker2 # [ 0.004238] rcu: Max phase no-delay instances is 1000.232worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]233worker2 # [ 0.005565] fsl-mc MSI: its@8080000 domain created234worker1 # [ 0.000000] Zone ranges:235worker2 # [ 0.005661] EFI services will not be available.236worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]237worker2 # [ 0.005799] smp: Bringing up secondary CPUs ...238worker1 # [ 0.000000] DMA32 empty239worker2 # [ 0.005807] smp: Brought up 1 node, 1 CPU240worker1 # [ 0.000000] Normal empty241client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]242worker1 # [ 0.000000] Device empty243worker2 # [ 0.005811] SMP: Total of 1 processors activated.244worker1 # [ 0.000000] Movable zone start for each node245worker2 # [ 0.005817] CPU: All CPU(s) started at EL1246worker1 # [ 0.000000] Early memory node ranges247client # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026248worker2 # [ 0.005828] CPU features: detected: Branch Target Identification249client # [ 0.000000] KASLR enabled250worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]251client # [ 0.000000] random: crng init done252worker2 # [ 0.005832] CPU features: detected: ARMv8.4 Translation Table Level253worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]254client # [ 0.000000] Machine model: linux,dummy-virt255client # [ 0.000000] efi: UEFI not found.256worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000257worker2 # [ 0.005835] CPU features: detected: Instruction cache invalidation not required for I/D coherence258worker1 # [ 0.000000] psci: probing for conduit method from DT.259lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]260client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT261worker2 # [ 0.005839] CPU features: detected: Data cache clean to the PoU not required for I/D coherence262worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware.263client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]264worker2 # [ 0.005843] CPU features: detected: Common not Private translations265worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs266lb # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026267client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]268worker1 # [ 0.000000] psci: Trusted OS migration not required269worker2 # [ 0.005846] CPU features: detected: CRC32 instructions270lb # [ 0.000000] KASLR enabled271client # [ 0.000000] Zone ranges:272worker1 # [ 0.000000] psci: SMC Calling Convention v1.1273lb # [ 0.000000] random: crng init done274worker2 # [ 0.005849] CPU features: detected: Data cache clean to Point of Deep Persistence275client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]276lb # [ 0.000000] Machine model: linux,dummy-virt277client # [ 0.000000] DMA32 empty278worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)279lb # [ 0.000000] efi: UEFI not found.280client # [ 0.000000] Normal empty281worker2 # [ 0.005852] CPU features: detected: Data cache clean to Point of Persistence282client # [ 0.000000] Device empty283worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296284lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT285client # [ 0.000000] Movable zone start for each node286worker2 # [ 0.005855] CPU features: detected: Data independent timing control (DIT)287worker1 # [ 0.000000] Detected PIPT I-cache on CPU0288client # [ 0.000000] Early memory node ranges289worker2 # [ 0.005859] CPU features: detected: E0PD290lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff]291client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]292worker2 # [ 0.005861] CPU features: detected: Enhanced Counter Virtualization293worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)294lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f]295lb # [ 0.000000] Zone ranges:296client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]297worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface298worker2 # [ 0.005864] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)299lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff]300worker1 # [ 0.000000] CPU features: detected: Spectre-v4301client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000302lb # [ 0.000000] DMA32 empty303worker2 # [ 0.005868] CPU features: detected: Enhanced Virtualization Traps304worker1 # [ 0.000000] CPU features: detected: Spectre-BHB305client # [ 0.000000] psci: probing for conduit method from DT.306lb # [ 0.000000] Normal empty307worker2 # [ 0.005871] CPU features: detected: Fine Grained Traps308lb # [ 0.000000] Device empty309worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38310client # [ 0.000000] psci: PSCIv1.3 detected in firmware.311lb # [ 0.000000] Movable zone start for each node312client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs313worker2 # [ 0.005874] CPU features: detected: Generic authentication (architected QARMA5 algorithm)314lb # [ 0.000000] Early memory node ranges315worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23316client # [ 0.000000] psci: Trusted OS migration not required317worker1 # [ 0.000000] alternatives: applying boot alternatives318worker2 # [ 0.005879] CPU features: detected: RCpc load-acquire (LDAPR)319lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff]320client # [ 0.000000] psci: SMC Calling Convention v1.1321worker2 # [ 0.005882] CPU features: detected: LSE atomic instructions322lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff]323worker2 # [ 0.005885] CPU features: detected: Privileged Access Never324client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)325lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000326worker2 # [ 0.005888] CPU features: detected: PMUv3327client # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296328lb # [ 0.000000] psci: probing for conduit method from DT.329worker2 # [ 0.005891] CPU features: detected: RAS Extension Support330client # [ 0.000000] Detected PIPT I-cache on CPU0331lb # [ 0.000000] psci: PSCIv1.3 detected in firmware.332worker2 # [ 0.005894] CPU features: detected: RASv1p1 Extension Support333lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs334client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)335worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/bxr6j9ivlmns43c2wprw1ap8ri6zy4cy-nixos-system-worker1-test/init regInfo=/nix/store/yk09r4pllfnpp3p2b377174lbb0bdcwh-closure-info/registration console=ttyAMA0,115200n8 console=tty0336worker2 # [ 0.005897] CPU features: detected: Random Number Generator337lb # [ 0.000000] psci: Trusted OS migration not required338client # [ 0.000000] CPU features: detected: GICv3 CPU interface339lb # [ 0.000000] psci: SMC Calling Convention v1.1340worker2 # [ 0.005899] CPU features: detected: Speculation barrier (SB)341client # [ 0.000000] CPU features: detected: Spectre-v4342worker2 # [ 0.005902] CPU features: detected: Stage-2 Force Write-Back343worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/yk09r4pllfnpp3p2b377174lbb0bdcwh-closure-info/registration", will be passed to user space.344client # [ 0.000000] CPU features: detected: Spectre-BHB345lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)346worker2 # [ 0.005905] CPU features: detected: TLB range maintenance instructions347client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38348lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296349worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes350client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23351worker2 # [ 0.005910] CPU features: detected: Speculative Store Bypassing Safe (SSBS)352lb # [ 0.000000] Detected PIPT I-cache on CPU0353worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)354client # [ 0.000000] alternatives: applying boot alternatives355worker2 # [ 0.005957] alternatives: applying system-wide alternatives356lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)357worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)358worker2 # [ 0.009085] CPU features: detected: BBM Level 2 without TLB conflict abort359lb # [ 0.000000] CPU features: detected: GICv3 CPU interface360worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB361lb # [ 0.000000] CPU features: detected: Spectre-v4362worker1 # [ 0.000000] software IO TLB: area num 1.363lb # [ 0.000000] CPU features: detected: Spectre-BHB364worker2 # [ 0.009296] Memory: 1405648K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124632K reserved, 32768K cma-reserved)365worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB366lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38367worker2 # [ 0.009724] devtmpfs: initialized368lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23369client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/lspz9b2l80bjga3bjag9my08g82dwqc5-nixos-system-client-test/init regInfo=/nix/store/ygdja2gncrgjfdyhl3npr5sxj0p1m2yr-closure-info/registration console=ttyAMA0,115200n8 console=tty0370worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)371worker2 # [ 0.011677] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)372worker1 # [ 0.000000] Fallback order for Node 0: 0373lb # [ 0.000000] alternatives: applying boot alternatives374worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216375worker2 # [ 0.011700] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).376worker1 # [ 0.000000] Policy zone: DMA377worker2 # [ 0.011897] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL378worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off379client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/ygdja2gncrgjfdyhl3npr5sxj0p1m2yr-closure-info/registration", will be passed to user space.380worker2 # [ 0.011901] 0 pages in range for non-PLT usage381worker2 # [ 0.011902] 508272 pages in range for PLT usage382worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1383client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes384worker2 # [ 0.012002] pinctrl core: initialized pinctrl subsystem385worker1 # [ 0.000000] allocated 3145728 bytes of page_ext386lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/rwj7rgrjnik4yfrdy5nxpi16ig7dj0yx-nixos-system-lb-test/init regInfo=/nix/store/y0b8gyps1r0yyzfhbdbfwqvj69pgkv2z-closure-info/registration console=ttyAMA0,115200n8 console=tty0387worker2 # [ 0.012804] DMI not present or invalid.388client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)389worker1 # [ 0.000000] ftrace: allocating 74950 entries in 294 pages390worker2 # [ 0.016650] NET: Registered PF_NETLINK/PF_ROUTE protocol family391worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups392client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)393worker1 # [ 0.000000] rcu: Hierarchical RCU implementation.394worker2 # [ 0.019269] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations395client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB396worker1 # [ 0.000000] rcu: RCU event tracing is enabled.397client # [ 0.000000] software IO TLB: area num 1.398lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/y0b8gyps1r0yyzfhbdbfwqvj69pgkv2z-closure-info/registration", will be passed to user space.399worker2 # [ 0.019478] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations400worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.401client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB402lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes403worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled.404worker2 # [ 0.019691] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations405worker1 # [ 0.000000] Rude variant of Tasks RCU enabled.406client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)407worker2 # [ 0.019715] audit: initializing netlink subsys (disabled)408lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)409client # [ 0.000000] Fallback order for Node 0: 0410worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled.411worker2 # [ 0.020284] thermal_sys: Registered thermal governor 'fair_share'412lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)413client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216414worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.415client # [ 0.000000] Policy zone: DMA416worker2 # [ 0.020286] thermal_sys: Registered thermal governor 'bang_bang'417lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB418worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1419worker2 # [ 0.020290] thermal_sys: Registered thermal governor 'step_wise'420client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off421lb # [ 0.000000] software IO TLB: area num 1.422worker2 # [ 0.020292] thermal_sys: Registered thermal governor 'user_space'423lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB424client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1425worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.426client # [ 0.000000] allocated 3145728 bytes of page_ext427worker2 # [ 0.020298] thermal_sys: Registered thermal governor 'power_allocator'428lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB)429worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.430client # [ 0.000000] ftrace: allocating 74950 entries in 294 pages431lb # [ 0.000000] Fallback order for Node 0: 0432worker2 # [ 0.020324] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1433client # [ 0.000000] ftrace: allocated 294 pages with 4 groups434worker2 # [ 0.020333] cpuidle: using governor ladder435lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216436client # [ 0.000000] rcu: Hierarchical RCU implementation.437worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.438lb # [ 0.000000] Policy zone: DMA439worker2 # [ 0.020339] cpuidle: using governor menu440worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0441client # [ 0.000000] rcu: RCU event tracing is enabled.442worker1 # [ 0.000000] GICv3: 256 SPIs implemented443lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off444worker2 # [ 0.020542] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.445client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.446worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented447worker2 # [ 0.020558] ASID allocator initialised with 65536 entries448lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1449client # [ 0.000000] Trampoline variant of Tasks RCU enabled.450worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq451worker2 # [ 0.021932] Serial: AMBA PL011 UART driver452lb # [ 0.000000] allocated 3145728 bytes of page_ext453client # [ 0.000000] Rude variant of Tasks RCU enabled.454worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI455lb # [ 0.000000] ftrace: allocating 74950 entries in 294 pages456client # [ 0.000000] Tracing variant of Tasks RCU enabled.457worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0458worker2 # [ 0.027635] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1459lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups460worker2 # [ 0.027832] printk: console [ttyAMA0] enabled461client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.462worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000463lb # [ 0.000000] rcu: Hierarchical RCU implementation.464worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]465lb # [ 0.000000] rcu: RCU event tracing is enabled.466client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1467lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.468worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)469client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.470lb # [ 0.000000] Trampoline variant of Tasks RCU enabled.471lb # [ 0.000000] Rude variant of Tasks RCU enabled.472client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.473worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)474lb # [ 0.000000] Tracing variant of Tasks RCU enabled.475worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000476client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.477lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.478worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000479client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0480lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1481client # [ 0.000000] GICv3: 256 SPIs implemented482worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.483client # [ 0.000000] GICv3: 0 Extended SPIs implemented484lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.485client # [ 0.000000] Root IRQ handler: gic_handle_irq486worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns487client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI488lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.489worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).490client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0491client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000492lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.493worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns494client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]495lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0496worker2 # [ 0.152294] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages497lb # [ 0.000000] GICv3: 256 SPIs implemented498worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns499client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1)500worker2 # [ 0.152311] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page501lb # [ 0.000000] GICv3: 0 Extended SPIs implemented502worker1 # [ 0.000032] arm-pv: using stolen time PV503lb # [ 0.000000] Root IRQ handler: gic_handle_irq504worker2 # [ 0.152317] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages505client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1)506lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI507worker1 # [ 0.000495] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)508worker2 # [ 0.152321] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page509lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0510client # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000511worker1 # [ 0.000690] Console: colour dummy device 80x25512worker2 # [ 0.152326] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages513worker1 # [ 0.000699] printk: legacy console [tty0] enabled514lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000515client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000516lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]517worker2 # [ 0.152330] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page518client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.519worker1 # [ 0.000895] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)520worker2 # [ 0.152334] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages521lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1)522worker1 # [ 0.000901] pid_max: default: 32768 minimum: 301523worker2 # [ 0.152338] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page524client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns525lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1)526client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).527worker1 # [ 0.000980] LSM: initializing lsm=capability,landlock,yama,bpf,ima528worker1 # [ 0.001114] landlock: Up and running.529worker1 # [ 0.001116] Yama: becoming mindful.530lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a20000531worker1 # [ 0.001631] LSM support for eBPF active532client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns533worker2 # [ 0.159779] fbcon: Taking over console534lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a30000535worker1 # [ 0.001823] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)536worker2 # [ 0.159797] ACPI: Interpreter disabled.537client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns538lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.539client # [ 0.000035] arm-pv: using stolen time PV540worker1 # [ 0.001857] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)541worker1 # [ 0.003808] rcu: Hierarchical SRCU implementation.542lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns543worker1 # [ 0.003814] rcu: Max phase no-delay instances is 1000.544client # [ 0.000422] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)545lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).546client # [ 0.000624] Console: colour dummy device 80x25547worker1 # [ 0.005071] fsl-mc MSI: its@8080000 domain created548client # [ 0.000634] printk: legacy console [tty0] enabled549worker1 # [ 0.005159] EFI services will not be available.550lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns551worker1 # [ 0.005240] smp: Bringing up secondary CPUs ...552worker1 # [ 0.005249] smp: Brought up 1 node, 1 CPU553client # [ 0.000836] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)554lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns555worker1 # [ 0.005252] SMP: Total of 1 processors activated.556client # [ 0.000843] pid_max: default: 32768 minimum: 301557lb # [ 0.000030] arm-pv: using stolen time PV558worker1 # [ 0.005258] CPU: All CPU(s) started at EL1559client # [ 0.000925] LSM: initializing lsm=capability,landlock,yama,bpf,ima560worker1 # [ 0.005268] CPU features: detected: Branch Target Identification561client # [ 0.001055] landlock: Up and running.562lb # [ 0.000389] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)563client # [ 0.001058] Yama: becoming mindful.564worker1 # [ 0.005273] CPU features: detected: ARMv8.4 Translation Table Level565lb # [ 0.000573] Console: colour dummy device 80x25566client # [ 0.001524] LSM support for eBPF active567lb # [ 0.000581] printk: legacy console [tty0] enabled568worker1 # [ 0.005276] CPU features: detected: Instruction cache invalidation not required for I/D coherence569client # [ 0.001690] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)570lb # [ 0.000771] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)571worker2 # [ 0.168842] iommu: Default domain type: Translated572client # [ 0.001729] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)573worker1 # [ 0.005280] CPU features: detected: Data cache clean to the PoU not required for I/D coherence574lb # [ 0.000778] pid_max: default: 32768 minimum: 301575worker2 # [ 0.168853] iommu: DMA domain TLB invalidation policy: strict mode576client # [ 0.003662] rcu: Hierarchical SRCU implementation.577worker1 # [ 0.005284] CPU features: detected: Common not Private translations578worker2 # [ 0.169193] SCSI subsystem initialized579lb # [ 0.000860] LSM: initializing lsm=capability,landlock,yama,bpf,ima580client # [ 0.003667] rcu: Max phase no-delay instances is 1000.581worker1 # [ 0.005287] CPU features: detected: CRC32 instructions582lb # [ 0.000994] landlock: Up and running.583client # [ 0.004947] fsl-mc MSI: its@8080000 domain created584lb # [ 0.000997] Yama: becoming mindful.585worker1 # [ 0.005290] CPU features: detected: Data cache clean to Point of Deep Persistence586client # [ 0.005039] EFI services will not be available.587worker2 # [ 0.171226] usbcore: registered new interface driver usbfs588lb # [ 0.001484] LSM support for eBPF active589client # [ 0.005137] smp: Bringing up secondary CPUs ...590worker2 # [ 0.171257] usbcore: registered new interface driver hub591worker1 # [ 0.005293] CPU features: detected: Data cache clean to Point of Persistence592lb # [ 0.001622] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)593client # [ 0.005146] smp: Brought up 1 node, 1 CPU594worker2 # [ 0.171272] usbcore: registered new device driver usb595worker1 # [ 0.005296] CPU features: detected: Data independent timing control (DIT)596client # [ 0.005149] SMP: Total of 1 processors activated.597lb # [ 0.001656] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)598worker2 # [ 0.171563] pps_core: LinuxPPS API ver. 1 registered599client # [ 0.005155] CPU: All CPU(s) started at EL1600worker1 # [ 0.005299] CPU features: detected: E0PD601lb # [ 0.003601] rcu: Hierarchical SRCU implementation.602client # [ 0.005164] CPU features: detected: Branch Target Identification603worker1 # [ 0.005302] CPU features: detected: Enhanced Counter Virtualization604lb # [ 0.003606] rcu: Max phase no-delay instances is 1000.605worker2 # [ 0.171568] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>606client # [ 0.005168] CPU features: detected: ARMv8.4 Translation Table Level607lb # [ 0.004899] fsl-mc MSI: its@8080000 domain created608worker2 # [ 0.171578] PTP clock support registered609worker1 # [ 0.005305] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)610worker2 # [ 0.171629] EDAC MC: Ver: 3.0.0611lb # [ 0.004998] EFI services will not be available.612worker1 # [ 0.005309] CPU features: detected: Enhanced Virtualization Traps613client # [ 0.005171] CPU features: detected: Instruction cache invalidation not required for I/D coherence614lb # [ 0.005076] smp: Bringing up secondary CPUs ...615worker2 # [ 0.176320] scmi_core: SCMI protocol bus registered616worker1 # [ 0.005312] CPU features: detected: Fine Grained Traps617lb # [ 0.005085] smp: Brought up 1 node, 1 CPU618client # [ 0.005175] CPU features: detected: Data cache clean to the PoU not required for I/D coherence619lb # [ 0.005088] SMP: Total of 1 processors activated.620worker2 # [ 0.177289] FPGA manager framework621worker1 # [ 0.005315] CPU features: detected: Generic authentication (architected QARMA5 algorithm)622lb # [ 0.005093] CPU: All CPU(s) started at EL1623client # [ 0.005179] CPU features: detected: Common not Private translations624worker2 # [ 0.178237] vgaarb: loaded625worker1 # [ 0.005320] CPU features: detected: RCpc load-acquire (LDAPR)626client # [ 0.005182] CPU features: detected: CRC32 instructions627lb # [ 0.005103] CPU features: detected: Branch Target Identification628worker1 # [ 0.005323] CPU features: detected: LSE atomic instructions629worker2 # [ 0.178871] clocksource: Switched to clocksource arch_sys_counter630lb # [ 0.005107] CPU features: detected: ARMv8.4 Translation Table Level631client # [ 0.005185] CPU features: detected: Data cache clean to Point of Deep Persistence632worker1 # [ 0.005326] CPU features: detected: Privileged Access Never633worker1 # [ 0.005328] CPU features: detected: PMUv3634client # [ 0.005189] CPU features: detected: Data cache clean to Point of Persistence635lb # [ 0.005110] CPU features: detected: Instruction cache invalidation not required for I/D coherence636worker1 # [ 0.005332] CPU features: detected: RAS Extension Support637client # [ 0.005192] CPU features: detected: Data independent timing control (DIT)638worker1 # [ 0.005334] CPU features: detected: RASv1p1 Extension Support639lb # [ 0.005114] CPU features: detected: Data cache clean to the PoU not required for I/D coherence640client # [ 0.005195] CPU features: detected: E0PD641worker2 # [ 0.181873] VFS: Disk quotas dquot_6.6.0642worker1 # [ 0.005337] CPU features: detected: Random Number Generator643lb # [ 0.005118] CPU features: detected: Common not Private translations644client # [ 0.005198] CPU features: detected: Enhanced Counter Virtualization645worker1 # [ 0.005340] CPU features: detected: Speculation barrier (SB)646worker2 # [ 0.181909] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)647lb # [ 0.005121] CPU features: detected: CRC32 instructions648client # [ 0.005201] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)649worker1 # [ 0.005342] CPU features: detected: Stage-2 Force Write-Back650lb # [ 0.005124] CPU features: detected: Data cache clean to Point of Deep Persistence651client # [ 0.005205] CPU features: detected: Enhanced Virtualization Traps652worker1 # [ 0.005345] CPU features: detected: TLB range maintenance instructions653lb # [ 0.005128] CPU features: detected: Data cache clean to Point of Persistence654client # [ 0.005208] CPU features: detected: Fine Grained Traps655worker1 # [ 0.005350] CPU features: detected: Speculative Store Bypassing Safe (SSBS)656lb # [ 0.005131] CPU features: detected: Data independent timing control (DIT)657client # [ 0.005211] CPU features: detected: Generic authentication (architected QARMA5 algorithm)658worker1 # [ 0.005391] alternatives: applying system-wide alternatives659worker2 # [ 0.185596] netfs: FS-Cache loaded660lb # [ 0.005134] CPU features: detected: E0PD661worker2 # [ 0.185698] pnp: PnP ACPI: disabled662client # [ 0.005216] CPU features: detected: RCpc load-acquire (LDAPR)663worker1 # [ 0.008468] CPU features: detected: BBM Level 2 without TLB conflict abort664lb # [ 0.005137] CPU features: detected: Enhanced Counter Virtualization665client # [ 0.005219] CPU features: detected: LSE atomic instructions666lb # [ 0.005140] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)667client # [ 0.005222] CPU features: detected: Privileged Access Never668client # [ 0.005224] CPU features: detected: PMUv3669worker1 # [ 0.008661] Memory: 1405624K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124664K reserved, 32768K cma-reserved)670lb # [ 0.005144] CPU features: detected: Enhanced Virtualization Traps671worker1 # [ 0.009097] devtmpfs: initialized672client # [ 0.005227] CPU features: detected: RAS Extension Support673lb # [ 0.005147] CPU features: detected: Fine Grained Traps674worker1 # [ 0.011044] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)675client # [ 0.005230] CPU features: detected: RASv1p1 Extension Support676lb # [ 0.005150] CPU features: detected: Generic authentication (architected QARMA5 algorithm)677client # [ 0.005233] CPU features: detected: Random Number Generator678worker1 # [ 0.011068] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).679lb # [ 0.005156] CPU features: detected: RCpc load-acquire (LDAPR)680client # [ 0.005235] CPU features: detected: Speculation barrier (SB)681worker2 # [ 0.189643] NET: Registered PF_INET protocol family682worker1 # [ 0.011248] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL683lb # [ 0.005159] CPU features: detected: LSE atomic instructions684client # [ 0.005238] CPU features: detected: Stage-2 Force Write-Back685worker1 # [ 0.011252] 0 pages in range for non-PLT usage686lb # [ 0.005161] CPU features: detected: Privileged Access Never687worker2 # [ 0.189929] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)688worker1 # [ 0.011253] 508272 pages in range for PLT usage689lb # [ 0.005164] CPU features: detected: PMUv3690client # [ 0.005241] CPU features: detected: TLB range maintenance instructions691worker1 # [ 0.011351] pinctrl core: initialized pinctrl subsystem692lb # [ 0.005167] CPU features: detected: RAS Extension Support693client # [ 0.005246] CPU features: detected: Speculative Store Bypassing Safe (SSBS)694worker1 # [ 0.012094] DMI not present or invalid.695lb # [ 0.005170] CPU features: detected: RASv1p1 Extension Support696client # [ 0.005281] alternatives: applying system-wide alternatives697worker1 # [ 0.015532] NET: Registered PF_NETLINK/PF_ROUTE protocol family698lb # [ 0.005173] CPU features: detected: Random Number Generator699client # [ 0.008271] CPU features: detected: BBM Level 2 without TLB conflict abort700lb # [ 0.005175] CPU features: detected: Speculation barrier (SB)701worker1 # [ 0.017827] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations702worker1 # [ 0.018019] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations703lb # [ 0.005178] CPU features: detected: Stage-2 Force Write-Back704client # [ 0.008505] Memory: 1405660K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124660K reserved, 32768K cma-reserved)705lb # [ 0.005181] CPU features: detected: TLB range maintenance instructions706worker1 # [ 0.018215] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations707client # [ 0.008865] devtmpfs: initialized708worker1 # [ 0.018238] audit: initializing netlink subsys (disabled)709lb # [ 0.005186] CPU features: detected: Speculative Store Bypassing Safe (SSBS)710client # [ 0.010718] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)711worker1 # [ 0.018803] thermal_sys: Registered thermal governor 'fair_share'712lb # [ 0.005222] alternatives: applying system-wide alternatives713client # [ 0.010740] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).714worker1 # [ 0.018805] thermal_sys: Registered thermal governor 'bang_bang'715lb # [ 0.008163] CPU features: detected: BBM Level 2 without TLB conflict abort716client # [ 0.010932] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL717worker1 # [ 0.018809] thermal_sys: Registered thermal governor 'step_wise'718worker1 # [ 0.018811] thermal_sys: Registered thermal governor 'user_space'719lb # [ 0.008294] Memory: 1405632K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124636K reserved, 32768K cma-reserved)720lb # [ 0.008671] devtmpfs: initialized721worker1 # [ 0.018816] thermal_sys: Registered thermal governor 'power_allocator'722lb # [ 0.010520] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)723worker1 # [ 0.018841] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1724lb # [ 0.010543] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).725worker1 # [ 0.018849] cpuidle: using governor ladder726worker1 # [ 0.018855] cpuidle: using governor menu727worker1 # [ 0.019032] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.728worker1 # [ 0.019046] ASID allocator initialised with 65536 entries729worker1 # [ 0.020231] Serial: AMBA PL011 UART driver730worker1 # [ 0.025447] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1731worker1 # [ 0.025579] printk: console [ttyAMA0] enabled732client # [ 0.010936] 0 pages in range for non-PLT usage733client # [ 0.010937] 508272 pages in range for PLT usage734client # [ 0.011029] pinctrl core: initialized pinctrl subsystem735client # [ 0.011786] DMI not present or invalid.736client # [ 0.015081] NET: Registered PF_NETLINK/PF_ROUTE protocol family737client # [ 0.017342] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations738lb # [ 0.010730] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL739client # [ 0.017549] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations740lb # [ 0.010735] 0 pages in range for non-PLT usage741lb # [ 0.010736] 508272 pages in range for PLT usage742client # [ 0.017746] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations743lb # [ 0.010830] pinctrl core: initialized pinctrl subsystem744client # [ 0.017768] audit: initializing netlink subsys (disabled)745lb # [ 0.011594] DMI not present or invalid.746worker1 # [ 0.143764] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages747client # [ 0.018316] thermal_sys: Registered thermal governor 'fair_share'748lb # [ 0.014886] NET: Registered PF_NETLINK/PF_ROUTE protocol family749worker1 # [ 0.143783] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page750client # [ 0.018318] thermal_sys: Registered thermal governor 'bang_bang'751lb # [ 0.017124] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations752worker1 # [ 0.143789] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages753client # [ 0.018322] thermal_sys: Registered thermal governor 'step_wise'754worker1 # [ 0.143794] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page755lb # [ 0.017298] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations756client # [ 0.018325] thermal_sys: Registered thermal governor 'user_space'757worker1 # [ 0.143798] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages758lb # [ 0.017511] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations759client # [ 0.018330] thermal_sys: Registered thermal governor 'power_allocator'760worker1 # [ 0.143802] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page761lb # [ 0.017539] audit: initializing netlink subsys (disabled)762client # [ 0.018354] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1763worker1 # [ 0.143807] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages764lb # [ 0.018125] thermal_sys: Registered thermal governor 'fair_share'765client # [ 0.018362] cpuidle: using governor ladder766client # [ 0.018369] cpuidle: using governor menu767lb # [ 0.018127] thermal_sys: Registered thermal governor 'bang_bang'768worker1 # [ 0.143811] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page769client # [ 0.018565] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.770lb # [ 0.018131] thermal_sys: Registered thermal governor 'step_wise'771client # [ 0.018581] ASID allocator initialised with 65536 entries772lb # [ 0.018133] thermal_sys: Registered thermal governor 'user_space'773client # [ 0.019803] Serial: AMBA PL011 UART driver774worker1 # [ 0.151211] fbcon: Taking over console775lb # [ 0.018138] thermal_sys: Registered thermal governor 'power_allocator'776worker1 # [ 0.151226] ACPI: Interpreter disabled.777client # [ 0.025030] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1778lb # [ 0.018165] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1779client # [ 0.025158] printk: console [ttyAMA0] enabled780lb # [ 0.018173] cpuidle: using governor ladder781lb # [ 0.018179] cpuidle: using governor menu782client # [ 0.145581] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages783lb # [ 0.018369] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.784client # [ 0.145603] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page785lb # [ 0.018386] ASID allocator initialised with 65536 entries786lb # [ 0.019607] Serial: AMBA PL011 UART driver787client # [ 0.145608] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages788client # [ 0.145613] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page789lb # [ 0.024893] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1790lb # [ 0.025047] printk: console [ttyAMA0] enabled791client # [ 0.145617] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages792worker2 # [ 0.219573] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)793client # [ 0.145621] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page794lb # [ 0.146011] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages795worker2 # [ 0.219621] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)796client # [ 0.145625] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages797lb # [ 0.146035] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page798client # [ 0.145629] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page799worker2 # [ 0.219648] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)800lb # [ 0.146040] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages801worker2 # [ 0.219733] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)802worker1 # [ 0.160273] iommu: Default domain type: Translated803lb # [ 0.146045] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page804worker1 # [ 0.160284] iommu: DMA domain TLB invalidation policy: strict mode805worker2 # [ 0.219877] TCP: Hash tables configured (established 16384 bind 16384)806lb # [ 0.146049] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages807worker1 # [ 0.160633] SCSI subsystem initialized808client # [ 0.153140] fbcon: Taking over console809worker2 # [ 0.219966] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)810lb # [ 0.146054] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page811client # [ 0.153155] ACPI: Interpreter disabled.812worker2 # [ 0.220018] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)813worker1 # [ 0.162654] usbcore: registered new interface driver usbfs814client # [ 0.154990] iommu: Default domain type: Translated815lb # [ 0.146058] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages816worker1 # [ 0.162686] usbcore: registered new interface driver hub817client # [ 0.154999] iommu: DMA domain TLB invalidation policy: strict mode818worker2 # [ 0.220054] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)819lb # [ 0.146062] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page820worker1 # [ 0.162702] usbcore: registered new device driver usb821worker2 # [ 0.220149] NET: Registered PF_UNIX/PF_LOCAL protocol family822client # [ 0.156656] SCSI subsystem initialized823worker1 # [ 0.162974] pps_core: LinuxPPS API ver. 1 registered824worker2 # [ 0.220196] NET: Registered PF_XDP protocol family825worker2 # [ 0.220215] PCI: CLS 0 bytes, default 64826worker1 # [ 0.162980] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>827worker2 # [ 0.220458] Trying to unpack rootfs image as initramfs...828worker1 # [ 0.162990] PTP clock support registered829lb # [ 0.153549] fbcon: Taking over console830worker1 # [ 0.163039] EDAC MC: Ver: 3.0.0831lb # [ 0.153565] ACPI: Interpreter disabled.832lb # [ 0.155465] iommu: Default domain type: Translated833worker1 # [ 0.167626] scmi_core: SCMI protocol bus registered834lb # [ 0.155475] iommu: DMA domain TLB invalidation policy: strict mode835worker1 # [ 0.168663] FPGA manager framework836worker1 # [ 0.169596] vgaarb: loaded837lb # [ 0.157232] SCSI subsystem initialized838worker1 # [ 0.170270] clocksource: Switched to clocksource arch_sys_counter839client # [ 0.164400] usbcore: registered new interface driver usbfs840worker2 # [ 0.236674] kvm [1]: HYP mode not available841client # [ 0.164426] usbcore: registered new interface driver hub842client # [ 0.164450] usbcore: registered new device driver usb843client # [ 0.164730] pps_core: LinuxPPS API ver. 1 registered844client # [ 0.164737] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>845client # [ 0.164747] PTP clock support registered846worker1 # [ 0.176647] VFS: Disk quotas dquot_6.6.0847client # [ 0.164794] EDAC MC: Ver: 3.0.0848lb # [ 0.164360] usbcore: registered new interface driver usbfs849worker1 # [ 0.176700] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)850lb # [ 0.164393] usbcore: registered new interface driver hub851client # [ 0.169437] scmi_core: SCMI protocol bus registered852worker1 # [ 0.178348] netfs: FS-Cache loaded853lb # [ 0.164408] usbcore: registered new device driver usb854worker1 # [ 0.178451] pnp: PnP ACPI: disabled855client # [ 0.170389] FPGA manager framework856lb # [ 0.164691] pps_core: LinuxPPS API ver. 1 registered857client # [ 0.171345] vgaarb: loaded858lb # [ 0.164697] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>859lb # [ 0.164708] PTP clock support registered860client # [ 0.171993] clocksource: Switched to clocksource arch_sys_counter861lb # [ 0.164757] EDAC MC: Ver: 3.0.0862client # [ 0.173366] VFS: Disk quotas dquot_6.6.0863lb # [ 0.169441] scmi_core: SCMI protocol bus registered864client # [ 0.173396] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)865lb # [ 0.170412] FPGA manager framework866client # [ 0.174975] netfs: FS-Cache loaded867lb # [ 0.171355] vgaarb: loaded868client # [ 0.175094] pnp: PnP ACPI: disabled869lb # [ 0.172010] clocksource: Switched to clocksource arch_sys_counter870worker1 # [ 0.182301] NET: Registered PF_INET protocol family871lb # [ 0.174051] VFS: Disk quotas dquot_6.6.0872lb # [ 0.174090] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)873worker1 # [ 0.182568] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)874lb # [ 0.177874] netfs: FS-Cache loaded875lb # [ 0.177980] pnp: PnP ACPI: disabled876client # [ 0.181198] NET: Registered PF_INET protocol family877client # [ 0.181490] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)878lb # [ 0.182016] NET: Registered PF_INET protocol family879lb # [ 0.182269] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)880worker1 # [ 0.212229] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)881worker1 # [ 0.212279] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)882worker1 # [ 0.212308] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)883worker1 # [ 0.212386] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)884worker1 # [ 0.212529] TCP: Hash tables configured (established 16384 bind 16384)885worker1 # [ 0.212614] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)886worker1 # [ 0.212650] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)887lb # [ 0.211687] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)888worker1 # [ 0.212686] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)889worker1 # [ 0.212782] NET: Registered PF_UNIX/PF_LOCAL protocol family890lb # [ 0.211737] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)891worker1 # [ 0.212837] NET: Registered PF_XDP protocol family892worker1 # [ 0.212857] PCI: CLS 0 bytes, default 64893lb # [ 0.211769] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)894worker1 # [ 0.213101] Trying to unpack rootfs image as initramfs...895lb # [ 0.211837] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)896lb # [ 0.211980] TCP: Hash tables configured (established 16384 bind 16384)897client # [ 0.210871] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)898client # [ 0.210924] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)899client # [ 0.210952] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)900client # [ 0.211030] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)901client # [ 0.211174] TCP: Hash tables configured (established 16384 bind 16384)902client # [ 0.211262] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)903client # [ 0.211300] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)904client # [ 0.211337] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)905client # [ 0.211434] NET: Registered PF_UNIX/PF_LOCAL protocol family906client # [ 0.211479] NET: Registered PF_XDP protocol family907lb # [ 0.216892] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)908client # [ 0.211499] PCI: CLS 0 bytes, default 64909client # [ 0.211763] Trying to unpack rootfs image as initramfs...910lb # [ 0.216933] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)911lb # [ 0.216970] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)912lb # [ 0.217075] NET: Registered PF_UNIX/PF_LOCAL protocol family913lb # [ 0.217096] NET: Registered PF_XDP protocol family914lb # [ 0.217116] PCI: CLS 0 bytes, default 64915lb # [ 0.217419] Trying to unpack rootfs image as initramfs...916worker1 # [ 0.234297] kvm [1]: HYP mode not available917client # [ 0.229915] kvm [1]: HYP mode not available918lb # [ 0.229076] kvm [1]: HYP mode not available919worker2 # [ 0.332093] Initialise system trusted keyrings920worker2 # [ 0.332842] workingset: timestamp_bits=42 max_order=19 bucket_order=0921worker2 # [ 0.334144] squashfs: version 4.0 (2009/01/31) Phillip Lougher922worker2 # [ 0.334957] 9p: Installing v9fs 9p2000 file system support923worker2 # [ 0.363044] Key type asymmetric registered924worker2 # [ 0.363076] Asymmetric key parser 'x509' registered925worker2 # [ 0.363195] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)926worker2 # [ 0.365390] io scheduler mq-deadline registered927worker2 # [ 0.365401] io scheduler kyber registered928worker2 # [ 0.375038] pl061_gpio 9030000.pl061: PL061 GPIO chip registered929worker2 # [ 0.376544] ledtrig-cpu: registered to indicate activity on CPUs930worker2 # [ 0.376955] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:931worker2 # [ 0.376972] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000932worker2 # [ 0.376984] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000933worker2 # [ 0.376992] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000934worker2 # [ 0.377025] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits935worker2 # [ 0.377064] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]936worker2 # [ 0.377140] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00937worker2 # [ 0.377149] pci_bus 0000:00: root bus resource [bus 00-ff]938worker2 # [ 0.377155] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]939worker2 # [ 0.377160] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]940worker2 # [ 0.377165] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]941worker2 # [ 0.377259] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint942worker2 # [ 0.377717] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint943worker2 # [ 0.377902] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]944worker2 # [ 0.377918] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]945worker2 # [ 0.377947] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]946worker2 # [ 0.377963] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]947client # [ 0.316809] Initialise system trusted keyrings948worker2 # [ 0.378410] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint949client # [ 0.317594] workingset: timestamp_bits=42 max_order=19 bucket_order=0950worker2 # [ 0.378589] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]951worker1 # [ 0.326803] Initialise system trusted keyrings952worker2 # [ 0.378605] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]953worker1 # [ 0.327544] workingset: timestamp_bits=42 max_order=19 bucket_order=0954worker2 # [ 0.378633] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]955worker1 # [ 0.328876] squashfs: version 4.0 (2009/01/31) Phillip Lougher956worker1 # [ 0.329652] 9p: Installing v9fs 9p2000 file system support957client # [ 0.324442] squashfs: version 4.0 (2009/01/31) Phillip Lougher958client # [ 0.325265] 9p: Installing v9fs 9p2000 file system support959lb # [ 0.324731] Initialise system trusted keyrings960lb # [ 0.325503] workingset: timestamp_bits=42 max_order=19 bucket_order=0961lb # [ 0.326821] squashfs: version 4.0 (2009/01/31) Phillip Lougher962worker2 # [ 0.407260] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint963worker2 # [ 0.407474] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f]964worker2 # [ 0.407492] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]965worker2 # [ 0.407521] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]966worker2 # [ 0.408005] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint967worker2 # [ 0.408196] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]968worker2 # [ 0.408212] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]969worker2 # [ 0.408242] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]970worker2 # [ 0.408262] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref]971lb # [ 0.332072] 9p: Installing v9fs 9p2000 file system support972worker2 # [ 0.408724] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint973worker2 # [ 0.408916] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]974client # [ 0.346048] Key type asymmetric registered975worker2 # [ 0.408946] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]976client # [ 0.346072] Asymmetric key parser 'x509' registered977worker2 # [ 0.409404] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint978client # [ 0.346150] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)979worker2 # [ 0.409588] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]980worker2 # [ 0.409617] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]981worker2 # [ 0.410005] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint982worker1 # [ 0.358342] Key type asymmetric registered983worker2 # [ 0.410186] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff]984worker1 # [ 0.358370] Asymmetric key parser 'x509' registered985worker1 # [ 0.358442] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)986worker2 # [ 0.410480] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint987client # [ 0.352040] io scheduler mq-deadline registered988worker1 # [ 0.360572] io scheduler mq-deadline registered989worker2 # [ 0.410663] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]990client # [ 0.352060] io scheduler kyber registered991worker1 # [ 0.360584] io scheduler kyber registered992worker2 # [ 0.410696] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]993worker2 # [ 0.411196] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint994worker2 # [ 0.411381] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]995worker2 # [ 0.411411] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]996lb # [ 0.352135] Key type asymmetric registered997lb # [ 0.352156] Asymmetric key parser 'x509' registered998worker2 # [ 0.411864] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint999worker2 # [ 0.412056] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff]1000lb # [ 0.352220] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)1001worker2 # [ 0.412084] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1002worker2 # [ 0.412550] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1003worker2 # [ 0.412868] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1004client # [ 0.360148] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1005worker2 # [ 0.412885] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1006worker2 # [ 0.412914] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1007worker2 # [ 0.413378] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1008worker1 # [ 0.370411] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1009worker2 # [ 0.413565] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1010client # [ 0.361548] ledtrig-cpu: registered to indicate activity on CPUs1011worker2 # [ 0.413580] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1012lb # [ 0.360066] io scheduler mq-deadline registered1013lb # [ 0.360084] io scheduler kyber registered1014worker2 # [ 0.413609] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1015client # [ 0.361937] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1016worker2 # [ 0.414202] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1017client # [ 0.361955] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001018worker1 # [ 0.371855] ledtrig-cpu: registered to indicate activity on CPUs1019worker2 # [ 0.414213] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1020worker1 # [ 0.372270] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1021client # [ 0.361967] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001022worker2 # [ 0.414219] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1023worker1 # [ 0.372288] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001024client # [ 0.361977] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001025worker2 # [ 0.414267] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1026client # [ 0.361998] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1027worker1 # [ 0.372302] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001028worker2 # [ 0.414314] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1029lb # [ 0.365384] pl061_gpio 9030000.pl061: PL061 GPIO chip registered1030worker1 # [ 0.372311] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001031client # [ 0.362022] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1032worker2 # [ 0.414359] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1033client # [ 0.362099] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001034worker1 # [ 0.372333] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1035worker2 # [ 0.414405] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1036client # [ 0.362109] pci_bus 0000:00: root bus resource [bus 00-ff]1037lb # [ 0.366683] ledtrig-cpu: registered to indicate activity on CPUs1038worker1 # [ 0.372358] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1039client # [ 0.362115] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1040worker2 # [ 0.414451] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1041lb # [ 0.367064] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:1042worker1 # [ 0.372433] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001043client # [ 0.362120] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1044worker2 # [ 0.414498] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1045worker1 # [ 0.372443] pci_bus 0000:00: root bus resource [bus 00-ff]1046client # [ 0.362125] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1047lb # [ 0.367081] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x00000000001048worker1 # [ 0.372454] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1049worker2 # [ 0.414544] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1050lb # [ 0.367093] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x00100000001051client # [ 0.362183] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1052worker1 # [ 0.372460] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1053worker2 # [ 0.414591] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1054client # [ 0.362619] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1055worker1 # [ 0.372465] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1056lb # [ 0.367101] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x80000000001057worker2 # [ 0.414636] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1058client # [ 0.362804] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1059worker1 # [ 0.372552] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1060lb # [ 0.367121] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits1061client # [ 0.362820] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1062worker2 # [ 0.414706] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1063client # [ 0.362849] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1064worker1 # [ 0.372998] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1065lb # [ 0.367142] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]1066worker2 # [ 0.414754] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1067worker1 # [ 0.373183] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1068client # [ 0.362865] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1069worker2 # [ 0.414775] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1070lb # [ 0.367217] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:001071worker1 # [ 0.373200] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1072lb # [ 0.367227] pci_bus 0000:00: root bus resource [bus 00-ff]1073worker2 # [ 0.414797] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1074client # [ 0.363315] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1075worker1 # [ 0.373229] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1076lb # [ 0.367233] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]1077client # [ 0.363502] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1078worker2 # [ 0.414819] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1079worker1 # [ 0.373246] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1080client # [ 0.363517] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1081lb # [ 0.367238] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]1082worker2 # [ 0.414840] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1083client # [ 0.363551] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1084worker1 # [ 0.373723] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1085worker2 # [ 0.414861] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1086lb # [ 0.367243] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]1087worker1 # [ 0.373909] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1088lb # [ 0.367330] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint1089worker1 # [ 0.373925] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1090worker1 # [ 0.373954] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1091lb # [ 0.367767] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1092lb # [ 0.367951] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]1093worker2 # [ 0.460518] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned1094lb # [ 0.367969] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]1095worker2 # [ 0.460550] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1096lb # [ 0.367999] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1097worker1 # [ 0.393076] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1098worker2 # [ 0.460572] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1099worker1 # [ 0.393261] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f]1100worker1 # [ 0.393277] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1101worker2 # [ 0.460594] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned1102worker1 # [ 0.393306] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1103worker2 # [ 0.460617] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1104worker2 # [ 0.460639] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1105worker1 # [ 0.393765] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1106worker1 # [ 0.393948] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1107worker2 # [ 0.460660] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned1108worker1 # [ 0.393964] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1109worker2 # [ 0.460682] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned1110worker1 # [ 0.393993] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1111worker2 # [ 0.460703] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned1112worker1 # [ 0.394012] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref]1113worker2 # [ 0.460724] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned1114worker2 # [ 0.460751] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned1115worker2 # [ 0.460773] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned1116worker2 # [ 0.460801] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1117worker2 # [ 0.460810] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1118lb # [ 0.388048] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]1119client # [ 0.388070] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1120worker2 # [ 0.460815] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1121client # [ 0.388273] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f]1122worker2 # [ 0.461638] pci 0000:00:07.0: enabling device (0000 -> 0002)1123lb # [ 0.388593] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1124client # [ 0.388290] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1125lb # [ 0.388786] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]1126client # [ 0.388320] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1127lb # [ 0.388802] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]1128lb # [ 0.388831] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1129client # [ 0.388828] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1130client # [ 0.389014] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1131lb # [ 0.389295] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1132client # [ 0.389030] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1133lb # [ 0.389494] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f]1134client # [ 0.389059] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1135lb # [ 0.389510] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]1136client # [ 0.389078] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref]1137lb # [ 0.389539] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1138client # [ 0.389554] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1139lb # [ 0.390001] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1140client # [ 0.389741] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1141lb # [ 0.390187] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]1142client # [ 0.389770] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1143lb # [ 0.390203] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]1144lb # [ 0.390232] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1145client # [ 0.390231] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1146worker1 # [ 0.406562] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1147lb # [ 0.390250] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref]1148client # [ 0.390420] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1149worker1 # [ 0.406766] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1150client # [ 0.390449] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1151lb # [ 0.390715] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint1152worker1 # [ 0.406797] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1153lb # [ 0.390900] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]1154client # [ 0.391088] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1155worker1 # [ 0.407260] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1156lb # [ 0.390930] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1157client # [ 0.391275] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff]1158worker1 # [ 0.407454] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1159lb # [ 0.391381] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1160client # [ 0.391524] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1161worker1 # [ 0.407486] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1162lb # [ 0.391569] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]1163client # [ 0.391710] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1164worker1 # [ 0.407890] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1165lb # [ 0.391598] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1166client # [ 0.391741] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1167worker1 # [ 0.408075] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff]1168lb # [ 0.391986] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint1169client # [ 0.392208] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1170worker1 # [ 0.408366] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1171client # [ 0.392395] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1172worker1 # [ 0.408552] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1173client # [ 0.392424] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1174worker1 # [ 0.408582] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1175client # [ 0.392876] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1176worker1 # [ 0.409032] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1177client # [ 0.393071] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff]1178lb # [ 0.409197] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff]1179worker1 # [ 0.409219] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1180client # [ 0.393101] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1181lb # [ 0.409513] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1182worker1 # [ 0.409248] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1183client # [ 0.393574] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1184lb # [ 0.409698] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]1185worker1 # [ 0.409708] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1186client # [ 0.393870] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1187lb # [ 0.409728] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1188worker1 # [ 0.409894] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff]1189client # [ 0.393886] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1190lb # [ 0.410174] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1191worker1 # [ 0.409923] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1192client # [ 0.393915] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1193lb # [ 0.410357] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]1194worker1 # [ 0.410401] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1195client # [ 0.394375] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1196lb # [ 0.410387] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1197worker1 # [ 0.410678] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1198client # [ 0.394569] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1199worker1 # [ 0.410696] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1200worker2 # [ 0.498476] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1201lb # [ 0.410839] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint1202client # [ 0.394584] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1203lb # [ 0.411022] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff]1204worker1 # [ 0.410725] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1205client # [ 0.394614] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1206lb # [ 0.411052] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1207client # [ 0.395183] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1208worker1 # [ 0.411184] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1209worker1 # [ 0.411375] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1210client # [ 0.395195] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1211lb # [ 0.411514] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1212worker1 # [ 0.411391] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1213lb # [ 0.411802] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]1214client # [ 0.395201] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1215lb # [ 0.411819] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]1216worker1 # [ 0.411420] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1217client # [ 0.395246] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1218lb # [ 0.411848] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1219worker1 # [ 0.411997] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1220client # [ 0.395295] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1221worker1 # [ 0.412008] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1222client # [ 0.395340] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1223worker1 # [ 0.412014] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1224client # [ 0.395387] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1225worker1 # [ 0.412059] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1226client # [ 0.395433] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1227worker1 # [ 0.412107] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1228client # [ 0.395478] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1229worker1 # [ 0.412157] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1230client # [ 0.395523] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1231worker1 # [ 0.412207] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1232client # [ 0.395569] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1233worker1 # [ 0.412254] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1234worker2 # [ 0.508369] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1235client # [ 0.395616] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1236worker1 # [ 0.412300] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1237client # [ 0.395691] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1238worker1 # [ 0.412346] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1239client # [ 0.395736] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1240lb # [ 0.428406] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1241worker1 # [ 0.412392] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1242client # [ 0.395758] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1243lb # [ 0.428616] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]1244worker1 # [ 0.412438] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1245client # [ 0.395779] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1246lb # [ 0.428634] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]1247worker1 # [ 0.412507] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1248client # [ 0.395800] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1249lb # [ 0.428663] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]1250worker1 # [ 0.412554] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1251client # [ 0.395821] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1252lb # [ 0.429264] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned1253worker1 # [ 0.412577] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1254client # [ 0.395841] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1255lb # [ 0.429276] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned1256worker1 # [ 0.412599] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1257client # [ 0.395863] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned1258lb # [ 0.429281] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned1259worker1 # [ 0.412620] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1260client # [ 0.395887] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1261lb # [ 0.429326] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned1262worker1 # [ 0.412642] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1263client # [ 0.395909] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1264lb # [ 0.429396] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned1265worker1 # [ 0.412663] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1266client # [ 0.395931] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned1267worker1 # [ 0.412685] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned1268lb # [ 0.429444] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned1269client # [ 0.395952] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1270worker1 # [ 0.412710] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1271client # [ 0.395974] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1272lb # [ 0.429492] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned1273worker1 # [ 0.412732] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1274lb # [ 0.429542] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned1275worker1 # [ 0.412753] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned1276lb # [ 0.429589] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned1277worker1 # [ 0.412776] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1278worker1 # [ 0.412798] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1279lb # [ 0.429636] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned1280worker1 # [ 0.412819] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned1281lb # [ 0.429683] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned1282worker2 # [ 0.519513] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1283worker1 # [ 0.412840] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned1284lb # [ 0.429730] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned1285worker2 # [ 0.521832] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1286worker1 # [ 0.412863] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned1287worker2 # [ 0.523981] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002)1288lb # [ 0.429859] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned1289worker1 # [ 0.412885] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned1290worker2 # [ 0.526212] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002)1291worker1 # [ 0.412906] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned1292lb # [ 0.429912] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned1293worker1 # [ 0.412928] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned1294lb # [ 0.429934] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned1295worker1 # [ 0.412955] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1296lb # [ 0.429959] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned1297worker1 # [ 0.412965] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1298lb # [ 0.429982] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned1299worker1 # [ 0.412970] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1300lb # [ 0.430003] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned1301client # [ 0.452041] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned1302worker1 # [ 0.413793] pci 0000:00:07.0: enabling device (0000 -> 0002)1303client # [ 0.452111] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned1304lb # [ 0.430026] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned1305client # [ 0.452137] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned1306lb # [ 0.430051] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned1307client # [ 0.452159] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned1308lb # [ 0.430078] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned1309client # [ 0.452181] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned1310lb # [ 0.430100] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned1311client # [ 0.452203] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned1312lb # [ 0.430122] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned1313client # [ 0.452235] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1314lb # [ 0.430144] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned1315client # [ 0.452244] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1316lb # [ 0.430166] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned1317client # [ 0.452248] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1318worker2 # [ 0.536454] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1319lb # [ 0.430186] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned1320client # [ 0.453082] pci 0000:00:07.0: enabling device (0000 -> 0002)1321worker2 # [ 0.538412] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1322lb # [ 0.430207] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned1323lb # [ 0.430228] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned1324worker1 # [ 0.470380] pci 0000:00:07.0: quirk_usb_early_handoff+0x0/0xa60 took 55263 usecs1325lb # [ 0.430249] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned1326lb # [ 0.430272] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned1327lb # [ 0.430294] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned1328lb # [ 0.430320] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]1329lb # [ 0.430329] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]1330lb # [ 0.430334] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]1331lb # [ 0.431145] pci 0000:00:07.0: enabling device (0000 -> 0002)1332worker2 # [ 0.548937] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002)1333worker2 # [ 0.550799] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1334worker2 # [ 0.561794] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1335worker1 # [ 0.491593] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1336worker1 # [ 0.493824] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1337client # [ 0.486337] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1338client # [ 0.489405] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1339client # [ 0.491524] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1340worker2 # [ 0.572122] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1341worker2 # [ 0.574856] msm_serial: driver initialized1342worker1 # [ 0.505201] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1343lb # [ 0.495001] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)1344client # [ 0.501507] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1345lb # [ 0.498153] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)1346client # [ 0.503553] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002)1347worker2 # [ 0.579207] SuperH (H)SCI(F) driver initialized1348worker2 # [ 0.579291] STM32 USART driver initialized1349worker1 # [ 0.519639] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1350worker1 # [ 0.521803] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002)1351client # [ 0.514405] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002)1352worker1 # [ 0.525532] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002)1353client # [ 0.517067] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1354lb # [ 0.508266] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)1355client # [ 0.519116] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1356lb # [ 0.510392] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)1357lb # [ 0.512421] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002)1358worker1 # [ 0.528200] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1359lb # [ 0.514592] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002)1360lb # [ 0.524188] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)1361client # [ 0.529229] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002)1362lb # [ 0.526129] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1363client # [ 0.531100] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1364worker1 # [ 0.538470] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)1365worker2 # [ 0.611990] loop: module loaded1366worker1 # [ 0.540370] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002)1367worker2 # [ 0.612212] virtio_blk virtio2: 1/0/0 default/read/poll queues1368worker1 # [ 0.542227] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1369worker2 # [ 0.613064] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1370client # [ 0.541800] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1371lb # [ 0.536193] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002)1372lb # [ 0.538183] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)1373worker2 # [ 0.619714] megasas: 07.734.00.00-rc11374worker2 # [ 0.620490] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1375worker1 # [ 0.555860] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1376client # [ 0.553006] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1377worker1 # [ 0.561914] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1378client # [ 0.555645] msm_serial: driver initialized1379client # [ 0.555823] SuperH (H)SCI(F) driver initialized1380client # [ 0.555876] STM32 USART driver initialized1381lb # [ 0.548643] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)1382worker2 # [ 0.630958] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001383lb # [ 0.555070] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1384worker2 # [ 0.631019] Intel/Sharp Extended Query Table at 0x00311385worker2 # [ 0.632793] Using buffer write method1386worker2 # [ 0.632893] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1387worker1 # [ 0.567159] msm_serial: driver initialized1388worker1 # [ 0.567305] SuperH (H)SCI(F) driver initialized1389worker2 # [ 0.634727] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001390worker1 # [ 0.567361] STM32 USART driver initialized1391worker2 # [ 0.634767] Intel/Sharp Extended Query Table at 0x00311392worker2 # [ 0.636503] Using buffer write method1393worker2 # [ 0.636541] Concatenating MTD devices:1394worker2 # [ 0.636545] (0): "0.flash"1395worker2 # [ 0.636549] (1): "0.flash"1396worker2 # [ 0.636559] into device "0.flash"1397lb # [ 0.561283] msm_serial: driver initialized1398lb # [ 0.561472] SuperH (H)SCI(F) driver initialized1399lb # [ 0.561531] STM32 USART driver initialized1400client # [ 0.586972] loop: module loaded1401client # [ 0.587172] virtio_blk virtio2: 1/0/0 default/read/poll queues1402client # [ 0.587934] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1403worker1 # [ 0.599000] loop: module loaded1404worker1 # [ 0.599178] virtio_blk virtio2: 1/0/0 default/read/poll queues1405worker1 # [ 0.600130] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1406lb # [ 0.592788] loop: module loaded1407lb # [ 0.592969] virtio_blk virtio2: 1/0/0 default/read/poll queues1408lb # [ 0.593937] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)1409worker1 # [ 0.610940] megasas: 07.734.00.00-rc11410worker1 # [ 0.611646] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1411client # [ 0.600659] megasas: 07.734.00.00-rc11412worker1 # [ 0.613956] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001413worker1 # [ 0.613983] Intel/Sharp Extended Query Table at 0x00311414client # [ 0.601370] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1415client # [ 0.603287] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001416client # [ 0.603315] Intel/Sharp Extended Query Table at 0x00311417client # [ 0.605012] Using buffer write method1418lb # [ 0.604647] megasas: 07.734.00.00-rc11419lb # [ 0.605385] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]1420client # [ 0.605081] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1421lb # [ 0.607649] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001422client # [ 0.606917] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001423lb # [ 0.607675] Intel/Sharp Extended Query Table at 0x00311424client # [ 0.606943] Intel/Sharp Extended Query Table at 0x00311425worker1 # [ 0.623326] Using buffer write method1426worker1 # [ 0.623399] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1427lb # [ 0.612609] Using buffer write method1428worker1 # [ 0.627924] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001429lb # [ 0.612683] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]1430worker1 # [ 0.627945] Intel/Sharp Extended Query Table at 0x00311431worker1 # [ 0.629336] Using buffer write method1432worker1 # [ 0.629362] Concatenating MTD devices:1433lb # [ 0.614571] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x0000001434worker1 # [ 0.629366] (0): "0.flash"1435worker1 # [ 0.629379] (1): "0.flash"1436lb # [ 0.614594] Intel/Sharp Extended Query Table at 0x00311437worker1 # [ 0.629383] into device "0.flash"1438client # [ 0.627562] Using buffer write method1439client # [ 0.627601] Concatenating MTD devices:1440client # [ 0.627606] (0): "0.flash"1441client # [ 0.627610] (1): "0.flash"1442client # [ 0.627620] into device "0.flash"1443lb # [ 0.632073] Using buffer write method1444lb # [ 0.632112] Concatenating MTD devices:1445lb # [ 0.632116] (0): "0.flash"1446lb # [ 0.632121] (1): "0.flash"1447lb # [ 0.632128] into device "0.flash"1448worker2 # [ 0.920460] Freeing initrd memory: 26944K1449worker2 # [ 0.926731] tun: Universal TUN/TAP device driver, 1.61450worker2 # [ 0.930732] thunder_xcv, ver 1.01451worker2 # [ 0.930787] thunder_bgx, ver 1.01452worker2 # [ 0.930809] nicpf, ver 1.01453worker2 # [ 0.932639] e1000: Intel(R) PRO/1000 Network Driver1454worker2 # [ 0.932649] e1000: Copyright (c) 1999-2006 Intel Corporation.1455worker2 # [ 0.932674] e1000e: Intel(R) PRO/1000 Network Driver1456worker2 # [ 0.932682] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1457worker2 # [ 0.932712] igb: Intel(R) Gigabit Ethernet Network Driver1458worker2 # [ 0.932718] igb: Copyright (c) 2007-2014 Intel Corporation.1459worker2 # [ 0.932741] igbvf: Intel(R) Gigabit Virtual Function Network Driver1460worker2 # [ 0.932746] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1461worker2 # [ 0.932882] sky2: driver version 1.301462worker2 # [ 0.934512] usbcore: registered new interface driver usb-storage1463worker2 # [ 0.934596] usbcore: registered new interface driver usbserial_generic1464worker2 # [ 0.934608] usbserial: USB Serial support registered for generic1465worker2 # [ 0.935717] ehci-pci 0000:00:07.0: EHCI Host Controller1466worker2 # [ 0.935750] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 11467worker2 # [ 0.936030] ehci-pci 0000:00:07.0: irq 16, io mem 0x100860001468worker2 # [ 0.947038] hv_vmbus: registering driver hyperv_keyboard1469worker2 # [ 0.948391] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.001470worker2 # [ 0.948704] hub 1-0:1.0: USB hub found1471worker2 # [ 0.948728] hub 1-0:1.0: 6 ports detected1472worker2 # [ 0.951069] rtc-pl031 9010000.pl031: registered as rtc01473worker2 # [ 0.951096] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T14:50:45 UTC (1790088645)1474worker2 # [ 0.951441] i2c_dev: i2c /dev entries driver1475worker2 # [ 0.956779] sdhci: Secure Digital Host Controller Interface driver1476worker2 # [ 0.956792] sdhci: Copyright(c) Pierre Ossman1477worker2 # [ 0.957055] Synopsys Designware Multimedia Card Interface Driver1478worker2 # [ 0.957428] sdhci-pltfm: SDHCI platform and OF driver helper1479worker2 # [ 0.961630] hid: raw HID events driver (C) Jiri Kosina1480worker2 # [ 0.961874] usbcore: registered new interface driver usbhid1481worker2 # [ 0.961882] usbhid: USB HID core driver1482worker1 # [ 0.895898] Freeing initrd memory: 26976K1483worker2 # [ 0.964774] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1484worker2 # [ 0.966367] drop_monitor: Initializing network drop monitor service1485worker2 # [ 0.966575] NET: Registered PF_INET6 protocol family1486worker2 # [ 0.969703] Segment Routing with IPv61487worker2 # [ 0.969722] In-situ OAM (IOAM) with IPv61488worker2 # [ 0.969751] NET: Registered PF_PACKET protocol family1489worker1 # [ 0.902062] tun: Universal TUN/TAP device driver, 1.61490client # [ 0.893269] Freeing initrd memory: 26972K1491worker2 # [ 0.971611] 9pnet: Installing 9P2000 support1492worker2 # [ 0.971659] Key type dns_resolver registered1493worker1 # [ 0.906004] thunder_xcv, ver 1.01494lb # [ 0.894065] Freeing initrd memory: 26948K1495worker1 # [ 0.906050] thunder_bgx, ver 1.01496worker1 # [ 0.906073] nicpf, ver 1.01497client # [ 0.899236] tun: Universal TUN/TAP device driver, 1.61498worker2 # [ 0.978386] registered taskstats version 11499worker2 # [ 0.978557] Loading compiled-in X.509 certificates1500worker1 # [ 0.907858] e1000: Intel(R) PRO/1000 Network Driver1501client # [ 0.903105] thunder_xcv, ver 1.01502worker1 # [ 0.907868] e1000: Copyright (c) 1999-2006 Intel Corporation.1503client # [ 0.903148] thunder_bgx, ver 1.01504lb # [ 0.900174] tun: Universal TUN/TAP device driver, 1.61505worker1 # [ 0.907897] e1000e: Intel(R) PRO/1000 Network Driver1506client # [ 0.903171] nicpf, ver 1.01507worker1 # [ 0.907907] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1508client # [ 0.903755] e1000: Intel(R) PRO/1000 Network Driver1509worker1 # [ 0.907936] igb: Intel(R) Gigabit Ethernet Network Driver1510client # [ 0.903762] e1000: Copyright (c) 1999-2006 Intel Corporation.1511client # [ 0.903786] e1000e: Intel(R) PRO/1000 Network Driver1512worker1 # [ 0.907942] igb: Copyright (c) 2007-2014 Intel Corporation.1513client # [ 0.903794] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1514worker1 # [ 0.907986] igbvf: Intel(R) Gigabit Virtual Function Network Driver1515lb # [ 0.903914] thunder_xcv, ver 1.01516client # [ 0.903824] igb: Intel(R) Gigabit Ethernet Network Driver1517worker1 # [ 0.907992] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1518lb # [ 0.903958] thunder_bgx, ver 1.01519worker1 # [ 0.908128] sky2: driver version 1.301520lb # [ 0.903981] nicpf, ver 1.01521client # [ 0.903829] igb: Copyright (c) 2007-2014 Intel Corporation.1522worker1 # [ 0.909828] usbcore: registered new interface driver usb-storage1523client # [ 0.903856] igbvf: Intel(R) Gigabit Virtual Function Network Driver1524worker2 # [ 0.987201] Demotion targets for Node 0: null1525worker1 # [ 0.909926] usbcore: registered new interface driver usbserial_generic1526client # [ 0.903861] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1527worker2 # [ 0.987312] Key type .fscrypt registered1528worker1 # [ 0.909940] usbserial: USB Serial support registered for generic1529worker2 # [ 0.987319] Key type fscrypt-provisioning registered1530worker1 # [ 0.911047] ehci-pci 0000:00:07.0: EHCI Host Controller1531worker2 # [ 0.987416] ima: No TPM chip found, activating TPM-bypass!1532worker2 # [ 0.987434] ima: Allocated hash algorithm: sha11533worker1 # [ 0.911072] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 11534worker2 # [ 0.987454] ima: No architecture policies found1535client # [ 0.910685] sky2: driver version 1.301536worker1 # [ 0.911343] ehci-pci 0000:00:07.0: irq 16, io mem 0x100860001537lb # [ 0.905771] e1000: Intel(R) PRO/1000 Network Driver1538client # [ 0.912720] ehci-pci 0000:00:07.0: EHCI Host Controller1539lb # [ 0.905783] e1000: Copyright (c) 1999-2006 Intel Corporation.1540worker1 # [ 0.922259] hv_vmbus: registering driver hyperv_keyboard1541worker2 # [ 0.991678] input: gpio-keys as /devices/platform/gpio-keys/input/input01542client # [ 0.912746] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 11543lb # [ 0.905809] e1000e: Intel(R) PRO/1000 Network Driver1544worker1 # [ 0.922919] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.001545client # [ 0.912997] ehci-pci 0000:00:07.0: irq 16, io mem 0x100860001546lb # [ 0.905818] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.1547worker1 # [ 0.923895] hub 1-0:1.0: USB hub found1548lb # [ 0.905850] igb: Intel(R) Gigabit Ethernet Network Driver1549worker1 # [ 0.924396] hub 1-0:1.0: 6 ports detected1550lb # [ 0.905856] igb: Copyright (c) 2007-2014 Intel Corporation.1551lb # [ 0.905880] igbvf: Intel(R) Gigabit Virtual Function Network Driver1552client # [ 0.916044] usbcore: registered new interface driver usb-storage1553lb # [ 0.905886] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.1554worker1 # [ 0.926176] rtc-pl031 9010000.pl031: registered as rtc01555client # [ 0.916145] usbcore: registered new interface driver usbserial_generic1556lb # [ 0.906029] sky2: driver version 1.301557client # [ 0.916159] usbserial: USB Serial support registered for generic1558worker1 # [ 0.926204] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T14:50:45 UTC (1790088645)1559lb # [ 0.907659] usbcore: registered new interface driver usb-storage1560client # [ 0.916746] hv_vmbus: registering driver hyperv_keyboard1561lb # [ 0.907708] usbcore: registered new interface driver usbserial_generic1562worker1 # [ 0.928173] i2c_dev: i2c /dev entries driver1563lb # [ 0.907723] usbserial: USB Serial support registered for generic1564lb # [ 0.908735] ehci-pci 0000:00:07.0: EHCI Host Controller1565client # [ 0.920507] rtc-pl031 9010000.pl031: registered as rtc01566lb # [ 0.908759] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 11567client # [ 0.920532] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T14:50:45 UTC (1790088645)1568lb # [ 0.909028] ehci-pci 0000:00:07.0: irq 16, io mem 0x100860001569client # [ 0.920837] i2c_dev: i2c /dev entries driver1570lb # [ 0.920197] hv_vmbus: registering driver hyperv_keyboard1571lb # [ 0.921601] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.001572worker1 # [ 0.931887] sdhci: Secure Digital Host Controller Interface driver1573lb # [ 0.922671] hub 1-0:1.0: USB hub found1574worker1 # [ 0.931899] sdhci: Copyright(c) Pierre Ossman1575lb # [ 0.923165] hub 1-0:1.0: 6 ports detected1576worker1 # [ 0.932178] Synopsys Designware Multimedia Card Interface Driver1577worker1 # [ 0.932552] sdhci-pltfm: SDHCI platform and OF driver helper1578worker1 # [ 0.934096] hid: raw HID events driver (C) Jiri Kosina1579client # [ 0.926121] sdhci: Secure Digital Host Controller Interface driver1580client # [ 0.926136] sdhci: Copyright(c) Pierre Ossman1581lb # [ 0.924256] rtc-pl031 9010000.pl031: registered as rtc01582client # [ 0.926396] Synopsys Designware Multimedia Card Interface Driver1583worker1 # [ 0.937687] usbcore: registered new interface driver usbhid1584worker1 # [ 0.937697] usbhid: USB HID core driver1585lb # [ 0.924287] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T14:50:45 UTC (1790088645)1586client # [ 0.926763] sdhci-pltfm: SDHCI platform and OF driver helper1587lb # [ 0.924621] i2c_dev: i2c /dev entries driver1588client # [ 0.928057] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.001589client # [ 0.928355] hub 1-0:1.0: USB hub found1590client # [ 0.928375] hub 1-0:1.0: 6 ports detected1591worker2 # [ 1.008990] clk: Disabling unused clocks1592worker2 # [ 1.009023] PM: genpd: Disabling unused power domains1593worker1 # [ 0.939954] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1594client # [ 0.933288] hid: raw HID events driver (C) Jiri Kosina1595worker1 # [ 0.941487] drop_monitor: Initializing network drop monitor service1596client # [ 0.933557] usbcore: registered new interface driver usbhid1597worker1 # [ 0.941649] NET: Registered PF_INET6 protocol family1598client # [ 0.933564] usbhid: USB HID core driver1599worker2 # [ 1.013218] Freeing unused kernel memory: 4736K1600lb # [ 0.930152] sdhci: Secure Digital Host Controller Interface driver1601worker2 # [ 1.013400] Run /init as init process1602worker1 # [ 0.944748] Segment Routing with IPv61603lb # [ 0.930166] sdhci: Copyright(c) Pierre Ossman1604worker1 # [ 0.944766] In-situ OAM (IOAM) with IPv61605lb # [ 0.930437] Synopsys Designware Multimedia Card Interface Driver1606worker1 # [ 0.944794] NET: Registered PF_PACKET protocol family1607lb # [ 0.930823] sdhci-pltfm: SDHCI platform and OF driver helper1608client # [ 0.936501] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1609client # [ 0.938006] drop_monitor: Initializing network drop monitor service1610lb # [ 0.935140] hid: raw HID events driver (C) Jiri Kosina1611client # [ 0.938150] NET: Registered PF_INET6 protocol family1612lb # [ 0.935434] usbcore: registered new interface driver usbhid1613client # [ 0.941214] Segment Routing with IPv61614lb # [ 0.935441] usbhid: USB HID core driver1615client # [ 0.941232] In-situ OAM (IOAM) with IPv61616worker1 # [ 0.946621] 9pnet: Installing 9P2000 support1617client # [ 0.941261] NET: Registered PF_PACKET protocol family1618worker1 # [ 0.946665] Key type dns_resolver registered1619client # [ 0.942966] 9pnet: Installing 9P2000 support1620client # [ 0.943012] Key type dns_resolver registered1621lb # [ 0.938468] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available1622lb # [ 0.941210] drop_monitor: Initializing network drop monitor service1623worker1 # [ 0.953451] registered taskstats version 11624lb # [ 0.941347] NET: Registered PF_INET6 protocol family1625worker1 # [ 0.953591] Loading compiled-in X.509 certificates1626lb # [ 0.943367] Segment Routing with IPv61627lb # [ 0.943388] In-situ OAM (IOAM) with IPv61628lb # [ 0.943439] NET: Registered PF_PACKET protocol family1629worker2 # [ 1.029087] systemd[1]: Successfully made /usr/ read-only.1630lb # [ 0.945332] 9pnet: Installing 9P2000 support1631client # [ 0.949907] registered taskstats version 11632lb # [ 0.945397] Key type dns_resolver registered1633client # [ 0.950048] Loading compiled-in X.509 certificates1634worker1 # [ 0.962503] Demotion targets for Node 0: null1635worker1 # [ 0.962610] Key type .fscrypt registered1636worker1 # [ 0.962616] Key type fscrypt-provisioning registered1637worker1 # [ 0.962720] ima: No TPM chip found, activating TPM-bypass!1638worker1 # [ 0.962740] ima: Allocated hash algorithm: sha11639worker1 # [ 0.962762] ima: No architecture policies found1640worker1 # [ 0.967085] input: gpio-keys as /devices/platform/gpio-keys/input/input01641client # [ 0.959055] Demotion targets for Node 0: null1642client # [ 0.959163] Key type .fscrypt registered1643lb # [ 0.952301] registered taskstats version 11644client # [ 0.959170] Key type fscrypt-provisioning registered1645lb # [ 0.952450] Loading compiled-in X.509 certificates1646client # [ 0.959266] ima: No TPM chip found, activating TPM-bypass!1647client # [ 0.959286] ima: Allocated hash algorithm: sha11648client # [ 0.959310] ima: No architecture policies found1649client # [ 0.963350] input: gpio-keys as /devices/platform/gpio-keys/input/input01650lb # [ 0.961493] Demotion targets for Node 0: null1651lb # [ 0.961628] Key type .fscrypt registered1652lb # [ 0.961636] Key type fscrypt-provisioning registered1653lb # [ 0.961744] ima: No TPM chip found, activating TPM-bypass!1654lb # [ 0.961765] ima: Allocated hash algorithm: sha11655lb # [ 0.961790] ima: No architecture policies found1656lb # [ 0.965998] input: gpio-keys as /devices/platform/gpio-keys/input/input01657worker1 # [ 0.984642] clk: Disabling unused clocks1658worker1 # [ 0.984672] PM: genpd: Disabling unused power domains1659worker1 # [ 0.988864] Freeing unused kernel memory: 4736K1660worker1 # [ 0.989048] Run /init as init process1661client # [ 0.980667] clk: Disabling unused clocks1662client # [ 0.980693] PM: genpd: Disabling unused power domains1663client # [ 0.984928] Freeing unused kernel memory: 4736K1664client # [ 0.985109] Run /init as init process1665lb # [ 0.983933] clk: Disabling unused clocks1666lb # [ 0.983969] PM: genpd: Disabling unused power domains1667lb # [ 0.988348] Freeing unused kernel memory: 4736K1668lb # [ 0.988562] Run /init as init process1669worker1 # [ 1.004475] systemd[1]: Successfully made /usr/ read-only.1670client # [ 1.002290] systemd[1]: Successfully made /usr/ read-only.1671lb # [ 1.006508] systemd[1]: Successfully made /usr/ read-only.1672worker2 # [ 1.194998] usb 1-1: new high-speed USB device number 2 using ehci-pci1673worker1 # [ 1.170654] usb 1-1: new high-speed USB device number 2 using ehci-pci1674lb # [ 1.168060] usb 1-1: new high-speed USB device number 2 using ehci-pci1675client # [ 1.176117] usb 1-1: new high-speed USB device number 2 using ehci-pci1676worker2 # [ 1.344848] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11677worker2 # [ 1.363920] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1678worker2 # [ 1.373660] systemd[1]: Detected virtualization qemu.1679worker2 # [ 1.375279] systemd[1]: Detected architecture arm64.1680worker2 # [ 1.376688] systemd[1]: Running in initrd.1681worker2 # [ 1.378563] systemd[1]: Initializing machine ID from random generator.1682worker2 # [ 1.380786] systemd[1]: Hostname set to <worker2>.1683worker1 # [ 1.323092] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11684lb # [ 1.322795] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11685client # [ 1.330553] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input11686worker1 # [ 1.339520] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1687client # [ 1.337034] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1688client # [ 1.343868] systemd[1]: Detected virtualization qemu.1689worker1 # [ 1.351953] systemd[1]: Detected virtualization qemu.1690client # [ 1.345224] systemd[1]: Detected architecture arm64.1691client # [ 1.346445] systemd[1]: Running in initrd.1692worker1 # [ 1.354099] systemd[1]: Detected architecture arm64.1693client # [ 1.347959] systemd[1]: Initializing machine ID from random generator.1694worker1 # [ 1.356148] systemd[1]: Running in initrd.1695client # [ 1.349785] systemd[1]: Hostname set to <client>.1696worker1 # [ 1.358921] systemd[1]: Initializing machine ID from random generator.1697worker1 # [ 1.362053] systemd[1]: Hostname set to <worker1>.1698worker2 # [ 1.431267] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input01699lb # [ 1.341498] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1700lb # [ 1.353849] systemd[1]: Detected virtualization qemu.1701lb # [ 1.355854] systemd[1]: Detected architecture arm64.1702lb # [ 1.357893] systemd[1]: Running in initrd.1703lb # [ 1.360628] systemd[1]: Initializing machine ID from random generator.1704lb # [ 1.363515] systemd[1]: Hostname set to <lb>.1705worker1 # [ 1.406617] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input01706lb # [ 1.408374] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input01707client # [ 1.420185] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input01708worker2 # [ 1.550969] usb 1-2: new high-speed USB device number 3 using ehci-pci1709worker1 # [ 1.530366] usb 1-2: new high-speed USB device number 3 using ehci-pci1710lb # [ 1.536168] usb 1-2: new high-speed USB device number 3 using ehci-pci1711client # [ 1.540079] usb 1-2: new high-speed USB device number 3 using ehci-pci1712worker2 # [ 1.681788] systemd[1]: bpf-restrict-fs: LSM BPF program attached1713client # [ 1.630596] systemd[1]: bpf-restrict-fs: LSM BPF program attached1714worker2 # [ 1.715084] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21715worker2 # [ 1.720267] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input01716worker1 # [ 1.669676] systemd[1]: bpf-restrict-fs: LSM BPF program attached1717lb # [ 1.671249] systemd[1]: bpf-restrict-fs: LSM BPF program attached1718worker1 # [ 1.692962] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21719worker1 # [ 1.698505] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input01720client # [ 1.699428] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21721client # [ 1.703318] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input01722lb # [ 1.698972] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input21723lb # [ 1.704373] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input01724worker2 # [ 1.799269] systemd[1]: Queued start job for default target Initrd Default Target.1725worker2 # [ 1.809101] systemd[1]: Created slice Slice /system/modprobe.1726worker2 # [ 1.810218] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1727worker2 # [ 1.811395] systemd[1]: Expecting device /dev/disk/by-label/nixos...1728worker2 # [ 1.812278] systemd[1]: Reached target Path Units.1729worker2 # [ 1.812939] systemd[1]: Reached target Slice Units.1730worker2 # [ 1.813568] systemd[1]: Reached target Swaps.1731worker2 # [ 1.814137] systemd[1]: Reached target Timer Units.1732worker2 # [ 1.814952] systemd[1]: Listening on D-Bus System Message Bus Socket.1733worker2 # [ 1.815965] systemd[1]: Listening on Journal Socket (/dev/log).1734worker2 # [ 1.816848] systemd[1]: Listening on Journal Sockets.1735worker2 # [ 1.817609] systemd[1]: Listening on udev Control Socket.1736worker2 # [ 1.818444] systemd[1]: Listening on udev Kernel Socket.1737worker2 # [ 1.819265] systemd[1]: Reached target Socket Units.1738worker2 # [ 1.821256] systemd[1]: Starting Create List of Static Device Nodes...1739client # [ 1.743450] systemd[1]: Queued start job for default target Initrd Default Target.1740worker2 # [ 1.822199] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1741worker2 # [ 1.830654] systemd[1]: Mounting Kernel Configuration File System...1742client # [ 1.754753] systemd[1]: Created slice Slice /system/modprobe.1743client # [ 1.756114] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1744client # [ 1.756160] systemd[1]: Expecting device /dev/disk/by-label/nixos...1745client # [ 1.756195] systemd[1]: Reached target Path Units.1746client # [ 1.756218] systemd[1]: Reached target Slice Units.1747worker2 # [ 1.839305] systemd[1]: Starting Journal Service...1748client # [ 1.756240] systemd[1]: Reached target Swaps.1749client # [ 1.756259] systemd[1]: Reached target Timer Units.1750worker1 # [ 1.772030] systemd[1]: Queued start job for default target Initrd Default Target.1751client # [ 1.756463] systemd[1]: Listening on D-Bus System Message Bus Socket.1752client # [ 1.756639] systemd[1]: Listening on Journal Socket (/dev/log).1753client # [ 1.756803] systemd[1]: Listening on Journal Sockets.1754client # [ 1.756955] systemd[1]: Listening on udev Control Socket.1755client # [ 1.757082] systemd[1]: Listening on udev Kernel Socket.1756client # [ 1.757106] systemd[1]: Reached target Socket Units.1757client # [ 1.770712] systemd[1]: Starting Create List of Static Device Nodes...1758worker1 # [ 1.780623] systemd[1]: Created slice Slice /system/modprobe.1759client # [ 1.772094] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1760worker1 # [ 1.781798] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1761worker1 # [ 1.783129] systemd[1]: Expecting device /dev/disk/by-label/nixos...1762worker1 # [ 1.784139] systemd[1]: Reached target Path Units.1763worker1 # [ 1.784898] systemd[1]: Reached target Slice Units.1764worker1 # [ 1.785683] systemd[1]: Reached target Swaps.1765worker1 # [ 1.786524] systemd[1]: Reached target Timer Units.1766worker1 # [ 1.787476] systemd[1]: Listening on D-Bus System Message Bus Socket.1767worker1 # [ 1.788636] systemd[1]: Listening on Journal Socket (/dev/log).1768worker1 # [ 1.789702] systemd[1]: Listening on Journal Sockets.1769worker1 # [ 1.790667] systemd[1]: Listening on udev Control Socket.1770worker1 # [ 1.791630] systemd[1]: Listening on udev Kernel Socket.1771worker1 # [ 1.792473] systemd[1]: Reached target Socket Units.1772client # [ 1.784184] systemd[1]: Mounting Kernel Configuration File System...1773worker2 # [ 1.861777] systemd[1]: Starting Load Kernel Modules...1774worker2 # [ 1.861891] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1775worker1 # [ 1.794901] systemd[1]: Starting Create List of Static Device Nodes...1776worker2 # [ 1.865676] systemd[1]: Starting Coldplug All udev Devices...1777worker1 # [ 1.796010] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1778lb # [ 1.786732] systemd[1]: Queued start job for default target Initrd Default Target.1779client # [ 1.792313] systemd[1]: Starting Journal Service...1780worker1 # [ 1.803444] systemd[1]: Mounting Kernel Configuration File System...1781lb # [ 1.798704] systemd[1]: Created slice Slice /system/modprobe.1782client # [ 1.804446] systemd[1]: Starting Load Kernel Modules...1783lb # [ 1.799960] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1784client # [ 1.805438] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1785worker1 # [ 1.814568] systemd[1]: Starting Journal Service...1786lb # [ 1.801477] systemd[1]: Expecting device /dev/disk/by-label/nixos...1787lb # [ 1.801516] systemd[1]: Reached target Path Units.1788lb # [ 1.801537] systemd[1]: Reached target Slice Units.1789lb # [ 1.801557] systemd[1]: Reached target Swaps.1790lb # [ 1.801584] systemd[1]: Reached target Timer Units.1791worker2 # [ 1.888471] systemd[1]: Finished Create List of Static Device Nodes.1792lb # [ 1.801794] systemd[1]: Listening on D-Bus System Message Bus Socket.1793lb # [ 1.801956] systemd[1]: Listening on Journal Socket (/dev/log).1794lb # [ 1.802109] systemd[1]: Listening on Journal Sockets.1795lb # [ 1.802244] systemd[1]: Listening on udev Control Socket.1796lb # [ 1.802364] systemd[1]: Listening on udev Kernel Socket.1797lb # [ 1.802386] systemd[1]: Reached target Socket Units.1798lb # [ 1.813929] systemd[1]: Starting Create List of Static Device Nodes...1799lb # [ 1.815106] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs1800worker2 # [ 1.897095] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1801worker2 # [ 1.904219] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1802worker2 # [ 1.904492] systemd[1]: Mounted Kernel Configuration File System.1803lb # [ 1.824249] systemd[1]: Mounting Kernel Configuration File System...1804worker1 # [ 1.838511] systemd[1]: Starting Load Kernel Modules...1805client # [ 1.832199] systemd[1]: Starting Coldplug All udev Devices...1806worker1 # [ 1.838634] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1807lb # [ 1.832300] systemd[1]: Starting Journal Service...1808worker2 # [ 1.923020] systemd-journald[72]: Collecting audit messages is disabled.1809client # [ 1.844304] systemd-journald[72]: Collecting audit messages is disabled.1810client # [ 1.849080] systemd[1]: Finished Create List of Static Device Nodes.1811worker1 # [ 1.860710] systemd-journald[72]: Collecting audit messages is disabled.1812worker2 # [ 1.931256] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1813worker1 # [ 1.862983] systemd[1]: Starting Coldplug All udev Devices...1814worker2 # [ 1.938870] [drm] pci: virtio-gpu-pci detected at 0000:00:05.01815client # [ 1.864397] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1816client # [ 1.865958] systemd[1]: Mounted Kernel Configuration File System.1817worker1 # [ 1.874659] systemd[1]: Finished Create List of Static Device Nodes.1818worker1 # [ 1.875330] systemd[1]: Mounted Kernel Configuration File System.1819lb # [ 1.864320] systemd[1]: Starting Load Kernel Modules...1820lb # [ 1.864454] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1821worker2 # [ 1.951753] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1822worker2 # [ 1.955300] systemd[1]: Starting Create Static Device Nodes in /dev...1823lb # [ 1.880235] systemd[1]: Starting Coldplug All udev Devices...1824lb # [ 1.882020] systemd-journald[72]: Collecting audit messages is disabled.1825worker1 # [ 1.890623] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1826worker2 # [ 1.967198] [drm] features: -virgl +edid -resource_blob -host_visible1827worker2 # [ 1.967219] [drm] features: -context_init1828worker2 # [ 1.968002] [drm] number of scanouts: 11829worker2 # [ 1.968021] [drm] number of cap sets: 01830worker2 # [ 1.970924] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic1831lb # [ 1.892152] systemd[1]: Finished Create List of Static Device Nodes.1832worker2 # [ 1.970935] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 01833lb # [ 1.892855] systemd[1]: Mounted Kernel Configuration File System.1834lb # [ 1.904403] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1835client # [ 1.912703] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1836worker1 # [ 1.928279] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1837client # [ 1.920373] systemd[1]: Starting Create Static Device Nodes in /dev...1838worker2 # [ 1.995516] Console: switching to colour frame buffer device 160x501839worker2 # [ 2.002088] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device1840client # [ 1.937008] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1841client # [ 1.938729] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1842worker1 # [ 1.950040] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1843worker1 # [ 1.952987] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1844worker1 # [ 1.955633] systemd[1]: Starting Create Static Device Nodes in /dev...1845client # [ 1.949447] [drm] pci: virtio-gpu-pci detected at 0000:00:05.01846client # [ 1.949693] [drm] features: -virgl +edid -resource_blob -host_visible1847client # [ 1.949703] [drm] features: -context_init1848client # [ 1.950399] [drm] number of scanouts: 11849client # [ 1.950416] [drm] number of cap sets: 01850worker2 # [ 2.028631] systemd[1]: Finished Create Static Device Nodes in /dev.1851lb # [ 1.948738] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1852worker2 # [ 2.028860] systemd[1]: Reached target Preparation for Local File Systems.1853worker2 # [ 2.028895] systemd[1]: Reached target Local File Systems.1854lb # [ 1.951476] systemd[1]: Starting Create Static Device Nodes in /dev...1855worker2 # [ 2.034278] systemd[1]: Starting Rule-based Manager for Device Events and Files...1856worker1 # [ 1.967714] [drm] pci: virtio-gpu-pci detected at 0000:00:05.01857worker1 # [ 1.967964] [drm] features: -virgl +edid -resource_blob -host_visible1858worker1 # [ 1.967974] [drm] features: -context_init1859worker1 # [ 1.968688] [drm] number of scanouts: 11860worker1 # [ 1.968710] [drm] number of cap sets: 01861lb # [ 1.961288] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1862client # [ 1.968689] systemd[1]: Finished Create Static Device Nodes in /dev.1863worker2 # [ 2.047471] systemd[1]: Finished Load Kernel Modules.1864client # [ 1.968878] systemd[1]: Reached target Preparation for Local File Systems.1865client # [ 1.968905] systemd[1]: Reached target Local File Systems.1866client # [ 1.972876] systemd[1]: Starting Rule-based Manager for Device Events and Files...1867lb # [ 1.972498] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1868client # [ 1.980471] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic1869client # [ 1.980490] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 01870worker1 # [ 1.990655] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic1871worker1 # [ 1.990678] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 01872lb # [ 1.985281] [drm] pci: virtio-gpu-pci detected at 0000:00:05.01873lb # [ 1.985528] [drm] features: -virgl +edid -resource_blob -host_visible1874lb # [ 1.985538] [drm] features: -context_init1875lb # [ 1.986269] [drm] number of scanouts: 11876lb # [ 1.986293] [drm] number of cap sets: 01877worker2 # [ 2.071147] systemd[1]: Starting Apply Kernel Variables...1878lb # [ 2.008427] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic1879client # [ 2.008384] Console: switching to colour frame buffer device 160x501880lb # [ 2.008450] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 01881client # [ 2.015153] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device1882worker1 # [ 2.018627] Console: switching to colour frame buffer device 160x501883worker2 # [ 2.094716] systemd[1]: Started Journal Service.1884worker1 # [ 2.025662] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device1885worker1 # [ 2.031016] systemd[1]: Finished Create Static Device Nodes in /dev.1886worker1 # [ 2.031418] systemd[1]: Reached target Preparation for Local File Systems.1887lb # [ 2.024741] systemd[1]: Finished Create Static Device Nodes in /dev.1888worker1 # [ 2.031456] systemd[1]: Reached target Local File Systems.1889client # [ 2.014799] systemd-modules-load[73]: Inserted module 'dm_mod'1890lb # [ 2.025131] systemd[1]: Reached target Preparation for Local File Systems.1891lb # [ 2.025164] systemd[1]: Reached target Local File Systems.1892client # [ 2.016201] systemd-modules-load[73]: Module 'virtio_balloon' is built in1893worker1 # [ 2.040259] systemd[1]: Starting Rule-based Manager for Device Events and Files...1894worker2 # [ 2.092328] systemd-modules-load[73]: Inserted module 'dm_mod'1895worker2 # [ 2.093625] systemd-modules-load[73]: Module 'virtio_balloon' is built in1896worker2 # [ 2.094682] systemd-modules-load[73]: Module 'virtio_console' is built in1897worker2 # [ 2.095760] systemd-modules-load[73]: Inserted module 'virtio_gpu'1898client # [ 2.036199] systemd[1]: Started Journal Service.1899lb # [ 2.035117] systemd[1]: Starting Rule-based Manager for Device Events and Files...1900worker2 # [ 2.101722] systemd-modules-load[73]: Module 'virtio_rng' is built in1901client # [ 2.028444] systemd-modules-load[73]: Module 'virtio_console' is built in1902client # [ 2.032306] systemd-modules-load[73]: Inserted module 'virtio_gpu'1903worker1 # [ 2.057208] systemd[1]: Started Journal Service.1904client # [ 2.036278] systemd-modules-load[73]: Module 'virtio_rng' is built in1905worker1 # [ 2.048449] systemd-modules-load[74]: Inserted module 'dm_mod'1906lb # [ 2.044311] Console: switching to colour frame buffer device 160x501907lb # [ 2.051084] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device1908worker2 # [ 2.116900] systemd[1]: Starting Create System Files and Directories...1909client # [ 2.042384] systemd[1]: Starting Create System Files and Directories...1910worker1 # [ 2.052593] systemd-modules-load[74]: Module 'virtio_balloon' is built in1911worker1 # [ 2.053690] systemd-modules-load[74]: Module 'virtio_console' is built in1912worker2 # [ 2.118805] systemd[1]: Finished Apply Kernel Variables.1913client # [ 2.044279] systemd[1]: Finished Load Kernel Modules.1914worker1 # [ 2.054761] systemd-modules-load[74]: Inserted module 'virtio_gpu'1915worker1 # [ 2.068409] systemd-modules-load[74]: Module 'virtio_rng' is built in1916worker2 # [ 2.134938] systemd[1]: Finished Create System Files and Directories.1917worker1 # [ 2.070321] systemd[1]: Starting Create System Files and Directories...1918worker1 # [ 2.072559] systemd[1]: Finished Load Kernel Modules.1919client # [ 2.065400] systemd-udevd[79]: Using default interface naming scheme 'v261'.1920lb # [ 2.076658] systemd[1]: Finished Load Kernel Modules.1921lb # [ 2.064751] systemd-modules-load[73]: Inserted module 'dm_mod'1922worker2 # [ 2.144511] systemd-udevd[79]: Using default interface naming scheme 'v261'.1923lb # [ 2.081978] systemd[1]: Started Journal Service.1924client # [ 2.072063] systemd[1]: Starting Apply Kernel Variables...1925lb # [ 2.070678] systemd-modules-load[73]: Module 'virtio_balloon' is built in1926lb # [ 2.080430] systemd-modules-load[73]: Module 'virtio_console' is built in1927lb # [ 2.084532] systemd-modules-load[73]: Inserted module 'virtio_gpu'1928lb # [ 2.088399] systemd-modules-load[73]: Module 'virtio_rng' is built in1929worker2 # [ 2.169179] systemd[1]: Started Rule-based Manager for Device Events and Files.1930worker1 # [ 2.108131] systemd[1]: Starting Apply Kernel Variables...1931lb # [ 2.096555] systemd[1]: Starting Apply Kernel Variables...1932client # [ 2.108894] systemd[1]: Finished Apply Kernel Variables.1933client # [ 2.111752] systemd[1]: Finished Create System Files and Directories.1934lb # [ 2.109293] systemd[1]: Starting Create System Files and Directories...1935worker1 # [ 2.126034] systemd-udevd[78]: Using default interface naming scheme 'v261'.1936client # [ 2.124482] systemd[1]: Started Rule-based Manager for Device Events and Files.1937lb # [ 2.129133] systemd-udevd[79]: Using default interface naming scheme 'v261'.1938worker1 # [ 2.144084] systemd[1]: Finished Create System Files and Directories.1939worker1 # [ 2.147188] systemd[1]: Finished Apply Kernel Variables.1940worker2 # [ 2.228114] systemd[1]: Starting Virtual Console Setup...1941worker1 # [ 2.169047] systemd[1]: Started Rule-based Manager for Device Events and Files.1942lb # [ 2.172978] systemd[1]: Finished Apply Kernel Variables.1943lb # [ 2.177144] systemd[1]: Finished Create System Files and Directories.1944client # [ 2.188138] systemd[1]: Starting Virtual Console Setup...1945lb # [ 2.188409] systemd[1]: Started Rule-based Manager for Device Events and Files.1946worker2 # [ 2.276528] systemd-vconsole-setup[101]: Configuration of first virtual console was skipped, ignoring remaining ones.1947worker2 # [ 2.280087] systemd[1]: Finished Virtual Console Setup.1948worker1 # [ 2.228120] systemd[1]: Starting Virtual Console Setup...1949client # [ 2.232565] systemd-vconsole-setup[101]: Configuration of first virtual console was skipped, ignoring remaining ones.1950client # [ 2.236170] systemd[1]: Finished Virtual Console Setup.1951lb # [ 2.245245] systemd[1]: Starting Virtual Console Setup...1952worker1 # [ 2.276541] systemd-vconsole-setup[100]: Configuration of first virtual console was skipped, ignoring remaining ones.1953worker1 # [ 2.280001] systemd[1]: Finished Virtual Console Setup.1954lb # [ 2.300545] systemd-vconsole-setup[101]: Configuration of first virtual console was skipped, ignoring remaining ones.1955lb # [ 2.304204] systemd[1]: Finished Virtual Console Setup.1956worker2 # [ 2.877668] systemd[1]: Finished Coldplug All udev Devices.1957worker2 # [ 2.878688] systemd[1]: Reached target System Initialization.1958worker2 # [ 2.884124] systemd[1]: Reached target Basic System.1959client # [ 2.849648] systemd[1]: Finished Coldplug All udev Devices.1960client # [ 2.850606] systemd[1]: Reached target System Initialization.1961client # [ 2.851454] systemd[1]: Reached target Basic System.1962worker1 # [ 2.919941] systemd[1]: Finished Coldplug All udev Devices.1963worker1 # [ 2.924707] systemd[1]: Reached target System Initialization.1964worker1 # [ 2.925605] systemd[1]: Reached target Basic System.1965worker2 # [ 3.008085] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1966lb # [ 2.960870] systemd[1]: Finished Coldplug All udev Devices.1967lb # [ 2.964721] systemd[1]: Reached target System Initialization.1968lb # [ 2.965692] systemd[1]: Reached target Basic System.1969worker2 # [ 3.050752] (udev-worker)[105]: Network interface NamePolicy= disabled on kernel command line.1970worker2 # [ 3.053194] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line.1971client # [ 2.987831] (udev-worker)[93]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1972client # [ 3.015879] (udev-worker)[99]: Network interface NamePolicy= disabled on kernel command line.1973client # [ 3.030632] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line.1974worker2 # [ 3.133995] systemd[1]: Found device /dev/disk/by-label/nixos.1975worker1 # [ 3.067998] (udev-worker)[93]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1976worker2 # [ 3.139334] systemd[1]: Reached target Initrd Root Device.1977worker2 # [ 3.142766] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1978worker1 # [ 3.101343] (udev-worker)[99]: Network interface NamePolicy= disabled on kernel command line.1979client # [ 3.092546] systemd[1]: Found device /dev/disk/by-label/nixos.1980client # [ 3.095957] systemd[1]: Reached target Initrd Root Device.1981worker1 # [ 3.107469] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line.1982client # [ 3.099667] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1983lb # [ 3.100354] (udev-worker)[90]: Network interface NamePolicy= disabled on kernel command line.1984worker2 # [ 3.202826] systemd-fsck[110]: nixos: clean, 12/65536 files, 13019/262144 blocks1985worker2 # [ 3.212115] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1986worker2 # [ 3.216285] systemd[1]: Mounting /sysroot...1987lb # [ 3.148450] (udev-worker)[100]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.1988client # [ 3.157307] systemd-fsck[110]: nixos: clean, 12/65536 files, 13019/262144 blocks1989lb # [ 3.154544] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line.1990client # [ 3.165963] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.1991client # [ 3.177196] systemd[1]: Mounting /sysroot...1992worker2 # [ 3.273071] EXT4-fs (vda): mounted filesystem 5009ca46-ef03-4a4f-be7f-ab9ba76160e4 r/w with ordered data mode. Quota mode: none.1993worker1 # [ 3.197524] systemd[1]: Found device /dev/disk/by-label/nixos.1994worker2 # [ 3.262834] systemd[1]: Mounted /sysroot.1995worker2 # [ 3.264815] systemd[1]: Reached target Initrd Root File System.1996worker1 # [ 3.200690] systemd[1]: Reached target Initrd Root Device.1997worker2 # [ 3.268805] systemd[1]: Starting Mountpoints Configured in the Real Root...1998worker1 # [ 3.203837] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...1999client # [ 3.224769] EXT4-fs (vda): mounted filesystem 42475ddb-4856-4c13-88b2-a776ef152770 r/w with ordered data mode. Quota mode: none.2000client # [ 3.217052] systemd[1]: Mounted /sysroot.
loading 2,157 hidden lines…
4158client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 outPath4159client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 outPath, in 0.21 seconds)4160client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4161client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.03 seconds)4162client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4163client # copying 3 paths...4164client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'...4165client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'...4166client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'...4167client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.26 seconds)4168(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 6.66 seconds)4169subtest: repeat is answered Cached by the scheduler without building4170worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4171worker1 # finding garbage collector roots...4172worker1 # deleting specified paths...4173worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4174worker1 # deleting unused links...4175worker1 # note: hard linking is currently saving 0.0 KiB4176worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.24 seconds)4177worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top4178worker2 # finding garbage collector roots...4179worker2 # deleting specified paths...4180worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top'4181worker2 # deleting unused links...4182worker2 # note: hard linking is currently saving 0.0 KiB4183worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.23 seconds)4184client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 >&24185client # don't know how to build these paths:4186client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv4187worker1 # [ 42.990688] nix-grpc-daemon[767]: ts=2026-09-22T14:51:27Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:406444188worker2 # [ 43.061552] nix-grpc-daemon[771]: ts=2026-09-22T14:51:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:353404189worker2 # [ 43.079915] nix-grpc-daemon[851]: time=2026-09-22T14:51:27.646Z level=INFO msg="All 2 paths already cached"4190worker1 # [ 43.037241] nix-grpc-daemon[767]: ts=2026-09-22T14:51:27Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=14191client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 >&2, in 0.31 seconds)4192client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 outPath4193client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 outPath, in 0.15 seconds)4194lb: must succeed: curl -sf localhost:9901/clusters4195lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4196lb: must succeed: curl -sf localhost:9901/clusters4197lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4198worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4199worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)4200(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.21 seconds)4201subtest: inputs already in the cache are not sent to the scheduler4202lb: must succeed: curl -sf localhost:9901/clusters4203lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4204lb: must succeed: curl -sf localhost:9901/clusters4205lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4206worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4207worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds)4208client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 --argstr top t1b >&24209worker1 # [ 43.911501] nix-grpc-daemon[767]: ts=2026-09-22T14:51:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:406444210client # don't know how to build these paths:4211client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4212worker1 # [ 43.924345] nix-grpc-daemon[767]: ts=2026-09-22T14:51:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406444213worker1 # [ 43.953626] nix-grpc-daemon[767]: ts=2026-09-22T14:51:28Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=04214worker1 # [ 43.956917] nix-grpc-daemon[767]: ts=2026-09-22T14:51:28Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.4:50051 clients=14215worker2 # [ 44.067547] nix-grpc-daemon[771]: ts=2026-09-22T14:51:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:353404216worker2 # [ 44.087875] nix-grpc-daemon[771]: ts=2026-09-22T14:51:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:353404217worker2 # [ 44.110295] nix-grpc-daemon[851]: time=2026-09-22T14:51:28.676Z level=INFO msg="All 2 paths already cached"4218client # copying 1 paths to 'lb:50051'...4219client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'...4220worker2 # [ 44.125792] nix-grpc-daemon[771]: ts=2026-09-22T14:51:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:353404221worker2 # [ 44.143235] nix-daemon[838]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4222worker2 # [ 44.311549] nix-daemon[838]: accepted connection from pid 984, user nix-grpc-daemon (trusted)4223worker2 # [ 44.340293] nix-daemon[838]: reaped child process 987, status = succeeded4224worker2 # [ 44.444743] nix-daemon[838]: accepted connection from pid 989, user nix-grpc-daemon (trusted)4225worker2 # [ 44.468364] nix-daemon[838]: reaped child process 992, status = succeeded4226lb # [ 44.395294] niks3-server[947]: 2026/09/22 14:51:28 INFO Received uploads request method=POST path=/api/pending_closures4227worker2 # [ 44.486659] nix-grpc-daemon[851]: time=2026-09-22T14:51:29.053Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4228worker2 # [ 44.488450] nix-grpc-daemon[851]: time=2026-09-22T14:51:29.054Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)"4229lb # [ 44.429523] niks3-server[947]: 2026/09/22 14:51:29 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst4230lb # [ 44.448089] niks3-server[947]: 2026/09/22 14:51:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4231worker2 # [ 44.535082] nix-grpc-daemon[851]: time=2026-09-22T14:51:29.102Z level=INFO msg="Uploading 1 narinfos"4232lb # [ 44.461035] niks3-server[947]: 2026/09/22 14:51:29 INFO Signed narinfos id=7 count=14233lb # [ 44.470190] niks3-server[947]: 2026/09/22 14:51:29 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls4234lb # [ 44.488397] niks3-server[947]: 2026/09/22 14:51:29 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4235lb # [ 44.497674] niks3-server[947]: 2026/09/22 14:51:29 INFO Completed upload id=74236worker2 # [ 44.577001] nix-grpc-daemon[851]: time=2026-09-22T14:51:29.144Z level=INFO msg="Upload complete. (415ms)"4237lb # [ 44.501874] niks3-server[947]: 2026/09/22 14:51:29 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo4238worker2 # [ 44.588474] nix-grpc-daemon[771]: ts=2026-09-22T14:51:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35340 duration_s=0 paths=1 nar_bytes_in=7524239worker2 # [ 44.609077] nix-grpc-daemon[771]: ts=2026-09-22T14:51:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:353404240worker2 # [ 44.617505] nix-daemon[838]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4241worker2 # [ 44.624254] nix-daemon[838]: reaped child process 982, status = succeeded4242client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051...4243client # farm-top> worker2: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4244worker2 # [ 44.639931] nix-daemon[838]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4245client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds4246client # farm-top> LOG-farm-top-t1b4247worker2 # [ 46.330139] nix-daemon[838]: reaped child process 996, status = succeeded4248worker2 # [ 46.397505] nix-daemon[838]: accepted connection from pid 1013, user nix-grpc-daemon (trusted)4249worker2 # [ 46.419643] nix-daemon[838]: reaped child process 1016, status = succeeded4250lb # [ 46.346131] niks3-server[947]: 2026/09/22 14:51:30 INFO Received uploads request method=POST path=/api/pending_closures4251worker2 # [ 46.435548] nix-grpc-daemon[851]: time=2026-09-22T14:51:31.000Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4252worker2 # [ 46.437217] nix-grpc-daemon[851]: time=2026-09-22T14:51:31.000Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)"4253lb # [ 46.384198] niks3-server[947]: 2026/09/22 14:51:30 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst4254worker2 # [ 46.480038] nix-grpc-daemon[851]: time=2026-09-22T14:51:31.047Z level=INFO msg="Uploading 1 narinfos"4255lb # [ 46.402033] niks3-server[947]: 2026/09/22 14:51:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4256lb # [ 46.413011] niks3-server[947]: 2026/09/22 14:51:30 INFO Signed narinfos id=8 count=14257lb # [ 46.419322] niks3-server[947]: 2026/09/22 14:51:31 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv4258lb # [ 46.431249] niks3-server[947]: 2026/09/22 14:51:31 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls4259worker2 # [ 46.516971] nix-grpc-daemon[851]: time=2026-09-22T14:51:31.084Z level=INFO msg="Upload complete. (264ms)"4260lb # [ 46.438790] niks3-server[947]: 2026/09/22 14:51:31 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4261lb # [ 46.443213] niks3-server[947]: 2026/09/22 14:51:31 INFO Completed upload id=84262lb # [ 46.447385] niks3-server[947]: 2026/09/22 14:51:31 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo4263worker2 # [ 46.529219] nix-grpc-daemon[771]: ts=2026-09-22T14:51:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35340 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=14264worker2 # [ 46.548301] nix-daemon[838]: reaped child process 994, status = succeeded4265client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.83 seconds)4266client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 --argstr top t1b outPath4267client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.19 seconds)4268lb: must succeed: curl -sf localhost:9901/clusters4269lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4270lb: must succeed: curl -sf localhost:9901/clusters4271lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4272worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4273worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds)4274(finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.37 seconds)4275subtest: outputs read back through any worker carry the cache signature4276client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag sig >&24277client # don't know how to build these paths:4278client # /nix/store/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv4279worker1 # [ 47.100465] nix-grpc-daemon[767]: ts=2026-09-22T14:51:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:406444280worker2 # [ 47.169020] nix-grpc-daemon[771]: ts=2026-09-22T14:51:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:353404281worker1 # [ 47.130138] nix-grpc-daemon[767]: ts=2026-09-22T14:51:31Z level=debug event=want client=4 drv=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv cached=04282worker1 # [ 47.137901] nix-grpc-daemon[767]: ts=2026-09-22T14:51:31Z level=debug event=assigned drv=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv worker=192.168.1.3:50051 clients=14283worker1 # [ 47.145819] nix-grpc-daemon[767]: ts=2026-09-22T14:51:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406444284worker1 # [ 47.162737] nix-grpc-daemon[767]: ts=2026-09-22T14:51:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406444285client # copying 1 paths to 'lb:50051'...4286client # copying path '/nix/store/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv' to 'lb:50051'...4287worker1 # [ 47.179542] nix-grpc-daemon[767]: ts=2026-09-22T14:51:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:406444288worker1 # [ 47.195653] nix-daemon[848]: accepted connection from pid 767, user nix-grpc-daemon (trusted)4289worker1 # [ 47.227271] nix-grpc-daemon[767]: ts=2026-09-22T14:51:31Z level=info event=niks3_push_started pid=9014290worker1 # [ 47.408507] nix-grpc-daemon[901]: time=2026-09-22T14:51:31.994Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.key ca=""4291worker1 # [ 47.520638] nix-daemon[848]: accepted connection from pid 914, user nix-grpc-daemon (trusted)4292worker1 # [ 47.544267] nix-daemon[848]: reaped child process 917, status = succeeded4293worker1 # [ 47.648741] nix-daemon[848]: accepted connection from pid 919, user nix-grpc-daemon (trusted)4294worker1 # [ 47.668159] nix-daemon[848]: reaped child process 922, status = succeeded4295lb # [ 47.662433] niks3-server[947]: 2026/09/22 14:51:32 INFO Received uploads request method=POST path=/api/pending_closures4296worker1 # [ 47.688090] nix-grpc-daemon[901]: time=2026-09-22T14:51:32.274Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4297worker1 # [ 47.689646] nix-grpc-daemon[901]: time=2026-09-22T14:51:32.274Z level=INFO msg="Uploading 3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv (512B)"4298lb # [ 47.701828] niks3-server[947]: 2026/09/22 14:51:32 INFO Registered completed upload object_key=nar/13mhmmy2qay13imbbdi287vhryz1hwnyg0w6agd9s0ph37wnsqll.nar.zst4299worker1 # [ 47.731967] nix-grpc-daemon[901]: time=2026-09-22T14:51:32.319Z level=INFO msg="Uploading 1 narinfos"4300lb # [ 47.717958] niks3-server[947]: 2026/09/22 14:51:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4301lb # [ 47.729715] niks3-server[947]: 2026/09/22 14:51:32 INFO Signed narinfos id=9 count=14302lb # [ 47.734745] niks3-server[947]: 2026/09/22 14:51:32 INFO Registered completed upload object_key=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y.ls4303lb # [ 47.743348] niks3-server[947]: 2026/09/22 14:51:32 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4304lb # [ 47.753118] niks3-server[947]: 2026/09/22 14:51:32 INFO Completed upload id=94305worker1 # [ 47.767721] nix-grpc-daemon[901]: time=2026-09-22T14:51:32.355Z level=INFO msg="Upload complete. (359ms)"4306lb # [ 47.755822] niks3-server[947]: 2026/09/22 14:51:32 INFO Registered completed upload object_key=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y.narinfo4307worker1 # [ 47.778371] nix-grpc-daemon[767]: ts=2026-09-22T14:51:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40644 duration_s=0 paths=1 nar_bytes_in=5124308worker1 # [ 47.788999] nix-grpc-daemon[767]: ts=2026-09-22T14:51:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406444309worker1 # [ 47.800474] nix-daemon[848]: accepted connection from pid 767, user nix-grpc-daemon (trusted)4310worker1 # [ 47.805591] nix-daemon[848]: reaped child process 899, status = succeeded4311client # building '/nix/store/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv' on lb:50051...4312client # farm-a> node-a: building 3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv4313worker1 # [ 47.819171] nix-daemon[848]: accepted connection from pid 767, user nix-grpc-daemon (trusted)4314client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds4315client # farm-a> LOG-farm-a-sig4316worker1 # [ 48.924638] nix-daemon[848]: reaped child process 926, status = succeeded4317worker1 # [ 49.012733] nix-daemon[848]: accepted connection from pid 942, user nix-grpc-daemon (trusted)4318worker1 # [ 49.034485] nix-daemon[848]: reaped child process 945, status = succeeded4319lb # [ 49.025858] niks3-server[947]: 2026/09/22 14:51:33 INFO Received uploads request method=POST path=/api/pending_closures4320worker1 # [ 49.052526] nix-grpc-daemon[901]: time=2026-09-22T14:51:33.638Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4321worker1 # [ 49.054162] nix-grpc-daemon[901]: time=2026-09-22T14:51:33.638Z level=INFO msg="Uploading 2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a (128B)"4322lb # [ 49.070966] niks3-server[947]: 2026/09/22 14:51:33 INFO Registered completed upload object_key=log/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv4323lb # [ 49.087938] niks3-server[947]: 2026/09/22 14:51:33 INFO Registered completed upload object_key=nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst4324lb # [ 49.099180] niks3-server[947]: 2026/09/22 14:51:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4325worker1 # [ 49.118787] nix-grpc-daemon[901]: time=2026-09-22T14:51:33.705Z level=INFO msg="Uploading 1 narinfos"4326lb # [ 49.107756] niks3-server[947]: 2026/09/22 14:51:33 INFO Signed narinfos id=10 count=14327lb # [ 49.113136] niks3-server[947]: 2026/09/22 14:51:33 INFO Registered completed upload object_key=2ykckkv44ccpw95ad66fm21ggp6krwj9.ls4328lb # [ 49.123704] niks3-server[947]: 2026/09/22 14:51:33 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4329lb # [ 49.129632] niks3-server[947]: 2026/09/22 14:51:33 INFO Completed upload id=104330worker1 # [ 49.143631] nix-grpc-daemon[901]: time=2026-09-22T14:51:33.731Z level=INFO msg="Upload complete. (310ms)"4331lb # [ 49.132670] niks3-server[947]: 2026/09/22 14:51:33 INFO Registered completed upload object_key=2ykckkv44ccpw95ad66fm21ggp6krwj9.narinfo4332worker1 # [ 49.163647] nix-grpc-daemon[767]: ts=2026-09-22T14:51:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40644 duration_s=1 drv=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv assign_id=5 outputs=14333worker1 # [ 49.180401] nix-grpc-daemon[767]: ts=2026-09-22T14:51:33Z level=debug event=want client=4 drv=z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv cached=04334worker1 # [ 49.185508] nix-grpc-daemon[767]: ts=2026-09-22T14:51:33Z level=debug event=assigned drv=z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv worker=192.168.1.3:50051 clients=14335worker1 # [ 49.189583] nix-daemon[848]: reaped child process 924, status = succeeded4336worker1 # [ 49.207138] nix-grpc-daemon[767]: ts=2026-09-22T14:51:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406444337worker1 # [ 49.223222] nix-grpc-daemon[767]: ts=2026-09-22T14:51:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406444338worker1 # [ 49.237781] nix-grpc-daemon[901]: time=2026-09-22T14:51:33.825Z level=INFO msg="All 1 paths already cached"4339client # copying 1 paths to 'lb:50051'...4340client # copying path '/nix/store/z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv' to 'lb:50051'...4341worker1 # [ 49.250046] nix-grpc-daemon[767]: ts=2026-09-22T14:51:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:406444342worker1 # [ 49.264159] nix-daemon[848]: accepted connection from pid 767, user nix-grpc-daemon (trusted)4343worker1 # [ 49.426725] nix-daemon[848]: accepted connection from pid 951, user nix-grpc-daemon (trusted)4344worker1 # [ 49.445652] nix-daemon[848]: reaped child process 954, status = succeeded4345worker1 # [ 49.555884] nix-daemon[848]: accepted connection from pid 956, user nix-grpc-daemon (trusted)4346worker1 # [ 49.576112] nix-daemon[848]: reaped child process 959, status = succeeded4347lb # [ 49.565539] niks3-server[947]: 2026/09/22 14:51:34 INFO Received uploads request method=POST path=/api/pending_closures4348worker1 # [ 49.593435] nix-grpc-daemon[901]: time=2026-09-22T14:51:34.180Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4349worker1 # [ 49.595105] nix-grpc-daemon[901]: time=2026-09-22T14:51:34.181Z level=INFO msg="Uploading z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv (624B)"4350lb # [ 49.598879] niks3-server[947]: 2026/09/22 14:51:34 INFO Registered completed upload object_key=nar/0cnhkgsbmxv5hj7zw3fa59qfxikw6251mlhz2gz1v6pgn8c8shwp.nar.zst4351worker1 # [ 49.634770] nix-grpc-daemon[901]: time=2026-09-22T14:51:34.222Z level=INFO msg="Uploading 1 narinfos"4352lb # [ 49.614506] niks3-server[947]: 2026/09/22 14:51:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4353lb # [ 49.628130] niks3-server[947]: 2026/09/22 14:51:34 INFO Signed narinfos id=11 count=14354lb # [ 49.635576] niks3-server[947]: 2026/09/22 14:51:34 INFO Registered completed upload object_key=z8kadp39h0myij9ln0hpxb61ldn71h4i.ls4355lb # [ 49.650946] niks3-server[947]: 2026/09/22 14:51:34 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4356worker1 # [ 49.666885] nix-grpc-daemon[901]: time=2026-09-22T14:51:34.251Z level=INFO msg="Upload complete. (382ms)"4357lb # [ 49.660883] niks3-server[947]: 2026/09/22 14:51:34 INFO Completed upload id=114358lb # [ 49.663826] niks3-server[947]: 2026/09/22 14:51:34 INFO Registered completed upload object_key=z8kadp39h0myij9ln0hpxb61ldn71h4i.narinfo4359worker1 # [ 49.675658] nix-grpc-daemon[767]: ts=2026-09-22T14:51:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40644 duration_s=0 paths=1 nar_bytes_in=6244360worker1 # [ 49.684530] nix-grpc-daemon[767]: ts=2026-09-22T14:51:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406444361worker1 # [ 49.696466] nix-daemon[848]: accepted connection from pid 767, user nix-grpc-daemon (trusted)4362worker1 # [ 49.701695] nix-daemon[848]: reaped child process 949, status = succeeded4363lb # [ 49.692159] envoy[905]: conn peer=[2001:db8:1::1]:41610 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9493 tx=4355 ms=58674364client # building '/nix/store/z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv' on lb:50051...4365worker1 # [ 49.715676] nix-daemon[848]: accepted connection from pid 767, user nix-grpc-daemon (trusted)4366lb # [ 49.698938] envoy[905]: conn peer=[2001:db8:1::1]:39098 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=714367client # farm-b> node-a: building z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv4368lb # [ 49.703883] envoy[905]: conn peer=[2001:db8:1::1]:39102 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4202 tx=1911 ms=25694369client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds4370client # farm-b> LOG-farm-b-sig4371worker1 # [ 50.404439] nix-daemon[848]: reaped child process 963, status = succeeded4372worker1 # [ 50.494222] nix-daemon[848]: accepted connection from pid 979, user nix-grpc-daemon (trusted)4373worker1 # [ 50.518274] nix-daemon[848]: reaped child process 982, status = succeeded4374lb # [ 50.507590] niks3-server[947]: 2026/09/22 14:51:35 INFO Received uploads request method=POST path=/api/pending_closures4375worker1 # [ 50.536215] nix-grpc-daemon[901]: time=2026-09-22T14:51:35.123Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4376worker1 # [ 50.537800] nix-grpc-daemon[901]: time=2026-09-22T14:51:35.123Z level=INFO msg="Uploading h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b (176B)"4377lb # [ 50.569740] niks3-server[947]: 2026/09/22 14:51:35 INFO Registered completed upload object_key=nar/0f75gpfkjj0g9xi2113yvvpdw0l16spc2f1xik1ifnzfbrvx4pfk.nar.zst4378lb # [ 50.578331] niks3-server[947]: 2026/09/22 14:51:35 INFO Registered completed upload object_key=log/z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv4379lb # [ 50.585923] niks3-server[947]: 2026/09/22 14:51:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4380worker1 # [ 50.604708] nix-grpc-daemon[901]: time=2026-09-22T14:51:35.191Z level=INFO msg="Uploading 1 narinfos"4381lb # [ 50.592827] niks3-server[947]: 2026/09/22 14:51:35 INFO Signed narinfos id=12 count=14382lb # [ 50.599441] niks3-server[947]: 2026/09/22 14:51:35 INFO Registered completed upload object_key=h1r17djqpb9gp4y7v8nzx65ns9vdr50c.ls4383lb # [ 50.610963] niks3-server[947]: 2026/09/22 14:51:35 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4384lb # [ 50.619568] niks3-server[947]: 2026/09/22 14:51:35 INFO Completed upload id=124385worker1 # [ 50.632419] nix-grpc-daemon[901]: time=2026-09-22T14:51:35.220Z level=INFO msg="Upload complete. (306ms)"4386lb # [ 50.621852] niks3-server[947]: 2026/09/22 14:51:35 INFO Registered completed upload object_key=h1r17djqpb9gp4y7v8nzx65ns9vdr50c.narinfo4387worker1 # [ 50.649299] nix-grpc-daemon[767]: ts=2026-09-22T14:51:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40644 duration_s=0 drv=z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv assign_id=6 outputs=14388worker1 # [ 50.676397] nix-grpc-daemon[767]: ts=2026-09-22T14:51:35Z level=debug event=want client=4 drv=knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv cached=04389worker1 # [ 50.681357] nix-grpc-daemon[767]: ts=2026-09-22T14:51:35Z level=debug event=assigned drv=knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv worker=192.168.1.3:50051 clients=14390worker1 # [ 50.686203] nix-daemon[848]: reaped child process 961, status = succeeded4391worker1 # [ 50.708197] nix-grpc-daemon[767]: ts=2026-09-22T14:51:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406444392worker1 # [ 50.727319] nix-grpc-daemon[767]: ts=2026-09-22T14:51:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406444393worker1 # [ 50.748667] nix-grpc-daemon[901]: time=2026-09-22T14:51:35.336Z level=INFO msg="All 2 paths already cached"4394client # copying 1 paths to 'lb:50051'...4395worker1 # [ 50.761297] nix-grpc-daemon[767]: ts=2026-09-22T14:51:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:406444396client # copying path '/nix/store/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv' to 'lb:50051'...4397worker1 # [ 50.770893] nix-daemon[848]: accepted connection from pid 767, user nix-grpc-daemon (trusted)4398worker1 # [ 50.890963] nix-daemon[848]: accepted connection from pid 988, user nix-grpc-daemon (trusted)4399worker1 # [ 50.919807] nix-daemon[848]: reaped child process 991, status = succeeded4400worker1 # [ 51.023673] nix-daemon[848]: accepted connection from pid 993, user nix-grpc-daemon (trusted)4401worker1 # [ 51.044516] nix-daemon[848]: reaped child process 996, status = succeeded4402lb # [ 51.036221] niks3-server[947]: 2026/09/22 14:51:35 INFO Received uploads request method=POST path=/api/pending_closures4403worker1 # [ 51.067755] nix-grpc-daemon[901]: time=2026-09-22T14:51:35.655Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4404worker1 # [ 51.070055] nix-grpc-daemon[901]: time=2026-09-22T14:51:35.657Z level=INFO msg="Uploading knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv (752B)"4405lb # [ 51.072972] niks3-server[947]: 2026/09/22 14:51:35 INFO Registered completed upload object_key=nar/0lpagyrngav67x80d1hq0njjlkmqdkvqawraz8dsp36ag50v6iwf.nar.zst4406lb # [ 51.081310] niks3-server[947]: 2026/09/22 14:51:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4407worker1 # [ 51.096179] nix-grpc-daemon[901]: time=2026-09-22T14:51:35.683Z level=INFO msg="Uploading 1 narinfos"4408lb # [ 51.085946] niks3-server[947]: 2026/09/22 14:51:35 INFO Signed narinfos id=13 count=14409lb # [ 51.090782] niks3-server[947]: 2026/09/22 14:51:35 INFO Registered completed upload object_key=knvx2sz45j0sdqm3fnbdrv7m887k7a6x.ls4410lb # [ 51.100711] niks3-server[947]: 2026/09/22 14:51:35 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4411lb # [ 51.107098] niks3-server[947]: 2026/09/22 14:51:35 INFO Completed upload id=134412worker1 # [ 51.119724] nix-grpc-daemon[901]: time=2026-09-22T14:51:35.707Z level=INFO msg="Upload complete. (341ms)"4413lb # [ 51.111512] niks3-server[947]: 2026/09/22 14:51:35 INFO Registered completed upload object_key=knvx2sz45j0sdqm3fnbdrv7m887k7a6x.narinfo4414worker1 # [ 51.128389] nix-grpc-daemon[767]: ts=2026-09-22T14:51:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40644 duration_s=0 paths=1 nar_bytes_in=7524415worker1 # [ 51.143206] nix-grpc-daemon[767]: ts=2026-09-22T14:51:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406444416worker1 # [ 51.149221] nix-daemon[848]: accepted connection from pid 767, user nix-grpc-daemon (trusted)4417worker1 # [ 51.154220] nix-daemon[848]: reaped child process 986, status = succeeded4418client # building '/nix/store/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv' on lb:50051...4419worker1 # [ 51.167792] nix-daemon[848]: accepted connection from pid 767, user nix-grpc-daemon (trusted)4420client # farm-top> node-a: building knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv4421client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds4422client # farm-top> LOG-farm-top-sig4423worker1 # [ 52.397560] nix-daemon[848]: reaped child process 1000, status = succeeded4424worker1 # [ 52.522497] nix-daemon[848]: accepted connection from pid 1016, user nix-grpc-daemon (trusted)4425worker1 # [ 52.544956] nix-daemon[848]: reaped child process 1019, status = succeeded4426lb # [ 52.543208] niks3-server[947]: 2026/09/22 14:51:37 INFO Received uploads request method=POST path=/api/pending_closures4427worker1 # [ 52.572185] nix-grpc-daemon[901]: time=2026-09-22T14:51:37.158Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4428worker1 # [ 52.573723] nix-grpc-daemon[901]: time=2026-09-22T14:51:37.158Z level=INFO msg="Uploading 4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top (232B)"4429lb # [ 52.610627] niks3-server[947]: 2026/09/22 14:51:37 INFO Registered completed upload object_key=nar/07ar364rwqqniwi2nkdpqlgv7ws7702n5lqz703ackfmssrh40v8.nar.zst4430worker1 # [ 52.641855] nix-grpc-daemon[901]: time=2026-09-22T14:51:37.229Z level=INFO msg="Uploading 1 narinfos"4431lb # [ 52.622630] niks3-server[947]: 2026/09/22 14:51:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4432lb # [ 52.632295] niks3-server[947]: 2026/09/22 14:51:37 INFO Signed narinfos id=14 count=14433lb # [ 52.637010] niks3-server[947]: 2026/09/22 14:51:37 INFO Registered completed upload object_key=log/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv4434lb # [ 52.646431] niks3-server[947]: 2026/09/22 14:51:37 INFO Registered completed upload object_key=4s2wbz2hg55lpb7s5vn3ynd342bs09lw.ls4435lb # [ 52.660651] niks3-server[947]: 2026/09/22 14:51:37 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4436lb # [ 52.669984] niks3-server[947]: 2026/09/22 14:51:37 INFO Completed upload id=144437worker1 # [ 52.683977] nix-grpc-daemon[901]: time=2026-09-22T14:51:37.271Z level=INFO msg="Upload complete. (305ms)"4438lb # [ 52.673531] niks3-server[947]: 2026/09/22 14:51:37 INFO Registered completed upload object_key=4s2wbz2hg55lpb7s5vn3ynd342bs09lw.narinfo4439worker1 # [ 52.701479] nix-grpc-daemon[767]: ts=2026-09-22T14:51:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40644 duration_s=1 drv=knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv assign_id=7 outputs=14440worker1 # [ 52.723258] nix-daemon[848]: reaped child process 998, status = succeeded4441client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag sig >&2, in 5.87 seconds)4442client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag sig outPath4443client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag sig outPath, in 0.19 seconds)4444client: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top4445worker1 # [ 53.079293] nix-grpc-daemon[767]: ts=2026-09-22T14:51:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:359464446worker1 # [ 53.123126] nix-grpc-daemon[767]: ts=2026-09-22T14:51:37Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:359464447client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top, in 0.26 seconds)4448client: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top4449worker2 # [ 53.448622] nix-grpc-daemon[771]: ts=2026-09-22T14:51:38Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:412124450client # these 3 paths will be fetched (0.0 KiB download, 0.5 KiB unpacked):4451client # /nix/store/2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a4452worker2 # [ 53.491972] nix-grpc-daemon[771]: ts=2026-09-22T14:51:38Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:412124453client # /nix/store/h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b4454client # /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top4455worker2 # [ 53.496884] nix-grpc-daemon[771]: copying path '/nix/store/2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a' from 'http://lb:5751'...4456worker2 # [ 53.514857] nix-grpc-daemon[771]: copying path '/nix/store/h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b' from 'http://lb:5751'...4457worker2 # [ 53.533669] nix-grpc-daemon[771]: copying path '/nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top' from 'http://lb:5751'...4458client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top, in 0.32 seconds)4459client: must succeed: nix-store --delete /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top4460client # finding garbage collector roots...4461client # removing stale temporary roots file "/nix/var/nix/temproots/946"4462client # removing stale temporary roots file "/nix/var/nix/temproots/931"4463client # removing stale temporary roots file "/nix/var/nix/temproots/901"4464client # removing stale temporary roots file "/nix/var/nix/temproots/909"4465client # removing stale temporary roots file "/nix/var/nix/temproots/923"4466client # removing stale temporary roots file "/nix/var/nix/temproots/889"4467client # removing stale temporary roots file "/nix/var/nix/temproots/851"4468client # removing stale temporary roots file "/nix/var/nix/temproots/867"4469client # deleting specified paths...4470client # deleting '/nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top'4471client # deleting unused links...4472client # note: hard linking is currently saving 0.0 KiB4473worker1 # [ 53.878387] nix-grpc-daemon[767]: ts=2026-09-22T14:51:38Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:406444474worker1 # [ 53.889010] nix-grpc-daemon[767]: ts=2026-09-22T14:51:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406444475worker1 # [ 53.905836] nix-grpc-daemon[901]: time=2026-09-22T14:51:38.490Z level=INFO msg="All 1 paths already cached"4476worker1 # [ 53.911469] nix-grpc-daemon[767]: ts=2026-09-22T14:51:38Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:406444477worker1 # [ 53.922800] nix-grpc-daemon[767]: ts=2026-09-22T14:51:38Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:406444478client # copying 3 paths...4479worker2 # [ 54.006000] nix-grpc-daemon[771]: ts=2026-09-22T14:51:38Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:353404480client # copying path '/nix/store/2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a' from 'grpc://lb:50051'...4481worker2 # [ 54.040102] nix-grpc-daemon[771]: ts=2026-09-22T14:51:38Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:353404482worker2 # [ 54.048478] nix-grpc-daemon[771]: ts=2026-09-22T14:51:38Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:35340 duration_s=0 paths=1 nar_bytes_out=2324483worker1 # [ 53.995815] nix-grpc-daemon[767]: ts=2026-09-22T14:51:38Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:406444484worker1 # [ 54.004480] nix-grpc-daemon[767]: ts=2026-09-22T14:51:38Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40644 duration_s=0 paths=1 nar_bytes_out=1764485worker1 # [ 54.021153] nix-grpc-daemon[767]: ts=2026-09-22T14:51:38Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:406444486worker1 # [ 54.028853] nix-grpc-daemon[767]: ts=2026-09-22T14:51:38Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40644 duration_s=0 paths=1 nar_bytes_out=1284487client # copying path '/nix/store/h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b' from 'grpc://lb:50051'...4488client # copying path '/nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top' from 'grpc://lb:50051'...4489client: (finished: must succeed: nix-store --delete /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top, in 0.62 seconds)4490(finished: subtest: outputs read back through any worker carry the cache signature, in 7.26 seconds)4491subtest: two clients wanting the same drv build it once4492client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup4493client # [ 54.186187] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup.4494client # Running as unit: dedup1.service; invocation ID: 914304bf3e4d4bb4affc9fb4c1db4f044495client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup, in 0.07 seconds)4496client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup4497worker1 # [ 54.389141] nix-grpc-daemon[767]: ts=2026-09-22T14:51:38Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:406444498client # [ 54.386951] nix[999]: don't know how to build these paths:4499client # [ 54.388835] nix[999]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4500worker1 # [ 54.410146] nix-grpc-daemon[767]: ts=2026-09-22T14:51:38Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04501worker1 # [ 54.416741] nix-grpc-daemon[767]: ts=2026-09-22T14:51:38Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=14502worker2 # [ 54.525506] nix-grpc-daemon[771]: ts=2026-09-22T14:51:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:353404503worker2 # [ 54.545666] nix-grpc-daemon[771]: ts=2026-09-22T14:51:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:353404504client # [ 54.492272] nix[999]: copying 1 paths to 'lb:50051'...4505worker2 # [ 54.565114] nix-grpc-daemon[771]: ts=2026-09-22T14:51:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:353404506client # [ 54.497431] nix[999]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'...4507worker2 # [ 54.583692] nix-daemon[838]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4508worker2 # [ 54.737580] nix-daemon[838]: accepted connection from pid 1023, user nix-grpc-daemon (trusted)4509worker2 # [ 54.761339] nix-daemon[838]: reaped child process 1026, status = succeeded4510worker2 # [ 54.873425] nix-daemon[838]: accepted connection from pid 1028, user nix-grpc-daemon (trusted)4511worker2 # [ 54.896045] nix-daemon[838]: reaped child process 1031, status = succeeded4512lb # [ 54.817894] niks3-server[947]: 2026/09/22 14:51:39 INFO Received uploads request method=POST path=/api/pending_closures4513worker2 # [ 54.907115] nix-grpc-daemon[851]: time=2026-09-22T14:51:39.474Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4514worker2 # [ 54.908781] nix-grpc-daemon[851]: time=2026-09-22T14:51:39.474Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)"4515lb # [ 54.856480] niks3-server[947]: 2026/09/22 14:51:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4516worker2 # [ 54.947541] nix-grpc-daemon[851]: time=2026-09-22T14:51:39.514Z level=INFO msg="Uploading 1 narinfos"4517lb # [ 54.872747] niks3-server[947]: 2026/09/22 14:51:39 INFO Signed narinfos id=15 count=14518lb # [ 54.875403] niks3-server[947]: 2026/09/22 14:51:39 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst4519worker2 # [ 54.970332] nix-grpc-daemon[851]: time=2026-09-22T14:51:39.537Z level=INFO msg="Upload complete. (372ms)"4520lb # [ 54.891575] niks3-server[947]: 2026/09/22 14:51:39 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls4521lb # [ 54.900631] niks3-server[947]: 2026/09/22 14:51:39 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4522lb # [ 54.903239] niks3-server[947]: 2026/09/22 14:51:39 INFO Completed upload id=154523worker2 # [ 54.979848] nix-grpc-daemon[771]: ts=2026-09-22T14:51:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35340 duration_s=0 paths=1 nar_bytes_in=4324524lb # [ 54.906040] niks3-server[947]: 2026/09/22 14:51:39 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo4525worker2 # [ 54.987173] nix-grpc-daemon[771]: ts=2026-09-22T14:51:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:353404526worker2 # [ 54.998955] nix-daemon[838]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4527worker2 # [ 55.003418] nix-daemon[838]: reaped child process 1021, status = succeeded4528worker2 # [ 55.013830] nix-daemon[838]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4529client # [ 54.938799] nix[999]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4530client # [ 55.287120] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup.4531client # Running as unit: dedup2.service; invocation ID: e873a13ab121402c9539726bb2e6c7634532client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup, in 1.12 seconds)4533worker2 # [ 55.617742] nix-grpc-daemon[771]: ts=2026-09-22T14:51:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:353404534client # [ 55.559675] nix[1015]: this derivation will be built:4535worker1 # [ 55.577462] nix-grpc-daemon[767]: ts=2026-09-22T14:51:40Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:406444536worker1 # [ 55.593182] nix-grpc-daemon[767]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' from 'http://lb:5751'...4537client # [ 55.604922] nix[1015]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4538worker1 # [ 55.628378] nix-grpc-daemon[767]: ts=2026-09-22T14:51:40Z level=debug event=want client=6 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=04539worker2 # [ 55.703977] nix-grpc-daemon[771]: ts=2026-09-22T14:51:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:353404540client # [ 55.637031] nix[1015]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051...4541client: must succeed: sleep 24542client: (finished: must succeed: sleep 2, in 2.05 seconds)4543client: waiting for success: ! systemctl is-active dedup1 dedup24544worker2 # [ 59.051558] nix-daemon[838]: reaped child process 1035, status = succeeded4545worker2 # [ 59.168367] nix-daemon[838]: accepted connection from pid 1066, user nix-grpc-daemon (trusted)4546worker2 # [ 59.191912] nix-daemon[838]: reaped child process 1069, status = succeeded4547lb # [ 59.111047] niks3-server[947]: 2026/09/22 14:51:43 INFO Received uploads request method=POST path=/api/pending_closures4548worker2 # [ 59.200843] nix-grpc-daemon[851]: time=2026-09-22T14:51:43.766Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4549worker2 # [ 59.202341] nix-grpc-daemon[851]: time=2026-09-22T14:51:43.766Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)"4550lb # [ 59.151837] niks3-server[947]: 2026/09/22 14:51:43 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4551lb # [ 59.173930] niks3-server[947]: 2026/09/22 14:51:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4552worker2 # [ 59.258988] nix-grpc-daemon[851]: time=2026-09-22T14:51:43.825Z level=INFO msg="Uploading 1 narinfos"4553lb # [ 59.182325] niks3-server[947]: 2026/09/22 14:51:43 INFO Signed narinfos id=16 count=14554lb # [ 59.193588] niks3-server[947]: 2026/09/22 14:51:43 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls4555lb # [ 59.202910] niks3-server[947]: 2026/09/22 14:51:43 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv4556lb # [ 59.217567] niks3-server[947]: 2026/09/22 14:51:43 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4557worker2 # [ 59.296907] nix-grpc-daemon[851]: time=2026-09-22T14:51:43.864Z level=INFO msg="Upload complete. (266ms)"4558lb # [ 59.222594] niks3-server[947]: 2026/09/22 14:51:43 INFO Completed upload id=164559lb # [ 59.228642] niks3-server[947]: 2026/09/22 14:51:43 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo4560worker2 # [ 59.312377] nix-grpc-daemon[771]: ts=2026-09-22T14:51:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35340 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=8 outputs=14561worker2 # [ 59.330174] nix-grpc-daemon[771]: ts=2026-09-22T14:51:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35340 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=8 outputs=14562worker2 # [ 59.337630] nix-daemon[838]: reaped child process 1033, status = succeeded4563client # [ 59.281643] systemd[1]: dedup1.service: Deactivated successfully.4564client # [ 59.287444] systemd[1]: dedup1.service: Consumed 187ms CPU time over 5.094s wall clock time, 41.5M memory peak, 7.2K incoming IP traffic, 8.3K outgoing IP traffic.4565client # [ 59.333230] systemd[1]: dedup2.service: Deactivated successfully.4566client # [ 59.337598] systemd[1]: dedup2.service: Consumed 238ms CPU time over 4.049s wall clock time, 35.2M memory peak, 6.6K incoming IP traffic, 5.9K outgoing IP traffic.4567lb # [ 59.688988] envoy[905]: conn peer=[2001:db8:1::1]:39106 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9584 tx=4414 ms=56174568lb # [ 59.694001] envoy[905]: conn peer=[2001:db8:1::1]:56364 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=427 tx=426 ms=1434569lb # [ 59.698941] envoy[905]: conn peer=[2001:db8:1::1]:56368 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=376 ms=1264570lb # [ 59.705759] envoy[905]: conn peer=[2001:db8:1::1]:56350 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1051 tx=2888 ms=2424571lb # [ 59.710590] envoy[905]: conn peer=[2001:db8:1::1]:56384 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=408 tx=329 ms=1074572lb # [ 59.715521] envoy[905]: conn peer=[2001:db8:1::1]:56388 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3005 tx=1565 ms=48764573lb # [ 59.720456] envoy[905]: conn peer=[2001:db8:1::1]:56398 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1592 tx=1599 ms=37684574client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.13 seconds)4575client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4576client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds)4577worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4578worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds)4579worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4580worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds)4581worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4582worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)4583worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4584worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)4585(finished: subtest: two clients wanting the same drv build it once, in 6.16 seconds)4586subtest: --timeout and --max-silent-time reach the builder4587worker1 # [ 60.549291] nix-grpc-daemon[767]: ts=2026-09-22T14:51:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:406444588worker1 # [ 60.563432] nix-grpc-daemon[767]: ts=2026-09-22T14:51:45Z level=debug event=want client=7 drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv cached=04589worker1 # [ 60.570996] nix-grpc-daemon[767]: ts=2026-09-22T14:51:45Z level=debug event=assigned drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv worker=192.168.1.3:50051 clients=14590worker1 # [ 60.581755] nix-grpc-daemon[767]: ts=2026-09-22T14:51:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406444591worker1 # [ 60.593748] nix-grpc-daemon[767]: ts=2026-09-22T14:51:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406444592worker1 # [ 60.610333] nix-grpc-daemon[767]: ts=2026-09-22T14:51:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:406444593worker1 # [ 60.626033] nix-daemon[848]: accepted connection from pid 767, user nix-grpc-daemon (trusted)4594worker1 # [ 60.792247] nix-daemon[848]: accepted connection from pid 1051, user nix-grpc-daemon (trusted)4595worker1 # [ 60.814287] nix-daemon[848]: reaped child process 1054, status = succeeded4596worker1 # [ 60.925996] nix-daemon[848]: accepted connection from pid 1056, user nix-grpc-daemon (trusted)4597worker1 # [ 60.948781] nix-daemon[848]: reaped child process 1059, status = succeeded4598lb # [ 60.933456] niks3-server[947]: 2026/09/22 14:51:45 INFO Received uploads request method=POST path=/api/pending_closures4599worker1 # [ 60.958887] nix-grpc-daemon[901]: time=2026-09-22T14:51:45.546Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4600worker1 # [ 60.960685] nix-grpc-daemon[901]: time=2026-09-22T14:51:45.546Z level=INFO msg="Uploading sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv (424B)"4601lb # [ 60.966914] niks3-server[947]: 2026/09/22 14:51:45 INFO Registered completed upload object_key=nar/1m12xmj6yzmb9y2j8ly0yvh5fyzy1nqk7ajhqwr4wn3b5h0bsch5.nar.zst4602worker1 # [ 61.007436] nix-grpc-daemon[901]: time=2026-09-22T14:51:45.595Z level=INFO msg="Uploading 1 narinfos"4603lb # [ 60.986484] niks3-server[947]: 2026/09/22 14:51:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4604lb # [ 61.000487] niks3-server[947]: 2026/09/22 14:51:45 INFO Signed narinfos id=17 count=14605lb # [ 61.009384] niks3-server[947]: 2026/09/22 14:51:45 INFO Registered completed upload object_key=sfkglm39i7dsf4k91pn9ij8xz5mkgirx.ls4606lb # [ 61.025520] niks3-server[947]: 2026/09/22 14:51:45 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4607lb # [ 61.035705] niks3-server[947]: 2026/09/22 14:51:45 INFO Completed upload id=174608worker1 # [ 61.049143] nix-grpc-daemon[901]: time=2026-09-22T14:51:45.637Z level=INFO msg="Upload complete. (406ms)"4609lb # [ 61.039536] niks3-server[947]: 2026/09/22 14:51:45 INFO Registered completed upload object_key=sfkglm39i7dsf4k91pn9ij8xz5mkgirx.narinfo4610worker1 # [ 61.060331] nix-grpc-daemon[767]: ts=2026-09-22T14:51:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40644 duration_s=0 paths=1 nar_bytes_in=4244611worker1 # [ 61.076997] nix-grpc-daemon[767]: ts=2026-09-22T14:51:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406444612worker1 # [ 61.085336] nix-daemon[848]: accepted connection from pid 767, user nix-grpc-daemon (trusted)4613worker1 # [ 61.091723] nix-daemon[848]: reaped child process 1049, status = succeeded4614worker1 # [ 61.103305] nix-daemon[848]: accepted connection from pid 767, user nix-grpc-daemon (trusted)4615worker1 # [ 66.721410] nix-grpc-daemon[767]: ts=2026-09-22T14:51:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40644 duration_s=5 drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv assign_id=9 outputs=04616worker1 # [ 66.750191] nix-daemon[848]: reaped child process 1061, status = succeeded4617worker1 # [ 66.752302] nix-daemon[848]: reaped child process 1063, status = succeeded4618worker1 # [ 66.999060] nix-grpc-daemon[767]: ts=2026-09-22T14:51:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:406444619worker1 # [ 67.015643] nix-grpc-daemon[767]: ts=2026-09-22T14:51:51Z level=debug event=want client=8 drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv cached=04620worker2 # [ 67.087614] nix-grpc-daemon[771]: ts=2026-09-22T14:51:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:353404621worker1 # [ 67.022929] nix-grpc-daemon[767]: ts=2026-09-22T14:51:51Z level=debug event=assigned drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv worker=192.168.1.4:50051 clients=14622worker2 # [ 67.105923] nix-grpc-daemon[771]: ts=2026-09-22T14:51:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:353404623worker2 # [ 67.122618] nix-grpc-daemon[771]: ts=2026-09-22T14:51:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:353404624worker2 # [ 67.138971] nix-daemon[838]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4625worker2 # [ 67.317277] nix-daemon[838]: accepted connection from pid 1082, user nix-grpc-daemon (trusted)4626worker2 # [ 67.338061] nix-daemon[838]: reaped child process 1085, status = succeeded4627worker2 # [ 67.447192] nix-daemon[838]: accepted connection from pid 1087, user nix-grpc-daemon (trusted)4628worker2 # [ 67.466373] nix-daemon[838]: reaped child process 1090, status = succeeded4629lb # [ 67.393664] niks3-server[947]: 2026/09/22 14:51:51 INFO Received uploads request method=POST path=/api/pending_closures4630worker2 # [ 67.482974] nix-grpc-daemon[851]: time=2026-09-22T14:51:52.049Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4631worker2 # [ 67.484600] nix-grpc-daemon[851]: time=2026-09-22T14:51:52.050Z level=INFO msg="Uploading pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv (424B)"4632lb # [ 67.424670] niks3-server[947]: 2026/09/22 14:51:52 INFO Registered completed upload object_key=nar/14f5yrnllfav3svmw4v4svw15r4zlf5yv1p972jy14mmq6gdw943.nar.zst4633worker2 # [ 67.518616] nix-grpc-daemon[851]: time=2026-09-22T14:51:52.086Z level=INFO msg="Uploading 1 narinfos"4634lb # [ 67.439385] niks3-server[947]: 2026/09/22 14:51:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4635lb # [ 67.449610] niks3-server[947]: 2026/09/22 14:51:52 INFO Signed narinfos id=18 count=14636lb # [ 67.458258] niks3-server[947]: 2026/09/22 14:51:52 INFO Registered completed upload object_key=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s.ls4637lb # [ 67.473316] niks3-server[947]: 2026/09/22 14:51:52 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4638worker2 # [ 67.561768] nix-grpc-daemon[851]: time=2026-09-22T14:51:52.129Z level=INFO msg="Upload complete. (401ms)"4639lb # [ 67.483556] niks3-server[947]: 2026/09/22 14:51:52 INFO Completed upload id=184640lb # [ 67.487079] niks3-server[947]: 2026/09/22 14:51:52 INFO Registered completed upload object_key=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s.narinfo4641worker2 # [ 67.572308] nix-grpc-daemon[771]: ts=2026-09-22T14:51:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35340 duration_s=0 paths=1 nar_bytes_in=4244642worker2 # [ 67.586684] nix-grpc-daemon[771]: ts=2026-09-22T14:51:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:353404643worker2 # [ 67.594280] nix-daemon[838]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4644worker2 # [ 67.599640] nix-daemon[838]: reaped child process 1080, status = succeeded4645worker2 # [ 67.614713] nix-daemon[838]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4646lb # [ 69.686992] envoy[905]: conn peer=[2001:db8:1::1]:56410 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3001 tx=973 ms=62364647worker2 # [ 74.232395] nix-grpc-daemon[771]: ts=2026-09-22T14:51:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35340 duration_s=6 drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv assign_id=10 outputs=04648worker2 # [ 74.263341] nix-daemon[838]: reaped child process 1092, status = succeeded4649worker2 # [ 74.266642] nix-daemon[838]: reaped child process 1094, status = succeeded4650(finished: subtest: --timeout and --max-silent-time reach the builder, in 14.06 seconds)4651subtest: the first client leaving does not fail the second4652client: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share4653client # [ 74.418797] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share.4654client # Running as unit: share1.service; invocation ID: 368cb93c52a14ddc907657d6b23237364655client: (finished: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share, in 0.09 seconds)4656client: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share4657client # [ 74.626519] nix[1088]: don't know how to build these paths:4658client # [ 74.627487] nix[1088]: /nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv4659worker1 # [ 74.635986] nix-grpc-daemon[767]: ts=2026-09-22T14:51:59Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:406444660worker1 # [ 74.650703] nix-grpc-daemon[767]: ts=2026-09-22T14:51:59Z level=debug event=want client=9 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv cached=04661worker1 # [ 74.660825] nix-grpc-daemon[767]: ts=2026-09-22T14:51:59Z level=debug event=assigned drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv worker=192.168.1.3:50051 clients=14662worker1 # [ 74.669810] nix-grpc-daemon[767]: ts=2026-09-22T14:51:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406444663worker1 # [ 74.677590] nix-grpc-daemon[767]: ts=2026-09-22T14:51:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406444664client # [ 74.675815] nix[1088]: copying 1 paths to 'lb:50051'...4665client # [ 74.679511] nix[1088]: copying path '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' to 'lb:50051'...4666worker1 # [ 74.690019] nix-grpc-daemon[767]: ts=2026-09-22T14:51:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:406444667worker1 # [ 74.705280] nix-daemon[848]: accepted connection from pid 767, user nix-grpc-daemon (trusted)4668worker1 # [ 74.855915] nix-daemon[848]: accepted connection from pid 1090, user nix-grpc-daemon (trusted)4669worker1 # [ 74.880620] nix-daemon[848]: reaped child process 1093, status = succeeded4670worker1 # [ 74.984471] nix-daemon[848]: accepted connection from pid 1095, user nix-grpc-daemon (trusted)4671worker1 # [ 75.005219] nix-daemon[848]: reaped child process 1098, status = succeeded4672lb # [ 74.993375] niks3-server[947]: 2026/09/22 14:51:59 INFO Received uploads request method=POST path=/api/pending_closures4673worker1 # [ 75.017918] nix-grpc-daemon[901]: time=2026-09-22T14:51:59.605Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4674worker1 # [ 75.019433] nix-grpc-daemon[901]: time=2026-09-22T14:51:59.605Z level=INFO msg="Uploading rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv (432B)"4675lb # [ 75.034552] niks3-server[947]: 2026/09/22 14:51:59 INFO Registered completed upload object_key=nar/0chdjpc9an2ckdblh08lnyrmzvw3h8qs76cn5ydwjwvgwkrm731l.nar.zst4676lb # [ 75.049868] niks3-server[947]: 2026/09/22 14:51:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4677worker1 # [ 75.070474] nix-grpc-daemon[901]: time=2026-09-22T14:51:59.658Z level=INFO msg="Uploading 1 narinfos"4678lb # [ 75.062827] niks3-server[947]: 2026/09/22 14:51:59 INFO Signed narinfos id=19 count=14679lb # [ 75.071017] niks3-server[947]: 2026/09/22 14:51:59 INFO Registered completed upload object_key=rxafkggp1xca5h7p0r6gwpq3qqp2kn63.ls4680lb # [ 75.083353] niks3-server[947]: 2026/09/22 14:51:59 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4681worker1 # [ 75.106994] nix-grpc-daemon[901]: time=2026-09-22T14:51:59.694Z level=INFO msg="Upload complete. (386ms)"4682lb # [ 75.094288] niks3-server[947]: 2026/09/22 14:51:59 INFO Completed upload id=194683lb # [ 75.099101] niks3-server[947]: 2026/09/22 14:51:59 INFO Registered completed upload object_key=rxafkggp1xca5h7p0r6gwpq3qqp2kn63.narinfo4684worker1 # [ 75.116393] nix-grpc-daemon[767]: ts=2026-09-22T14:51:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40644 duration_s=0 paths=1 nar_bytes_in=4324685worker1 # [ 75.129243] nix-grpc-daemon[767]: ts=2026-09-22T14:51:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406444686worker1 # [ 75.143221] nix-daemon[848]: accepted connection from pid 767, user nix-grpc-daemon (trusted)4687worker1 # [ 75.149306] nix-daemon[848]: reaped child process 1088, status = succeeded4688client # [ 75.150545] nix[1088]: building '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' on lb:50051...4689worker1 # [ 75.163915] nix-daemon[848]: accepted connection from pid 767, user nix-grpc-daemon (trusted)4690client # [ 75.527342] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share.4691client # Running as unit: share2.service; invocation ID: b47cd10a56524fc58a77cfe93c827f7b4692client: (finished: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share, in 1.12 seconds)4693worker1 # [ 75.735705] nix-grpc-daemon[767]: ts=2026-09-22T14:52:00Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:406444694client # [ 75.737127] nix[1104]: this derivation will be built:4695worker1 # [ 75.750269] nix-grpc-daemon[767]: ts=2026-09-22T14:52:00Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:406444696client # [ 75.745345] nix[1104]: /nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv4697worker1 # [ 75.761836] nix-grpc-daemon[767]: ts=2026-09-22T14:52:00Z level=debug event=want client=10 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv cached=04698worker1 # [ 75.768227] nix-grpc-daemon[767]: ts=2026-09-22T14:52:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406444699client # [ 75.761929] nix[1104]: building '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' on lb:50051...4700client: must succeed: sleep 2; systemctl kill -s INT share14701client # [ 78.908666] systemd[1]: share1.service: Sent signal SIGINT to main process 1088 (nix) on client request.4702client # [ 78.917175] nix[1088]: shutting downrxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)4703client # [ 78.931143] nix[1088]: error: interrupted by the user4704client: (finished: must succeed: sleep 2; systemctl kill -s INT share1, in 2.10 seconds)4705client: waiting for success: ! systemctl is-active share14706client # [ 78.989073] systemd[1]: share1.service: Main process exited, code=exited, status=1/FAILURE4707client # [ 78.990838] systemd[1]: share1.service: Failed with result 'exit-code'.4708client # [ 78.993773] systemd[1]: share1.service: Consumed 173ms CPU time over 4.570s wall clock time, 41.4M memory peak, 6.3K incoming IP traffic, 8.2K outgoing IP traffic.4709lb # [ 79.690409] envoy[905]: conn peer=[2001:db8:1::1]:41748 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3002 tx=954 ms=71924710lb # [ 79.695589] envoy[905]: conn peer=[2001:db8:1::1]:33270 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2964 tx=811 ms=43134711client: (finished: waiting for success: ! systemctl is-active share1, in 1.11 seconds)4712client: waiting for success: ! systemctl is-active share24713worker1 # [ 80.470787] nix-daemon[848]: reaped child process 1102, status = succeeded4714worker1 # [ 80.537831] nix-daemon[848]: accepted connection from pid 1138, user nix-grpc-daemon (trusted)4715worker1 # [ 80.560433] nix-daemon[848]: reaped child process 1141, status = succeeded4716lb # [ 80.551677] niks3-server[947]: 2026/09/22 14:52:05 INFO Received uploads request method=POST path=/api/pending_closures4717worker1 # [ 80.576431] nix-grpc-daemon[901]: time=2026-09-22T14:52:05.163Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4718worker1 # [ 80.578097] nix-grpc-daemon[901]: time=2026-09-22T14:52:05.163Z level=INFO msg="Uploading fjww0fd4rwk1s35jav3cyal62l24n356-slow-share (120B)"4719lb # [ 80.595495] niks3-server[947]: 2026/09/22 14:52:05 INFO Registered completed upload object_key=log/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv4720lb # [ 80.615035] niks3-server[947]: 2026/09/22 14:52:05 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst4721lb # [ 80.627397] niks3-server[947]: 2026/09/22 14:52:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4722worker1 # [ 80.642448] nix-grpc-daemon[901]: time=2026-09-22T14:52:05.229Z level=INFO msg="Uploading 1 narinfos"4723lb # [ 80.636431] niks3-server[947]: 2026/09/22 14:52:05 INFO Signed narinfos id=20 count=14724lb # [ 80.644776] niks3-server[947]: 2026/09/22 14:52:05 INFO Registered completed upload object_key=fjww0fd4rwk1s35jav3cyal62l24n356.ls4725lb # [ 80.656871] niks3-server[947]: 2026/09/22 14:52:05 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4726worker1 # [ 80.675862] nix-grpc-daemon[901]: time=2026-09-22T14:52:05.263Z level=INFO msg="Upload complete. (298ms)"4727lb # [ 80.664680] niks3-server[947]: 2026/09/22 14:52:05 INFO Completed upload id=204728lb # [ 80.667570] niks3-server[947]: 2026/09/22 14:52:05 INFO Registered completed upload object_key=fjww0fd4rwk1s35jav3cyal62l24n356.narinfo4729worker1 # [ 80.689262] nix-grpc-daemon[767]: ts=2026-09-22T14:52:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40644 duration_s=4 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv assign_id=11 outputs=14730worker1 # [ 80.708384] nix-grpc-daemon[767]: ts=2026-09-22T14:52:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40644 duration_s=5 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv assign_id=11 outputs=14731worker1 # [ 80.716713] nix-daemon[848]: reaped child process 1100, status = succeeded4732client # [ 80.756646] systemd[1]: share2.service: Deactivated successfully.4733client # [ 80.761123] systemd[1]: share2.service: Consumed 181ms CPU time over 5.233s wall clock time, 33.3M memory peak, 6.6K incoming IP traffic, 5.9K outgoing IP traffic.4734client: (finished: waiting for success: ! systemctl is-active share2, in 1.12 seconds)4735client: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }4736client: (finished: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }, in 0.05 seconds)4737(finished: subtest: the first client leaving does not fail the second, in 7.14 seconds)4738subtest: build hook: nix-daemon with builders = grpc://lb4739client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag hook 2>/tmp/hook.log4740client # [ 81.622402] systemd[1]: Started Nix Daemon.4741client # [ 81.747151] nix-daemon[1156]: accepted connection from pid 1153, user root (trusted)4742worker1 # [ 81.914177] nix-grpc-daemon[767]: ts=2026-09-22T14:52:06Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:406444743worker1 # [ 81.921311] nix-grpc-daemon[767]: ts=2026-09-22T14:52:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406444744worker1 # [ 81.934742] nix-grpc-daemon[767]: ts=2026-09-22T14:52:06Z level=debug event=want client=11 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=04745worker1 # [ 81.941319] nix-grpc-daemon[767]: ts=2026-09-22T14:52:06Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.4:50051 clients=14746worker2 # [ 82.011253] nix-grpc-daemon[771]: ts=2026-09-22T14:52:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:353404747worker2 # [ 82.027932] nix-grpc-daemon[771]: ts=2026-09-22T14:52:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:353404748worker2 # [ 82.042972] nix-grpc-daemon[771]: ts=2026-09-22T14:52:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:353404749worker2 # [ 82.058581] nix-daemon[838]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4750worker2 # [ 82.224727] nix-daemon[838]: accepted connection from pid 1133, user nix-grpc-daemon (trusted)4751worker2 # [ 82.246918] nix-daemon[838]: reaped child process 1136, status = succeeded4752worker2 # [ 82.357062] nix-daemon[838]: accepted connection from pid 1138, user nix-grpc-daemon (trusted)4753worker2 # [ 82.374722] nix-daemon[838]: reaped child process 1141, status = succeeded4754lb # [ 82.304814] niks3-server[947]: 2026/09/22 14:52:06 INFO Received uploads request method=POST path=/api/pending_closures4755worker2 # [ 82.395736] nix-grpc-daemon[851]: time=2026-09-22T14:52:06.962Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4756worker2 # [ 82.397434] nix-grpc-daemon[851]: time=2026-09-22T14:52:06.962Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)"4757lb # [ 82.336126] niks3-server[947]: 2026/09/22 14:52:06 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst4758lb # [ 82.351016] niks3-server[947]: 2026/09/22 14:52:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4759worker2 # [ 82.436940] nix-grpc-daemon[851]: time=2026-09-22T14:52:07.004Z level=INFO msg="Uploading 1 narinfos"4760lb # [ 82.364385] niks3-server[947]: 2026/09/22 14:52:06 INFO Signed narinfos id=21 count=14761lb # [ 82.371899] niks3-server[947]: 2026/09/22 14:52:06 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls4762lb # [ 82.385603] niks3-server[947]: 2026/09/22 14:52:06 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4763worker2 # [ 82.472684] nix-grpc-daemon[851]: time=2026-09-22T14:52:07.040Z level=INFO msg="Upload complete. (396ms)"4764lb # [ 82.396603] niks3-server[947]: 2026/09/22 14:52:06 INFO Completed upload id=214765lb # [ 82.400991] niks3-server[947]: 2026/09/22 14:52:06 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo4766worker2 # [ 82.484395] nix-grpc-daemon[771]: ts=2026-09-22T14:52:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35340 duration_s=0 paths=1 nar_bytes_in=5124767worker2 # [ 82.499505] nix-grpc-daemon[771]: ts=2026-09-22T14:52:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:353404768worker2 # [ 82.506921] nix-daemon[838]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4769worker2 # [ 82.513187] nix-daemon[838]: reaped child process 1131, status = succeeded4770worker2 # [ 82.526065] nix-daemon[838]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4771worker2 # [ 83.763872] nix-daemon[838]: reaped child process 1145, status = succeeded4772worker2 # [ 83.872231] nix-daemon[838]: accepted connection from pid 1161, user nix-grpc-daemon (trusted)4773worker2 # [ 83.894353] nix-daemon[838]: reaped child process 1164, status = succeeded4774lb # [ 83.814327] niks3-server[947]: 2026/09/22 14:52:08 INFO Received uploads request method=POST path=/api/pending_closures4775worker2 # [ 83.904429] nix-grpc-daemon[851]: time=2026-09-22T14:52:08.470Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4776worker2 # [ 83.905932] nix-grpc-daemon[851]: time=2026-09-22T14:52:08.470Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)"4777lb # [ 83.853975] niks3-server[947]: 2026/09/22 14:52:08 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4778lb # [ 83.871806] niks3-server[947]: 2026/09/22 14:52:08 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv4779worker2 # [ 83.959582] nix-grpc-daemon[851]: time=2026-09-22T14:52:08.526Z level=INFO msg="Uploading 1 narinfos"4780lb # [ 83.884746] niks3-server[947]: 2026/09/22 14:52:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4781lb # [ 83.892276] niks3-server[947]: 2026/09/22 14:52:08 INFO Signed narinfos id=22 count=14782lb # [ 83.894650] niks3-server[947]: 2026/09/22 14:52:08 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls4783lb # [ 83.906962] niks3-server[947]: 2026/09/22 14:52:08 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4784lb # [ 83.912477] niks3-server[947]: 2026/09/22 14:52:08 INFO Completed upload id=224785worker2 # [ 83.990983] nix-grpc-daemon[851]: time=2026-09-22T14:52:08.558Z level=INFO msg="Upload complete. (251ms)"4786lb # [ 83.915739] niks3-server[947]: 2026/09/22 14:52:08 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo4787worker2 # [ 84.001023] nix-grpc-daemon[771]: ts=2026-09-22T14:52:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35340 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=12 outputs=14788worker2 # [ 84.020593] nix-grpc-daemon[771]: ts=2026-09-22T14:52:08Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:353404789worker2 # [ 84.025786] nix-daemon[838]: reaped child process 1143, status = succeeded4790worker1 # [ 83.986945] nix-grpc-daemon[767]: ts=2026-09-22T14:52:08Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:406444791worker1 # [ 84.001097] nix-grpc-daemon[767]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'...4792worker1 # [ 84.017444] nix-grpc-daemon[767]: ts=2026-09-22T14:52:08Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40644 duration_s=0 paths=1 nar_bytes_out=1284793worker2 # [ 84.366151] nix-grpc-daemon[771]: ts=2026-09-22T14:52:08Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:353404794worker2 # [ 84.374150] nix-grpc-daemon[771]: ts=2026-09-22T14:52:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:353404795worker2 # [ 84.382201] nix-grpc-daemon[851]: time=2026-09-22T14:52:08.947Z level=INFO msg="All 1 paths already cached"4796worker1 # [ 84.330806] nix-grpc-daemon[767]: ts=2026-09-22T14:52:08Z level=debug event=want client=12 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=04797worker1 # [ 84.337824] nix-grpc-daemon[767]: ts=2026-09-22T14:52:08Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.4:50051 clients=14798worker2 # [ 84.406007] nix-grpc-daemon[771]: ts=2026-09-22T14:52:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:353404799worker2 # [ 84.422011] nix-grpc-daemon[771]: ts=2026-09-22T14:52:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:353404800worker2 # [ 84.436863] nix-grpc-daemon[851]: time=2026-09-22T14:52:09.004Z level=INFO msg="All 1 paths already cached"4801worker2 # [ 84.447011] nix-grpc-daemon[771]: ts=2026-09-22T14:52:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:353404802worker2 # [ 84.461317] nix-daemon[838]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4803worker2 # [ 84.623594] nix-daemon[838]: accepted connection from pid 1168, user nix-grpc-daemon (trusted)4804worker2 # [ 84.644093] nix-daemon[838]: reaped child process 1171, status = succeeded4805worker2 # [ 84.748184] nix-daemon[838]: accepted connection from pid 1173, user nix-grpc-daemon (trusted)4806worker2 # [ 84.769260] nix-daemon[838]: reaped child process 1176, status = succeeded4807lb # [ 84.688122] niks3-server[947]: 2026/09/22 14:52:09 INFO Received uploads request method=POST path=/api/pending_closures4808worker2 # [ 84.776174] nix-grpc-daemon[851]: time=2026-09-22T14:52:09.343Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4809worker2 # [ 84.778141] nix-grpc-daemon[851]: time=2026-09-22T14:52:09.345Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)"4810lb # [ 84.718952] niks3-server[947]: 2026/09/22 14:52:09 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst4811lb # [ 84.733821] niks3-server[947]: 2026/09/22 14:52:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4812worker2 # [ 84.818996] nix-grpc-daemon[851]: time=2026-09-22T14:52:09.386Z level=INFO msg="Uploading 1 narinfos"4813lb # [ 84.746653] niks3-server[947]: 2026/09/22 14:52:09 INFO Signed narinfos id=23 count=14814lb # [ 84.753791] niks3-server[947]: 2026/09/22 14:52:09 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls4815worker2 # [ 84.843838] nix-grpc-daemon[851]: time=2026-09-22T14:52:09.411Z level=INFO msg="Upload complete. (364ms)"4816lb # [ 84.766571] niks3-server[947]: 2026/09/22 14:52:09 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4817lb # [ 84.771637] niks3-server[947]: 2026/09/22 14:52:09 INFO Completed upload id=234818lb # [ 84.775479] niks3-server[947]: 2026/09/22 14:52:09 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo4819worker2 # [ 84.852319] nix-grpc-daemon[771]: ts=2026-09-22T14:52:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35340 duration_s=0 paths=1 nar_bytes_in=6244820worker2 # [ 84.868399] nix-grpc-daemon[771]: ts=2026-09-22T14:52:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:353404821worker2 # [ 84.876232] nix-daemon[838]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4822worker2 # [ 84.880889] nix-daemon[838]: reaped child process 1166, status = succeeded4823worker2 # [ 84.892857] nix-daemon[838]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4824worker2 # [ 85.585997] nix-daemon[838]: reaped child process 1180, status = succeeded4825worker2 # [ 85.662787] nix-daemon[838]: accepted connection from pid 1196, user nix-grpc-daemon (trusted)4826worker2 # [ 85.685685] nix-daemon[838]: reaped child process 1199, status = succeeded4827lb # [ 85.606401] niks3-server[947]: 2026/09/22 14:52:10 INFO Received uploads request method=POST path=/api/pending_closures4828worker2 # [ 85.694826] nix-grpc-daemon[851]: time=2026-09-22T14:52:10.262Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4829worker2 # [ 85.700573] nix-grpc-daemon[851]: time=2026-09-22T14:52:10.264Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)"4830lb # [ 85.646251] niks3-server[947]: 2026/09/22 14:52:10 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst4831lb # [ 85.658988] niks3-server[947]: 2026/09/22 14:52:10 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv4832worker2 # [ 85.748977] nix-grpc-daemon[851]: time=2026-09-22T14:52:10.316Z level=INFO msg="Uploading 1 narinfos"4833lb # [ 85.671416] niks3-server[947]: 2026/09/22 14:52:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4834lb # [ 85.681378] niks3-server[947]: 2026/09/22 14:52:10 INFO Signed narinfos id=24 count=14835lb # [ 85.687874] niks3-server[947]: 2026/09/22 14:52:10 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls4836lb # [ 85.697229] niks3-server[947]: 2026/09/22 14:52:10 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4837lb # [ 85.703121] niks3-server[947]: 2026/09/22 14:52:10 INFO Completed upload id=244838worker2 # [ 85.782389] nix-grpc-daemon[851]: time=2026-09-22T14:52:10.350Z level=INFO msg="Upload complete. (277ms)"4839lb # [ 85.706402] niks3-server[947]: 2026/09/22 14:52:10 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo4840worker2 # [ 85.797164] nix-grpc-daemon[771]: ts=2026-09-22T14:52:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35340 duration_s=0 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=13 outputs=14841worker1 # [ 85.737312] nix-grpc-daemon[767]: ts=2026-09-22T14:52:10Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:406444842worker1 # [ 85.745368] nix-grpc-daemon[767]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'...4843worker2 # [ 85.816681] nix-daemon[838]: reaped child process 1178, status = succeeded4844worker2 # [ 85.848367] nix-grpc-daemon[771]: ts=2026-09-22T14:52:10Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:353404845worker2 # [ 85.855700] nix-grpc-daemon[771]: ts=2026-09-22T14:52:10Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:35340 duration_s=0 paths=1 nar_bytes_out=1764846worker2 # [ 86.102486] nix-grpc-daemon[771]: ts=2026-09-22T14:52:10Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:353404847worker1 # [ 86.041793] nix-grpc-daemon[767]: ts=2026-09-22T14:52:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406444848worker1 # [ 86.053629] nix-grpc-daemon[901]: time=2026-09-22T14:52:10.640Z level=INFO msg="All 2 paths already cached"4849worker1 # [ 86.073977] nix-grpc-daemon[767]: ts=2026-09-22T14:52:10Z level=debug event=want client=13 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=04850worker1 # [ 86.080795] nix-grpc-daemon[767]: ts=2026-09-22T14:52:10Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.4:50051 clients=14851worker2 # [ 86.149500] nix-grpc-daemon[771]: ts=2026-09-22T14:52:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:353404852worker2 # [ 86.165678] nix-grpc-daemon[771]: ts=2026-09-22T14:52:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:353404853worker2 # [ 86.181250] nix-grpc-daemon[851]: time=2026-09-22T14:52:10.748Z level=INFO msg="All 2 paths already cached"4854worker2 # [ 86.192039] nix-grpc-daemon[771]: ts=2026-09-22T14:52:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:353404855worker2 # [ 86.206030] nix-daemon[838]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4856worker2 # [ 86.373597] nix-daemon[838]: accepted connection from pid 1203, user nix-grpc-daemon (trusted)4857worker2 # [ 86.399211] nix-daemon[838]: reaped child process 1206, status = succeeded4858worker2 # [ 86.503916] nix-daemon[838]: accepted connection from pid 1208, user nix-grpc-daemon (trusted)4859worker2 # [ 86.522838] nix-daemon[838]: reaped child process 1211, status = succeeded4860lb # [ 86.450312] niks3-server[947]: 2026/09/22 14:52:11 INFO Received uploads request method=POST path=/api/pending_closures4861worker2 # [ 86.541499] nix-grpc-daemon[851]: time=2026-09-22T14:52:11.108Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4862worker2 # [ 86.543061] nix-grpc-daemon[851]: time=2026-09-22T14:52:11.108Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)"4863lb # [ 86.484814] niks3-server[947]: 2026/09/22 14:52:11 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst4864worker2 # [ 86.580931] nix-grpc-daemon[851]: time=2026-09-22T14:52:11.148Z level=INFO msg="Uploading 1 narinfos"4865lb # [ 86.502364] niks3-server[947]: 2026/09/22 14:52:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign4866lb # [ 86.515007] niks3-server[947]: 2026/09/22 14:52:11 INFO Signed narinfos id=25 count=14867lb # [ 86.521628] niks3-server[947]: 2026/09/22 14:52:11 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls4868lb # [ 86.533455] niks3-server[947]: 2026/09/22 14:52:11 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete4869worker2 # [ 86.617230] nix-grpc-daemon[851]: time=2026-09-22T14:52:11.184Z level=INFO msg="Upload complete. (393ms)"4870lb # [ 86.540249] niks3-server[947]: 2026/09/22 14:52:11 INFO Completed upload id=254871lb # [ 86.543419] niks3-server[947]: 2026/09/22 14:52:11 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo4872worker2 # [ 86.628376] nix-grpc-daemon[771]: ts=2026-09-22T14:52:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35340 duration_s=0 paths=1 nar_bytes_in=7524873worker2 # [ 86.643448] nix-grpc-daemon[771]: ts=2026-09-22T14:52:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:353404874worker2 # [ 86.650713] nix-daemon[838]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4875worker2 # [ 86.656713] nix-daemon[838]: reaped child process 1201, status = succeeded4876worker2 # [ 86.671082] nix-daemon[838]: accepted connection from pid 771, user nix-grpc-daemon (trusted)4877worker2 # [ 87.917422] nix-daemon[838]: reaped child process 1215, status = succeeded4878worker2 # [ 88.032198] nix-daemon[838]: accepted connection from pid 1231, user nix-grpc-daemon (trusted)4879worker2 # [ 88.054396] nix-daemon[838]: reaped child process 1234, status = succeeded4880lb # [ 87.974815] niks3-server[947]: 2026/09/22 14:52:12 INFO Received uploads request method=POST path=/api/pending_closures4881worker2 # [ 88.066395] nix-grpc-daemon[851]: time=2026-09-22T14:52:12.632Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4882worker2 # [ 88.068309] nix-grpc-daemon[851]: time=2026-09-22T14:52:12.632Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)"4883lb # [ 88.008911] niks3-server[947]: 2026/09/22 14:52:12 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv4884lb # [ 88.028842] niks3-server[947]: 2026/09/22 14:52:12 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst4885lb # [ 88.040539] niks3-server[947]: 2026/09/22 14:52:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign4886worker2 # [ 88.124863] nix-grpc-daemon[851]: time=2026-09-22T14:52:12.692Z level=INFO msg="Uploading 1 narinfos"4887lb # [ 88.049016] niks3-server[947]: 2026/09/22 14:52:12 INFO Signed narinfos id=26 count=14888lb # [ 88.051067] niks3-server[947]: 2026/09/22 14:52:12 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls4889lb # [ 88.063402] niks3-server[947]: 2026/09/22 14:52:12 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete4890lb # [ 88.069570] niks3-server[947]: 2026/09/22 14:52:12 INFO Completed upload id=264891worker2 # [ 88.145687] nix-grpc-daemon[851]: time=2026-09-22T14:52:12.713Z level=INFO msg="Upload complete. (263ms)"4892worker2 # [ 88.157472] nix-grpc-daemon[771]: ts=2026-09-22T14:52:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35340 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=14 outputs=14893worker1 # [ 88.098161] nix-grpc-daemon[767]: ts=2026-09-22T14:52:12Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:406444894worker2 # [ 88.175902] nix-daemon[838]: reaped child process 1213, status = succeeded4895worker1 # [ 88.112383] nix-grpc-daemon[767]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'...4896lb # [ 88.116918] niks3-server[947]: 2026/09/22 14:52:12 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo4897worker2 # [ 88.228634] nix-grpc-daemon[771]: ts=2026-09-22T14:52:12Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:353404898worker2 # [ 88.236095] nix-grpc-daemon[771]: ts=2026-09-22T14:52:12Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:35340 duration_s=0 paths=1 nar_bytes_out=2324899client # [ 88.247735] nix-daemon[1156]: reaped child process 1158, status = succeeded4900client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag hook 2>/tmp/hook.log, in 6.78 seconds)4901client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top4902client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds)4903client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4904client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds)4905client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4906client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4907(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 6.90 seconds)4908subtest: an input only one worker has still reaches the builder4909client: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag w1only4910client # this derivation will be built:4911client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv4912client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'...4913client: (finished: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag w1only, in 0.31 seconds)4914client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure4915client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.12 seconds)4916worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4917worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.20 seconds)4918worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only4919worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.03 seconds)4920client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt a >&24921client # [ 89.233107] nix-daemon[1156]: accepted connection from pid 1239, user root (trusted)4922client # this derivation will be built:4923client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4924client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux'...4925worker1 # [ 89.409103] nix-grpc-daemon[767]: ts=2026-09-22T14:52:13Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:406444926worker1 # [ 89.417449] nix-grpc-daemon[767]: ts=2026-09-22T14:52:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406444927worker1 # [ 89.593793] nix-daemon[848]: accepted connection from pid 1157, user nix-grpc-daemon (trusted)4928worker1 # [ 89.613985] nix-daemon[848]: reaped child process 1160, status = succeeded4929lb # [ 89.605833] niks3-server[947]: 2026/09/22 14:52:14 INFO Received uploads request method=POST path=/api/pending_closures4930worker1 # [ 89.630533] nix-grpc-daemon[901]: time=2026-09-22T14:52:14.217Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4931worker1 # [ 89.632400] nix-grpc-daemon[901]: time=2026-09-22T14:52:14.217Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)"4932lb # [ 89.636794] niks3-server[947]: 2026/09/22 14:52:14 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4933lb # [ 89.656722] niks3-server[947]: 2026/09/22 14:52:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign4934worker1 # [ 89.678436] nix-grpc-daemon[901]: time=2026-09-22T14:52:14.265Z level=INFO msg="Uploading 1 narinfos"4935lb # [ 89.667458] niks3-server[947]: 2026/09/22 14:52:14 INFO Signed narinfos id=27 count=14936lb # [ 89.679683] niks3-server[947]: 2026/09/22 14:52:14 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete4937lb # [ 89.694671] envoy[905]: conn peer=[2001:db8:1::1]:33278 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1592 tx=1598 ms=50094938lb # [ 89.700255] envoy[905]: conn peer=[2001:db8:1::1]:33796 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=334 ms=934939lb # [ 89.706237] envoy[905]: conn peer=[2001:db8:1::1]:33794 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3414 tx=1944 ms=21654940lb # [ 89.710568] envoy[905]: conn peer=[2001:db8:1::1]:33802 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3858 tx=2140 ms=15064941lb # [ 89.714538] envoy[905]: conn peer=[2001:db8:1::1]:33806 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=375 ms=284942lb # [ 89.718162] envoy[905]: conn peer=[2001:db8:1::1]:33816 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4339 tx=2392 ms=21514943lb # [ 89.721943] envoy[905]: conn peer=[2001:db8:1::1]:33826 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=412 tx=406 ms=324944lb # [ 89.809091] niks3-server[947]: 2026/09/22 14:52:14 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls4945lb # [ 89.821635] niks3-server[947]: 2026/09/22 14:52:14 INFO Completed upload id=274946worker1 # [ 89.836198] nix-grpc-daemon[901]: time=2026-09-22T14:52:14.424Z level=INFO msg="Upload complete. (419ms)"4947lb # [ 89.830836] niks3-server[947]: 2026/09/22 14:52:14 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo4948worker1 # [ 89.865003] nix-grpc-daemon[767]: ts=2026-09-22T14:52:14Z level=debug event=want client=14 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=04949worker1 # [ 89.872978] nix-grpc-daemon[767]: ts=2026-09-22T14:52:14Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=14950worker1 # [ 89.911789] nix-grpc-daemon[767]: ts=2026-09-22T14:52:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406444951worker1 # [ 89.930998] nix-grpc-daemon[767]: ts=2026-09-22T14:52:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406444952client # copying 2 paths to 'lb:50051'...4953client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'...4954worker1 # [ 89.952145] nix-grpc-daemon[767]: ts=2026-09-22T14:52:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:406444955client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'...4956worker1 # [ 89.968238] nix-daemon[848]: accepted connection from pid 767, user nix-grpc-daemon (trusted)4957worker1 # [ 90.136121] nix-daemon[848]: accepted connection from pid 1166, user nix-grpc-daemon (trusted)4958worker1 # [ 90.156990] nix-daemon[848]: reaped child process 1169, status = succeeded4959worker1 # [ 90.269540] nix-daemon[848]: accepted connection from pid 1171, user nix-grpc-daemon (trusted)4960worker1 # [ 90.291437] nix-daemon[848]: reaped child process 1174, status = succeeded4961lb # [ 90.274386] niks3-server[947]: 2026/09/22 14:52:14 INFO Received uploads request method=POST path=/api/pending_closures4962lb # [ 90.285373] niks3-server[947]: 2026/09/22 14:52:14 INFO Received uploads request method=POST path=/api/pending_closures4963worker1 # [ 90.311034] nix-grpc-daemon[901]: time=2026-09-22T14:52:14.898Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4964worker1 # [ 90.312720] nix-grpc-daemon[901]: time=2026-09-22T14:52:14.898Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)"4965worker1 # [ 90.314433] nix-grpc-daemon[901]: time=2026-09-22T14:52:14.898Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)"4966lb # [ 90.329273] niks3-server[947]: 2026/09/22 14:52:14 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst4967lb # [ 90.346395] niks3-server[947]: 2026/09/22 14:52:14 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst4968lb # [ 90.364262] niks3-server[947]: 2026/09/22 14:52:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign4969worker1 # [ 90.385599] nix-grpc-daemon[901]: time=2026-09-22T14:52:14.972Z level=INFO msg="Uploading 3 narinfos"4970lb # [ 90.374735] niks3-server[947]: 2026/09/22 14:52:14 INFO Signed narinfos id=28 count=14971lb # [ 90.383996] niks3-server[947]: 2026/09/22 14:52:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign4972lb # [ 90.392288] niks3-server[947]: 2026/09/22 14:52:14 INFO Signed narinfos id=29 count=24973lb # [ 90.394491] niks3-server[947]: 2026/09/22 14:52:14 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls4974lb # [ 90.403501] niks3-server[947]: 2026/09/22 14:52:14 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls4975lb # [ 90.412660] niks3-server[947]: 2026/09/22 14:52:15 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete4976lb # [ 90.422780] niks3-server[947]: 2026/09/22 14:52:15 INFO Completed upload id=284977worker1 # [ 90.439733] nix-grpc-daemon[901]: time=2026-09-22T14:52:15.027Z level=INFO msg="Upload complete. (449ms)"4978lb # [ 90.430305] niks3-server[947]: 2026/09/22 14:52:15 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete4979lb # [ 90.438686] niks3-server[947]: 2026/09/22 14:52:15 INFO Completed upload id=294980lb # [ 90.440921] niks3-server[947]: 2026/09/22 14:52:15 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo4981lb # [ 90.443842] niks3-server[947]: 2026/09/22 14:52:15 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4982worker1 # [ 90.454549] nix-grpc-daemon[767]: ts=2026-09-22T14:52:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40644 duration_s=0 paths=2 nar_bytes_in=9844983lb # [ 90.447169] niks3-server[947]: 2026/09/22 14:52:15 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo4984worker1 # [ 90.469003] nix-grpc-daemon[767]: ts=2026-09-22T14:52:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406444985worker1 # [ 90.481661] nix-daemon[848]: accepted connection from pid 767, user nix-grpc-daemon (trusted)4986worker1 # [ 90.488995] nix-daemon[848]: reaped child process 1164, status = succeeded4987client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051...4988worker1 # [ 90.504223] nix-daemon[848]: accepted connection from pid 767, user nix-grpc-daemon (trusted)4989client # uses-input-w1onlya> node-a: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv4990client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds4991worker1 # [ 91.819267] nix-daemon[848]: reaped child process 1178, status = succeeded4992worker1 # [ 91.889744] nix-daemon[848]: accepted connection from pid 1194, user nix-grpc-daemon (trusted)4993worker1 # [ 91.910130] nix-daemon[848]: reaped child process 1197, status = succeeded4994lb # [ 91.905094] niks3-server[947]: 2026/09/22 14:52:16 INFO Received uploads request method=POST path=/api/pending_closures4995worker1 # [ 91.931342] nix-grpc-daemon[901]: time=2026-09-22T14:52:16.517Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4996lb # [ 91.941883] niks3-server[947]: 2026/09/22 14:52:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign4997worker1 # [ 91.968597] nix-grpc-daemon[901]: time=2026-09-22T14:52:16.556Z level=INFO msg="Uploading 1 narinfos"4998lb # [ 91.956150] niks3-server[947]: 2026/09/22 14:52:16 INFO Signed narinfos id=30 count=14999lb # [ 91.967302] niks3-server[947]: 2026/09/22 14:52:16 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls5000lb # [ 91.977844] niks3-server[947]: 2026/09/22 14:52:16 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv5001worker1 # [ 92.022392] nix-grpc-daemon[901]: time=2026-09-22T14:52:16.610Z level=INFO msg="Upload complete. (305ms)"5002lb # [ 92.002242] niks3-server[947]: 2026/09/22 14:52:16 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5003lb # [ 92.015082] niks3-server[947]: 2026/09/22 14:52:16 INFO Completed upload id=305004lb # [ 92.020813] niks3-server[947]: 2026/09/22 14:52:16 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo5005worker1 # [ 92.037386] nix-grpc-daemon[767]: ts=2026-09-22T14:52:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40644 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=15 outputs=15006worker1 # [ 92.058043] nix-daemon[848]: reaped child process 1176, status = succeeded5007client # copying 1 paths...5008worker2 # [ 92.153428] nix-grpc-daemon[771]: ts=2026-09-22T14:52:16Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:353405009worker2 # [ 92.170329] nix-grpc-daemon[771]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'...5010client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'...5011worker2 # [ 92.223693] nix-grpc-daemon[771]: ts=2026-09-22T14:52:16Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:353405012worker2 # [ 92.231356] nix-grpc-daemon[771]: ts=2026-09-22T14:52:16Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:35340 duration_s=0 paths=1 nar_bytes_out=1205013client # [ 92.294569] nix-daemon[1156]: reaped child process 1242, status = succeeded5014client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.27 seconds)5015client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt b >&25016client # [ 92.473017] nix-daemon[1156]: accepted connection from pid 1260, user root (trusted)5017client # this derivation will be built:5018client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv5019worker2 # [ 92.708269] nix-grpc-daemon[771]: ts=2026-09-22T14:52:17Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:353405020client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux'...5021worker1 # [ 92.647973] nix-grpc-daemon[767]: ts=2026-09-22T14:52:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406445022worker1 # [ 92.660429] nix-grpc-daemon[901]: time=2026-09-22T14:52:17.248Z level=INFO msg="All 1 paths already cached"5023worker1 # [ 92.677913] nix-grpc-daemon[767]: ts=2026-09-22T14:52:17Z level=debug event=want client=15 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=05024worker1 # [ 92.684393] nix-grpc-daemon[767]: ts=2026-09-22T14:52:17Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=15025worker2 # [ 92.753003] nix-grpc-daemon[771]: ts=2026-09-22T14:52:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:353405026worker2 # [ 92.772557] nix-grpc-daemon[771]: ts=2026-09-22T14:52:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:353405027client # copying 1 paths to 'lb:50051'...5028client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'...5029worker2 # [ 92.797102] nix-grpc-daemon[771]: ts=2026-09-22T14:52:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:353405030worker2 # [ 92.812814] nix-daemon[838]: accepted connection from pid 771, user nix-grpc-daemon (trusted)5031worker2 # [ 92.836993] nix-grpc-daemon[771]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 20 ms (attempt 1/5)5032worker2 # [ 92.865612] nix-grpc-daemon[771]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 10 ms (attempt 2/5)5033worker2 # [ 92.884652] nix-grpc-daemon[771]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 145 ms (attempt 3/5)5034worker2 # [ 93.031841] nix-grpc-daemon[771]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 142 ms (attempt 4/5)5035worker2 # [ 93.177258] nix-grpc-daemon[771]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5036worker2 # [ 93.185450] nix-grpc-daemon[771]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5037worker2 # [ 93.192721] nix-grpc-daemon[771]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'...5038worker2 # [ 93.367596] nix-daemon[838]: accepted connection from pid 1247, user nix-grpc-daemon (trusted)5039worker2 # [ 93.387503] nix-daemon[838]: reaped child process 1250, status = succeeded5040worker2 # [ 93.495343] nix-daemon[838]: accepted connection from pid 1252, user nix-grpc-daemon (trusted)5041worker2 # [ 93.511362] nix-daemon[838]: reaped child process 1255, status = succeeded5042lb # [ 93.441051] niks3-server[947]: 2026/09/22 14:52:18 INFO Received uploads request method=POST path=/api/pending_closures5043worker2 # [ 93.534042] nix-grpc-daemon[851]: time=2026-09-22T14:52:18.101Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5044worker2 # [ 93.535681] nix-grpc-daemon[851]: time=2026-09-22T14:52:18.101Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)"5045lb # [ 93.477522] niks3-server[947]: 2026/09/22 14:52:18 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst5046lb # [ 93.492697] niks3-server[947]: 2026/09/22 14:52:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5047worker2 # [ 93.577516] nix-grpc-daemon[851]: time=2026-09-22T14:52:18.145Z level=INFO msg="Uploading 1 narinfos"5048lb # [ 93.501327] niks3-server[947]: 2026/09/22 14:52:18 INFO Signed narinfos id=31 count=15049lb # [ 93.510593] niks3-server[947]: 2026/09/22 14:52:18 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls5050lb # [ 93.520705] niks3-server[947]: 2026/09/22 14:52:18 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5051lb # [ 93.530816] niks3-server[947]: 2026/09/22 14:52:18 INFO Completed upload id=315052worker2 # [ 93.608783] nix-grpc-daemon[851]: time=2026-09-22T14:52:18.176Z level=INFO msg="Upload complete. (394ms)"5053lb # [ 93.534048] niks3-server[947]: 2026/09/22 14:52:18 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo5054worker2 # [ 93.620491] nix-grpc-daemon[771]: ts=2026-09-22T14:52:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35340 duration_s=0 paths=1 nar_bytes_in=5685055worker2 # [ 93.636514] nix-grpc-daemon[771]: ts=2026-09-22T14:52:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:353405056worker2 # [ 93.643566] nix-daemon[838]: accepted connection from pid 771, user nix-grpc-daemon (trusted)5057worker2 # [ 93.649120] nix-daemon[838]: reaped child process 1240, status = succeeded5058worker2 # [ 93.664946] nix-grpc-daemon[771]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'...5059client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051...5060worker2 # [ 93.682527] nix-daemon[838]: accepted connection from pid 771, user nix-grpc-daemon (trusted)5061client # uses-input-w1onlyb> worker2: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv5062client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds5063worker2 # [ 95.192702] nix-daemon[838]: reaped child process 1260, status = succeeded5064worker2 # [ 95.260221] nix-daemon[838]: accepted connection from pid 1276, user nix-grpc-daemon (trusted)5065worker2 # [ 95.282071] nix-daemon[838]: reaped child process 1279, status = succeeded5066lb # [ 95.207704] niks3-server[947]: 2026/09/22 14:52:19 INFO Received uploads request method=POST path=/api/pending_closures5067worker2 # [ 95.299889] nix-grpc-daemon[851]: time=2026-09-22T14:52:19.864Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5068lb # [ 95.241034] niks3-server[947]: 2026/09/22 14:52:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5069worker2 # [ 95.332512] nix-grpc-daemon[851]: time=2026-09-22T14:52:19.899Z level=INFO msg="Uploading 1 narinfos"5070lb # [ 95.256770] niks3-server[947]: 2026/09/22 14:52:19 INFO Signed narinfos id=32 count=15071lb # [ 95.265041] niks3-server[947]: 2026/09/22 14:52:19 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv5072lb # [ 95.276561] niks3-server[947]: 2026/09/22 14:52:19 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls5073worker2 # [ 95.368217] nix-grpc-daemon[851]: time=2026-09-22T14:52:19.935Z level=INFO msg="Upload complete. (272ms)"5074lb # [ 95.289003] niks3-server[947]: 2026/09/22 14:52:19 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5075lb # [ 95.298242] niks3-server[947]: 2026/09/22 14:52:19 INFO Completed upload id=325076client # copying 1 paths...5077worker2 # [ 95.381108] nix-grpc-daemon[771]: ts=2026-09-22T14:52:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35340 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=16 outputs=15078lb # [ 95.305192] niks3-server[947]: 2026/09/22 14:52:19 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo5079worker1 # [ 95.327532] nix-grpc-daemon[767]: ts=2026-09-22T14:52:19Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:406445080worker2 # [ 95.398743] nix-daemon[838]: reaped child process 1257, status = succeeded5081worker1 # [ 95.340527] nix-grpc-daemon[767]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'...5082client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'...5083worker2 # [ 95.449905] nix-grpc-daemon[771]: ts=2026-09-22T14:52:20Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:353405084worker2 # [ 95.457500] nix-grpc-daemon[771]: ts=2026-09-22T14:52:20Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:35340 duration_s=0 paths=1 nar_bytes_out=1205085client # [ 95.469526] nix-daemon[1156]: reaped child process 1263, status = succeeded5086client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.17 seconds)5087client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt c >&25088client # [ 95.642456] nix-daemon[1156]: accepted connection from pid 1282, user root (trusted)5089client # this derivation will be built:5090client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv5091worker2 # [ 95.865147] nix-grpc-daemon[771]: ts=2026-09-22T14:52:20Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:353405092client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux'...5093worker2 # [ 95.872986] nix-grpc-daemon[771]: ts=2026-09-22T14:52:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:353405094worker2 # [ 95.879838] nix-grpc-daemon[851]: time=2026-09-22T14:52:20.446Z level=INFO msg="All 1 paths already cached"5095worker1 # [ 95.825204] nix-grpc-daemon[767]: ts=2026-09-22T14:52:20Z level=debug event=want client=16 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=05096worker1 # [ 95.830783] nix-grpc-daemon[767]: ts=2026-09-22T14:52:20Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=15097worker1 # [ 95.835594] nix-grpc-daemon[767]: ts=2026-09-22T14:52:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406445098worker1 # [ 95.839653] nix-grpc-daemon[767]: ts=2026-09-22T14:52:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:406445099worker1 # [ 95.847259] nix-grpc-daemon[901]: time=2026-09-22T14:52:20.434Z level=INFO msg="All 1 paths already cached"5100client # copying 1 paths to 'lb:50051'...5101client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'...5102worker1 # [ 95.854966] nix-grpc-daemon[767]: ts=2026-09-22T14:52:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:406445103worker1 # [ 95.869101] nix-daemon[848]: accepted connection from pid 767, user nix-grpc-daemon (trusted)5104worker1 # [ 96.006888] nix-daemon[848]: accepted connection from pid 1206, user nix-grpc-daemon (trusted)5105worker1 # [ 96.026706] nix-daemon[848]: reaped child process 1209, status = succeeded5106worker1 # [ 96.128201] nix-daemon[848]: accepted connection from pid 1211, user nix-grpc-daemon (trusted)5107worker1 # [ 96.145634] nix-daemon[848]: reaped child process 1214, status = succeeded5108lb # [ 96.137549] niks3-server[947]: 2026/09/22 14:52:20 INFO Received uploads request method=POST path=/api/pending_closures5109worker1 # [ 96.161424] nix-grpc-daemon[901]: time=2026-09-22T14:52:20.749Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5110worker1 # [ 96.163047] nix-grpc-daemon[901]: time=2026-09-22T14:52:20.749Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)"5111lb # [ 96.166062] niks3-server[947]: 2026/09/22 14:52:20 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst5112worker1 # [ 96.194960] nix-grpc-daemon[901]: time=2026-09-22T14:52:20.782Z level=INFO msg="Uploading 1 narinfos"5113lb # [ 96.181947] niks3-server[947]: 2026/09/22 14:52:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5114lb # [ 96.193983] niks3-server[947]: 2026/09/22 14:52:20 INFO Signed narinfos id=33 count=15115lb # [ 96.201706] niks3-server[947]: 2026/09/22 14:52:20 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls5116lb # [ 96.213320] niks3-server[947]: 2026/09/22 14:52:20 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5117worker1 # [ 96.233494] nix-grpc-daemon[901]: time=2026-09-22T14:52:20.821Z level=INFO msg="Upload complete. (350ms)"5118lb # [ 96.221069] niks3-server[947]: 2026/09/22 14:52:20 INFO Completed upload id=335119lb # [ 96.223092] niks3-server[947]: 2026/09/22 14:52:20 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo5120worker1 # [ 96.245070] nix-grpc-daemon[767]: ts=2026-09-22T14:52:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40644 duration_s=0 paths=1 nar_bytes_in=5685121worker1 # [ 96.256109] nix-grpc-daemon[767]: ts=2026-09-22T14:52:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:406445122worker1 # [ 96.262851] nix-daemon[848]: accepted connection from pid 767, user nix-grpc-daemon (trusted)5123worker1 # [ 96.267681] nix-daemon[848]: reaped child process 1204, status = succeeded5124client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051...5125worker1 # [ 96.281897] nix-daemon[848]: accepted connection from pid 767, user nix-grpc-daemon (trusted)5126client # uses-input-w1onlyc> node-a: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv5127client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds5128worker1 # [ 97.126322] nix-daemon[848]: reaped child process 1218, status = succeeded5129worker1 # [ 97.239263] nix-daemon[848]: accepted connection from pid 1234, user nix-grpc-daemon (trusted)5130worker1 # [ 97.259084] nix-daemon[848]: reaped child process 1237, status = succeeded5131lb # [ 97.243828] niks3-server[947]: 2026/09/22 14:52:21 INFO Received uploads request method=POST path=/api/pending_closures5132worker1 # [ 97.272455] nix-grpc-daemon[901]: time=2026-09-22T14:52:21.859Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5133worker1 # [ 97.309428] nix-grpc-daemon[901]: time=2026-09-22T14:52:21.897Z level=INFO msg="Uploading 1 narinfos"5134lb # [ 97.283538] niks3-server[947]: 2026/09/22 14:52:21 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls5135lb # [ 97.299512] niks3-server[947]: 2026/09/22 14:52:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5136lb # [ 97.308480] niks3-server[947]: 2026/09/22 14:52:21 INFO Signed narinfos id=34 count=15137lb # [ 97.316659] niks3-server[947]: 2026/09/22 14:52:21 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv5138worker1 # [ 97.338780] nix-grpc-daemon[901]: time=2026-09-22T14:52:21.926Z level=INFO msg="Upload complete. (247ms)"5139lb # [ 97.326673] niks3-server[947]: 2026/09/22 14:52:21 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5140lb # [ 97.334703] niks3-server[947]: 2026/09/22 14:52:21 INFO Completed upload id=345141client # copying 1 paths...5142worker1 # [ 97.350122] nix-grpc-daemon[767]: ts=2026-09-22T14:52:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40644 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=17 outputs=15143lb # [ 97.338605] niks3-server[947]: 2026/09/22 14:52:21 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo5144worker2 # [ 97.424971] nix-grpc-daemon[771]: ts=2026-09-22T14:52:21Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:353405145worker1 # [ 97.367214] nix-daemon[848]: reaped child process 1216, status = succeeded5146worker2 # [ 97.438412] nix-grpc-daemon[771]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'...5147client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'...5148worker2 # [ 97.477502] nix-grpc-daemon[771]: ts=2026-09-22T14:52:22Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:353405149worker2 # [ 97.484706] nix-grpc-daemon[771]: ts=2026-09-22T14:52:22Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:35340 duration_s=0 paths=1 nar_bytes_out=1205150client # [ 97.539916] nix-daemon[1156]: reaped child process 1285, status = succeeded5151client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.07 seconds)5152(finished: subtest: an input only one worker has still reaches the builder, in 9.17 seconds)5153subtest: upload whose reference the worker lacks is completed from the cache5154client: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag viacache5155client # this derivation will be built:5156client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv5157client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'...5158client: (finished: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag viacache, in 0.34 seconds)5159client: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A referrer --argstr tag viacache5160client # this derivation will be built:5161client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv5162client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'...5163client: (finished: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A referrer --argstr tag viacache, in 0.29 seconds)5164client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure5165client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.12 seconds)5166worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5167worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.19 seconds)5168worker2 # [ 98.628878] systemd[1]: Stopping Nix worker-protocol over gRPC...5169worker2 # [ 99.168199] nix-grpc-daemon[771]: ts=2026-09-22T14:52:23Z level=info event=signal_exit5170lb # [ 99.692865] envoy[905]: conn peer=[2001:db8:1::1]:51462 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=745171lb # [ 99.693267] envoy[905]: conn peer=[2001:db8:1::1]:33834 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3890 tx=2085 ms=28195172lb # [ 99.693445] envoy[905]: conn peer=[2001:db8:1::1]:51480 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=305173lb # [ 99.693552] envoy[905]: conn peer=[2001:db8:1::1]:51478 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3753 tx=2124 ms=27715174lb # [ 99.693651] envoy[905]: conn peer=[2001:db8:1::1]:51484 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3740 tx=2123 ms=16795175lb # [ 99.693750] envoy[905]: conn peer=[2001:db8:1::1]:51492 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=665176worker2 # [ 100.537155] nix-grpc-daemon[771]: ts=2026-09-22T14:52:25Z level=info event=scheduler_restarting5177worker1 # [ 100.485359] nix-grpc-daemon[767]: ts=2026-09-22T14:52:25Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:406345178worker1 # [ 100.490551] nix-grpc-daemon[767]: ts=2026-09-22T14:52:25Z level=info event=worker_gone addr=192.168.1.4:500515179worker2 # [ 100.582188] nix-grpc-daemon[771]: ts=2026-09-22T14:52:25Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5180worker2 # [ 100.601796] nix-daemon[838]: reaped child process 840, status = succeeded5181worker2 # [ 101.338413] nix-grpc-daemon[771]: E0000 00:00:1790088745.905614 816 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 18, started true, shutdown true5182worker2 # [ 101.338789] nix-grpc-daemon[771]: E0000 00:00:1790088745.906020 816 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5183worker2 # [ 102.442197] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5184worker2 # [ 102.448900] systemd[1]: Stopped Nix worker-protocol over gRPC.5185worker2 # [ 102.451558] systemd[1]: nix-grpc-daemon.service: Consumed 4.480s CPU time over 1min 22.524s wall clock time, 66.8M memory peak, 98.4K incoming IP traffic, 211.9K outgoing IP traffic.5186worker2 # [ 102.469474] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5187worker2 # [ 102.478575] systemd[1]: Closed Nix worker-protocol over gRPC.5188lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy5189lb: must succeed: curl -sf localhost:9901/clusters5190worker2 # [ 102.483894] systemd[1]: nix-grpc-daemon.socket: Consumed 620us CPU time over 1min 32.066s wall clock time, 256K memory peak, 101.6K incoming IP traffic, 87.6K outgoing IP traffic.5191lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5192lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.07 seconds)5193client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&25194worker1 # [ 102.718947] nix-grpc-daemon[767]: ts=2026-09-22T14:52:27Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:406445195client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache5196client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.26 seconds)5197worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache5198worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.03 seconds)5199worker2 # [ 102.910959] systemd[1]: Listening on Nix worker-protocol over gRPC.5200worker1 # [ 102.725804] nix-grpc-daemon[767]: ts=2026-09-22T14:52:27Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:406445201worker1 # [ 102.917795] systemd[1]: Stopping Nix worker-protocol over gRPC...5202worker1 # [ 102.995486] nix-grpc-daemon[767]: ts=2026-09-22T14:52:27Z level=info event=signal_exit5203worker2 # [ 103.435769] systemd[1]: Starting scheduler-token.service...5204worker2 # [ 103.526524] systemd[1]: scheduler-token.service: Deactivated successfully.5205worker2 # [ 103.536772] systemd[1]: Finished scheduler-token.service.5206lb # [ 103.457448] niks3-server[947]: 2026/09/22 14:52:28 INFO lead: released remote=192.168.1.3:392245207worker2 # [ 103.538756] systemd[1]: scheduler-token.service: Consumed 59ms CPU time over 93ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5208worker2 # [ 103.546441] systemd[1]: Starting Nix worker-protocol over gRPC...5209worker2 # [ 103.683265] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:28Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5210worker2 # [ 103.685782] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:28Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5211worker2 # [ 103.689686] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:28Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15212worker2 # [ 103.695377] nix-grpc-daemon[1304]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5213lb # [ 103.631819] niks3-server[947]: 2026/09/22 14:52:28 INFO lead: acquired remote=192.168.1.4:512745214worker2 # [ 103.715484] nix-grpc-daemon[1304]: E0000 00:00:1790088748.262377 1304 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5215worker2 # [ 103.744183] nix-grpc-daemon[1304]: E0000 00:00:1790088748.266230 1304 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5216worker2 # [ 103.746528] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:28Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5217worker2 # [ 103.751735] nix-grpc-daemon[1304]: E0000 00:00:1790088748.277285 1345 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5218worker2 # [ 103.754819] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:28Z level=info event=scheduler_take_over5219worker2 # [ 103.756166] nix-grpc-daemon[1304]: E0000 00:00:1790088748.299262 1345 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5220worker2 # [ 103.758570] nix-grpc-daemon[1304]: E0000 00:00:1790088748.299448 1345 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5221worker2 # [ 103.763846] systemd[1]: Started Nix worker-protocol over gRPC.5222worker2 # [ 103.767024] nix-grpc-daemon[1304]: E0000 00:00:1790088748.318282 1345 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5223worker2 # [ 103.769691] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:28Z level=info event=scheduler_connected addr=lb:500515224worker2 # [ 103.770982] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5225worker2 # [ 103.968829] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:28Z level=info event=scheduler_connected addr=lb:500515226worker2 # [ 103.973979] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5227worker2 # [ 104.175226] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:28Z level=info event=scheduler_connected addr=lb:500515228worker2 # [ 104.181021] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5229worker2 # [ 104.382160] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:28Z level=info event=scheduler_connected addr=lb:500515230worker2 # [ 104.387839] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5231worker1 # [ 104.479583] nix-grpc-daemon[767]: ts=2026-09-22T14:52:29Z level=info event=scheduler_restarting5232worker1 # [ 104.483770] nix-grpc-daemon[767]: ts=2026-09-22T14:52:29Z level=info event=scheduler_restarting addr=lb:500515233worker1 # [ 104.488336] nix-grpc-daemon[767]: ts=2026-09-22T14:52:29Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:406345234worker1 # [ 104.493430] nix-grpc-daemon[767]: ts=2026-09-22T14:52:29Z level=info event=worker_gone addr=192.168.1.3:500515235worker1 # [ 104.514260] nix-daemon[848]: reaped child process 850, status = succeeded5236worker2 # [ 104.589051] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:29Z level=info event=scheduler_connected addr=lb:500515237worker2 # [ 104.594681] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5238worker1 # [ 104.698618] nix-grpc-daemon[767]: ts=2026-09-22T14:52:29Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5239worker2 # [ 104.798955] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:29Z level=info event=scheduler_connected addr=lb:500515240worker2 # [ 104.814420] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:29Z level=info event=oidc_jwks provider=mock keys=15241worker2 # [ 104.819145] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:29Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:541445242worker2 # [ 104.824598] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:29Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05243worker1 # [ 105.146758] nix-grpc-daemon[767]: E0000 00:00:1790088749.734432 812 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 19, started true, shutdown true5244worker1 # [ 105.171839] nix-grpc-daemon[767]: E0000 00:00:1790088749.759664 812 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5245worker1 # [ 106.301320] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5246worker1 # [ 106.305285] systemd[1]: Stopped Nix worker-protocol over gRPC.5247worker1 # [ 106.306786] systemd[1]: nix-grpc-daemon.service: Consumed 3.696s CPU time over 1min 26.590s wall clock time, 64M memory peak, 92.5K incoming IP traffic, 181.6K outgoing IP traffic.5248worker1 # [ 106.315751] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5249worker1 # [ 106.320651] systemd[1]: Closed Nix worker-protocol over gRPC.5250worker1 # [ 106.321913] systemd[1]: nix-grpc-daemon.socket: Consumed 619us CPU time over 1min 36.093s wall clock time, 256K memory peak, 117.2K incoming IP traffic, 103K outgoing IP traffic.5251lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy5252lb: must succeed: curl -sf localhost:9901/clusters5253lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5254lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.08 seconds)5255client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&25256worker2 # [ 106.698395] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:541605257worker2 # [ 106.714813] nix-daemon[838]: accepted connection from pid 1304, user nix-grpc-daemon (trusted)5258worker2 # [ 106.745666] nix-grpc-daemon[1304]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 12 ms (attempt 1/5)5259worker2 # [ 106.764797] nix-grpc-daemon[1304]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 39 ms (attempt 2/5)5260worker2 # [ 106.805661] nix-grpc-daemon[1304]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 41 ms (attempt 3/5)5261worker2 # [ 106.848789] nix-grpc-daemon[1304]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 800 ms (attempt 4/5)5262worker2 # [ 107.661753] nix-grpc-daemon[1304]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5263worker2 # [ 107.666294] nix-grpc-daemon[1304]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5264client # copying 2 paths...5265client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'...5266worker2 # [ 107.693222] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:541605267client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'...5268worker2 # [ 107.712157] nix-daemon[838]: accepted connection from pid 1304, user nix-grpc-daemon (trusted)5269worker2 # [ 107.745755] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:32Z level=info event=niks3_push_started pid=13645270worker2 # [ 107.898644] nix-grpc-daemon[1364]: time=2026-09-22T14:52:32.465Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca=""5271worker2 # [ 108.012603] nix-daemon[838]: accepted connection from pid 1377, user nix-grpc-daemon (trusted)5272worker2 # [ 108.030368] nix-daemon[838]: reaped child process 1380, status = succeeded5273lb # [ 107.961683] niks3-server[947]: 2026/09/22 14:52:32 INFO Received uploads request method=POST path=/api/pending_closures5274lb # [ 107.972147] niks3-server[947]: 2026/09/22 14:52:32 INFO Received uploads request method=POST path=/api/pending_closures5275worker2 # [ 108.062456] nix-grpc-daemon[1364]: time=2026-09-22T14:52:32.628Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5276worker2 # [ 108.066057] nix-grpc-daemon[1364]: time=2026-09-22T14:52:32.628Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)"5277worker2 # [ 108.068305] nix-grpc-daemon[1364]: time=2026-09-22T14:52:32.628Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)"5278lb # [ 108.036959] niks3-server[947]: 2026/09/22 14:52:32 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst5279lb # [ 108.046868] niks3-server[947]: 2026/09/22 14:52:32 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5280lb # [ 108.057735] niks3-server[947]: 2026/09/22 14:52:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5281lb # [ 108.068451] niks3-server[947]: 2026/09/22 14:52:32 INFO Signed narinfos id=35 count=15282worker2 # [ 108.148225] nix-grpc-daemon[1364]: time=2026-09-22T14:52:32.714Z level=INFO msg="Uploading 3 narinfos"5283lb # [ 108.070609] niks3-server[947]: 2026/09/22 14:52:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5284lb # [ 108.084248] niks3-server[947]: 2026/09/22 14:52:32 INFO Signed narinfos id=36 count=25285lb # [ 108.086189] niks3-server[947]: 2026/09/22 14:52:32 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls5286lb # [ 108.115475] niks3-server[947]: 2026/09/22 14:52:32 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo5287lb # [ 108.123895] niks3-server[947]: 2026/09/22 14:52:32 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5288lb # [ 108.128290] niks3-server[947]: 2026/09/22 14:52:32 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo5289lb # [ 108.132505] niks3-server[947]: 2026/09/22 14:52:32 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls5290lb # [ 108.135930] niks3-server[947]: 2026/09/22 14:52:32 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo5291lb # [ 108.140598] niks3-server[947]: 2026/09/22 14:52:32 INFO Completed upload id=355292worker2 # [ 108.219944] nix-grpc-daemon[1364]: time=2026-09-22T14:52:32.787Z level=INFO msg="Upload complete. (317ms)"5293lb # [ 108.142485] niks3-server[947]: 2026/09/22 14:52:32 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5294lb # [ 108.146259] niks3-server[947]: 2026/09/22 14:52:32 INFO Completed upload id=365295worker2 # [ 108.232382] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54160 duration_s=0 paths=2 nar_bytes_in=3125296worker2 # [ 108.250169] nix-daemon[838]: reaped child process 1362, status = succeeded5297client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.79 seconds)5298worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache5299worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.03 seconds)5300worker1 # [ 108.308947] systemd[1]: Listening on Nix worker-protocol over gRPC.5301worker1 # [ 108.315441] systemd[1]: Starting Nix worker-protocol over gRPC...5302worker1 # [ 108.458140] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:33Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5303worker1 # [ 108.460543] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:33Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5304worker1 # [ 108.464457] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:33Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15305worker1 # [ 108.471240] nix-grpc-daemon[1260]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5306worker1 # [ 108.480748] nix-grpc-daemon[1260]: E0000 00:00:1790088753.056939 1260 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5307lb: waiting until exactly no endpoints of aarch64-linux are unhealthy5308lb: must succeed: curl -sf localhost:9901/clusters5309worker1 # [ 108.509318] nix-grpc-daemon[1260]: E0000 00:00:1790088753.059065 1260 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5310worker1 # [ 108.511636] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:33Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5311worker1 # [ 108.521426] nix-grpc-daemon[1260]: E0000 00:00:1790088753.074025 1299 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5312worker1 # [ 108.524487] nix-grpc-daemon[1260]: E0000 00:00:1790088753.089384 1299 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5313worker1 # [ 108.526944] nix-grpc-daemon[1260]: E0000 00:00:1790088753.089555 1299 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5314worker1 # [ 108.529443] systemd[1]: Started Nix worker-protocol over gRPC.5315worker1 # [ 108.530262] nix-grpc-daemon[1260]: E0000 00:00:1790088753.108462 1299 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5316worker1 # [ 108.538340] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:33Z level=info event=scheduler_connected addr=lb:500515317worker2 # [ 108.604413] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:33Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:541445318worker2 # [ 108.611132] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:33Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05319lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)5320lb: must succeed: curl -sf localhost:9901/clusters5321lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5322lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.16 seconds)5323(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 12.08 seconds)5324subtest: a niks3 restart does not cost the leader its role5325lb: must succeed: curl -sf localhost:9901/clusters5326lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5327lb: must succeed: curl -sf localhost:9901/clusters5328lb # [ 109.694156] envoy[905]: conn peer=[2001:db8:1::4]:43512 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=46236 tx=2919 ms=803665329lb # [ 109.694381] envoy[905]: conn peer=[2001:db8:1::1]:47994 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=265330lb # [ 109.694446] envoy[905]: conn peer=[2001:db8:1::3]:50960 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=9797 tx=2772 ms=846565331lb # [ 109.694505] envoy[905]: conn peer=[2001:db8:1::1]:48000 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1006 tx=305 ms=15495332lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5333lb # [ 109.762673] systemd[1]: Stopping niks3 server...5334worker1 # [ 109.778732] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:34Z level=info event=scheduler_lock_lost status=2005335worker2 # [ 109.850473] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:34Z level=info event=scheduler_lock_lost status=2005336lb # [ 109.775274] niks3-server[947]: 2026/09/22 14:52:34 INFO Shutdown signal received, draining in-flight requests timeout=10s5337lb # [ 109.788301] niks3-server[947]: 2026/09/22 14:52:34 INFO lead: released remote=192.168.1.4:512745338lb # [ 109.792652] systemd[1]: niks3.service: Deactivated successfully.5339lb # [ 109.794634] systemd[1]: Stopped niks3 server.5340lb # [ 109.795366] systemd[1]: niks3.service: Consumed 711ms CPU time over 1min 28.617s wall clock time, 27.8M memory peak, 101.2K incoming IP traffic, 144.2K outgoing IP traffic.5341lb # [ 109.804753] systemd[1]: Starting niks3 server...5342lb # [ 109.864512] niks3-server[1086]: 2026/09/22 14:52:34 goose: no migrations to run. current version: 202609200000005343lb # [ 109.869527] niks3-server[1086]: 2026/09/22 14:52:34 OK 1_commit_pending_closure.sql (6.6ms)5344lb # [ 109.873263] niks3-server[1086]: 2026/09/22 14:52:34 OK 2_object_stats_trigger.sql (2.06ms)5345lb # [ 109.874461] niks3-server[1086]: 2026/09/22 14:52:34 goose: up to current file version: 25346lb # [ 109.876177] niks3-server[1086]: 2026/09/22 14:52:34 INFO Loaded signing key name=farm-test-1 path=/nix/store/3qiyvklx8qgcqqsb1swilx6drs1cdj8m-key5347lb # [ 109.887048] niks3-server[1086]: 2026/09/22 14:52:34 INFO Read proxy enabled — serving cache objects from S35348lb # [ 109.892060] niks3-server[1086]: 2026/09/22 14:52:34 INFO Using socket-activated listener address=0.0.0.0:57515349lb # [ 109.893579] niks3-server[1086]: 2026/09/22 14:52:34 INFO systemd watchdog enabled interval=15s5350lb # [ 109.894820] niks3-server[1086]: 2026/09/22 14:52:34 INFO Starting HTTP server address=0.0.0.0:57515351lb # [ 109.896968] systemd[1]: Started niks3 server.5352lb: waiting for unit niks3.service5353lb: (finished: waiting for unit niks3.service, in 0.03 seconds)5354lb: must succeed: curl -sf localhost:9901/clusters5355lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5356worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5357worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)5358lb: must succeed: curl -sf localhost:9901/clusters5359lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5360lb: must succeed: curl -sf localhost:9901/clusters5361lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5362worker2: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield5363worker2: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.07 seconds)5364client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart >&25365worker2 # [ 110.443096] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:35Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:541605366client # don't know how to build these paths:5367client # /nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv5368worker2 # [ 110.454698] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:541605369worker2 # [ 110.486029] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:35Z level=debug event=want client=1 drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv cached=05370worker2 # [ 110.493569] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:35Z level=debug event=assigned drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv worker=192.168.1.4:50051 clients=15371worker2 # [ 110.531402] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:541605372worker2 # [ 110.547556] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:541605373client # copying 1 paths to 'lb:50051'...5374client # copying path '/nix/store/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv' to 'lb:50051'...5375worker2 # [ 110.563903] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:541605376worker2 # [ 110.579129] nix-daemon[838]: accepted connection from pid 1304, user nix-grpc-daemon (trusted)5377worker2 # [ 110.739252] nix-daemon[838]: accepted connection from pid 1397, user nix-grpc-daemon (trusted)5378worker2 # [ 110.759613] nix-daemon[838]: reaped child process 1400, status = succeeded5379lb # [ 110.776987] niks3-server[1086]: 2026/09/22 14:52:35 INFO lead: acquired remote=192.168.1.4:377405380worker2 # [ 110.867396] nix-daemon[838]: accepted connection from pid 1402, user nix-grpc-daemon (trusted)5381worker2 # [ 110.885261] nix-daemon[838]: reaped child process 1407, status = succeeded5382lb # [ 110.812734] niks3-server[1086]: 2026/09/22 14:52:35 INFO Received uploads request method=POST path=/api/pending_closures5383worker2 # [ 110.922596] nix-grpc-daemon[1364]: time=2026-09-22T14:52:35.489Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5384worker2 # [ 110.924852] nix-grpc-daemon[1364]: time=2026-09-22T14:52:35.489Z level=INFO msg="Uploading mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv (544B)"5385lb # [ 110.878551] niks3-server[1086]: 2026/09/22 14:52:35 INFO Registered completed upload object_key=nar/0hn539w6achi7azzyhpihsi61g85x9f535dxv438yq5y50ksrp1d.nar.zst5386lb # [ 110.897707] niks3-server[1086]: 2026/09/22 14:52:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5387worker2 # [ 110.982836] nix-grpc-daemon[1364]: time=2026-09-22T14:52:35.550Z level=INFO msg="Uploading 1 narinfos"5388lb # [ 110.909126] niks3-server[1086]: 2026/09/22 14:52:35 INFO Signed narinfos id=37 count=15389lb # [ 110.922483] niks3-server[1086]: 2026/09/22 14:52:35 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5390lb # [ 110.935935] niks3-server[1086]: 2026/09/22 14:52:35 INFO Registered completed upload object_key=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z.ls5391lb # [ 110.941531] niks3-server[1086]: 2026/09/22 14:52:35 INFO Registered completed upload object_key=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z.narinfo5392lb # [ 110.945296] niks3-server[1086]: 2026/09/22 14:52:35 INFO Completed upload id=375393worker2 # [ 111.024751] nix-grpc-daemon[1364]: time=2026-09-22T14:52:35.592Z level=INFO msg="Upload complete. (428ms)"5394worker2 # [ 111.037173] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54160 duration_s=0 paths=1 nar_bytes_in=5445395worker2 # [ 111.056340] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:541605396worker2 # [ 111.065207] nix-daemon[838]: accepted connection from pid 1304, user nix-grpc-daemon (trusted)5397worker2 # [ 111.072685] nix-daemon[838]: reaped child process 1395, status = succeeded5398client # building '/nix/store/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv' on lb:50051...5399client # farm-a> worker2: building mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv5400worker2 # [ 111.088273] nix-daemon[838]: accepted connection from pid 1304, user nix-grpc-daemon (trusted)5401client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds5402client # farm-a> LOG-farm-a-after-niks3-restart5403worker2 # [ 112.148921] nix-daemon[838]: reaped child process 1411, status = succeeded5404worker2 # [ 112.257495] nix-daemon[838]: accepted connection from pid 1427, user nix-grpc-daemon (trusted)5405worker2 # [ 112.276477] nix-daemon[838]: reaped child process 1430, status = succeeded5406lb # [ 112.203936] niks3-server[1086]: 2026/09/22 14:52:36 INFO Received uploads request method=POST path=/api/pending_closures5407worker2 # [ 112.299002] nix-grpc-daemon[1364]: time=2026-09-22T14:52:36.863Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5408worker2 # [ 112.300897] nix-grpc-daemon[1364]: time=2026-09-22T14:52:36.863Z level=INFO msg="Uploading j3iswx3ynilvcycpyw0z667966c9kpzx-farm-a (144B)"5409lb # [ 112.260971] niks3-server[1086]: 2026/09/22 14:52:36 INFO Registered completed upload object_key=log/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv5410worker2 # [ 112.346964] nix-grpc-daemon[1364]: time=2026-09-22T14:52:36.913Z level=INFO msg="Uploading 1 narinfos"5411lb # [ 112.273389] niks3-server[1086]: 2026/09/22 14:52:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5412lb # [ 112.284566] niks3-server[1086]: 2026/09/22 14:52:36 INFO Signed narinfos id=38 count=15413lb # [ 112.287196] niks3-server[1086]: 2026/09/22 14:52:36 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst5414worker2 # [ 112.381115] nix-grpc-daemon[1364]: time=2026-09-22T14:52:36.948Z level=INFO msg="Upload complete. (277ms)"5415lb # [ 112.301915] niks3-server[1086]: 2026/09/22 14:52:36 INFO Registered completed upload object_key=j3iswx3ynilvcycpyw0z667966c9kpzx.ls5416lb # [ 112.306955] niks3-server[1086]: 2026/09/22 14:52:36 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5417lb # [ 112.314836] niks3-server[1086]: 2026/09/22 14:52:36 INFO Completed upload id=385418lb # [ 112.319079] niks3-server[1086]: 2026/09/22 14:52:36 INFO Registered completed upload object_key=j3iswx3ynilvcycpyw0z667966c9kpzx.narinfo5419worker2 # [ 112.402983] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54160 duration_s=1 drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv assign_id=1 outputs=15420worker2 # [ 112.420524] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:36Z level=debug event=want client=1 drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv cached=05421worker2 # [ 112.426922] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:36Z level=debug event=assigned drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv worker=192.168.1.4:50051 clients=15422worker2 # [ 112.432246] nix-daemon[838]: reaped child process 1409, status = succeeded5423worker2 # [ 112.459656] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:541605424worker2 # [ 112.473677] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:541605425worker2 # [ 112.489512] nix-grpc-daemon[1364]: time=2026-09-22T14:52:37.057Z level=INFO msg="All 1 paths already cached"5426client # copying 1 paths to 'lb:50051'...5427client # copying path '/nix/store/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv' to 'lb:50051'...5428worker2 # [ 112.501165] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:541605429worker2 # [ 112.515263] nix-daemon[838]: accepted connection from pid 1304, user nix-grpc-daemon (trusted)5430worker2 # [ 112.664193] nix-daemon[838]: accepted connection from pid 1436, user nix-grpc-daemon (trusted)5431worker2 # [ 112.684343] nix-daemon[838]: reaped child process 1439, status = succeeded5432worker2 # [ 112.790598] nix-daemon[838]: accepted connection from pid 1441, user nix-grpc-daemon (trusted)5433worker2 # [ 112.813189] nix-daemon[838]: reaped child process 1444, status = succeeded5434lb # [ 112.735164] niks3-server[1086]: 2026/09/22 14:52:37 INFO Received uploads request method=POST path=/api/pending_closures5435worker2 # [ 112.824777] nix-grpc-daemon[1364]: time=2026-09-22T14:52:37.392Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5436worker2 # [ 112.826226] nix-grpc-daemon[1364]: time=2026-09-22T14:52:37.392Z level=INFO msg="Uploading 5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv (656B)"5437lb # [ 112.764653] niks3-server[1086]: 2026/09/22 14:52:37 INFO Registered completed upload object_key=nar/1xpcisa10g5by3yknnrs1xwhxhf4s243h7gwzjii0799pwbhfjfa.nar.zst5438worker2 # [ 112.857205] nix-grpc-daemon[1364]: time=2026-09-22T14:52:37.424Z level=INFO msg="Uploading 1 narinfos"5439lb # [ 112.779979] niks3-server[1086]: 2026/09/22 14:52:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5440lb # [ 112.792509] niks3-server[1086]: 2026/09/22 14:52:37 INFO Signed narinfos id=39 count=15441lb # [ 112.795727] niks3-server[1086]: 2026/09/22 14:52:37 INFO Registered completed upload object_key=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.ls5442lb # [ 112.811082] niks3-server[1086]: 2026/09/22 14:52:37 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5443lb # [ 112.816798] niks3-server[1086]: 2026/09/22 14:52:37 INFO Completed upload id=395444worker2 # [ 112.896061] nix-grpc-daemon[1364]: time=2026-09-22T14:52:37.463Z level=INFO msg="Upload complete. (364ms)"5445lb # [ 112.824124] niks3-server[1086]: 2026/09/22 14:52:37 INFO Registered completed upload object_key=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.narinfo5446worker2 # [ 112.904115] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54160 duration_s=0 paths=1 nar_bytes_in=6565447worker2 # [ 112.918620] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:541605448worker2 # [ 112.924558] nix-daemon[838]: accepted connection from pid 1304, user nix-grpc-daemon (trusted)5449worker2 # [ 112.929438] nix-daemon[838]: reaped child process 1434, status = succeeded5450client # building '/nix/store/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv' on lb:50051...5451worker2 # [ 112.941994] nix-daemon[838]: accepted connection from pid 1304, user nix-grpc-daemon (trusted)5452client # farm-b> worker2: building 5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv5453client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds5454client # farm-b> LOG-farm-b-after-niks3-restart5455worker2 # [ 113.977160] nix-daemon[838]: reaped child process 1448, status = succeeded5456worker2 # [ 114.074099] nix-daemon[838]: accepted connection from pid 1464, user nix-grpc-daemon (trusted)5457worker2 # [ 114.094780] nix-daemon[838]: reaped child process 1467, status = succeeded5458lb # [ 114.015333] niks3-server[1086]: 2026/09/22 14:52:38 INFO Received uploads request method=POST path=/api/pending_closures5459worker2 # [ 114.106254] nix-grpc-daemon[1364]: time=2026-09-22T14:52:38.673Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5460worker2 # [ 114.107738] nix-grpc-daemon[1364]: time=2026-09-22T14:52:38.673Z level=INFO msg="Uploading myar0ljvsqm9h7fxyh6qrqkg0175r3xn-farm-b (192B)"5461lb # [ 114.055962] niks3-server[1086]: 2026/09/22 14:52:38 INFO Registered completed upload object_key=nar/0zvv5rxmyk9afay83j52m7ipyhrqivhg6h6a0ksjd658pxzwi78w.nar.zst5462lb # [ 114.066245] niks3-server[1086]: 2026/09/22 14:52:38 INFO Registered completed upload object_key=log/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv5463worker2 # [ 114.155901] nix-grpc-daemon[1364]: time=2026-09-22T14:52:38.723Z level=INFO msg="Uploading 1 narinfos"5464lb # [ 114.076547] niks3-server[1086]: 2026/09/22 14:52:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5465lb # [ 114.086323] niks3-server[1086]: 2026/09/22 14:52:38 INFO Signed narinfos id=40 count=15466lb # [ 114.092291] niks3-server[1086]: 2026/09/22 14:52:38 INFO Registered completed upload object_key=myar0ljvsqm9h7fxyh6qrqkg0175r3xn.ls5467lb # [ 114.100525] niks3-server[1086]: 2026/09/22 14:52:38 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5468lb # [ 114.112406] niks3-server[1086]: 2026/09/22 14:52:38 INFO Completed upload id=405469worker2 # [ 114.191629] nix-grpc-daemon[1364]: time=2026-09-22T14:52:38.759Z level=INFO msg="Upload complete. (240ms)"5470lb # [ 114.115573] niks3-server[1086]: 2026/09/22 14:52:38 INFO Registered completed upload object_key=myar0ljvsqm9h7fxyh6qrqkg0175r3xn.narinfo5471worker2 # [ 114.212861] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54160 duration_s=1 drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv assign_id=2 outputs=15472worker2 # [ 114.227023] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:38Z level=debug event=want client=1 drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv cached=05473worker2 # [ 114.230985] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:38Z level=debug event=assigned drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv worker=192.168.1.4:50051 clients=15474worker2 # [ 114.235112] nix-daemon[838]: reaped child process 1446, status = succeeded5475worker2 # [ 114.256348] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:541605476worker2 # [ 114.271854] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:541605477worker2 # [ 114.288663] nix-grpc-daemon[1364]: time=2026-09-22T14:52:38.856Z level=INFO msg="All 2 paths already cached"5478client # copying 1 paths to 'lb:50051'...5479client # copying path '/nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv' to 'lb:50051'...5480worker2 # [ 114.300727] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:541605481worker2 # [ 114.314874] nix-daemon[838]: accepted connection from pid 1304, user nix-grpc-daemon (trusted)5482worker2 # [ 114.470072] nix-daemon[838]: accepted connection from pid 1473, user nix-grpc-daemon (trusted)5483worker2 # [ 114.488348] nix-daemon[838]: reaped child process 1476, status = succeeded5484worker2 # [ 114.591640] nix-daemon[838]: accepted connection from pid 1478, user nix-grpc-daemon (trusted)5485worker2 # [ 114.609907] nix-daemon[838]: reaped child process 1481, status = succeeded5486lb # [ 114.535845] niks3-server[1086]: 2026/09/22 14:52:39 INFO Received uploads request method=POST path=/api/pending_closures5487worker2 # [ 114.626039] nix-grpc-daemon[1364]: time=2026-09-22T14:52:39.193Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5488worker2 # [ 114.627552] nix-grpc-daemon[1364]: time=2026-09-22T14:52:39.193Z level=INFO msg="Uploading 6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv (784B)"5489lb # [ 114.567572] niks3-server[1086]: 2026/09/22 14:52:39 INFO Registered completed upload object_key=nar/1fnvw3c0v6n1j60nd5iagl3bggzcvixsw103w98mwhnpmnmgb248.nar.zst5490worker2 # [ 114.660992] nix-grpc-daemon[1364]: time=2026-09-22T14:52:39.228Z level=INFO msg="Uploading 1 narinfos"5491lb # [ 114.581866] niks3-server[1086]: 2026/09/22 14:52:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5492lb # [ 114.592059] niks3-server[1086]: 2026/09/22 14:52:39 INFO Signed narinfos id=41 count=15493lb # [ 114.597749] niks3-server[1086]: 2026/09/22 14:52:39 INFO Registered completed upload object_key=6j7gr603xfslr5lxcbh72430f5q1r4b0.ls5494lb # [ 114.609047] niks3-server[1086]: 2026/09/22 14:52:39 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5495worker2 # [ 114.693572] nix-grpc-daemon[1364]: time=2026-09-22T14:52:39.261Z level=INFO msg="Upload complete. (361ms)"5496lb # [ 114.615168] niks3-server[1086]: 2026/09/22 14:52:39 INFO Completed upload id=415497lb # [ 114.618760] niks3-server[1086]: 2026/09/22 14:52:39 INFO Registered completed upload object_key=6j7gr603xfslr5lxcbh72430f5q1r4b0.narinfo5498worker2 # [ 114.704064] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54160 duration_s=0 paths=1 nar_bytes_in=7845499worker2 # [ 114.711393] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:541605500worker2 # [ 114.722536] nix-daemon[838]: accepted connection from pid 1304, user nix-grpc-daemon (trusted)5501worker2 # [ 114.728062] nix-daemon[838]: reaped child process 1471, status = succeeded5502client # building '/nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv' on lb:50051...5503worker2 # [ 114.742180] nix-daemon[838]: accepted connection from pid 1304, user nix-grpc-daemon (trusted)5504client # farm-top> worker2: building 6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv5505client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds5506client # farm-top> LOG-farm-top-after-niks3-restart5507worker2 # [ 115.424373] nix-daemon[838]: reaped child process 1485, status = succeeded5508worker2 # [ 115.519801] nix-daemon[838]: accepted connection from pid 1501, user nix-grpc-daemon (trusted)5509worker2 # [ 115.537920] nix-daemon[838]: reaped child process 1504, status = succeeded5510lb # [ 115.465347] niks3-server[1086]: 2026/09/22 14:52:40 INFO Received uploads request method=POST path=/api/pending_closures5511worker2 # [ 115.556458] nix-grpc-daemon[1364]: time=2026-09-22T14:52:40.122Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5512worker2 # [ 115.558214] nix-grpc-daemon[1364]: time=2026-09-22T14:52:40.122Z level=INFO msg="Uploading z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc-farm-top (248B)"5513lb # [ 115.506941] niks3-server[1086]: 2026/09/22 14:52:40 INFO Registered completed upload object_key=nar/0cypkbh15calmx90jgh2waxpq661jalf4c99dgb7j606z61xh0ld.nar.zst5514lb # [ 115.518934] niks3-server[1086]: 2026/09/22 14:52:40 INFO Registered completed upload object_key=log/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv5515worker2 # [ 115.605825] nix-grpc-daemon[1364]: time=2026-09-22T14:52:40.173Z level=INFO msg="Uploading 1 narinfos"5516lb # [ 115.531181] niks3-server[1086]: 2026/09/22 14:52:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5517lb # [ 115.536761] niks3-server[1086]: 2026/09/22 14:52:40 INFO Signed narinfos id=42 count=15518lb # [ 115.544524] niks3-server[1086]: 2026/09/22 14:52:40 INFO Registered completed upload object_key=z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.ls5519lb # [ 115.547310] niks3-server[1086]: 2026/09/22 14:52:40 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5520lb # [ 115.553920] niks3-server[1086]: 2026/09/22 14:52:40 INFO Completed upload id=425521worker2 # [ 115.631580] nix-grpc-daemon[1364]: time=2026-09-22T14:52:40.199Z level=INFO msg="Upload complete. (279ms)"5522lb # [ 115.555864] niks3-server[1086]: 2026/09/22 14:52:40 INFO Registered completed upload object_key=z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.narinfo5523worker2 # [ 115.648916] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54160 duration_s=0 drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv assign_id=3 outputs=15524worker2 # [ 115.663576] nix-daemon[838]: reaped child process 1483, status = succeeded5525client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart >&2, in 5.47 seconds)5526client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart outPath5527client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart outPath, in 0.19 seconds)5528(finished: subtest: a niks3 restart does not cost the leader its role, in 6.17 seconds)5529subtest: scheduler down: the other node takes the lock and keeps it5530lb: must succeed: curl -sf localhost:9901/clusters5531lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5532lb: must succeed: curl -sf localhost:9901/clusters5533lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5534lb: must succeed: curl -sf localhost:9901/clusters5535lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5536lb: must succeed: curl -sf localhost:9901/clusters5537lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5538worker2 # [ 116.139509] systemd[1]: Stopping Nix worker-protocol over gRPC...5539worker2 # [ 116.713544] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:41Z level=info event=signal_exit5540lb # [ 116.788678] niks3-server[1086]: 2026/09/22 14:52:41 INFO lead: released remote=192.168.1.4:377405541worker1 # [ 117.798002] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:42Z level=info event=scheduler_restarting addr=lb:500515542worker2 # [ 117.865165] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:42Z level=info event=scheduler_restarting5543worker2 # [ 117.873171] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:42Z level=info event=scheduler_restarting addr=lb:500515544worker2 # [ 117.877933] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:42Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:541445545worker2 # [ 117.883115] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:42Z level=info event=worker_gone addr=192.168.1.3:500515546worker2 # [ 117.887797] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:42Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:541445547worker2 # [ 117.894216] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:42Z level=info event=worker_gone addr=192.168.1.4:500515548worker2 # [ 117.917470] nix-daemon[838]: reaped child process 1356, status = succeeded5549worker1 # [ 117.997762] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:42Z level=info event=scheduler_connected addr=lb:500515550worker1 # [ 118.003440] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5551worker2 # [ 118.082621] nix-grpc-daemon[1304]: ts=2026-09-22T14:52:42Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5552worker2 # [ 118.135988] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5553worker2 # [ 118.143048] systemd[1]: Stopped Nix worker-protocol over gRPC.5554worker2 # [ 118.149056] systemd[1]: nix-grpc-daemon.service: Consumed 1.646s CPU time over 14.591s wall clock time, 38.3M memory peak, 46.3K incoming IP traffic, 81.6K outgoing IP traffic.5555worker2 # [ 118.166856] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5556worker2 # [ 118.171283] systemd[1]: Closed Nix worker-protocol over gRPC.5557worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5558worker2 # [ 118.173437] systemd[1]: nix-grpc-daemon.socket: Consumed 1ms CPU time over 15.261s wall clock time, 256K memory peak, 35.9K incoming IP traffic, 28.6K outgoing IP traffic.5559worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.08 seconds)5560worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5561worker1 # [ 118.204235] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:42Z level=info event=scheduler_connected addr=lb:500515562worker1 # [ 118.208530] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5563worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)5564worker1 # [ 118.409187] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:42Z level=info event=scheduler_connected addr=lb:500515565worker1 # [ 118.414355] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5566worker1 # [ 118.615287] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:43Z level=info event=scheduler_connected addr=lb:500515567worker1 # [ 118.620853] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5568worker1 # [ 118.823713] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:43Z level=info event=scheduler_connected addr=lb:500515569worker1 # [ 118.828068] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5570worker1 # [ 119.024563] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:43Z level=info event=scheduler_connected addr=lb:500515571worker1 # [ 119.029912] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5572worker1 # [ 119.231040] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:43Z level=info event=scheduler_connected addr=lb:500515573worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5574worker1 # [ 119.236573] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5575worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)5576worker1 # [ 119.437709] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:44Z level=info event=scheduler_connected addr=lb:500515577worker1 # [ 119.443220] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5578worker1 # [ 119.644238] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:44Z level=info event=scheduler_connected addr=lb:500515579worker1 # [ 119.649603] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5580lb # [ 119.696594] envoy[905]: conn peer=[2001:db8:1::1]:48006 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9697 tx=4427 ms=52165581lb # [ 119.701553] envoy[905]: conn peer=[2001:db8:1::4]:35910 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=5496 tx=648 ms=143085582worker1 # [ 119.852423] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:44Z level=info event=scheduler_connected addr=lb:500515583worker1 # [ 119.856587] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5584worker1 # [ 120.053252] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:44Z level=info event=scheduler_connected addr=lb:500515585worker1 # [ 120.058819] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5586worker1 # [ 120.259736] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:44Z level=info event=scheduler_connected addr=lb:500515587worker1 # [ 120.265174] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5588worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5589worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)5590worker1 # [ 120.465901] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:45Z level=info event=scheduler_connected addr=lb:500515591worker1 # [ 120.471036] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5592worker1 # [ 120.671828] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:45Z level=info event=scheduler_connected addr=lb:500515593worker1 # [ 120.677177] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5594worker1 # [ 120.784555] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:45Z level=info event=scheduler_take_over5595lb # [ 120.771112] niks3-server[1086]: 2026/09/22 14:52:45 INFO lead: acquired remote=192.168.1.3:348085596worker1 # [ 120.879701] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:45Z level=info event=scheduler_connected addr=lb:500515597worker1 # [ 120.883997] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5598worker1 # [ 121.080857] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:45Z level=info event=scheduler_connected addr=lb:500515599worker1 # [ 121.086028] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5600worker1 # [ 121.286862] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:45Z level=info event=scheduler_connected addr=lb:500515601worker1 # [ 121.292216] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5602worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5603worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)5604worker1 # [ 121.493065] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:46Z level=info event=scheduler_connected addr=lb:500515605worker1 # [ 121.502218] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:46Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:477665606worker1 # [ 121.507513] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:46Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05607worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5608worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)5609client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby >&25610worker1 # [ 122.734380] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:477685611worker1 # [ 122.749125] nix-daemon[848]: accepted connection from pid 1260, user nix-grpc-daemon (trusted)5612client # don't know how to build these paths:5613client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5614worker1 # [ 122.774250] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:477685615worker1 # [ 122.790484] nix-grpc-daemon[1260]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 10 ms (attempt 1/5)5616worker1 # [ 122.809655] nix-grpc-daemon[1260]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 45 ms (attempt 2/5)5617worker1 # [ 122.856273] nix-grpc-daemon[1260]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 258 ms (attempt 3/5)5618worker1 # [ 123.116434] nix-grpc-daemon[1260]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 767 ms (attempt 4/5)5619worker1 # [ 123.888416] nix-grpc-daemon[1260]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5620worker1 # [ 123.892705] nix-grpc-daemon[1260]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5621worker1 # [ 123.928198] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:48Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=05622worker1 # [ 123.935460] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:48Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=15623worker1 # [ 123.976232] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:477685624worker1 # [ 123.992118] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:477685625client # copying 1 paths to 'lb:50051'...5626client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'...5627worker1 # [ 124.008801] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:477685628worker1 # [ 124.025148] nix-daemon[848]: accepted connection from pid 1260, user nix-grpc-daemon (trusted)5629worker1 # [ 124.063107] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:48Z level=info event=niks3_push_started pid=13455630worker1 # [ 124.204630] nix-grpc-daemon[1345]: time=2026-09-22T14:52:48.792Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.key ca=""5631worker1 # [ 124.311642] nix-daemon[848]: accepted connection from pid 1358, user nix-grpc-daemon (trusted)5632worker1 # [ 124.330466] nix-daemon[848]: reaped child process 1361, status = succeeded5633worker1 # [ 124.434254] nix-daemon[848]: accepted connection from pid 1363, user nix-grpc-daemon (trusted)5634worker1 # [ 124.452498] nix-daemon[848]: reaped child process 1366, status = succeeded5635lb # [ 124.442966] niks3-server[1086]: 2026/09/22 14:52:49 INFO Received uploads request method=POST path=/api/pending_closures5636worker1 # [ 124.470657] nix-grpc-daemon[1345]: time=2026-09-22T14:52:49.057Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5637worker1 # [ 124.472495] nix-grpc-daemon[1345]: time=2026-09-22T14:52:49.057Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)"5638lb # [ 124.488310] niks3-server[1086]: 2026/09/22 14:52:49 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst5639worker1 # [ 124.514270] nix-grpc-daemon[1345]: time=2026-09-22T14:52:49.101Z level=INFO msg="Uploading 1 narinfos"5640lb # [ 124.499406] niks3-server[1086]: 2026/09/22 14:52:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5641lb # [ 124.510294] niks3-server[1086]: 2026/09/22 14:52:49 INFO Signed narinfos id=43 count=15642lb # [ 124.517898] niks3-server[1086]: 2026/09/22 14:52:49 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls5643lb # [ 124.533270] niks3-server[1086]: 2026/09/22 14:52:49 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5644lb # [ 124.546980] niks3-server[1086]: 2026/09/22 14:52:49 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo5645lb # [ 124.577717] niks3-server[1086]: 2026/09/22 14:52:49 INFO Completed upload id=435646worker1 # [ 124.592282] nix-grpc-daemon[1345]: time=2026-09-22T14:52:49.180Z level=INFO msg="Upload complete. (383ms)"5647worker1 # [ 124.601669] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47768 duration_s=0 paths=1 nar_bytes_in=5205648worker1 # [ 124.616899] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:477685649worker1 # [ 124.632732] nix-daemon[848]: accepted connection from pid 1260, user nix-grpc-daemon (trusted)5650worker1 # [ 124.644505] nix-daemon[848]: reaped child process 1343, status = succeeded5651client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051...5652worker1 # [ 124.654182] nix-daemon[848]: accepted connection from pid 1260, user nix-grpc-daemon (trusted)5653client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5654client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds5655client # farm-a> LOG-farm-a-on-standby5656worker1 # [ 125.718155] nix-daemon[848]: reaped child process 1370, status = succeeded5657worker1 # [ 125.853611] nix-daemon[848]: accepted connection from pid 1386, user nix-grpc-daemon (trusted)5658worker1 # [ 125.875661] nix-daemon[848]: reaped child process 1389, status = succeeded5659lb # [ 125.861086] niks3-server[1086]: 2026/09/22 14:52:50 INFO Received uploads request method=POST path=/api/pending_closures5660worker1 # [ 125.888512] nix-grpc-daemon[1345]: time=2026-09-22T14:52:50.475Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5661worker1 # [ 125.890618] nix-grpc-daemon[1345]: time=2026-09-22T14:52:50.475Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)"5662lb # [ 125.921731] niks3-server[1086]: 2026/09/22 14:52:50 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5663lb # [ 125.932839] niks3-server[1086]: 2026/09/22 14:52:50 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv5664lb # [ 125.945566] niks3-server[1086]: 2026/09/22 14:52:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5665lb # [ 125.949385] niks3-server[1086]: 2026/09/22 14:52:50 INFO Signed narinfos id=44 count=15666worker1 # [ 125.961719] nix-grpc-daemon[1345]: time=2026-09-22T14:52:50.547Z level=INFO msg="Uploading 1 narinfos"5667lb # [ 125.954361] niks3-server[1086]: 2026/09/22 14:52:50 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls5668lb # [ 125.965637] niks3-server[1086]: 2026/09/22 14:52:50 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5669worker1 # [ 125.984323] nix-grpc-daemon[1345]: time=2026-09-22T14:52:50.572Z level=INFO msg="Upload complete. (312ms)"5670lb # [ 125.972695] niks3-server[1086]: 2026/09/22 14:52:50 INFO Completed upload id=445671lb # [ 125.974581] niks3-server[1086]: 2026/09/22 14:52:50 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo5672worker1 # [ 126.006521] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47768 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=15673worker1 # [ 126.024384] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:50Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=05674worker1 # [ 126.028647] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:50Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=15675worker1 # [ 126.032627] nix-daemon[848]: reaped child process 1368, status = succeeded5676worker1 # [ 126.051131] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:477685677worker1 # [ 126.068399] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:477685678worker1 # [ 126.083415] nix-grpc-daemon[1345]: time=2026-09-22T14:52:50.671Z level=INFO msg="All 1 paths already cached"5679client # copying 1 paths to 'lb:50051'...5680client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'...5681worker1 # [ 126.094823] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:477685682worker1 # [ 126.109274] nix-daemon[848]: accepted connection from pid 1260, user nix-grpc-daemon (trusted)5683worker1 # [ 126.264146] nix-daemon[848]: accepted connection from pid 1395, user nix-grpc-daemon (trusted)5684worker1 # [ 126.291089] nix-daemon[848]: reaped child process 1398, status = succeeded5685worker1 # [ 126.392146] nix-daemon[848]: accepted connection from pid 1400, user nix-grpc-daemon (trusted)5686worker1 # [ 126.413216] nix-daemon[848]: reaped child process 1403, status = succeeded5687lb # [ 126.400107] niks3-server[1086]: 2026/09/22 14:52:50 INFO Received uploads request method=POST path=/api/pending_closures5688worker1 # [ 126.426418] nix-grpc-daemon[1345]: time=2026-09-22T14:52:51.013Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5689worker1 # [ 126.427928] nix-grpc-daemon[1345]: time=2026-09-22T14:52:51.014Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)"5690lb # [ 126.433858] niks3-server[1086]: 2026/09/22 14:52:51 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst5691worker1 # [ 126.464200] nix-grpc-daemon[1345]: time=2026-09-22T14:52:51.051Z level=INFO msg="Uploading 1 narinfos"5692lb # [ 126.450264] niks3-server[1086]: 2026/09/22 14:52:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5693lb # [ 126.457264] niks3-server[1086]: 2026/09/22 14:52:51 INFO Signed narinfos id=45 count=15694lb # [ 126.463067] niks3-server[1086]: 2026/09/22 14:52:51 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls5695lb # [ 126.474563] niks3-server[1086]: 2026/09/22 14:52:51 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5696worker1 # [ 126.494214] nix-grpc-daemon[1345]: time=2026-09-22T14:52:51.082Z level=INFO msg="Upload complete. (367ms)"5697lb # [ 126.482735] niks3-server[1086]: 2026/09/22 14:52:51 INFO Completed upload id=455698lb # [ 126.490317] niks3-server[1086]: 2026/09/22 14:52:51 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo5699worker1 # [ 126.504553] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47768 duration_s=0 paths=1 nar_bytes_in=6405700worker1 # [ 126.516312] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:477685701worker1 # [ 126.523136] nix-daemon[848]: accepted connection from pid 1260, user nix-grpc-daemon (trusted)5702worker1 # [ 126.528236] nix-daemon[848]: reaped child process 1393, status = succeeded5703client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051...5704worker1 # [ 126.539764] nix-daemon[848]: accepted connection from pid 1260, user nix-grpc-daemon (trusted)5705client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5706client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds5707client # farm-b> LOG-farm-b-on-standby5708worker1 # [ 127.425508] nix-daemon[848]: reaped child process 1407, status = succeeded5709worker1 # [ 127.491160] nix-daemon[848]: accepted connection from pid 1423, user nix-grpc-daemon (trusted)5710worker1 # [ 127.514068] nix-daemon[848]: reaped child process 1426, status = succeeded5711lb # [ 127.506091] niks3-server[1086]: 2026/09/22 14:52:52 INFO Received uploads request method=POST path=/api/pending_closures5712worker1 # [ 127.531713] nix-grpc-daemon[1345]: time=2026-09-22T14:52:52.119Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5713worker1 # [ 127.534363] nix-grpc-daemon[1345]: time=2026-09-22T14:52:52.121Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)"5714lb # [ 127.553267] niks3-server[1086]: 2026/09/22 14:52:52 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv5715lb # [ 127.565821] niks3-server[1086]: 2026/09/22 14:52:52 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst5716lb # [ 127.578408] niks3-server[1086]: 2026/09/22 14:52:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign5717worker1 # [ 127.597036] nix-grpc-daemon[1345]: time=2026-09-22T14:52:52.184Z level=INFO msg="Uploading 1 narinfos"5718lb # [ 127.587531] niks3-server[1086]: 2026/09/22 14:52:52 INFO Signed narinfos id=46 count=15719lb # [ 127.592212] niks3-server[1086]: 2026/09/22 14:52:52 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls5720lb # [ 127.603044] niks3-server[1086]: 2026/09/22 14:52:52 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete5721lb # [ 127.610698] niks3-server[1086]: 2026/09/22 14:52:52 INFO Completed upload id=465722worker1 # [ 127.625252] nix-grpc-daemon[1345]: time=2026-09-22T14:52:52.213Z level=INFO msg="Upload complete. (272ms)"5723lb # [ 127.614942] niks3-server[1086]: 2026/09/22 14:52:52 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo5724worker1 # [ 127.646174] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47768 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=15725worker1 # [ 127.667570] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:52Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=05726worker1 # [ 127.671647] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:52Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=15727worker1 # [ 127.676396] nix-daemon[848]: reaped child process 1405, status = succeeded5728worker1 # [ 127.692733] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:477685729worker1 # [ 127.713731] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:477685730worker1 # [ 127.734469] nix-grpc-daemon[1345]: time=2026-09-22T14:52:52.322Z level=INFO msg="All 2 paths already cached"5731client # copying 1 paths to 'lb:50051'...5732client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'...5733worker1 # [ 127.747770] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:477685734worker1 # [ 127.763617] nix-daemon[848]: accepted connection from pid 1260, user nix-grpc-daemon (trusted)5735worker1 # [ 127.936189] nix-daemon[848]: accepted connection from pid 1432, user nix-grpc-daemon (trusted)5736worker1 # [ 127.958631] nix-daemon[848]: reaped child process 1435, status = succeeded5737worker1 # [ 128.079320] nix-daemon[848]: accepted connection from pid 1437, user nix-grpc-daemon (trusted)5738worker1 # [ 128.102728] nix-daemon[848]: reaped child process 1440, status = succeeded5739lb # [ 128.086948] niks3-server[1086]: 2026/09/22 14:52:52 INFO Received uploads request method=POST path=/api/pending_closures5740worker1 # [ 128.113696] nix-grpc-daemon[1345]: time=2026-09-22T14:52:52.701Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5741worker1 # [ 128.115263] nix-grpc-daemon[1345]: time=2026-09-22T14:52:52.701Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)"5742lb # [ 128.128935] niks3-server[1086]: 2026/09/22 14:52:52 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst5743worker1 # [ 128.165148] nix-grpc-daemon[1345]: time=2026-09-22T14:52:52.752Z level=INFO msg="Uploading 1 narinfos"5744lb # [ 128.151882] niks3-server[1086]: 2026/09/22 14:52:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign5745lb # [ 128.164511] niks3-server[1086]: 2026/09/22 14:52:52 INFO Signed narinfos id=47 count=15746lb # [ 128.171581] niks3-server[1086]: 2026/09/22 14:52:52 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls5747lb # [ 128.185350] niks3-server[1086]: 2026/09/22 14:52:52 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete5748lb # [ 128.195058] niks3-server[1086]: 2026/09/22 14:52:52 INFO Completed upload id=475749worker1 # [ 128.208710] nix-grpc-daemon[1345]: time=2026-09-22T14:52:52.796Z level=INFO msg="Upload complete. (426ms)"5750lb # [ 128.197999] niks3-server[1086]: 2026/09/22 14:52:52 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo5751worker1 # [ 128.221717] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47768 duration_s=0 paths=1 nar_bytes_in=7685752worker1 # [ 128.241057] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:477685753worker1 # [ 128.249391] nix-daemon[848]: accepted connection from pid 1260, user nix-grpc-daemon (trusted)5754worker1 # [ 128.259568] nix-daemon[848]: reaped child process 1430, status = succeeded5755worker1 # [ 128.267550] nix-daemon[848]: accepted connection from pid 1260, user nix-grpc-daemon (trusted)5756client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051...5757client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5758client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds5759client # farm-top> LOG-farm-top-on-standby5760worker1 # [ 128.923476] nix-daemon[848]: reaped child process 1444, status = succeeded5761worker1 # [ 129.027225] nix-daemon[848]: accepted connection from pid 1460, user nix-grpc-daemon (trusted)5762worker1 # [ 129.047731] nix-daemon[848]: reaped child process 1463, status = succeeded5763lb # [ 129.042432] niks3-server[1086]: 2026/09/22 14:52:53 INFO Received uploads request method=POST path=/api/pending_closures5764worker1 # [ 129.064095] nix-grpc-daemon[1345]: time=2026-09-22T14:52:53.651Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5765worker1 # [ 129.067818] nix-grpc-daemon[1345]: time=2026-09-22T14:52:53.653Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)"5766lb # [ 129.074771] niks3-server[1086]: 2026/09/22 14:52:53 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst5767lb # [ 129.094034] niks3-server[1086]: 2026/09/22 14:52:53 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv5768lb # [ 129.106347] niks3-server[1086]: 2026/09/22 14:52:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign5769worker1 # [ 129.125288] nix-grpc-daemon[1345]: time=2026-09-22T14:52:53.712Z level=INFO msg="Uploading 1 narinfos"5770lb # [ 129.115909] niks3-server[1086]: 2026/09/22 14:52:53 INFO Signed narinfos id=48 count=15771lb # [ 129.121039] niks3-server[1086]: 2026/09/22 14:52:53 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls5772lb # [ 129.131608] niks3-server[1086]: 2026/09/22 14:52:53 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete5773lb # [ 129.137701] niks3-server[1086]: 2026/09/22 14:52:53 INFO Completed upload id=485774worker1 # [ 129.152118] nix-grpc-daemon[1345]: time=2026-09-22T14:52:53.740Z level=INFO msg="Upload complete. (272ms)"5775lb # [ 129.142455] niks3-server[1086]: 2026/09/22 14:52:53 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo5776worker1 # [ 129.165465] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47768 duration_s=0 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=15777worker1 # [ 129.186019] nix-daemon[848]: reaped child process 1442, status = succeeded5778client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby >&2, in 6.71 seconds)5779client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby outPath5780client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby outPath, in 0.20 seconds)5781worker2 # [ 129.564938] systemd[1]: Listening on Nix worker-protocol over gRPC.5782worker2 # [ 129.572901] systemd[1]: Starting scheduler-token.service...5783worker2 # [ 129.652116] systemd[1]: scheduler-token.service: Deactivated successfully.5784worker2 # [ 129.660268] systemd[1]: Finished scheduler-token.service.5785worker2 # [ 129.661917] systemd[1]: scheduler-token.service: Consumed 47ms CPU time over 80ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5786worker2 # [ 129.672169] systemd[1]: Starting Nix worker-protocol over gRPC...5787lb # [ 129.694635] envoy[905]: conn peer=[2001:db8:1::1]:51042 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9563 tx=4427 ms=64515788worker2 # [ 129.795719] nix-grpc-daemon[1525]: ts=2026-09-22T14:52:54Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5789worker2 # [ 129.798119] nix-grpc-daemon[1525]: ts=2026-09-22T14:52:54Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5790worker2 # [ 129.802214] nix-grpc-daemon[1525]: ts=2026-09-22T14:52:54Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15791worker2 # [ 129.808051] nix-grpc-daemon[1525]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5792worker2 # [ 129.809542] nix-grpc-daemon[1525]: E0000 00:00:1790088774.374297 1525 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5793lb: must succeed: curl -sf localhost:9901/clusters5794worker2 # [ 129.856118] nix-grpc-daemon[1525]: E0000 00:00:1790088774.380859 1525 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5795worker2 # [ 129.858468] nix-grpc-daemon[1525]: ts=2026-09-22T14:52:54Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5796worker2 # [ 129.865959] nix-grpc-daemon[1525]: E0000 00:00:1790088774.393324 1567 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5797worker2 # [ 129.868919] nix-grpc-daemon[1525]: E0000 00:00:1790088774.412799 1567 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5798worker2 # [ 129.871392] nix-grpc-daemon[1525]: E0000 00:00:1790088774.412944 1567 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5799worker2 # [ 129.873927] systemd[1]: Started Nix worker-protocol over gRPC.5800worker2 # [ 129.874743] nix-grpc-daemon[1525]: E0000 00:00:1790088774.432858 1567 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5801worker2 # [ 129.883210] nix-grpc-daemon[1525]: ts=2026-09-22T14:52:54Z level=info event=scheduler_connected addr=lb:500515802worker1 # [ 129.828130] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:54Z level=info event=oidc_jwks provider=mock keys=15803worker1 # [ 129.833225] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:54Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:477665804worker1 # [ 129.838306] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:54Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05805lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5806worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5807worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)5808lb: must succeed: curl -sf localhost:9901/clusters5809lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5810lb: must succeed: curl -sf localhost:9901/clusters5811lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5812worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics5813worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)5814(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 14.27 seconds)5815subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5816client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag rs5817client # [ 130.141350] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag rs.5818client # Running as unit: rs.service; invocation ID: 7123ec878ea345319b3c30250c4686095819client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag rs, in 0.09 seconds)5820client # [ 130.346342] nix[1409]: don't know how to build these paths:5821client # [ 130.348081] nix[1409]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5822worker1 # [ 130.355911] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:477685823worker1 # [ 130.369560] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:54Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=05824worker1 # [ 130.376395] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:54Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=15825worker1 # [ 130.415049] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:477685826worker1 # [ 130.431072] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:477685827client # [ 130.436195] nix[1409]: copying 1 paths to 'lb:50051'...5828worker1 # [ 130.445967] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:477685829client # [ 130.440226] nix[1409]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'...5830worker1 # [ 130.465485] nix-daemon[848]: accepted connection from pid 1260, user nix-grpc-daemon (trusted)5831worker1 # [ 130.627910] nix-daemon[848]: accepted connection from pid 1476, user nix-grpc-daemon (trusted)5832worker1 # [ 130.647750] nix-daemon[848]: reaped child process 1479, status = succeeded5833worker1 # [ 130.748333] nix-daemon[848]: accepted connection from pid 1481, user nix-grpc-daemon (trusted)5834worker1 # [ 130.769611] nix-daemon[848]: reaped child process 1484, status = succeeded5835lb # [ 130.754998] niks3-server[1086]: 2026/09/22 14:52:55 INFO Received uploads request method=POST path=/api/pending_closures5836worker1 # [ 130.779470] nix-grpc-daemon[1345]: time=2026-09-22T14:52:55.367Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5837worker1 # [ 130.781509] nix-grpc-daemon[1345]: time=2026-09-22T14:52:55.369Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)"5838lb # [ 130.791045] niks3-server[1086]: 2026/09/22 14:52:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign5839worker1 # [ 130.815983] nix-grpc-daemon[1345]: time=2026-09-22T14:52:55.403Z level=INFO msg="Uploading 1 narinfos"5840lb # [ 130.810271] niks3-server[1086]: 2026/09/22 14:52:55 INFO Signed narinfos id=49 count=15841lb # [ 130.821028] niks3-server[1086]: 2026/09/22 14:52:55 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst5842lb # [ 130.839541] niks3-server[1086]: 2026/09/22 14:52:55 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete5843worker1 # [ 130.862688] nix-grpc-daemon[1345]: time=2026-09-22T14:52:55.450Z level=INFO msg="Upload complete. (380ms)"5844lb # [ 130.851991] niks3-server[1086]: 2026/09/22 14:52:55 INFO Completed upload id=495845lb # [ 130.859159] niks3-server[1086]: 2026/09/22 14:52:55 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo5846worker1 # [ 130.872647] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47768 duration_s=0 paths=1 nar_bytes_in=4165847lb # [ 130.864285] niks3-server[1086]: 2026/09/22 14:52:55 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls5848worker1 # [ 130.884519] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:477685849worker1 # [ 130.897757] nix-daemon[848]: accepted connection from pid 1260, user nix-grpc-daemon (trusted)5850worker1 # [ 130.907998] nix-daemon[848]: reaped child process 1474, status = succeeded5851client # [ 130.903877] nix[1409]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051...5852worker1 # [ 130.916823] nix-daemon[848]: accepted connection from pid 1260, user nix-grpc-daemon (trusted)5853lb: must succeed: curl -sf localhost:9901/clusters5854lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5855lb: must succeed: curl -sf localhost:9901/clusters5856lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5857lb: must succeed: curl -sf localhost:9901/clusters5858lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5859lb: must succeed: curl -sf localhost:9901/clusters5860lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5861worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5862worker2 # [ 133.043632] systemd-journald[271]: Received client request to rotate journal, rotating.5863worker2 # [ 133.066114] systemd-journald[271]: Vacuuming done, freed 0B of archived journals from /var/log/journal/b0442838253c4141bbf2f9c21df1b334.5864worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.09 seconds)5865worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5866worker1 # [ 133.042949] systemd[1]: Stopping Nix worker-protocol over gRPC...5867worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.05 seconds)5868client: must succeed: sleep 5.05869worker1 # [ 133.486811] nix-grpc-daemon[1260]: ts=2026-09-22T14:52:58Z level=info event=draining5870client: (finished: must succeed: sleep 5.0, in 5.05 seconds)5871worker1 # [ 138.344160] nix-daemon[848]: reaped child process 1488, status = succeeded5872worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5873worker1 # [ 138.445481] nix-daemon[848]: accepted connection from pid 1529, user nix-grpc-daemon (trusted)5874worker1 # [ 138.466808] nix-daemon[848]: reaped child process 1532, status = succeeded5875lb # [ 138.458163] niks3-server[1086]: 2026/09/22 14:53:03 INFO Received uploads request method=POST path=/api/pending_closures5876worker1 # [ 138.488341] nix-grpc-daemon[1345]: time=2026-09-22T14:53:03.073Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5877worker1 # [ 138.490531] nix-grpc-daemon[1345]: time=2026-09-22T14:53:03.073Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)"5878lb # [ 138.511646] niks3-server[1086]: 2026/09/22 14:53:03 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv5879lb # [ 138.520603] niks3-server[1086]: 2026/09/22 14:53:03 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5880lb # [ 138.539494] niks3-server[1086]: 2026/09/22 14:53:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign5881worker1 # [ 138.559047] nix-grpc-daemon[1345]: time=2026-09-22T14:53:03.146Z level=INFO msg="Uploading 1 narinfos"5882lb # [ 138.547718] niks3-server[1086]: 2026/09/22 14:53:03 INFO Signed narinfos id=50 count=15883lb # [ 138.557888] niks3-server[1086]: 2026/09/22 14:53:03 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls5884lb # [ 138.567385] niks3-server[1086]: 2026/09/22 14:53:03 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete5885lb # [ 138.573344] niks3-server[1086]: 2026/09/22 14:53:03 INFO Completed upload id=505886worker1 # [ 138.587045] nix-grpc-daemon[1345]: time=2026-09-22T14:53:03.174Z level=INFO msg="Upload complete. (256ms)"5887lb # [ 138.576453] niks3-server[1086]: 2026/09/22 14:53:03 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo5888worker1 # [ 138.601297] nix-grpc-daemon[1260]: ts=2026-09-22T14:53:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47768 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=15889worker1 # [ 138.620944] nix-daemon[848]: reaped child process 1486, status = succeeded5890client # [ 138.624153] systemd[1]: rs.service: Deactivated successfully.5891client # [ 138.629305] systemd[1]: rs.service: Consumed 201ms CPU time over 8.486s wall clock time, 41.2M memory peak, 7.1K incoming IP traffic, 8.4K outgoing IP traffic.5892worker1 # [ 139.490566] nix-grpc-daemon[1260]: ts=2026-09-22T14:53:04Z level=info event=signal_exit5893lb # [ 139.699076] envoy[905]: conn peer=[2001:db8:1::1]:51048 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2966 tx=1539 ms=82605894lb # [ 139.777516] niks3-server[1086]: 2026/09/22 14:53:04 INFO lead: released remote=192.168.1.3:348085895worker2 # [ 140.857934] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:05Z level=info event=scheduler_restarting addr=lb:500515896worker1 # [ 140.797047] nix-grpc-daemon[1260]: ts=2026-09-22T14:53:05Z level=info event=scheduler_restarting5897worker1 # [ 140.802003] nix-grpc-daemon[1260]: ts=2026-09-22T14:53:05Z level=info event=scheduler_restarting addr=lb:500515898worker1 # [ 140.806909] nix-grpc-daemon[1260]: ts=2026-09-22T14:53:05Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:477665899worker1 # [ 140.812197] nix-grpc-daemon[1260]: ts=2026-09-22T14:53:05Z level=info event=worker_gone addr=192.168.1.4:500515900worker1 # [ 140.816947] nix-grpc-daemon[1260]: ts=2026-09-22T14:53:05Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:477665901worker1 # [ 140.821858] nix-grpc-daemon[1260]: ts=2026-09-22T14:53:05Z level=info event=worker_gone addr=192.168.1.3:500515902worker1 # [ 140.845176] nix-daemon[848]: reaped child process 1335, status = succeeded5903worker2 # [ 141.058263] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:05Z level=info event=scheduler_connected addr=lb:500515904worker2 # [ 141.063933] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5905worker1 # [ 141.017110] nix-grpc-daemon[1260]: ts=2026-09-22T14:53:05Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5906worker2 # [ 141.265189] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:05Z level=info event=scheduler_connected addr=lb:500515907worker2 # [ 141.270514] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5908worker1 # [ 141.362645] nix-grpc-daemon[1260]: E0000 00:00:1790088785.950391 1305 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true5909worker1 # [ 141.371753] nix-grpc-daemon[1260]: E0000 00:00:1790088785.959547 1305 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5910worker2 # [ 141.471543] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:06Z level=info event=scheduler_connected addr=lb:500515911worker2 # [ 141.476855] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5912worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 3.24 seconds)5913client: waiting for success: ! systemctl is-active rs5914worker2 # [ 141.678037] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:06Z level=info event=scheduler_connected addr=lb:500515915worker2 # [ 141.683547] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5916client: (finished: waiting for success: ! systemctl is-active rs, in 0.06 seconds)5917client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5918client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds)5919client: must fail: journalctl -u rs | grep -q 'reconnecting'5920client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5921lb: must succeed: curl -sf localhost:9901/clusters5922lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5923worker2 # [ 141.886149] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:06Z level=info event=scheduler_connected addr=lb:500515924worker2 # [ 141.890344] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5925worker1 # [ 141.966722] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5926worker1 # [ 141.973871] systemd[1]: Stopped Nix worker-protocol over gRPC.5927worker1 # [ 141.980543] systemd[1]: nix-grpc-daemon.service: Consumed 1.988s CPU time over 33.655s wall clock time, 38.7M memory peak, 50.3K incoming IP traffic, 96.4K outgoing IP traffic.5928worker1 # [ 142.004896] systemd[1]: Starting Nix worker-protocol over gRPC...5929worker2 # [ 142.086788] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:06Z level=info event=scheduler_connected addr=lb:500515930worker2 # [ 142.091994] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5931worker1 # [ 142.140470] nix-grpc-daemon[1539]: ts=2026-09-22T14:53:06Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5932worker1 # [ 142.143052] nix-grpc-daemon[1539]: ts=2026-09-22T14:53:06Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5933worker1 # [ 142.146976] nix-grpc-daemon[1539]: ts=2026-09-22T14:53:06Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15934worker1 # [ 142.152062] nix-grpc-daemon[1539]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5935worker1 # [ 142.153559] nix-grpc-daemon[1539]: E0000 00:00:1790088786.739509 1539 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5936worker1 # [ 142.164157] nix-grpc-daemon[1539]: E0000 00:00:1790088786.745883 1539 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5937lb # [ 142.151422] niks3-server[1086]: 2026/09/22 14:53:06 INFO lead: acquired remote=192.168.1.3:341485938worker1 # [ 142.188170] nix-grpc-daemon[1539]: ts=2026-09-22T14:53:06Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5939worker1 # [ 142.189892] systemd[1]: Started Nix worker-protocol over gRPC.5940worker1 # [ 142.200852] nix-grpc-daemon[1539]: ts=2026-09-22T14:53:06Z level=info event=scheduler_take_over5941worker1 # [ 142.202613] nix-grpc-daemon[1539]: E0000 00:00:1790088786.755097 1578 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5942worker1 # [ 142.205305] nix-grpc-daemon[1539]: E0000 00:00:1790088786.770479 1578 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5943worker1 # [ 142.210764] nix-grpc-daemon[1539]: E0000 00:00:1790088786.770640 1578 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.5944worker1 # [ 142.215602] nix-grpc-daemon[1539]: E0000 00:00:1790088786.787902 1578 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.5945worker1 # [ 142.218179] nix-grpc-daemon[1539]: ts=2026-09-22T14:53:06Z level=info event=scheduler_connected addr=lb:500515946worker1 # [ 142.219444] nix-grpc-daemon[1539]: ts=2026-09-22T14:53:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5947worker2 # [ 142.293566] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:06Z level=info event=scheduler_connected addr=lb:500515948worker2 # [ 142.298737] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5949worker1 # [ 142.416682] nix-grpc-daemon[1539]: ts=2026-09-22T14:53:07Z level=info event=scheduler_connected addr=lb:500515950worker1 # [ 142.422020] nix-grpc-daemon[1539]: ts=2026-09-22T14:53:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5951worker2 # [ 142.500338] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:07Z level=info event=scheduler_connected addr=lb:500515952worker2 # [ 142.505648] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5953worker1 # [ 142.622973] nix-grpc-daemon[1539]: ts=2026-09-22T14:53:07Z level=info event=scheduler_connected addr=lb:500515954worker1 # [ 142.628748] nix-grpc-daemon[1539]: ts=2026-09-22T14:53:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5955worker2 # [ 142.706913] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:07Z level=info event=scheduler_connected addr=lb:500515956worker2 # [ 142.712319] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5957lb: must succeed: curl -sf localhost:9901/clusters5958worker1 # [ 142.829578] nix-grpc-daemon[1539]: ts=2026-09-22T14:53:07Z level=info event=scheduler_connected addr=lb:500515959worker1 # [ 142.834939] nix-grpc-daemon[1539]: ts=2026-09-22T14:53:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5960worker2 # [ 142.915104] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:07Z level=info event=scheduler_connected addr=lb:500515961worker2 # [ 142.919414] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream"5962lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5963worker1 # [ 143.035676] nix-grpc-daemon[1539]: ts=2026-09-22T14:53:07Z level=info event=scheduler_connected addr=lb:500515964worker1 # [ 143.044265] nix-grpc-daemon[1539]: ts=2026-09-22T14:53:07Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:559845965worker2 # [ 143.116075] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:07Z level=info event=scheduler_connected addr=lb:500515966worker1 # [ 143.050406] nix-grpc-daemon[1539]: ts=2026-09-22T14:53:07Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=05967worker1 # [ 143.065704] nix-grpc-daemon[1539]: ts=2026-09-22T14:53:07Z level=info event=oidc_jwks provider=mock keys=15968worker1 # [ 143.070181] nix-grpc-daemon[1539]: ts=2026-09-22T14:53:07Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:559845969worker1 # [ 143.075582] nix-grpc-daemon[1539]: ts=2026-09-22T14:53:07Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=05970lb: must succeed: curl -sf localhost:9901/clusters5971lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5972worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5973worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)5974(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.94 seconds)5975subtest: scheduler restart mid-build: build finishes, no double build5976client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag mid5977client # [ 144.078641] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag mid.5978client # Running as unit: mid.service; invocation ID: 74e7460b3ec14edcbcfe9020acbf5eb55979client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag mid, in 0.09 seconds)5980worker1 # [ 144.287013] nix-grpc-daemon[1539]: ts=2026-09-22T14:53:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:559985981worker1 # [ 144.301780] nix-daemon[848]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)5982client # [ 144.310628] nix[1445]: don't know how to build these paths:5983client # [ 144.312433] nix[1445]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv5984worker1 # [ 144.334822] nix-grpc-daemon[1539]: ts=2026-09-22T14:53:08Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=05985worker1 # [ 144.341950] nix-grpc-daemon[1539]: ts=2026-09-22T14:53:08Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=15986worker1 # [ 144.387081] nix-grpc-daemon[1539]: ts=2026-09-22T14:53:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:559985987worker1 # [ 144.403583] nix-grpc-daemon[1539]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 58 ms (attempt 1/5)5988worker1 # [ 144.471194] nix-grpc-daemon[1539]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 62 ms (attempt 2/5)5989worker1 # [ 144.534910] nix-grpc-daemon[1539]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 381 ms (attempt 3/5)5990worker1 # [ 144.918055] nix-grpc-daemon[1539]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 585 ms (attempt 4/5)5991worker1 # [ 145.507621] nix-grpc-daemon[1539]: disabling binary cache 'https://cache.nixos.org' for 60 seconds5992worker1 # [ 145.513816] nix-grpc-daemon[1539]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5993worker1 # [ 145.533549] nix-grpc-daemon[1539]: ts=2026-09-22T14:53:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:559985994client # [ 145.541352] nix[1445]: copying 1 paths to 'lb:50051'...5995worker1 # [ 145.550852] nix-grpc-daemon[1539]: ts=2026-09-22T14:53:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:559985996client # [ 145.541646] nix[1445]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'...5997worker1 # [ 145.570150] nix-daemon[848]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)5998worker1 # [ 145.596698] nix-grpc-daemon[1539]: ts=2026-09-22T14:53:10Z level=info event=niks3_push_started pid=16125999worker1 # [ 145.745228] nix-grpc-daemon[1612]: time=2026-09-22T14:53:10.332Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.key ca=""6000worker1 # [ 145.854208] nix-daemon[848]: accepted connection from pid 1625, user nix-grpc-daemon (trusted)6001worker1 # [ 145.873773] nix-daemon[848]: reaped child process 1628, status = succeeded6002worker1 # [ 145.977254] nix-daemon[848]: accepted connection from pid 1630, user nix-grpc-daemon (trusted)6003worker1 # [ 145.997421] nix-daemon[848]: reaped child process 1633, status = succeeded6004lb # [ 145.988972] niks3-server[1086]: 2026/09/22 14:53:10 INFO Received uploads request method=POST path=/api/pending_closures6005worker1 # [ 146.013666] nix-grpc-daemon[1612]: time=2026-09-22T14:53:10.600Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6006worker1 # [ 146.015232] nix-grpc-daemon[1612]: time=2026-09-22T14:53:10.600Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)"6007lb # [ 146.032431] niks3-server[1086]: 2026/09/22 14:53:10 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst6008lb # [ 146.050470] niks3-server[1086]: 2026/09/22 14:53:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6009worker1 # [ 146.070918] nix-grpc-daemon[1612]: time=2026-09-22T14:53:10.658Z level=INFO msg="Uploading 1 narinfos"6010lb # [ 146.061464] niks3-server[1086]: 2026/09/22 14:53:10 INFO Signed narinfos id=51 count=16011lb # [ 146.068363] niks3-server[1086]: 2026/09/22 14:53:10 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls6012lb # [ 146.080121] niks3-server[1086]: 2026/09/22 14:53:10 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6013lb # [ 146.088893] niks3-server[1086]: 2026/09/22 14:53:10 INFO Completed upload id=516014worker1 # [ 146.103383] nix-grpc-daemon[1612]: time=2026-09-22T14:53:10.691Z level=INFO msg="Upload complete. (354ms)"6015lb # [ 146.093408] niks3-server[1086]: 2026/09/22 14:53:10 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo6016worker1 # [ 146.113630] nix-grpc-daemon[1539]: ts=2026-09-22T14:53:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55998 duration_s=0 paths=1 nar_bytes_in=4246017worker1 # [ 146.130779] nix-grpc-daemon[1539]: ts=2026-09-22T14:53:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:559986018worker1 # [ 146.140999] nix-daemon[848]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)6019worker1 # [ 146.144837] nix-daemon[848]: reaped child process 1610, status = succeeded6020worker1 # [ 146.156334] nix-daemon[848]: accepted connection from pid 1539, user nix-grpc-daemon (trusted)6021client # [ 146.145348] nix[1445]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...6022lb: must succeed: curl -sf localhost:9901/clusters6023lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6024lb: must succeed: curl -sf localhost:9901/clusters6025lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6026worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service6027worker1 # [ 147.961532] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1539 (nix-grpc-daemon) on client request.6028worker1 # [ 147.963161] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.6029lb # [ 147.960617] niks3-server[1086]: 2026/09/22 14:53:12 INFO lead: released remote=192.168.1.3:341486030worker1 # [ 147.982914] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL6031client # [ 147.972595] nix[1445]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again6032worker2 # [ 148.046634] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:12Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"6033client # [ 147.972975] nix[1445]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting6034worker1 # [ 147.997955] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.6035worker1 # [ 147.999619] systemd[1]: nix-grpc-daemon.service: Consumed 563ms CPU time over 5.979s wall clock time, 34.1M memory peak, 13.7K incoming IP traffic, 18.8K outgoing IP traffic.6036worker1 # [ 148.012241] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1.6037worker1 # [ 148.013763] systemd[1]: Starting Nix worker-protocol over gRPC...6038worker1 # [ 148.065217] nix-daemon[848]: reaped child process 1598, status = succeeded6039worker1 # [ 148.069038] nix-daemon[848]: reaped child process 1635, status = succeeded6040worker1 # [ 148.074263] nix-daemon[1637]: unexpected Nix daemon error: error: interrupted by the user6041worker1 # [ 148.083454] nix-daemon[848]: reaped child process 1637, status = failed with exit code 16042worker1 # [ 148.135887] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:12Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6043worker1 # [ 148.138339] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:12Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6044worker1 # [ 148.142210] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:12Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=16045worker1 # [ 148.148069] nix-grpc-daemon[1673]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6046worker1 # [ 148.149549] nix-grpc-daemon[1673]: E0000 00:00:1790088792.734554 1673 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6047worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.24 seconds)6048client: must succeed: sleep 5.06049worker1 # [ 148.166453] nix-grpc-daemon[1673]: E0000 00:00:1790088792.740872 1673 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6050lb # [ 148.157387] niks3-server[1086]: 2026/09/22 14:53:12 INFO lead: acquired remote=192.168.1.3:342146051worker2 # [ 148.246822] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:12Z level=info event=scheduler_connected addr=lb:500516052worker1 # [ 148.200143] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:12Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6053worker1 # [ 148.201844] systemd[1]: Started Nix worker-protocol over gRPC.6054worker1 # [ 148.202683] nix-grpc-daemon[1673]: E0000 00:00:1790088792.758687 1713 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6055worker1 # [ 148.211605] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:12Z level=info event=scheduler_take_over6056worker1 # [ 148.213272] nix-grpc-daemon[1673]: E0000 00:00:1790088792.775756 1713 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6057worker1 # [ 148.215920] nix-grpc-daemon[1673]: E0000 00:00:1790088792.775848 1713 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6058worker1 # [ 148.221203] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:12Z level=info event=oidc_jwks provider=mock keys=16059worker1 # [ 148.224662] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:12Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:560226060worker1 # [ 148.226752] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:12Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=06061worker1 # [ 148.228587] nix-grpc-daemon[1673]: E0000 00:00:1790088792.798856 1713 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6062worker1 # [ 148.230779] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:12Z level=info event=scheduler_connected addr=lb:500516063worker1 # [ 148.232035] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:12Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:560226064worker1 # [ 148.233547] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:12Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=06065worker1 # [ 148.492743] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:13Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=06066worker1 # [ 148.498952] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:13Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=16067worker2 # [ 148.621078] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603826068worker2 # [ 148.635952] nix-daemon[838]: accepted connection from pid 1525, user nix-grpc-daemon (trusted)6069worker2 # [ 148.663039] nix-grpc-daemon[1525]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 48 ms (attempt 1/5)6070worker2 # [ 148.719370] nix-grpc-daemon[1525]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 135 ms (attempt 2/5)6071worker2 # [ 148.856309] nix-grpc-daemon[1525]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 37 ms (attempt 3/5)6072worker2 # [ 148.895356] nix-grpc-daemon[1525]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 255 ms (attempt 4/5)6073worker2 # [ 149.154515] nix-grpc-daemon[1525]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6074worker2 # [ 149.161279] nix-grpc-daemon[1525]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6075worker2 # [ 149.177347] nix-grpc-daemon[1525]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' from 'http://lb:5751'...6076worker2 # [ 149.206812] nix-daemon[838]: accepted connection from pid 1525, user nix-grpc-daemon (trusted)6077client # [ 149.150162] nix[1445]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051...6078worker2 # [ 149.229231] nix-daemon[838]: accepted connection from pid 1525, user nix-grpc-daemon (trusted)6079lb # [ 149.702352] envoy[905]: conn peer=[2001:db8:1::3]:52444 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3750 tx=1185 ms=324706080lb # [ 149.702554] envoy[905]: conn peer=[2001:db8:1::3]:60564 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1015 tx=434 ms=57766081client: (finished: must succeed: sleep 5.0, in 5.05 seconds)6082client: waiting for success: ! systemctl is-active mid6083worker2 # [ 153.653495] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:18Z level=info event=niks3_push_started pid=16876084worker2 # [ 153.739927] nix-daemon[838]: reaped child process 1662, status = succeeded6085worker2 # [ 153.813895] nix-grpc-daemon[1687]: time=2026-09-22T14:53:18.381Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca=""6086worker2 # [ 153.921591] nix-daemon[838]: accepted connection from pid 1700, user nix-grpc-daemon (trusted)6087worker2 # [ 153.941436] nix-daemon[838]: reaped child process 1703, status = succeeded6088lb # [ 153.862013] niks3-server[1086]: 2026/09/22 14:53:18 INFO Received uploads request method=POST path=/api/pending_closures6089worker2 # [ 153.952085] nix-grpc-daemon[1687]: time=2026-09-22T14:53:18.518Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6090worker2 # [ 153.953526] nix-grpc-daemon[1687]: time=2026-09-22T14:53:18.518Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)"6091lb # [ 153.914590] niks3-server[1086]: 2026/09/22 14:53:18 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst6092lb # [ 153.931108] niks3-server[1086]: 2026/09/22 14:53:18 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv6093lb # [ 153.938781] niks3-server[1086]: 2026/09/22 14:53:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6094worker2 # [ 154.023384] nix-grpc-daemon[1687]: time=2026-09-22T14:53:18.589Z level=INFO msg="Uploading 1 narinfos"6095lb # [ 153.947487] niks3-server[1086]: 2026/09/22 14:53:18 INFO Signed narinfos id=52 count=16096lb # [ 153.952292] niks3-server[1086]: 2026/09/22 14:53:18 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls6097lb # [ 153.963042] niks3-server[1086]: 2026/09/22 14:53:18 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6098worker2 # [ 154.049030] nix-grpc-daemon[1687]: time=2026-09-22T14:53:18.616Z level=INFO msg="Upload complete. (231ms)"6099lb # [ 153.970261] niks3-server[1086]: 2026/09/22 14:53:18 INFO Completed upload id=526100worker2 # [ 154.060306] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60382 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=16101worker2 # [ 154.077781] nix-daemon[838]: reaped child process 1660, status = succeeded6102client # [ 154.021205] systemd[1]: mid.service: Deactivated successfully.6103client # [ 154.026217] systemd[1]: mid.service: Consumed 202ms CPU time over 9.943s wall clock time, 41.4M memory peak, 8.7K incoming IP traffic, 10.4K outgoing IP traffic.6104client: (finished: waiting for success: ! systemctl is-active mid, in 1.12 seconds)6105client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }6106client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds)6107(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.63 seconds)6108subtest: interrupting the client stops the build on the worker6109client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag intr6110client # [ 154.680779] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag intr.6111client # Running as unit: intr.service; invocation ID: 7e59d29e8bdc43b4b789cf07f62e64ca6112client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag intr, in 0.05 seconds)6113worker2 # [ 154.934107] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:603826114client # [ 154.867882] nix[1481]: don't know how to build these paths:6115client # [ 154.869006] nix[1481]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv6116worker1 # [ 154.893246] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:19Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=06117worker1 # [ 154.893615] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:19Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.3:50051 clients=16118worker1 # [ 154.953396] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379066119worker1 # [ 154.967951] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6120worker1 # [ 154.991026] nix-grpc-daemon[1673]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 7 ms (attempt 1/5)6121worker1 # [ 155.005803] nix-grpc-daemon[1673]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 44 ms (attempt 2/5)6122worker1 # [ 155.058382] nix-grpc-daemon[1673]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 40 ms (attempt 3/5)6123worker1 # [ 155.099998] nix-grpc-daemon[1673]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 735 ms (attempt 4/5)6124worker1 # [ 155.838246] nix-grpc-daemon[1673]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6125worker1 # [ 155.838632] nix-grpc-daemon[1673]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6126worker1 # [ 155.867393] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:379066127client # [ 155.873512] nix[1481]: copying 1 paths to 'lb:50051'...6128worker1 # [ 155.884874] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:379066129client # [ 155.878765] nix[1481]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'...6130worker1 # [ 155.904518] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6131worker1 # [ 155.939101] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:20Z level=info event=niks3_push_started pid=17546132worker1 # [ 156.088492] nix-grpc-daemon[1754]: time=2026-09-22T14:53:20.676Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.key ca=""6133worker1 # [ 156.201425] nix-daemon[848]: accepted connection from pid 1767, user nix-grpc-daemon (trusted)6134worker1 # [ 156.224476] nix-daemon[848]: reaped child process 1770, status = succeeded6135worker1 # [ 156.320996] nix-daemon[848]: accepted connection from pid 1772, user nix-grpc-daemon (trusted)6136worker1 # [ 156.340747] nix-daemon[848]: reaped child process 1775, status = succeeded6137lb # [ 156.334578] niks3-server[1086]: 2026/09/22 14:53:20 INFO Received uploads request method=POST path=/api/pending_closures6138worker1 # [ 156.364076] nix-grpc-daemon[1754]: time=2026-09-22T14:53:20.950Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6139worker1 # [ 156.365721] nix-grpc-daemon[1754]: time=2026-09-22T14:53:20.950Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)"6140lb # [ 156.387181] niks3-server[1086]: 2026/09/22 14:53:20 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst6141worker1 # [ 156.409362] nix-grpc-daemon[1754]: time=2026-09-22T14:53:20.996Z level=INFO msg="Uploading 1 narinfos"6142lb # [ 156.399147] niks3-server[1086]: 2026/09/22 14:53:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6143lb # [ 156.408716] niks3-server[1086]: 2026/09/22 14:53:20 INFO Signed narinfos id=53 count=16144lb # [ 156.414391] niks3-server[1086]: 2026/09/22 14:53:20 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls6145lb # [ 156.424257] niks3-server[1086]: 2026/09/22 14:53:21 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6146lb # [ 156.429011] niks3-server[1086]: 2026/09/22 14:53:21 INFO Completed upload id=536147worker1 # [ 156.443535] nix-grpc-daemon[1754]: time=2026-09-22T14:53:21.031Z level=INFO msg="Upload complete. (351ms)"6148lb # [ 156.432405] niks3-server[1086]: 2026/09/22 14:53:21 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo6149worker1 # [ 156.454359] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37906 duration_s=0 paths=1 nar_bytes_in=4246150worker1 # [ 156.470452] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379066151worker1 # [ 156.476571] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6152worker1 # [ 156.481507] nix-daemon[848]: reaped child process 1751, status = succeeded6153worker1 # [ 156.491834] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6154client # [ 156.481083] nix[1481]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051...6155client: must succeed: systemctl kill -s INT intr6156client # [ 158.425127] systemd[1]: intr.service: Sent signal SIGINT to main process 1481 (nix) on client request.6157worker1 # [ 158.445934] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:23Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv6158client # [ 158.437206] nix[1481]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)6159client # [ 158.449111] nix[1481]: error: interrupted by the user6160client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds)6161client # [ 158.471601] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE6162client # [ 158.476124] systemd[1]: intr.service: Failed with result 'exit-code'.6163client # [ 158.477986] systemd[1]: intr.service: Consumed 169ms CPU time over 3.793s wall clock time, 41.4M memory peak, 6.4K incoming IP traffic, 8.3K outgoing IP traffic.6164worker1 # [ 158.529342] nix-daemon[1779]: unexpected Nix daemon error: error: interrupted by the user6165worker1 # [ 158.538225] nix-daemon[848]: reaped child process 1777, status = succeeded6166worker1 # [ 158.539579] nix-daemon[848]: reaped child process 1779, status = failed with exit code 16167lb # [ 159.705125] envoy[905]: conn peer=[2001:db8:1::1]:51632 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3927 tx=1938 ms=97296168lb # [ 159.710204] envoy[905]: conn peer=[2001:db8:1::1]:59428 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2987 tx=827 ms=36016169(finished: subtest: interrupting the client stops the build on the worker, in 5.09 seconds)6170subtest: a deploy mid-build drains: the build finishes, the new generation takes over6171client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag sw6172client # [ 159.790878] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag sw.6173client # Running as unit: sw.service; invocation ID: c00329e34b454d539432675b902fae406174client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag sw, in 0.08 seconds)6175worker1 # [ 159.999408] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:379066176client # [ 159.996794] nix[1502]: don't know how to build these paths:6177client # [ 159.997727] nix[1502]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv6178worker1 # [ 160.018576] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:24Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=06179worker1 # [ 160.024653] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:24Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.4:50051 clients=16180worker2 # [ 160.132707] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603826181worker2 # [ 160.149061] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:603826182client # [ 160.086450] nix[1502]: copying 1 paths to 'lb:50051'...6183client # [ 160.092170] nix[1502]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'...6184worker2 # [ 160.166719] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:603826185worker2 # [ 160.181580] nix-daemon[838]: accepted connection from pid 1525, user nix-grpc-daemon (trusted)6186worker2 # [ 160.341800] nix-daemon[838]: accepted connection from pid 1735, user nix-grpc-daemon (trusted)6187worker2 # [ 160.362441] nix-daemon[838]: reaped child process 1738, status = succeeded6188worker2 # [ 160.464902] nix-daemon[838]: accepted connection from pid 1740, user nix-grpc-daemon (trusted)6189worker2 # [ 160.483251] nix-daemon[838]: reaped child process 1743, status = succeeded6190lb # [ 160.408870] niks3-server[1086]: 2026/09/22 14:53:24 INFO Received uploads request method=POST path=/api/pending_closures6191worker2 # [ 160.502318] nix-grpc-daemon[1687]: time=2026-09-22T14:53:25.069Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6192worker2 # [ 160.503768] nix-grpc-daemon[1687]: time=2026-09-22T14:53:25.069Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)"6193lb # [ 160.447241] niks3-server[1086]: 2026/09/22 14:53:25 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst6194worker2 # [ 160.539737] nix-grpc-daemon[1687]: time=2026-09-22T14:53:25.107Z level=INFO msg="Uploading 1 narinfos"6195lb # [ 160.460451] niks3-server[1086]: 2026/09/22 14:53:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6196lb # [ 160.470316] niks3-server[1086]: 2026/09/22 14:53:25 INFO Signed narinfos id=54 count=16197lb # [ 160.476486] niks3-server[1086]: 2026/09/22 14:53:25 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls6198lb # [ 160.487697] niks3-server[1086]: 2026/09/22 14:53:25 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6199lb # [ 160.495205] niks3-server[1086]: 2026/09/22 14:53:25 INFO Completed upload id=546200worker2 # [ 160.574137] nix-grpc-daemon[1687]: time=2026-09-22T14:53:25.141Z level=INFO msg="Upload complete. (375ms)"6201lb # [ 160.498237] niks3-server[1086]: 2026/09/22 14:53:25 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo6202worker2 # [ 160.584366] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60382 duration_s=0 paths=1 nar_bytes_in=4166203worker2 # [ 160.596190] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603826204worker2 # [ 160.603327] nix-daemon[838]: accepted connection from pid 1525, user nix-grpc-daemon (trusted)6205worker2 # [ 160.609018] nix-daemon[838]: reaped child process 1733, status = succeeded6206client # [ 160.544851] nix[1502]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051...6207worker2 # [ 160.623086] nix-daemon[838]: accepted connection from pid 1525, user nix-grpc-daemon (trusted)6208worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&26209worker2 # Checking switch inhibitors... done6210worker2 # [ 162.878664] nixos[1779]: switching to system configuration /nix/store/di3jjhf5scbnchwmjr29pa02igl35lm5-nixos-system-worker2-test6211worker2 # activating the configuration...6212worker2 # [ 162.885335] systemd[1]: Stopped target Local File Systems.6213worker2 # [ 162.886151] systemd[1]: Stopped target Remote File Systems.6214worker2 # setting up /etc...6215worker2 # [ 163.434921] systemd[1]: Reload requested from client PID 1779 ('.switch-to-conf') (unit backdoor.service)...6216worker2 # [ 163.437182] systemd[1]: Reloading...6217worker2 # [ 168.384475] systemd[1]: Reloading finished in 4938 ms.6218worker2 # restarting sysinit-reactivation.target6219worker2 # [ 168.519978] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....6220worker2 # [ 168.656107] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..6221worker2 # [ 168.657350] systemd[1]: Reached target Reactivate sysinit units.6222worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service6223worker2 # [ 168.673820] systemd[1]: Reloading D-Bus System Message Bus...6224worker2 # [ 168.675135] dbus-broker-launch[494]: Caught SIGHUP, trigger reload.6225worker2 # [ 168.681278] systemd[1]: Reloading Nix worker-protocol over gRPC...6226worker2 # [ 168.707009] dbus-broker-launch[494]: Looking up NSS user entry for 'systemd-timesync'...6227worker2 # [ 168.713413] dbus-broker-launch[494]: NSS returned no entry for 'systemd-timesync'6228worker2 # [ 168.714451] dbus-broker-launch[494]: Invalid user-name in /nix/store/ng2ydfkv03gvmdws4f4mjf9wj6qj3kq6-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"6229worker2 # [ 168.722815] systemd[1]: Reloaded Nix worker-protocol over gRPC.6230worker2 # [ 168.731806] systemd[1]: Reloaded D-Bus System Message Bus.6231worker2 # [ 168.739283] systemd[1]: Reached target Local File Systems.6232worker2 # [ 168.743247] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore6233worker2 # [ 168.756518] systemd[1]: Starting Create SUID/SGID Wrappers...6234worker2 # [ 168.757440] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.6235worker2 # [ 168.758592] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc676236worker2 # [ 168.769841] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore6237worker2 # [ 168.771419] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os6238worker2 # [ 168.776677] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os6239worker2 # [ 168.777917] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os6240worker2 # [ 168.784244] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki6241worker2 # [ 168.786040] systemd[1]: Reached target Remote File Systems.6242worker2 # [ 168.831523] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:33Z level=info event=draining6243worker2 # [ 169.113782] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.6244worker2 # [ 169.114913] systemd[1]: Finished Create SUID/SGID Wrappers.6245worker2 # [ 169.117414] systemd[1]: Starting linger-users.service...6246worker2 # [ 169.161965] systemd[1]: linger-users.service: Deactivated successfully.6247worker2 # [ 169.163022] systemd[1]: Finished linger-users.service.6248worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service6249worker2 # [ 169.419362] nixos[1779]: finished switching to system configuration /nix/store/di3jjhf5scbnchwmjr29pa02igl35lm5-nixos-system-worker2-test6250worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 6.98 seconds)6251worker2: must succeed: pgrep -f 'read -t [9]0 x'6252worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds)6253client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain >&26254client # don't know how to build these paths:6255client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv6256worker1 # [ 169.656938] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:34Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:379066257worker1 # [ 169.665744] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:379066258worker1 # [ 169.693686] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:34Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=06259worker1 # [ 169.700710] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:34Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.3:50051 clients=16260worker1 # [ 169.746164] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379066261worker1 # [ 169.766961] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:379066262client # copying 1 paths to 'lb:50051'...6263worker1 # [ 169.785909] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:379066264client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'...6265worker1 # [ 169.812574] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6266worker1 # [ 169.981139] nix-daemon[848]: accepted connection from pid 1834, user nix-grpc-daemon (trusted)6267worker1 # [ 170.010456] nix-daemon[848]: reaped child process 1837, status = succeeded6268worker1 # [ 170.111357] nix-daemon[848]: accepted connection from pid 1839, user nix-grpc-daemon (trusted)6269worker1 # [ 170.133333] nix-daemon[848]: reaped child process 1842, status = succeeded6270lb # [ 170.123834] niks3-server[1086]: 2026/09/22 14:53:34 INFO Received uploads request method=POST path=/api/pending_closures6271worker1 # [ 170.153761] nix-grpc-daemon[1754]: time=2026-09-22T14:53:34.740Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6272worker1 # [ 170.155371] nix-grpc-daemon[1754]: time=2026-09-22T14:53:34.741Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)"6273lb # [ 170.165994] niks3-server[1086]: 2026/09/22 14:53:34 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst6274worker1 # [ 170.192528] nix-grpc-daemon[1754]: time=2026-09-22T14:53:34.780Z level=INFO msg="Uploading 1 narinfos"6275lb # [ 170.181741] niks3-server[1086]: 2026/09/22 14:53:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6276lb # [ 170.189783] niks3-server[1086]: 2026/09/22 14:53:34 INFO Signed narinfos id=55 count=16277lb # [ 170.198125] niks3-server[1086]: 2026/09/22 14:53:34 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls6278worker1 # [ 170.218363] nix-grpc-daemon[1754]: time=2026-09-22T14:53:34.806Z level=INFO msg="Upload complete. (387ms)"6279lb # [ 170.204649] niks3-server[1086]: 2026/09/22 14:53:34 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6280lb # [ 170.208179] niks3-server[1086]: 2026/09/22 14:53:34 INFO Completed upload id=556281lb # [ 170.211114] niks3-server[1086]: 2026/09/22 14:53:34 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo6282worker1 # [ 170.228376] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37906 duration_s=0 paths=1 nar_bytes_in=5286283worker1 # [ 170.241778] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379066284worker1 # [ 170.246285] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6285worker1 # [ 170.251175] nix-daemon[848]: reaped child process 1832, status = succeeded6286worker1 # [ 170.262230] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6287client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051...6288client # farm-a> node-a: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv6289client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds6290client # farm-a> LOG-farm-a-during-drain6291worker1 # [ 171.499461] nix-daemon[848]: reaped child process 1846, status = succeeded6292worker1 # [ 171.612320] nix-daemon[848]: accepted connection from pid 1862, user nix-grpc-daemon (trusted)6293worker1 # [ 171.634194] nix-daemon[848]: reaped child process 1865, status = succeeded6294lb # [ 171.626520] niks3-server[1086]: 2026/09/22 14:53:36 INFO Received uploads request method=POST path=/api/pending_closures6295worker1 # [ 171.660573] nix-grpc-daemon[1754]: time=2026-09-22T14:53:36.246Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6296worker1 # [ 171.662618] nix-grpc-daemon[1754]: time=2026-09-22T14:53:36.246Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)"6297lb # [ 171.684122] niks3-server[1086]: 2026/09/22 14:53:36 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst6298worker1 # [ 171.707283] nix-grpc-daemon[1754]: time=2026-09-22T14:53:36.295Z level=INFO msg="Uploading 1 narinfos"6299lb # [ 171.694149] niks3-server[1086]: 2026/09/22 14:53:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6300lb # [ 171.704552] niks3-server[1086]: 2026/09/22 14:53:36 INFO Signed narinfos id=56 count=16301lb # [ 171.706479] niks3-server[1086]: 2026/09/22 14:53:36 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv6302lb # [ 171.719153] niks3-server[1086]: 2026/09/22 14:53:36 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6303lb # [ 171.728391] niks3-server[1086]: 2026/09/22 14:53:36 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls6304lb # [ 171.734201] niks3-server[1086]: 2026/09/22 14:53:36 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo6305lb # [ 171.747929] niks3-server[1086]: 2026/09/22 14:53:36 INFO Completed upload id=566306worker1 # [ 171.762590] nix-grpc-daemon[1754]: time=2026-09-22T14:53:36.350Z level=INFO msg="Upload complete. (287ms)"6307worker1 # [ 171.781759] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37906 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=16308worker1 # [ 171.800337] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:36Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=06309worker1 # [ 171.804773] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:36Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.3:50051 clients=16310worker1 # [ 171.808987] nix-daemon[848]: reaped child process 1844, status = succeeded6311worker1 # [ 171.827505] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379066312worker1 # [ 171.844634] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:379066313worker1 # [ 171.860911] nix-grpc-daemon[1754]: time=2026-09-22T14:53:36.448Z level=INFO msg="All 1 paths already cached"6314client # copying 1 paths to 'lb:50051'...6315worker1 # [ 171.872780] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:379066316client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'...6317worker1 # [ 171.896234] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6318worker1 # [ 172.053321] nix-daemon[848]: accepted connection from pid 1871, user nix-grpc-daemon (trusted)6319worker1 # [ 172.075937] nix-daemon[848]: reaped child process 1874, status = succeeded6320worker1 # [ 172.184848] nix-daemon[848]: accepted connection from pid 1876, user nix-grpc-daemon (trusted)6321worker1 # [ 172.206367] nix-daemon[848]: reaped child process 1879, status = succeeded6322lb # [ 172.190306] niks3-server[1086]: 2026/09/22 14:53:36 INFO Received uploads request method=POST path=/api/pending_closures6323worker1 # [ 172.217979] nix-grpc-daemon[1754]: time=2026-09-22T14:53:36.805Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6324worker1 # [ 172.219514] nix-grpc-daemon[1754]: time=2026-09-22T14:53:36.805Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)"6325lb # [ 172.234937] niks3-server[1086]: 2026/09/22 14:53:36 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst6326worker1 # [ 172.258920] nix-grpc-daemon[1754]: time=2026-09-22T14:53:36.846Z level=INFO msg="Uploading 1 narinfos"6327lb # [ 172.248741] niks3-server[1086]: 2026/09/22 14:53:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6328lb # [ 172.256831] niks3-server[1086]: 2026/09/22 14:53:36 INFO Signed narinfos id=57 count=16329lb # [ 172.258975] niks3-server[1086]: 2026/09/22 14:53:36 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls6330lb # [ 172.270784] niks3-server[1086]: 2026/09/22 14:53:36 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6331worker1 # [ 172.289053] nix-grpc-daemon[1754]: time=2026-09-22T14:53:36.876Z level=INFO msg="Upload complete. (375ms)"6332lb # [ 172.275424] niks3-server[1086]: 2026/09/22 14:53:36 INFO Completed upload id=576333lb # [ 172.279157] niks3-server[1086]: 2026/09/22 14:53:36 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo6334worker1 # [ 172.296797] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37906 duration_s=0 paths=1 nar_bytes_in=6406335worker1 # [ 172.308433] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379066336worker1 # [ 172.320806] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6337worker1 # [ 172.326400] nix-daemon[848]: reaped child process 1869, status = succeeded6338client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051...6339client # farm-b> node-a: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv6340worker1 # [ 172.338024] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6341client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds6342client # farm-b> LOG-farm-b-during-drain6343worker1 # [ 173.808514] nix-daemon[848]: reaped child process 1883, status = succeeded6344worker1 # [ 173.938720] nix-daemon[848]: accepted connection from pid 1899, user nix-grpc-daemon (trusted)6345worker1 # [ 173.959948] nix-daemon[848]: reaped child process 1902, status = succeeded6346lb # [ 173.945584] niks3-server[1086]: 2026/09/22 14:53:38 INFO Received uploads request method=POST path=/api/pending_closures6347worker1 # [ 173.972549] nix-grpc-daemon[1754]: time=2026-09-22T14:53:38.559Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6348worker1 # [ 173.974650] nix-grpc-daemon[1754]: time=2026-09-22T14:53:38.559Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)"6349lb # [ 173.978543] niks3-server[1086]: 2026/09/22 14:53:38 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv6350lb # [ 174.000622] niks3-server[1086]: 2026/09/22 14:53:38 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst6351lb # [ 174.015888] niks3-server[1086]: 2026/09/22 14:53:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6352worker1 # [ 174.030779] nix-grpc-daemon[1754]: time=2026-09-22T14:53:38.618Z level=INFO msg="Uploading 1 narinfos"6353lb # [ 174.024532] niks3-server[1086]: 2026/09/22 14:53:38 INFO Signed narinfos id=58 count=16354lb # [ 174.026746] niks3-server[1086]: 2026/09/22 14:53:38 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls6355lb # [ 174.038549] niks3-server[1086]: 2026/09/22 14:53:38 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6356lb # [ 174.045643] niks3-server[1086]: 2026/09/22 14:53:38 INFO Completed upload id=586357worker1 # [ 174.058906] nix-grpc-daemon[1754]: time=2026-09-22T14:53:38.645Z level=INFO msg="Upload complete. (305ms)"6358lb # [ 174.050531] niks3-server[1086]: 2026/09/22 14:53:38 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo6359worker1 # [ 174.074305] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37906 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=16360worker1 # [ 174.094293] nix-daemon[848]: reaped child process 1881, status = succeeded6361worker1 # [ 174.100307] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:38Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=06362worker1 # [ 174.106006] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:38Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.3:50051 clients=16363worker1 # [ 174.151002] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379066364worker1 # [ 174.164004] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:379066365worker1 # [ 174.175952] nix-grpc-daemon[1754]: time=2026-09-22T14:53:38.763Z level=INFO msg="All 2 paths already cached"6366client # copying 1 paths to 'lb:50051'...6367client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'...6368worker1 # [ 174.184695] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:379066369worker1 # [ 174.194458] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6370worker1 # [ 174.338004] nix-daemon[848]: accepted connection from pid 1908, user nix-grpc-daemon (trusted)6371worker1 # [ 174.365170] nix-daemon[848]: reaped child process 1911, status = succeeded6372worker1 # [ 174.465718] nix-daemon[848]: accepted connection from pid 1913, user nix-grpc-daemon (trusted)6373worker1 # [ 174.485470] nix-daemon[848]: reaped child process 1916, status = succeeded6374lb # [ 174.475664] niks3-server[1086]: 2026/09/22 14:53:39 INFO Received uploads request method=POST path=/api/pending_closures6375worker1 # [ 174.507240] nix-grpc-daemon[1754]: time=2026-09-22T14:53:39.095Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6376worker1 # [ 174.509254] nix-grpc-daemon[1754]: time=2026-09-22T14:53:39.095Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)"6377lb # [ 174.516036] niks3-server[1086]: 2026/09/22 14:53:39 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst6378worker1 # [ 174.546558] nix-grpc-daemon[1754]: time=2026-09-22T14:53:39.134Z level=INFO msg="Uploading 1 narinfos"6379lb # [ 174.532548] niks3-server[1086]: 2026/09/22 14:53:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6380lb # [ 174.546659] niks3-server[1086]: 2026/09/22 14:53:39 INFO Signed narinfos id=59 count=16381lb # [ 174.554872] niks3-server[1086]: 2026/09/22 14:53:39 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls6382worker1 # [ 174.584433] nix-grpc-daemon[1754]: time=2026-09-22T14:53:39.172Z level=INFO msg="Upload complete. (377ms)"6383lb # [ 174.570402] niks3-server[1086]: 2026/09/22 14:53:39 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6384lb # [ 174.577685] niks3-server[1086]: 2026/09/22 14:53:39 INFO Completed upload id=596385worker1 # [ 174.592286] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37906 duration_s=0 paths=1 nar_bytes_in=7686386lb # [ 174.580857] niks3-server[1086]: 2026/09/22 14:53:39 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo6387worker1 # [ 174.604854] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379066388worker1 # [ 174.619444] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6389worker1 # [ 174.625699] nix-daemon[848]: reaped child process 1906, status = succeeded6390client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051...6391client # farm-top> node-a: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv6392worker1 # [ 174.643026] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6393client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds6394client # farm-top> LOG-farm-top-during-drain6395worker1 # [ 175.289681] nix-daemon[848]: reaped child process 1920, status = succeeded6396worker1 # [ 175.390030] nix-daemon[848]: accepted connection from pid 1936, user nix-grpc-daemon (trusted)6397worker1 # [ 175.414081] nix-daemon[848]: reaped child process 1939, status = succeeded6398lb # [ 175.399618] niks3-server[1086]: 2026/09/22 14:53:39 INFO Received uploads request method=POST path=/api/pending_closures6399worker1 # [ 175.426466] nix-grpc-daemon[1754]: time=2026-09-22T14:53:40.012Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6400worker1 # [ 175.427973] nix-grpc-daemon[1754]: time=2026-09-22T14:53:40.012Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)"6401lb # [ 175.440307] niks3-server[1086]: 2026/09/22 14:53:40 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst6402lb # [ 175.452886] niks3-server[1086]: 2026/09/22 14:53:40 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv6403worker1 # [ 175.479644] nix-grpc-daemon[1754]: time=2026-09-22T14:53:40.067Z level=INFO msg="Uploading 1 narinfos"6404lb # [ 175.465902] niks3-server[1086]: 2026/09/22 14:53:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6405lb # [ 175.476298] niks3-server[1086]: 2026/09/22 14:53:40 INFO Signed narinfos id=60 count=16406lb # [ 175.482181] niks3-server[1086]: 2026/09/22 14:53:40 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls6407lb # [ 175.494005] niks3-server[1086]: 2026/09/22 14:53:40 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6408lb # [ 175.502195] niks3-server[1086]: 2026/09/22 14:53:40 INFO Completed upload id=606409worker1 # [ 175.514987] nix-grpc-daemon[1754]: time=2026-09-22T14:53:40.102Z level=INFO msg="Upload complete. (259ms)"6410lb # [ 175.504546] niks3-server[1086]: 2026/09/22 14:53:40 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo6411worker1 # [ 175.526681] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37906 duration_s=0 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=16412worker1 # [ 175.545264] nix-daemon[848]: reaped child process 1918, status = succeeded6413client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain >&2, in 6.15 seconds)6414client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain outPath6415client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain outPath, in 0.19 seconds)6416worker2: must succeed: pkill -f 'read -t [9]0 x'6417worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)6418client: waiting for success: ! systemctl is-active sw6419worker2 # [ 176.156114] nix-daemon[838]: reaped child process 1747, status = succeeded6420worker2 # [ 176.228540] nix-daemon[838]: accepted connection from pid 1919, user nix-grpc-daemon (trusted)6421worker2 # [ 176.251869] nix-daemon[838]: reaped child process 1922, status = succeeded6422lb # [ 176.175998] niks3-server[1086]: 2026/09/22 14:53:40 INFO Received uploads request method=POST path=/api/pending_closures6423worker2 # [ 176.265490] nix-grpc-daemon[1687]: time=2026-09-22T14:53:40.832Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6424worker2 # [ 176.267045] nix-grpc-daemon[1687]: time=2026-09-22T14:53:40.832Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)"6425lb # [ 176.212517] niks3-server[1086]: 2026/09/22 14:53:40 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6426lb # [ 176.231306] niks3-server[1086]: 2026/09/22 14:53:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6427worker2 # [ 176.318051] nix-grpc-daemon[1687]: time=2026-09-22T14:53:40.885Z level=INFO msg="Uploading 1 narinfos"6428lb # [ 176.250183] niks3-server[1086]: 2026/09/22 14:53:40 INFO Signed narinfos id=61 count=16429lb # [ 176.257636] niks3-server[1086]: 2026/09/22 14:53:40 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv6430lb # [ 176.266771] niks3-server[1086]: 2026/09/22 14:53:40 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls6431lb # [ 176.277264] niks3-server[1086]: 2026/09/22 14:53:40 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6432worker2 # [ 176.362647] nix-grpc-daemon[1687]: time=2026-09-22T14:53:40.930Z level=INFO msg="Upload complete. (307ms)"6433lb # [ 176.283944] niks3-server[1086]: 2026/09/22 14:53:40 INFO Completed upload id=616434lb # [ 176.292465] niks3-server[1086]: 2026/09/22 14:53:40 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo6435worker2 # [ 176.372879] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60382 duration_s=15 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=16436worker2 # [ 176.383588] nix-daemon[838]: reaped child process 1745, status = succeeded6437client # [ 176.331986] systemd[1]: sw.service: Deactivated successfully.6438client # [ 176.336523] systemd[1]: sw.service: Consumed 190ms CPU time over 16.542s wall clock time, 41.2M memory peak, 7.2K incoming IP traffic, 8.4K outgoing IP traffic.6439worker2 # [ 176.833580] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:41Z level=info event=signal_exit6440client: (finished: waiting for success: ! systemctl is-active sw, in 1.10 seconds)6441client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6442client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.05 seconds)6443worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6444worker2 # [ 177.119073] systemd[1]: Starting scheduler-token.service...6445worker2 # [ 177.184383] systemd[1]: scheduler-token.service: Deactivated successfully.6446worker2 # [ 177.187933] systemd[1]: Finished scheduler-token.service.6447worker2 # [ 177.189411] systemd[1]: scheduler-token.service: Consumed 39ms CPU time over 68ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.6448worker1 # [ 178.775419] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:43Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:560226449worker2 # [ 178.847950] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:43Z level=info event=scheduler_restarting6450worker2 # [ 178.865561] nix-grpc-daemon[1525]: ts=2026-09-22T14:53:43Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6451worker2 # [ 178.894522] nix-daemon[838]: reaped child process 1653, status = succeeded6452worker2 # [ 178.917188] nix-grpc-daemon[1525]: E0000 00:00:1790088823.484534 1570 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true6453worker2 # [ 178.923920] nix-grpc-daemon[1525]: E0000 00:00:1790088823.484801 1570 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true6454worker1 # [ 178.780844] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:43Z level=info event=worker_gone addr=192.168.1.4:500516455lb # [ 179.699247] envoy[905]: conn peer=[2001:db8:1::1]:47996 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9660 tx=4400 ms=58906456lb # [ 179.704549] envoy[905]: conn peer=[2001:db8:1::1]:59442 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2978 tx=1542 ms=163276457lb # [ 179.709476] envoy[905]: conn peer=[2001:db8:1::4]:49122 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=10665 tx=839 ms=489756458worker2 # [ 180.232931] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6459worker2 # [ 180.239431] systemd[1]: nix-grpc-daemon.service: Consumed 1.013s CPU time over 50.566s wall clock time, 35M memory peak, 23.9K incoming IP traffic, 41.7K outgoing IP traffic.6460worker2 # [ 180.262422] systemd[1]: Starting Nix worker-protocol over gRPC...6461worker2 # [ 180.409773] nix-grpc-daemon[1939]: ts=2026-09-22T14:53:44Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"6462worker2 # [ 180.412157] nix-grpc-daemon[1939]: ts=2026-09-22T14:53:44Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6463worker2 # [ 180.415980] nix-grpc-daemon[1939]: ts=2026-09-22T14:53:44Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16464worker2 # [ 180.422624] nix-grpc-daemon[1939]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6465worker2 # [ 180.444210] nix-grpc-daemon[1939]: E0000 00:00:1790088824.988144 1939 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6466worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 3.44 seconds)6467lb: waiting until exactly no endpoints of aarch64-linux are unhealthy6468lb: must succeed: curl -sf localhost:9901/clusters6469worker2 # [ 180.446557] nix-grpc-daemon[1939]: E0000 00:00:1790088824.990171 1939 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6470worker2 # [ 180.472828] nix-grpc-daemon[1939]: ts=2026-09-22T14:53:44Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6471worker2 # [ 180.474617] nix-grpc-daemon[1939]: E0000 00:00:1790088825.000135 1979 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6472worker2 # [ 180.477050] nix-grpc-daemon[1939]: E0000 00:00:1790088825.022169 1979 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6473worker2 # [ 180.479291] nix-grpc-daemon[1939]: E0000 00:00:1790088825.022384 1979 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates.6474worker2 # [ 180.484704] nix-grpc-daemon[1939]: E0000 00:00:1790088825.039096 1979 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates.6475worker2 # [ 180.489324] systemd[1]: Started Nix worker-protocol over gRPC.6476worker2 # [ 180.490313] nix-grpc-daemon[1939]: ts=2026-09-22T14:53:45Z level=info event=scheduler_connected addr=lb:500516477worker1 # [ 180.428798] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:45Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:560226478worker1 # [ 180.429237] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:45Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=06479lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)6480lb: must succeed: curl -sf localhost:9901/clusters6481lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6482lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.15 seconds)6483lb: must succeed: curl -sf localhost:9901/clusters6484lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6485worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6486worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)6487(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 21.93 seconds)6488subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6489client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16490worker2 # [ 181.970101] nix-grpc-daemon[1939]: ts=2026-09-22T14:53:46Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:564126491worker2 # [ 181.984764] nix-daemon[838]: accepted connection from pid 1939, user nix-grpc-daemon (trusted)6492worker1 # [ 181.944783] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:379066493worker1 # [ 181.993000] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:46Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=06494worker1 # [ 181.998266] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:46Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=16495worker1 # [ 182.002549] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:46Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=06496worker1 # [ 182.006109] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:46Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=06497worker1 # [ 182.039065] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379066498worker1 # [ 182.055368] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:379066499worker1 # [ 182.072131] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:379066500worker1 # [ 182.087986] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6501worker1 # [ 182.259038] nix-daemon[848]: accepted connection from pid 1948, user nix-grpc-daemon (trusted)6502worker1 # [ 182.282021] nix-daemon[848]: reaped child process 1951, status = succeeded6503worker1 # [ 182.395552] nix-daemon[848]: accepted connection from pid 1953, user nix-grpc-daemon (trusted)6504worker1 # [ 182.417356] nix-daemon[848]: reaped child process 1956, status = succeeded6505lb # [ 182.410753] niks3-server[1086]: 2026/09/22 14:53:47 INFO Received uploads request method=POST path=/api/pending_closures6506worker1 # [ 182.435112] nix-grpc-daemon[1754]: time=2026-09-22T14:53:47.022Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6507worker1 # [ 182.437119] nix-grpc-daemon[1754]: time=2026-09-22T14:53:47.022Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)"6508lb # [ 182.437474] niks3-server[1086]: 2026/09/22 14:53:47 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst6509lb # [ 182.445842] niks3-server[1086]: 2026/09/22 14:53:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6510worker1 # [ 182.463036] nix-grpc-daemon[1754]: time=2026-09-22T14:53:47.050Z level=INFO msg="Uploading 1 narinfos"6511lb # [ 182.452093] niks3-server[1086]: 2026/09/22 14:53:47 INFO Signed narinfos id=62 count=16512lb # [ 182.456271] niks3-server[1086]: 2026/09/22 14:53:47 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls6513lb # [ 182.462822] niks3-server[1086]: 2026/09/22 14:53:47 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6514lb # [ 182.470262] niks3-server[1086]: 2026/09/22 14:53:47 INFO Completed upload id=626515worker1 # [ 182.484654] nix-grpc-daemon[1754]: time=2026-09-22T14:53:47.072Z level=INFO msg="Upload complete. (378ms)"6516lb # [ 182.475889] niks3-server[1086]: 2026/09/22 14:53:47 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo6517worker1 # [ 182.492166] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37906 duration_s=0 paths=1 nar_bytes_in=5126518worker1 # [ 182.507886] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379066519worker1 # [ 182.514669] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6520worker1 # [ 182.520164] nix-daemon[848]: reaped child process 1946, status = succeeded6521worker1 # [ 182.532552] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6522worker1 # [ 183.362986] nix-daemon[848]: reaped child process 1960, status = succeeded6523worker1 # [ 183.467168] nix-daemon[848]: accepted connection from pid 1976, user nix-grpc-daemon (trusted)6524worker1 # [ 183.491855] nix-daemon[848]: reaped child process 1979, status = succeeded6525lb # [ 183.486412] niks3-server[1086]: 2026/09/22 14:53:48 INFO Received uploads request method=POST path=/api/pending_closures6526worker1 # [ 183.516091] nix-grpc-daemon[1754]: time=2026-09-22T14:53:48.099Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6527worker1 # [ 183.517890] nix-grpc-daemon[1754]: time=2026-09-22T14:53:48.100Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)"6528lb # [ 183.533417] niks3-server[1086]: 2026/09/22 14:53:48 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv6529lb # [ 183.545635] niks3-server[1086]: 2026/09/22 14:53:48 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6530lb # [ 183.558432] niks3-server[1086]: 2026/09/22 14:53:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6531worker1 # [ 183.580121] nix-grpc-daemon[1754]: time=2026-09-22T14:53:48.167Z level=INFO msg="Uploading 1 narinfos"6532lb # [ 183.569805] niks3-server[1086]: 2026/09/22 14:53:48 INFO Signed narinfos id=63 count=16533lb # [ 183.576601] niks3-server[1086]: 2026/09/22 14:53:48 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls6534lb # [ 183.588745] niks3-server[1086]: 2026/09/22 14:53:48 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6535lb # [ 183.596861] niks3-server[1086]: 2026/09/22 14:53:48 INFO Completed upload id=636536lb # [ 183.599993] niks3-server[1086]: 2026/09/22 14:53:48 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo6537worker1 # [ 183.608477] nix-grpc-daemon[1754]: time=2026-09-22T14:53:48.196Z level=INFO msg="Upload complete. (263ms)"6538worker1 # [ 183.630251] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37906 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=7 outputs=16539worker1 # [ 183.648397] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:48Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=16540worker1 # [ 183.652453] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379066541worker1 # [ 183.655642] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:48Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=06542worker1 # [ 183.660857] nix-daemon[848]: reaped child process 1958, status = succeeded6543worker1 # [ 183.664656] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:379066544worker1 # [ 183.677038] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:379066545worker1 # [ 183.688874] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6546worker1 # [ 183.840106] nix-daemon[848]: accepted connection from pid 1985, user nix-grpc-daemon (trusted)6547worker1 # [ 183.862836] nix-daemon[848]: reaped child process 1988, status = succeeded6548worker1 # [ 183.975062] nix-daemon[848]: accepted connection from pid 1990, user nix-grpc-daemon (trusted)6549worker1 # [ 183.998926] nix-daemon[848]: reaped child process 1993, status = succeeded6550lb # [ 183.982807] niks3-server[1086]: 2026/09/22 14:53:48 INFO Received uploads request method=POST path=/api/pending_closures6551worker1 # [ 184.008117] nix-grpc-daemon[1754]: time=2026-09-22T14:53:48.595Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6552worker1 # [ 184.009673] nix-grpc-daemon[1754]: time=2026-09-22T14:53:48.595Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)"6553lb # [ 184.014025] niks3-server[1086]: 2026/09/22 14:53:48 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst6554lb # [ 184.030960] niks3-server[1086]: 2026/09/22 14:53:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6555worker1 # [ 184.051999] nix-grpc-daemon[1754]: time=2026-09-22T14:53:48.639Z level=INFO msg="Uploading 1 narinfos"6556lb # [ 184.044610] niks3-server[1086]: 2026/09/22 14:53:48 INFO Signed narinfos id=64 count=16557lb # [ 184.052617] niks3-server[1086]: 2026/09/22 14:53:48 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls6558lb # [ 184.065683] niks3-server[1086]: 2026/09/22 14:53:48 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6559worker1 # [ 184.084857] nix-grpc-daemon[1754]: time=2026-09-22T14:53:48.672Z level=INFO msg="Upload complete. (382ms)"6560lb # [ 184.074111] niks3-server[1086]: 2026/09/22 14:53:48 INFO Completed upload id=646561lb # [ 184.077227] niks3-server[1086]: 2026/09/22 14:53:48 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo6562worker1 # [ 184.092179] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37906 duration_s=0 paths=1 nar_bytes_in=5126563worker1 # [ 184.104909] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379066564worker1 # [ 184.115398] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6565worker1 # [ 184.121010] nix-daemon[848]: reaped child process 1983, status = succeeded6566worker1 # [ 184.136388] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6567worker1 # [ 185.574728] nix-daemon[848]: reaped child process 1997, status = succeeded6568worker1 # [ 185.684255] nix-daemon[848]: accepted connection from pid 2013, user nix-grpc-daemon (trusted)6569worker1 # [ 185.708550] nix-daemon[848]: reaped child process 2016, status = succeeded6570lb # [ 185.693985] niks3-server[1086]: 2026/09/22 14:53:50 INFO Received uploads request method=POST path=/api/pending_closures6571worker1 # [ 185.718753] nix-grpc-daemon[1754]: time=2026-09-22T14:53:50.303Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6572worker1 # [ 185.722408] nix-grpc-daemon[1754]: time=2026-09-22T14:53:50.303Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)"6573lb # [ 185.735329] niks3-server[1086]: 2026/09/22 14:53:50 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv6574lb # [ 185.748698] niks3-server[1086]: 2026/09/22 14:53:50 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6575worker1 # [ 185.775357] nix-grpc-daemon[1754]: time=2026-09-22T14:53:50.363Z level=INFO msg="Uploading 1 narinfos"6576lb # [ 185.764660] niks3-server[1086]: 2026/09/22 14:53:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6577lb # [ 185.773277] niks3-server[1086]: 2026/09/22 14:53:50 INFO Signed narinfos id=65 count=16578lb # [ 185.780164] niks3-server[1086]: 2026/09/22 14:53:50 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls6579lb # [ 185.791120] niks3-server[1086]: 2026/09/22 14:53:50 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6580worker1 # [ 185.811828] nix-grpc-daemon[1754]: time=2026-09-22T14:53:50.399Z level=INFO msg="Upload complete. (264ms)"6581lb # [ 185.800122] niks3-server[1086]: 2026/09/22 14:53:50 INFO Completed upload id=656582lb # [ 185.802576] niks3-server[1086]: 2026/09/22 14:53:50 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo6583worker1 # [ 185.829587] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37906 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=8 outputs=16584worker1 # [ 185.846954] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:50Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=16585worker1 # [ 185.857492] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379066586worker1 # [ 185.862519] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:50Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=06587worker1 # [ 185.868197] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:379066588worker1 # [ 185.873070] nix-daemon[848]: reaped child process 1995, status = succeeded6589worker1 # [ 185.875204] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:379066590worker1 # [ 185.887066] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6591worker1 # [ 186.023373] nix-daemon[848]: accepted connection from pid 2022, user nix-grpc-daemon (trusted)6592worker1 # [ 186.049960] nix-daemon[848]: reaped child process 2025, status = succeeded6593worker1 # [ 186.154101] nix-daemon[848]: accepted connection from pid 2027, user nix-grpc-daemon (trusted)6594worker1 # [ 186.177211] nix-daemon[848]: reaped child process 2030, status = succeeded6595lb # [ 186.160575] niks3-server[1086]: 2026/09/22 14:53:50 INFO Received uploads request method=POST path=/api/pending_closures6596worker1 # [ 186.184655] nix-grpc-daemon[1754]: time=2026-09-22T14:53:50.772Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6597worker1 # [ 186.186218] nix-grpc-daemon[1754]: time=2026-09-22T14:53:50.772Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)"6598lb # [ 186.189717] niks3-server[1086]: 2026/09/22 14:53:50 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst6599lb # [ 186.205824] niks3-server[1086]: 2026/09/22 14:53:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6600worker1 # [ 186.227005] nix-grpc-daemon[1754]: time=2026-09-22T14:53:50.814Z level=INFO msg="Uploading 1 narinfos"6601lb # [ 186.220127] niks3-server[1086]: 2026/09/22 14:53:50 INFO Signed narinfos id=66 count=16602lb # [ 186.227276] niks3-server[1086]: 2026/09/22 14:53:50 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls6603worker1 # [ 186.252871] nix-grpc-daemon[1754]: time=2026-09-22T14:53:50.840Z level=INFO msg="Upload complete. (356ms)"6604lb # [ 186.239020] niks3-server[1086]: 2026/09/22 14:53:50 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6605lb # [ 186.248081] niks3-server[1086]: 2026/09/22 14:53:50 INFO Completed upload id=666606worker1 # [ 186.260307] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37906 duration_s=0 paths=1 nar_bytes_in=5126607lb # [ 186.251460] niks3-server[1086]: 2026/09/22 14:53:50 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo6608worker1 # [ 186.274158] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379066609worker1 # [ 186.281444] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6610worker1 # [ 186.286433] nix-daemon[848]: reaped child process 2020, status = succeeded6611worker1 # [ 186.297417] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6612worker1 # [ 187.580722] nix-daemon[848]: reaped child process 2034, status = succeeded6613worker1 # [ 187.674694] nix-daemon[848]: accepted connection from pid 2050, user nix-grpc-daemon (trusted)6614worker1 # [ 187.695735] nix-daemon[848]: reaped child process 2053, status = succeeded6615lb # [ 187.689243] niks3-server[1086]: 2026/09/22 14:53:52 INFO Received uploads request method=POST path=/api/pending_closures6616worker1 # [ 187.715164] nix-grpc-daemon[1754]: time=2026-09-22T14:53:52.301Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6617worker1 # [ 187.716850] nix-grpc-daemon[1754]: time=2026-09-22T14:53:52.301Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)"6618lb # [ 187.726683] niks3-server[1086]: 2026/09/22 14:53:52 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6619worker1 # [ 187.759943] nix-grpc-daemon[1754]: time=2026-09-22T14:53:52.347Z level=INFO msg="Uploading 1 narinfos"6620lb # [ 187.745412] niks3-server[1086]: 2026/09/22 14:53:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6621lb # [ 187.758228] niks3-server[1086]: 2026/09/22 14:53:52 INFO Signed narinfos id=67 count=16622lb # [ 187.765042] niks3-server[1086]: 2026/09/22 14:53:52 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv6623lb # [ 187.774452] niks3-server[1086]: 2026/09/22 14:53:52 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls6624lb # [ 187.782936] niks3-server[1086]: 2026/09/22 14:53:52 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6625lb # [ 187.789506] niks3-server[1086]: 2026/09/22 14:53:52 INFO Completed upload id=676626worker1 # [ 187.803113] nix-grpc-daemon[1754]: time=2026-09-22T14:53:52.391Z level=INFO msg="Upload complete. (292ms)"6627lb # [ 187.792498] niks3-server[1086]: 2026/09/22 14:53:52 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo6628worker1 # [ 187.822307] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37906 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=9 outputs=16629worker1 # [ 187.845030] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:52Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=16630worker1 # [ 187.849475] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379066631worker1 # [ 187.854839] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:52Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=06632worker1 # [ 187.860086] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:379066633worker1 # [ 187.863356] nix-daemon[848]: reaped child process 2032, status = succeeded6634worker1 # [ 187.867205] nix-grpc-daemon[1754]: time=2026-09-22T14:53:52.454Z level=INFO msg="All 1 paths already cached"6635worker1 # [ 187.871647] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:379066636worker1 # [ 187.886571] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6637worker1 # [ 188.022606] nix-daemon[848]: accepted connection from pid 2059, user nix-grpc-daemon (trusted)6638worker1 # [ 188.049511] nix-daemon[848]: reaped child process 2062, status = succeeded6639worker1 # [ 188.147914] nix-daemon[848]: accepted connection from pid 2064, user nix-grpc-daemon (trusted)6640worker1 # [ 188.169941] nix-daemon[848]: reaped child process 2067, status = succeeded6641lb # [ 188.159075] niks3-server[1086]: 2026/09/22 14:53:52 INFO Received uploads request method=POST path=/api/pending_closures6642worker1 # [ 188.187786] nix-grpc-daemon[1754]: time=2026-09-22T14:53:52.775Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6643worker1 # [ 188.189486] nix-grpc-daemon[1754]: time=2026-09-22T14:53:52.775Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)"6644lb # [ 188.195399] niks3-server[1086]: 2026/09/22 14:53:52 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst6645worker1 # [ 188.232621] nix-grpc-daemon[1754]: time=2026-09-22T14:53:52.820Z level=INFO msg="Uploading 1 narinfos"6646lb # [ 188.211568] niks3-server[1086]: 2026/09/22 14:53:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6647lb # [ 188.224538] niks3-server[1086]: 2026/09/22 14:53:52 INFO Signed narinfos id=68 count=16648lb # [ 188.227140] niks3-server[1086]: 2026/09/22 14:53:52 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls6649lb # [ 188.241469] niks3-server[1086]: 2026/09/22 14:53:52 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6650worker1 # [ 188.263097] nix-grpc-daemon[1754]: time=2026-09-22T14:53:52.850Z level=INFO msg="Upload complete. (364ms)"6651lb # [ 188.251278] niks3-server[1086]: 2026/09/22 14:53:52 INFO Completed upload id=686652lb # [ 188.254415] niks3-server[1086]: 2026/09/22 14:53:52 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo6653worker1 # [ 188.276376] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37906 duration_s=0 paths=1 nar_bytes_in=6246654worker1 # [ 188.292535] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379066655worker1 # [ 188.302574] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6656worker1 # [ 188.308810] nix-daemon[848]: reaped child process 2057, status = succeeded6657worker1 # [ 188.324090] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6658worker1 # [ 189.162170] nix-daemon[848]: reaped child process 2071, status = succeeded6659worker1 # [ 189.272672] nix-daemon[848]: accepted connection from pid 2087, user nix-grpc-daemon (trusted)6660worker1 # [ 189.295279] nix-daemon[848]: reaped child process 2090, status = succeeded6661lb # [ 189.289244] niks3-server[1086]: 2026/09/22 14:53:53 INFO Received uploads request method=POST path=/api/pending_closures6662worker1 # [ 189.313759] nix-grpc-daemon[1754]: time=2026-09-22T14:53:53.901Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6663worker1 # [ 189.318713] nix-grpc-daemon[1754]: time=2026-09-22T14:53:53.901Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)"6664lb # [ 189.333642] niks3-server[1086]: 2026/09/22 14:53:53 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst6665lb # [ 189.346923] niks3-server[1086]: 2026/09/22 14:53:53 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv6666worker1 # [ 189.371763] nix-grpc-daemon[1754]: time=2026-09-22T14:53:53.959Z level=INFO msg="Uploading 1 narinfos"6667lb # [ 189.360292] niks3-server[1086]: 2026/09/22 14:53:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6668lb # [ 189.367358] niks3-server[1086]: 2026/09/22 14:53:53 INFO Signed narinfos id=69 count=16669lb # [ 189.372324] niks3-server[1086]: 2026/09/22 14:53:53 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls6670lb # [ 189.380122] niks3-server[1086]: 2026/09/22 14:53:53 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6671lb # [ 189.386072] niks3-server[1086]: 2026/09/22 14:53:53 INFO Completed upload id=696672lb # [ 189.389551] niks3-server[1086]: 2026/09/22 14:53:53 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo6673worker1 # [ 189.400044] nix-grpc-daemon[1754]: time=2026-09-22T14:53:53.987Z level=INFO msg="Upload complete. (264ms)"6674worker1 # [ 189.419511] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37906 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=10 outputs=16675worker1 # [ 189.436363] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:53Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=16676worker1 # [ 189.446234] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379066677worker1 # [ 189.451492] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:54Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=06678worker1 # [ 189.457163] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:379066679worker1 # [ 189.462397] nix-daemon[848]: reaped child process 2069, status = succeeded6680worker1 # [ 189.464424] nix-grpc-daemon[1754]: time=2026-09-22T14:53:54.049Z level=INFO msg="All 1 paths already cached"6681worker1 # [ 189.468260] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:379066682worker1 # [ 189.478259] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6683worker1 # [ 189.611191] nix-daemon[848]: accepted connection from pid 2096, user nix-grpc-daemon (trusted)6684worker1 # [ 189.639533] nix-daemon[848]: reaped child process 2099, status = succeeded6685worker1 # [ 189.743202] nix-daemon[848]: accepted connection from pid 2101, user nix-grpc-daemon (trusted)6686worker1 # [ 189.760848] nix-daemon[848]: reaped child process 2104, status = succeeded6687lb # [ 189.755527] niks3-server[1086]: 2026/09/22 14:53:54 INFO Received uploads request method=POST path=/api/pending_closures6688worker1 # [ 189.780434] nix-grpc-daemon[1754]: time=2026-09-22T14:53:54.368Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6689worker1 # [ 189.782008] nix-grpc-daemon[1754]: time=2026-09-22T14:53:54.368Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)"6690lb # [ 189.789279] niks3-server[1086]: 2026/09/22 14:53:54 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst6691worker1 # [ 189.819546] nix-grpc-daemon[1754]: time=2026-09-22T14:53:54.407Z level=INFO msg="Uploading 1 narinfos"6692lb # [ 189.805160] niks3-server[1086]: 2026/09/22 14:53:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/70/sign6693lb # [ 189.816760] niks3-server[1086]: 2026/09/22 14:53:54 INFO Signed narinfos id=70 count=16694lb # [ 189.824200] niks3-server[1086]: 2026/09/22 14:53:54 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls6695lb # [ 189.836968] niks3-server[1086]: 2026/09/22 14:53:54 INFO Received complete upload request method=POST path=/api/pending_closures/70/complete6696lb # [ 189.846416] niks3-server[1086]: 2026/09/22 14:53:54 INFO Completed upload id=706697worker1 # [ 189.859965] nix-grpc-daemon[1754]: time=2026-09-22T14:53:54.447Z level=INFO msg="Upload complete. (370ms)"6698lb # [ 189.849581] niks3-server[1086]: 2026/09/22 14:53:54 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo6699worker1 # [ 189.868176] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37906 duration_s=0 paths=1 nar_bytes_in=6246700worker1 # [ 189.884570] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379066701worker1 # [ 189.892660] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6702worker1 # [ 189.899762] nix-daemon[848]: reaped child process 2094, status = succeeded6703worker1 # [ 189.910244] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6704worker1 # [ 191.174750] nix-daemon[848]: reaped child process 2108, status = succeeded6705worker1 # [ 191.315264] nix-daemon[848]: accepted connection from pid 2124, user nix-grpc-daemon (trusted)6706worker1 # [ 191.339772] nix-daemon[848]: reaped child process 2127, status = succeeded6707lb # [ 191.326679] niks3-server[1086]: 2026/09/22 14:53:55 INFO Received uploads request method=POST path=/api/pending_closures6708worker1 # [ 191.350699] nix-grpc-daemon[1754]: time=2026-09-22T14:53:55.937Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6709worker1 # [ 191.352422] nix-grpc-daemon[1754]: time=2026-09-22T14:53:55.937Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)"6710lb # [ 191.367993] niks3-server[1086]: 2026/09/22 14:53:55 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst6711lb # [ 191.382617] niks3-server[1086]: 2026/09/22 14:53:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/71/sign6712worker1 # [ 191.403689] nix-grpc-daemon[1754]: time=2026-09-22T14:53:55.991Z level=INFO msg="Uploading 1 narinfos"6713lb # [ 191.392716] niks3-server[1086]: 2026/09/22 14:53:55 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv6714lb # [ 191.402667] niks3-server[1086]: 2026/09/22 14:53:55 INFO Signed narinfos id=71 count=16715lb # [ 191.408660] niks3-server[1086]: 2026/09/22 14:53:55 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls6716lb # [ 191.416176] niks3-server[1086]: 2026/09/22 14:53:56 INFO Received complete upload request method=POST path=/api/pending_closures/71/complete6717worker1 # [ 191.438370] nix-grpc-daemon[1754]: time=2026-09-22T14:53:56.026Z level=INFO msg="Upload complete. (314ms)"6718lb # [ 191.427221] niks3-server[1086]: 2026/09/22 14:53:56 INFO Completed upload id=716719lb # [ 191.430301] niks3-server[1086]: 2026/09/22 14:53:56 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo6720worker1 # [ 191.460301] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37906 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=11 outputs=16721worker1 # [ 191.476895] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:56Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=16722worker1 # [ 191.486210] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379066723worker1 # [ 191.491436] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:56Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=06724worker1 # [ 191.496991] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:379066725worker1 # [ 191.510346] nix-daemon[848]: reaped child process 2106, status = succeeded6726worker1 # [ 191.515824] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6727worker1 # [ 191.519671] nix-grpc-daemon[1754]: time=2026-09-22T14:53:56.083Z level=INFO msg="All 1 paths already cached"6728worker1 # [ 191.524947] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:379066729worker1 # [ 191.651451] nix-daemon[848]: accepted connection from pid 2133, user nix-grpc-daemon (trusted)6730worker1 # [ 191.672205] nix-daemon[848]: reaped child process 2136, status = succeeded6731worker1 # [ 191.778368] nix-daemon[848]: accepted connection from pid 2138, user nix-grpc-daemon (trusted)6732worker1 # [ 191.801958] nix-daemon[848]: reaped child process 2141, status = succeeded6733lb # [ 191.786167] niks3-server[1086]: 2026/09/22 14:53:56 INFO Received uploads request method=POST path=/api/pending_closures6734worker1 # [ 191.809376] nix-grpc-daemon[1754]: time=2026-09-22T14:53:56.397Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6735worker1 # [ 191.810885] nix-grpc-daemon[1754]: time=2026-09-22T14:53:56.397Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)"6736lb # [ 191.813950] niks3-server[1086]: 2026/09/22 14:53:56 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst6737lb # [ 191.828314] niks3-server[1086]: 2026/09/22 14:53:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/72/sign6738worker1 # [ 191.850765] nix-grpc-daemon[1754]: time=2026-09-22T14:53:56.438Z level=INFO msg="Uploading 1 narinfos"6739lb # [ 191.841953] niks3-server[1086]: 2026/09/22 14:53:56 INFO Signed narinfos id=72 count=16740lb # [ 191.848503] niks3-server[1086]: 2026/09/22 14:53:56 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls6741lb # [ 191.858186] niks3-server[1086]: 2026/09/22 14:53:56 INFO Received complete upload request method=POST path=/api/pending_closures/72/complete6742lb # [ 191.864841] niks3-server[1086]: 2026/09/22 14:53:56 INFO Completed upload id=726743worker1 # [ 191.878730] nix-grpc-daemon[1754]: time=2026-09-22T14:53:56.466Z level=INFO msg="Upload complete. (354ms)"6744lb # [ 191.867085] niks3-server[1086]: 2026/09/22 14:53:56 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo6745worker1 # [ 191.888935] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37906 duration_s=0 paths=1 nar_bytes_in=6246746worker1 # [ 191.899482] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379066747worker1 # [ 191.907029] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6748worker1 # [ 191.911822] nix-daemon[848]: reaped child process 2131, status = succeeded6749worker1 # [ 191.922756] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6750worker1 # [ 193.204870] nix-daemon[848]: reaped child process 2145, status = succeeded6751worker1 # [ 193.321109] nix-daemon[848]: accepted connection from pid 2161, user nix-grpc-daemon (trusted)6752worker1 # [ 193.347377] nix-daemon[848]: reaped child process 2164, status = succeeded6753lb # [ 193.331901] niks3-server[1086]: 2026/09/22 14:53:57 INFO Received uploads request method=POST path=/api/pending_closures6754worker1 # [ 193.355387] nix-grpc-daemon[1754]: time=2026-09-22T14:53:57.941Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6755worker1 # [ 193.357208] nix-grpc-daemon[1754]: time=2026-09-22T14:53:57.941Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)"6756lb # [ 193.353580] niks3-server[1086]: 2026/09/22 14:53:57 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv6757lb # [ 193.366998] niks3-server[1086]: 2026/09/22 14:53:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/73/sign6758worker1 # [ 193.385842] nix-grpc-daemon[1754]: time=2026-09-22T14:53:57.973Z level=INFO msg="Uploading 1 narinfos"6759lb # [ 193.373523] niks3-server[1086]: 2026/09/22 14:53:57 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst6760lb # [ 193.375616] niks3-server[1086]: 2026/09/22 14:53:57 INFO Signed narinfos id=73 count=16761lb # [ 193.381398] niks3-server[1086]: 2026/09/22 14:53:57 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls6762lb # [ 193.388700] niks3-server[1086]: 2026/09/22 14:53:57 INFO Received complete upload request method=POST path=/api/pending_closures/73/complete6763lb # [ 193.392178] niks3-server[1086]: 2026/09/22 14:53:57 INFO Completed upload id=736764worker1 # [ 193.406249] nix-grpc-daemon[1754]: time=2026-09-22T14:53:57.994Z level=INFO msg="Upload complete. (269ms)"6765lb # [ 193.396693] niks3-server[1086]: 2026/09/22 14:53:57 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo6766worker1 # [ 193.412531] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37906 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=12 outputs=16767worker1 # [ 193.422323] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:57Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=16768worker1 # [ 193.424796] nix-daemon[848]: reaped child process 2143, status = succeeded6769worker1 # [ 193.456640] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379066770worker1 # [ 193.462319] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:58Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=06771worker1 # [ 193.471152] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:379066772worker1 # [ 193.484202] nix-grpc-daemon[1754]: time=2026-09-22T14:53:58.072Z level=INFO msg="All 2 paths already cached"6773worker1 # [ 193.493383] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:379066774worker1 # [ 193.503904] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6775worker1 # [ 193.647073] nix-daemon[848]: accepted connection from pid 2170, user nix-grpc-daemon (trusted)6776worker1 # [ 193.668710] nix-daemon[848]: reaped child process 2173, status = succeeded6777worker1 # [ 193.773277] nix-daemon[848]: accepted connection from pid 2175, user nix-grpc-daemon (trusted)6778worker1 # [ 193.794651] nix-daemon[848]: reaped child process 2178, status = succeeded6779lb # [ 193.787631] niks3-server[1086]: 2026/09/22 14:53:58 INFO Received uploads request method=POST path=/api/pending_closures6780worker1 # [ 193.816245] nix-grpc-daemon[1754]: time=2026-09-22T14:53:58.403Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6781worker1 # [ 193.817976] nix-grpc-daemon[1754]: time=2026-09-22T14:53:58.403Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)"6782lb # [ 193.824102] niks3-server[1086]: 2026/09/22 14:53:58 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst6783worker1 # [ 193.859782] nix-grpc-daemon[1754]: time=2026-09-22T14:53:58.447Z level=INFO msg="Uploading 1 narinfos"6784lb # [ 193.839342] niks3-server[1086]: 2026/09/22 14:53:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/74/sign6785lb # [ 193.852594] niks3-server[1086]: 2026/09/22 14:53:58 INFO Signed narinfos id=74 count=16786lb # [ 193.855637] niks3-server[1086]: 2026/09/22 14:53:58 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls6787lb # [ 193.869897] niks3-server[1086]: 2026/09/22 14:53:58 INFO Received complete upload request method=POST path=/api/pending_closures/74/complete6788worker1 # [ 193.892406] nix-grpc-daemon[1754]: time=2026-09-22T14:53:58.480Z level=INFO msg="Upload complete. (374ms)"6789lb # [ 193.879748] niks3-server[1086]: 2026/09/22 14:53:58 INFO Completed upload id=746790lb # [ 193.885084] niks3-server[1086]: 2026/09/22 14:53:58 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo6791worker1 # [ 193.904891] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37906 duration_s=0 paths=1 nar_bytes_in=7526792worker1 # [ 193.913167] nix-grpc-daemon[1673]: ts=2026-09-22T14:53:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379066793worker1 # [ 193.927194] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6794worker1 # [ 193.932954] nix-daemon[848]: reaped child process 2168, status = succeeded6795worker1 # [ 193.947222] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6796worker1 # [ 195.856645] nix-daemon[848]: reaped child process 2182, status = succeeded6797worker1 # [ 195.934245] nix-daemon[848]: accepted connection from pid 2198, user nix-grpc-daemon (trusted)6798worker1 # [ 195.955229] nix-daemon[848]: reaped child process 2201, status = succeeded6799lb # [ 195.950474] niks3-server[1086]: 2026/09/22 14:54:00 INFO Received uploads request method=POST path=/api/pending_closures6800worker1 # [ 195.977458] nix-grpc-daemon[1754]: time=2026-09-22T14:54:00.563Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6801worker1 # [ 195.979405] nix-grpc-daemon[1754]: time=2026-09-22T14:54:00.564Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)"6802lb # [ 195.988636] niks3-server[1086]: 2026/09/22 14:54:00 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv6803lb # [ 196.002684] niks3-server[1086]: 2026/09/22 14:54:00 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst6804worker1 # [ 196.039960] nix-grpc-daemon[1754]: time=2026-09-22T14:54:00.627Z level=INFO msg="Uploading 1 narinfos"6805lb # [ 196.019072] niks3-server[1086]: 2026/09/22 14:54:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/75/sign6806lb # [ 196.031022] niks3-server[1086]: 2026/09/22 14:54:00 INFO Signed narinfos id=75 count=16807lb # [ 196.037494] niks3-server[1086]: 2026/09/22 14:54:00 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls6808lb # [ 196.049547] niks3-server[1086]: 2026/09/22 14:54:00 INFO Received complete upload request method=POST path=/api/pending_closures/75/complete6809worker1 # [ 196.068851] nix-grpc-daemon[1754]: time=2026-09-22T14:54:00.656Z level=INFO msg="Upload complete. (309ms)"6810lb # [ 196.057593] niks3-server[1086]: 2026/09/22 14:54:00 INFO Completed upload id=756811lb # [ 196.060364] niks3-server[1086]: 2026/09/22 14:54:00 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo6812worker1 # [ 196.085444] nix-grpc-daemon[1673]: ts=2026-09-22T14:54:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37906 duration_s=2 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=13 outputs=16813worker1 # [ 196.100382] nix-grpc-daemon[1673]: ts=2026-09-22T14:54:00Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=16814worker1 # [ 196.111065] nix-grpc-daemon[1673]: ts=2026-09-22T14:54:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379066815worker1 # [ 196.117283] nix-daemon[848]: reaped child process 2180, status = succeeded6816worker1 # [ 196.121272] nix-grpc-daemon[1673]: ts=2026-09-22T14:54:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:379066817worker1 # [ 196.135845] nix-grpc-daemon[1754]: time=2026-09-22T14:54:00.723Z level=INFO msg="All 2 paths already cached"6818worker1 # [ 196.146142] nix-grpc-daemon[1673]: ts=2026-09-22T14:54:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:379066819worker1 # [ 196.158631] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6820worker1 # [ 196.310418] nix-daemon[848]: accepted connection from pid 2205, user nix-grpc-daemon (trusted)6821worker1 # [ 196.332448] nix-daemon[848]: reaped child process 2208, status = succeeded6822worker1 # [ 196.439536] nix-daemon[848]: accepted connection from pid 2210, user nix-grpc-daemon (trusted)6823worker1 # [ 196.460136] nix-daemon[848]: reaped child process 2213, status = succeeded6824lb # [ 196.449799] niks3-server[1086]: 2026/09/22 14:54:01 INFO Received uploads request method=POST path=/api/pending_closures6825worker1 # [ 196.474270] nix-grpc-daemon[1754]: time=2026-09-22T14:54:01.061Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6826worker1 # [ 196.475961] nix-grpc-daemon[1754]: time=2026-09-22T14:54:01.062Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)"6827lb # [ 196.479873] niks3-server[1086]: 2026/09/22 14:54:01 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst6828worker1 # [ 196.509224] nix-grpc-daemon[1754]: time=2026-09-22T14:54:01.097Z level=INFO msg="Uploading 1 narinfos"6829lb # [ 196.495034] niks3-server[1086]: 2026/09/22 14:54:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/76/sign6830lb # [ 196.509777] niks3-server[1086]: 2026/09/22 14:54:01 INFO Signed narinfos id=76 count=16831lb # [ 196.517041] niks3-server[1086]: 2026/09/22 14:54:01 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls6832lb # [ 196.532962] niks3-server[1086]: 2026/09/22 14:54:01 INFO Received complete upload request method=POST path=/api/pending_closures/76/complete6833worker1 # [ 196.555933] nix-grpc-daemon[1754]: time=2026-09-22T14:54:01.143Z level=INFO msg="Upload complete. (383ms)"6834lb # [ 196.542553] niks3-server[1086]: 2026/09/22 14:54:01 INFO Completed upload id=766835lb # [ 196.546364] niks3-server[1086]: 2026/09/22 14:54:01 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo6836worker1 # [ 196.564366] nix-grpc-daemon[1673]: ts=2026-09-22T14:54:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37906 duration_s=0 paths=1 nar_bytes_in=7526837worker1 # [ 196.583014] nix-grpc-daemon[1673]: ts=2026-09-22T14:54:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379066838worker1 # [ 196.590377] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6839worker1 # [ 196.595779] nix-daemon[848]: reaped child process 2203, status = succeeded6840worker1 # [ 196.608456] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6841worker1 # [ 197.852566] nix-daemon[848]: reaped child process 2217, status = succeeded6842worker1 # [ 197.939051] nix-daemon[848]: accepted connection from pid 2233, user nix-grpc-daemon (trusted)6843worker1 # [ 197.963189] nix-daemon[848]: reaped child process 2236, status = succeeded6844lb # [ 197.947437] niks3-server[1086]: 2026/09/22 14:54:02 INFO Received uploads request method=POST path=/api/pending_closures6845worker1 # [ 197.975136] nix-grpc-daemon[1754]: time=2026-09-22T14:54:02.560Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6846worker1 # [ 197.976773] nix-grpc-daemon[1754]: time=2026-09-22T14:54:02.560Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)"6847lb # [ 197.992565] niks3-server[1086]: 2026/09/22 14:54:02 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv6848worker1 # [ 198.029662] nix-grpc-daemon[1754]: time=2026-09-22T14:54:02.617Z level=INFO msg="Uploading 1 narinfos"6849lb # [ 198.004383] niks3-server[1086]: 2026/09/22 14:54:02 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst6850lb # [ 198.019502] niks3-server[1086]: 2026/09/22 14:54:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/77/sign6851lb # [ 198.029119] niks3-server[1086]: 2026/09/22 14:54:02 INFO Signed narinfos id=77 count=16852lb # [ 198.031934] niks3-server[1086]: 2026/09/22 14:54:02 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls6853lb # [ 198.045123] niks3-server[1086]: 2026/09/22 14:54:02 INFO Received complete upload request method=POST path=/api/pending_closures/77/complete6854lb # [ 198.050056] niks3-server[1086]: 2026/09/22 14:54:02 INFO Completed upload id=776855worker1 # [ 198.063137] nix-grpc-daemon[1754]: time=2026-09-22T14:54:02.651Z level=INFO msg="Upload complete. (241ms)"6856lb # [ 198.051922] niks3-server[1086]: 2026/09/22 14:54:02 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo6857worker1 # [ 198.077432] nix-grpc-daemon[1673]: ts=2026-09-22T14:54:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37906 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=14 outputs=16858worker1 # [ 198.092333] nix-grpc-daemon[1673]: ts=2026-09-22T14:54:02Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=16859worker1 # [ 198.103479] nix-grpc-daemon[1673]: ts=2026-09-22T14:54:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379066860worker1 # [ 198.109006] nix-grpc-daemon[1673]: ts=2026-09-22T14:54:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:379066861worker1 # [ 198.115198] nix-daemon[848]: reaped child process 2215, status = succeeded6862worker1 # [ 198.119084] nix-grpc-daemon[1754]: time=2026-09-22T14:54:02.707Z level=INFO msg="All 2 paths already cached"6863worker1 # [ 198.128732] nix-grpc-daemon[1673]: ts=2026-09-22T14:54:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:379066864worker1 # [ 198.140106] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6865worker1 # [ 198.276636] nix-daemon[848]: accepted connection from pid 2240, user nix-grpc-daemon (trusted)6866worker1 # [ 198.302118] nix-daemon[848]: reaped child process 2243, status = succeeded6867worker1 # [ 198.405951] nix-daemon[848]: accepted connection from pid 2245, user nix-grpc-daemon (trusted)6868worker1 # [ 198.426983] nix-daemon[848]: reaped child process 2248, status = succeeded6869lb # [ 198.411177] niks3-server[1086]: 2026/09/22 14:54:03 INFO Received uploads request method=POST path=/api/pending_closures6870worker1 # [ 198.434344] nix-grpc-daemon[1754]: time=2026-09-22T14:54:03.022Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6871worker1 # [ 198.436159] nix-grpc-daemon[1754]: time=2026-09-22T14:54:03.022Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)"6872lb # [ 198.439054] niks3-server[1086]: 2026/09/22 14:54:03 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst6873worker1 # [ 198.467512] nix-grpc-daemon[1754]: time=2026-09-22T14:54:03.055Z level=INFO msg="Uploading 1 narinfos"6874lb # [ 198.455018] niks3-server[1086]: 2026/09/22 14:54:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/78/sign6875lb # [ 198.465747] niks3-server[1086]: 2026/09/22 14:54:03 INFO Signed narinfos id=78 count=16876lb # [ 198.472367] niks3-server[1086]: 2026/09/22 14:54:03 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls6877lb # [ 198.481814] niks3-server[1086]: 2026/09/22 14:54:03 INFO Received complete upload request method=POST path=/api/pending_closures/78/complete6878lb # [ 198.487843] niks3-server[1086]: 2026/09/22 14:54:03 INFO Completed upload id=786879worker1 # [ 198.502130] nix-grpc-daemon[1754]: time=2026-09-22T14:54:03.090Z level=INFO msg="Upload complete. (350ms)"6880lb # [ 198.492058] niks3-server[1086]: 2026/09/22 14:54:03 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo6881worker1 # [ 198.510789] nix-grpc-daemon[1673]: ts=2026-09-22T14:54:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37906 duration_s=0 paths=1 nar_bytes_in=7526882worker1 # [ 198.523890] nix-grpc-daemon[1673]: ts=2026-09-22T14:54:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:379066883worker1 # [ 198.531187] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6884worker1 # [ 198.536570] nix-daemon[848]: reaped child process 2238, status = succeeded6885worker1 # [ 198.549495] nix-daemon[848]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6886worker1 # [ 200.053876] nix-daemon[848]: reaped child process 2252, status = succeeded6887worker1 # [ 200.122704] nix-daemon[848]: accepted connection from pid 2268, user nix-grpc-daemon (trusted)6888worker1 # [ 200.142838] nix-daemon[848]: reaped child process 2271, status = succeeded6889lb # [ 200.135316] niks3-server[1086]: 2026/09/22 14:54:04 INFO Received uploads request method=POST path=/api/pending_closures6890worker1 # [ 200.160512] nix-grpc-daemon[1754]: time=2026-09-22T14:54:04.747Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6891worker1 # [ 200.162274] nix-grpc-daemon[1754]: time=2026-09-22T14:54:04.747Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)"6892lb # [ 200.180476] niks3-server[1086]: 2026/09/22 14:54:04 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv6893lb # [ 200.195329] niks3-server[1086]: 2026/09/22 14:54:04 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst6894worker1 # [ 200.220415] nix-grpc-daemon[1754]: time=2026-09-22T14:54:04.808Z level=INFO msg="Uploading 1 narinfos"6895lb # [ 200.207276] niks3-server[1086]: 2026/09/22 14:54:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/79/sign6896lb # [ 200.215096] niks3-server[1086]: 2026/09/22 14:54:04 INFO Signed narinfos id=79 count=16897lb # [ 200.220635] niks3-server[1086]: 2026/09/22 14:54:04 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls6898lb # [ 200.230316] niks3-server[1086]: 2026/09/22 14:54:04 INFO Received complete upload request method=POST path=/api/pending_closures/79/complete6899lb # [ 200.237199] niks3-server[1086]: 2026/09/22 14:54:04 INFO Completed upload id=796900lb # [ 200.240062] niks3-server[1086]: 2026/09/22 14:54:04 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo6901worker1 # [ 200.250385] nix-grpc-daemon[1754]: time=2026-09-22T14:54:04.838Z level=INFO msg="Upload complete. (290ms)"6902worker1 # [ 200.265399] nix-grpc-daemon[1673]: ts=2026-09-22T14:54:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37906 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=15 outputs=16903worker1 # [ 200.282978] nix-daemon[848]: reaped child process 2250, status = succeeded6904client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 18.71 seconds)6905worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6906worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)6907client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag f5 --arg features '["gpu"]'6908client # [ 200.502053] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag f5 --arg features "[\"gpu\"]".6909client # Running as unit: gpu.service; invocation ID: 0bf01021abd643e0a487ca7ec24a805d6910client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.09 seconds)6911lb: must succeed: curl -sf localhost:9901/clusters6912lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6913lb: must succeed: curl -sf localhost:9901/clusters6914lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)6915worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6916worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)6917worker1 # [ 200.720551] nix-grpc-daemon[1673]: ts=2026-09-22T14:54:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:379066918client # [ 200.718057] nix[1582]: don't know how to build these paths:6919client # [ 200.719106] nix[1582]: /nix/store/3i1nziwpdqq19lzpqy4rywzxnm8dlps6-farm-top.drv6920worker2 # [ 200.801736] nix-grpc-daemon[1939]: ts=2026-09-22T14:54:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:564126921worker2 # [ 200.818310] nix-grpc-daemon[1939]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 78 ms (attempt 1/5)6922worker2 # [ 200.898545] nix-grpc-daemon[1939]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 78 ms (attempt 2/5)6923worker2 # [ 200.978760] nix-grpc-daemon[1939]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 33 ms (attempt 3/5)6924worker2 # [ 201.013783] nix-grpc-daemon[1939]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 325 ms (attempt 4/5)6925worker2 # [ 201.341459] nix-grpc-daemon[1939]: disabling binary cache 'https://cache.nixos.org' for 60 seconds6926worker2 # [ 201.348629] nix-grpc-daemon[1939]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6927worker1 # [ 201.315639] nix-grpc-daemon[1673]: ts=2026-09-22T14:54:05Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=06928client # [ 201.306260] nix[1582]: warning: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, waiting up to 30s for a worker6929lb: must succeed: curl -sf localhost:9901/clusters6930lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6931lb: must succeed: curl -sf localhost:9901/clusters6932lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6933worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6934worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)6935client: waiting for success: systemctl show -p Result gpu | grep -q exit-code6936lb # [ 209.708727] envoy[905]: conn peer=[2001:db8:1::1]:49330 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27127 tx=12352 ms=184236937client # [ 231.315383] nix[1582]: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}6938client # [ 231.329705] nix[1582]: error: dependency '1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv' failed6939client # [ 231.363028] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE6940client # [ 231.371309] systemd[1]: gpu.service: Failed with result 'exit-code'.6941client # [ 231.375238] systemd[1]: gpu.service: Consumed 207ms CPU time over 30.866s wall clock time, 37.4M memory peak, 5.3K incoming IP traffic, 5.1K outgoing IP traffic.6942client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 30.15 seconds)6943client: must succeed: journalctl -u gpu -o cat6944client: (finished: must succeed: journalctl -u gpu -o cat, in 0.03 seconds)6945lb: must succeed: curl -sf localhost:9901/clusters6946lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6947lb: must succeed: curl -sf localhost:9901/clusters6948lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6949worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6950worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)6951(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 50.56 seconds)6952subtest: low disk drains a worker and builds go to the other6953worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6954worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.19 seconds)6955worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6956worker1 # [ 234.208503] nix-grpc-daemon[1673]: ts=2026-09-22T14:54:38Z level=info event=unhealthy reason=min_free6957worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.11 seconds)6958client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain >&26959client # don't know how to build these paths:6960client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv6961worker1 # [ 234.768423] nix-grpc-daemon[1673]: ts=2026-09-22T14:54:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:379066962worker1 # [ 234.777890] nix-grpc-daemon[1673]: ts=2026-09-22T14:54:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:379066963worker1 # [ 234.798521] nix-grpc-daemon[1673]: ts=2026-09-22T14:54:39Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=06964worker1 # [ 234.804310] nix-grpc-daemon[1673]: ts=2026-09-22T14:54:39Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=16965worker2 # [ 234.914517] nix-grpc-daemon[1939]: ts=2026-09-22T14:54:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:564126966worker2 # [ 234.933007] nix-grpc-daemon[1939]: ts=2026-09-22T14:54:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:564126967client # copying 1 paths to 'lb:50051'...6968client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'...6969worker2 # [ 234.949989] nix-grpc-daemon[1939]: ts=2026-09-22T14:54:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:564126970worker2 # [ 234.965982] nix-daemon[838]: accepted connection from pid 1939, user nix-grpc-daemon (trusted)6971worker2 # [ 234.993965] nix-grpc-daemon[1939]: ts=2026-09-22T14:54:39Z level=info event=niks3_push_started pid=19996972worker2 # [ 235.140523] nix-grpc-daemon[1999]: time=2026-09-22T14:54:39.707Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca=""6973worker2 # [ 235.249351] nix-daemon[838]: accepted connection from pid 2012, user nix-grpc-daemon (trusted)6974worker2 # [ 235.271503] nix-daemon[838]: reaped child process 2015, status = succeeded6975worker2 # [ 235.372481] nix-daemon[838]: accepted connection from pid 2017, user nix-grpc-daemon (trusted)6976worker2 # [ 235.390696] nix-daemon[838]: reaped child process 2020, status = succeeded6977lb # [ 235.316976] niks3-server[1086]: 2026/09/22 14:54:39 INFO Received uploads request method=POST path=/api/pending_closures6978worker2 # [ 235.411100] nix-grpc-daemon[1999]: time=2026-09-22T14:54:39.977Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6979worker2 # [ 235.413037] nix-grpc-daemon[1999]: time=2026-09-22T14:54:39.977Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)"6980lb # [ 235.362470] niks3-server[1086]: 2026/09/22 14:54:39 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst6981worker2 # [ 235.454821] nix-grpc-daemon[1999]: time=2026-09-22T14:54:40.021Z level=INFO msg="Uploading 1 narinfos"6982lb # [ 235.377617] niks3-server[1086]: 2026/09/22 14:54:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/80/sign6983lb # [ 235.388409] niks3-server[1086]: 2026/09/22 14:54:39 INFO Signed narinfos id=80 count=16984lb # [ 235.398870] niks3-server[1086]: 2026/09/22 14:54:39 INFO Received complete upload request method=POST path=/api/pending_closures/80/complete6985worker2 # [ 235.491775] nix-grpc-daemon[1999]: time=2026-09-22T14:54:40.059Z level=INFO msg="Upload complete. (347ms)"6986lb # [ 235.412742] niks3-server[1086]: 2026/09/22 14:54:39 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls6987lb # [ 235.420157] niks3-server[1086]: 2026/09/22 14:54:40 INFO Completed upload id=806988lb # [ 235.423477] niks3-server[1086]: 2026/09/22 14:54:40 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo6989worker2 # [ 235.503550] nix-grpc-daemon[1939]: ts=2026-09-22T14:54:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56412 duration_s=0 paths=1 nar_bytes_in=5126990worker2 # [ 235.518493] nix-grpc-daemon[1939]: ts=2026-09-22T14:54:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:564126991worker2 # [ 235.524785] nix-daemon[838]: accepted connection from pid 1939, user nix-grpc-daemon (trusted)6992worker2 # [ 235.530192] nix-daemon[838]: reaped child process 1997, status = succeeded6993client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051...6994worker2 # [ 235.544089] nix-daemon[838]: accepted connection from pid 1939, user nix-grpc-daemon (trusted)6995client # farm-a> worker2-next: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv6996client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds6997client # farm-a> LOG-farm-a-drain6998worker2 # [ 236.855538] nix-daemon[838]: reaped child process 2024, status = succeeded6999worker2 # [ 236.928211] nix-daemon[838]: accepted connection from pid 2040, user nix-grpc-daemon (trusted)7000worker2 # [ 236.948373] nix-daemon[838]: reaped child process 2043, status = succeeded7001lb # [ 236.873383] niks3-server[1086]: 2026/09/22 14:54:41 INFO Received uploads request method=POST path=/api/pending_closures7002worker2 # [ 236.967810] nix-grpc-daemon[1999]: time=2026-09-22T14:54:41.532Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"7003worker2 # [ 236.970884] nix-grpc-daemon[1999]: time=2026-09-22T14:54:41.532Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)"7004lb # [ 236.911472] niks3-server[1086]: 2026/09/22 14:54:41 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv7005lb # [ 236.926220] niks3-server[1086]: 2026/09/22 14:54:41 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst7006lb # [ 236.939043] niks3-server[1086]: 2026/09/22 14:54:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/81/sign7007worker2 # [ 237.025215] nix-grpc-daemon[1999]: time=2026-09-22T14:54:41.591Z level=INFO msg="Uploading 1 narinfos"7008lb # [ 236.947779] niks3-server[1086]: 2026/09/22 14:54:41 INFO Signed narinfos id=81 count=17009lb # [ 236.953675] niks3-server[1086]: 2026/09/22 14:54:41 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls7010lb # [ 236.964086] niks3-server[1086]: 2026/09/22 14:54:41 INFO Received complete upload request method=POST path=/api/pending_closures/81/complete7011lb # [ 236.970569] niks3-server[1086]: 2026/09/22 14:54:41 INFO Completed upload id=817012worker2 # [ 237.049888] nix-grpc-daemon[1999]: time=2026-09-22T14:54:41.617Z level=INFO msg="Upload complete. (294ms)"7013lb # [ 236.973967] niks3-server[1086]: 2026/09/22 14:54:41 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo7014worker1 # [ 237.002968] nix-grpc-daemon[1673]: ts=2026-09-22T14:54:41Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=07015worker2 # [ 237.065232] nix-grpc-daemon[1939]: ts=2026-09-22T14:54:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56412 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=16 outputs=17016worker2 # [ 237.084130] nix-daemon[838]: reaped child process 2022, status = succeeded7017worker2 # [ 237.112351] nix-grpc-daemon[1939]: ts=2026-09-22T14:54:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:564127018worker2 # [ 237.129005] nix-grpc-daemon[1939]: ts=2026-09-22T14:54:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:564127019worker2 # [ 237.143222] nix-grpc-daemon[1999]: time=2026-09-22T14:54:41.710Z level=INFO msg="All 1 paths already cached"7020client # copying 1 paths to 'lb:50051'...7021client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'...7022worker2 # [ 237.153923] nix-grpc-daemon[1939]: ts=2026-09-22T14:54:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:564127023worker2 # [ 237.167620] nix-daemon[838]: accepted connection from pid 1939, user nix-grpc-daemon (trusted)7024worker2 # [ 237.327779] nix-daemon[838]: accepted connection from pid 2047, user nix-grpc-daemon (trusted)7025worker2 # [ 237.352349] nix-daemon[838]: reaped child process 2050, status = succeeded7026worker2 # [ 237.452143] nix-daemon[838]: accepted connection from pid 2052, user nix-grpc-daemon (trusted)7027worker2 # [ 237.471555] nix-daemon[838]: reaped child process 2055, status = succeeded7028lb # [ 237.390796] niks3-server[1086]: 2026/09/22 14:54:41 INFO Received uploads request method=POST path=/api/pending_closures7029worker2 # [ 237.480950] nix-grpc-daemon[1999]: time=2026-09-22T14:54:42.048Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7030worker2 # [ 237.482447] nix-grpc-daemon[1999]: time=2026-09-22T14:54:42.048Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)"7031lb # [ 237.420268] niks3-server[1086]: 2026/09/22 14:54:42 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst7032worker2 # [ 237.513429] nix-grpc-daemon[1999]: time=2026-09-22T14:54:42.080Z level=INFO msg="Uploading 1 narinfos"7033lb # [ 237.435420] niks3-server[1086]: 2026/09/22 14:54:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/82/sign7034lb # [ 237.447210] niks3-server[1086]: 2026/09/22 14:54:42 INFO Signed narinfos id=82 count=17035lb # [ 237.454036] niks3-server[1086]: 2026/09/22 14:54:42 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls7036worker2 # [ 237.543712] nix-grpc-daemon[1999]: time=2026-09-22T14:54:42.111Z level=INFO msg="Upload complete. (358ms)"7037lb # [ 237.467182] niks3-server[1086]: 2026/09/22 14:54:42 INFO Received complete upload request method=POST path=/api/pending_closures/82/complete7038lb # [ 237.474217] niks3-server[1086]: 2026/09/22 14:54:42 INFO Completed upload id=827039worker2 # [ 237.552285] nix-grpc-daemon[1939]: ts=2026-09-22T14:54:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56412 duration_s=0 paths=1 nar_bytes_in=6327040lb # [ 237.478771] niks3-server[1086]: 2026/09/22 14:54:42 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo7041worker2 # [ 237.560715] nix-grpc-daemon[1939]: ts=2026-09-22T14:54:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:564127042worker2 # [ 237.571187] nix-daemon[838]: accepted connection from pid 1939, user nix-grpc-daemon (trusted)7043worker2 # [ 237.575638] nix-daemon[838]: reaped child process 2045, status = succeeded7044worker2 # [ 237.585980] nix-daemon[838]: accepted connection from pid 1939, user nix-grpc-daemon (trusted)7045client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051...7046client # farm-b> worker2-next: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv7047worker1 # [ 237.008843] nix-grpc-daemon[1673]: ts=2026-09-22T14:54:41Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=17048client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds7049client # farm-b> LOG-farm-b-drain7050worker2 # [ 238.836888] nix-daemon[838]: reaped child process 2059, status = succeeded7051worker2 # [ 238.955941] nix-daemon[838]: accepted connection from pid 2075, user nix-grpc-daemon (trusted)7052worker2 # [ 238.977998] nix-daemon[838]: reaped child process 2078, status = succeeded7053lb # [ 238.897872] niks3-server[1086]: 2026/09/22 14:54:43 INFO Received uploads request method=POST path=/api/pending_closures7054worker2 # [ 238.988404] nix-grpc-daemon[1999]: time=2026-09-22T14:54:43.555Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"7055worker2 # [ 238.989898] nix-grpc-daemon[1999]: time=2026-09-22T14:54:43.555Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)"7056lb # [ 238.944127] niks3-server[1086]: 2026/09/22 14:54:43 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst7057worker2 # [ 239.033126] nix-grpc-daemon[1999]: time=2026-09-22T14:54:43.600Z level=INFO msg="Uploading 1 narinfos"7058lb # [ 238.957034] niks3-server[1086]: 2026/09/22 14:54:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/83/sign7059lb # [ 238.966761] niks3-server[1086]: 2026/09/22 14:54:43 INFO Signed narinfos id=83 count=17060lb # [ 238.971964] niks3-server[1086]: 2026/09/22 14:54:43 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv7061lb # [ 238.983553] niks3-server[1086]: 2026/09/22 14:54:43 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls7062worker2 # [ 239.067923] nix-grpc-daemon[1999]: time=2026-09-22T14:54:43.635Z level=INFO msg="Upload complete. (270ms)"7063lb # [ 238.989678] niks3-server[1086]: 2026/09/22 14:54:43 INFO Received complete upload request method=POST path=/api/pending_closures/83/complete7064lb # [ 238.993586] niks3-server[1086]: 2026/09/22 14:54:43 INFO Completed upload id=837065lb # [ 238.998228] niks3-server[1086]: 2026/09/22 14:54:43 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo7066worker1 # [ 239.021449] nix-grpc-daemon[1673]: ts=2026-09-22T14:54:43Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=07067worker2 # [ 239.081016] nix-grpc-daemon[1939]: ts=2026-09-22T14:54:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56412 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=17 outputs=17068worker2 # [ 239.102626] nix-grpc-daemon[1939]: ts=2026-09-22T14:54:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:564127069worker2 # [ 239.108800] nix-daemon[838]: reaped child process 2057, status = succeeded7070worker2 # [ 239.116129] nix-grpc-daemon[1939]: ts=2026-09-22T14:54:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:564127071worker2 # [ 239.128579] nix-grpc-daemon[1999]: time=2026-09-22T14:54:43.696Z level=INFO msg="All 2 paths already cached"7072client # copying 1 paths to 'lb:50051'...7073client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'...7074worker2 # [ 239.139420] nix-grpc-daemon[1939]: ts=2026-09-22T14:54:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:564127075worker2 # [ 239.155291] nix-daemon[838]: accepted connection from pid 1939, user nix-grpc-daemon (trusted)7076worker2 # [ 239.299525] nix-daemon[838]: accepted connection from pid 2082, user nix-grpc-daemon (trusted)7077worker2 # [ 239.317730] nix-daemon[838]: reaped child process 2085, status = succeeded7078worker2 # [ 239.423019] nix-daemon[838]: accepted connection from pid 2087, user nix-grpc-daemon (trusted)7079worker2 # [ 239.440808] nix-daemon[838]: reaped child process 2090, status = succeeded7080lb # [ 239.366890] niks3-server[1086]: 2026/09/22 14:54:43 INFO Received uploads request method=POST path=/api/pending_closures7081worker2 # [ 239.455943] nix-grpc-daemon[1999]: time=2026-09-22T14:54:44.023Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7082worker2 # [ 239.457632] nix-grpc-daemon[1999]: time=2026-09-22T14:54:44.023Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)"7083lb # [ 239.395779] niks3-server[1086]: 2026/09/22 14:54:43 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst7084worker2 # [ 239.491100] nix-grpc-daemon[1999]: time=2026-09-22T14:54:44.058Z level=INFO msg="Uploading 1 narinfos"7085lb # [ 239.412620] niks3-server[1086]: 2026/09/22 14:54:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/84/sign7086lb # [ 239.420775] niks3-server[1086]: 2026/09/22 14:54:44 INFO Signed narinfos id=84 count=17087lb # [ 239.428189] niks3-server[1086]: 2026/09/22 14:54:44 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls7088lb # [ 239.437806] niks3-server[1086]: 2026/09/22 14:54:44 INFO Received complete upload request method=POST path=/api/pending_closures/84/complete7089worker2 # [ 239.522288] nix-grpc-daemon[1999]: time=2026-09-22T14:54:44.089Z level=INFO msg="Upload complete. (355ms)"7090lb # [ 239.446087] niks3-server[1086]: 2026/09/22 14:54:44 INFO Completed upload id=847091lb # [ 239.449829] niks3-server[1086]: 2026/09/22 14:54:44 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo7092worker2 # [ 239.532298] nix-grpc-daemon[1939]: ts=2026-09-22T14:54:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56412 duration_s=0 paths=1 nar_bytes_in=7607093worker2 # [ 239.545645] nix-grpc-daemon[1939]: ts=2026-09-22T14:54:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:564127094worker2 # [ 239.552271] nix-daemon[838]: accepted connection from pid 1939, user nix-grpc-daemon (trusted)7095worker2 # [ 239.557499] nix-daemon[838]: reaped child process 2080, status = succeeded7096client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051...7097worker2 # [ 239.571004] nix-daemon[838]: accepted connection from pid 1939, user nix-grpc-daemon (trusted)7098client # farm-top> worker2-next: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv7099worker1 # [ 239.028120] nix-grpc-daemon[1673]: ts=2026-09-22T14:54:43Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=17100lb # [ 239.702100] envoy[905]: conn peer=[2001:db8:1::1]:47274 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=914 tx=517 ms=306307101client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds7102client # farm-top> LOG-farm-top-drain7103worker2 # [ 240.848422] nix-daemon[838]: reaped child process 2094, status = succeeded7104worker2 # [ 240.955257] nix-daemon[838]: accepted connection from pid 2110, user nix-grpc-daemon (trusted)7105worker2 # [ 240.977616] nix-daemon[838]: reaped child process 2113, status = succeeded7106lb # [ 240.903013] niks3-server[1086]: 2026/09/22 14:54:45 INFO Received uploads request method=POST path=/api/pending_closures7107worker2 # [ 240.994817] nix-grpc-daemon[1999]: time=2026-09-22T14:54:45.560Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"7108worker2 # [ 240.996613] nix-grpc-daemon[1999]: time=2026-09-22T14:54:45.560Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)"7109lb # [ 240.927458] niks3-server[1086]: 2026/09/22 14:54:45 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv7110lb # [ 240.935894] niks3-server[1086]: 2026/09/22 14:54:45 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst7111worker2 # [ 241.023115] nix-grpc-daemon[1999]: time=2026-09-22T14:54:45.590Z level=INFO msg="Uploading 1 narinfos"7112lb # [ 240.944105] niks3-server[1086]: 2026/09/22 14:54:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/85/sign7113lb # [ 240.946528] niks3-server[1086]: 2026/09/22 14:54:45 INFO Signed narinfos id=85 count=17114lb # [ 240.953090] niks3-server[1086]: 2026/09/22 14:54:45 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls7115lb # [ 240.960397] niks3-server[1086]: 2026/09/22 14:54:45 INFO Received complete upload request method=POST path=/api/pending_closures/85/complete7116lb # [ 240.965478] niks3-server[1086]: 2026/09/22 14:54:45 INFO Completed upload id=857117worker2 # [ 241.043612] nix-grpc-daemon[1999]: time=2026-09-22T14:54:45.611Z level=INFO msg="Upload complete. (261ms)"7118lb # [ 240.967476] niks3-server[1086]: 2026/09/22 14:54:45 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo7119worker2 # [ 241.052982] nix-grpc-daemon[1939]: ts=2026-09-22T14:54:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56412 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=18 outputs=17120worker2 # [ 241.069519] nix-daemon[838]: reaped child process 2092, status = succeeded7121client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain >&2, in 6.50 seconds)7122client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain outPath7123client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain outPath, in 0.19 seconds)7124worker1: must succeed: rm /nix/.rw-store/fill7125worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds)7126worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'7127worker1 # [ 242.212964] nix-grpc-daemon[1673]: ts=2026-09-22T14:54:46Z level=info event=healthy reason=min_free7128worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.11 seconds)7129(finished: subtest: low disk drains a worker and builds go to the other, in 10.32 seconds)7130(finished: run the VM test script, in 243.57 seconds)7131test script finished in 243.88s7132cleanup7133kill QemuMachine (pid 49)7134client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14)7135client # [2026-09-22T14:54:47Z INFO virtiofsd] Client disconnected, shutting down7136client # [2026-09-22T14:54:47Z INFO virtiofsd] Client disconnected, shutting down7137client # [2026-09-22T14:54:47Z INFO virtiofsd] Client disconnected, shutting down7138kill QemuMachine (pid 51)7139lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14)7140lb # [2026-09-22T14:54:47Z INFO virtiofsd] Client disconnected, shutting down7141lb # [2026-09-22T14:54:47Z INFO virtiofsd] Client disconnected, shutting down7142lb # [2026-09-22T14:54:47Z INFO virtiofsd] Client disconnected, shutting down7143kill QemuMachine (pid 50)7144worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14)7145worker1 # [2026-09-22T14:54:48Z INFO virtiofsd] Client disconnected, shutting down7146worker1 # [2026-09-22T14:54:48Z INFO virtiofsd] Client disconnected, shutting down7147worker1 # [2026-09-22T14:54:48Z INFO virtiofsd] Client disconnected, shutting down7148kill QemuMachine (pid 52)7149worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14)7150worker2 # [2026-09-22T14:54:48Z INFO virtiofsd] Client disconnected, shutting down7151worker2 # [2026-09-22T14:54:48Z INFO virtiofsd] Client disconnected, shutting down7152worker2 # [2026-09-22T14:54:48Z INFO virtiofsd] Client disconnected, shutting down7153(finished: cleanup, in 1.22 seconds)7154additionally exposed symbols:7155 client, lb, worker1, worker2,7156 vlan1,7157 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh